2024-05-08T21:35:11.986 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-08T21:35:11.987 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698071 --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mds 2-workunit/suites/iozone}} --name pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi --verbose --owner scheduled_pdonnell@teuthology -- /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698071/orig.config.yaml 2024-05-08T21:35:12.041 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-08T21:35:12.142 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698071 branch: wip-pdonnell-testing-20240508.150423-reef description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mds 2-workunit/suites/iozone}} email: pdonnell@redhat.com first_in_suite: false job_id: '7698071' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-pdonnell-testing-20240508.150423-reef ceph: cephfs: session_timeout: 300 conf: client: client mount timeout: 600 client_shutdown_timeout: 120 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds oft prefetch dirfrags: false mds op complaint time: 180 mds verify scatter: true mds_dir_prefetch: true mds_sleep_rank_change: 5000000.0 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - Replacing daemon mds sha1: d21e4f961318b56f0d915caa2490c3711bf13c34 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: d21e4f961318b56f0d915caa2490c3711bf13c34 kclient: syntax: v2 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240508.150423-reef sha1: d21e4f961318b56f0d915caa2490c3711bf13c34 owner: scheduled_pdonnell@teuthology priority: 65 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 2738 sha1: d21e4f961318b56f0d915caa2490c3711bf13c34 sleep_before_teardown: 0 subset: 17/512 suite: fs suite_branch: wip-pdonnell-testing-20240508.150423-reef suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_d21e4f961318b56f0d915caa2490c3711bf13c34/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: d21e4f961318b56f0d915caa2490c3711bf13c34 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi073.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMNHXp0Ryi/1ytQZqIM3SOH+8DhGtXTzEg/l+93RUx+Vv8qM1MLlxHYKRZma10Ts+sLXTO98WGUSfAS4wFAtYIY= smithi115.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHLE/vb+S6WqvNONnrPyOxyp/zwZg+puKVWdjhXDFgEyduobG6aAegLjI6LPOgfZx9SkZulbHGcVV3C8v1d9A8o= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - mds_thrash: null - workunit: clients: all: - suites/iozone.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-08_19:22:21 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-08T21:35:12.142 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_d21e4f961318b56f0d915caa2490c3711bf13c34/qa; will attempt to use it 2024-05-08T21:35:12.143 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_d21e4f961318b56f0d915caa2490c3711bf13c34/qa/tasks 2024-05-08T21:35:12.143 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-08T21:35:12.145 INFO:teuthology.task.internal:Checking packages... 2024-05-08T21:35:12.168 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash 'd21e4f961318b56f0d915caa2490c3711bf13c34' 2024-05-08T21:35:12.168 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-08T21:35:12.168 INFO:teuthology.packaging:ref: None 2024-05-08T21:35:12.168 INFO:teuthology.packaging:tag: None 2024-05-08T21:35:12.168 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240508.150423-reef 2024-05-08T21:35:12.168 INFO:teuthology.packaging:sha1: d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T21:35:12.169 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-pdonnell-testing-20240508.150423-reef 2024-05-08T21:35:12.317 INFO:teuthology.task.internal:Found packages for ceph version 18.2.2-1322.gd21e4f96 2024-05-08T21:35:12.318 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-08T21:35:12.324 INFO:teuthology.task.internal:no buildpackages task found 2024-05-08T21:35:12.324 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-08T21:35:12.338 INFO:teuthology.task.internal:Saving configuration 2024-05-08T21:35:12.357 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-08T21:35:12.362 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-08T21:35:12.388 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi073.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698071', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-08 21:29:14.110797', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMNHXp0Ryi/1ytQZqIM3SOH+8DhGtXTzEg/l+93RUx+Vv8qM1MLlxHYKRZma10Ts+sLXTO98WGUSfAS4wFAtYIY='} 2024-05-08T21:35:12.413 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi115.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698071', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-08 21:29:14.113226', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHLE/vb+S6WqvNONnrPyOxyp/zwZg+puKVWdjhXDFgEyduobG6aAegLjI6LPOgfZx9SkZulbHGcVV3C8v1d9A8o='} 2024-05-08T21:35:12.414 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-08T21:35:12.419 INFO:teuthology.task.internal:roles: ubuntu@smithi073.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-05-08T21:35:12.419 INFO:teuthology.task.internal:roles: ubuntu@smithi115.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-05-08T21:35:12.419 INFO:teuthology.run_tasks:Running task console_log... 2024-05-08T21:35:12.494 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ffb116e3160>, signals=[15]) 2024-05-08T21:35:12.494 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-08T21:35:12.500 INFO:teuthology.task.internal:Opening connections... 2024-05-08T21:35:12.500 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi073.front.sepia.ceph.com 2024-05-08T21:35:12.502 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T21:35:12.579 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi115.front.sepia.ceph.com 2024-05-08T21:35:12.580 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T21:35:12.652 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-08T21:35:12.658 DEBUG:teuthology.orchestra.run.smithi073:> uname -m 2024-05-08T21:35:12.681 INFO:teuthology.orchestra.run.smithi073.stdout:x86_64 2024-05-08T21:35:12.682 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release 2024-05-08T21:35:12.745 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="Red Hat Enterprise Linux" 2024-05-08T21:35:12.745 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="8.6 (Ootpa)" 2024-05-08T21:35:12.745 INFO:teuthology.orchestra.run.smithi073.stdout:ID="rhel" 2024-05-08T21:35:12.745 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="fedora" 2024-05-08T21:35:12.746 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="8.6" 2024-05-08T21:35:12.746 INFO:teuthology.orchestra.run.smithi073.stdout:PLATFORM_ID="platform:el8" 2024-05-08T21:35:12.746 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-05-08T21:35:12.746 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31" 2024-05-08T21:35:12.746 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-05-08T21:35:12.746 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://www.redhat.com/" 2024-05-08T21:35:12.746 INFO:teuthology.orchestra.run.smithi073.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-05-08T21:35:12.746 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-08T21:35:12.746 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:35:12.746 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-05-08T21:35:12.746 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-05-08T21:35:12.746 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-05-08T21:35:12.746 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-05-08T21:35:12.747 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2024-05-08T21:35:12.771 DEBUG:teuthology.orchestra.run.smithi115:> uname -m 2024-05-08T21:35:12.793 INFO:teuthology.orchestra.run.smithi115.stdout:x86_64 2024-05-08T21:35:12.793 DEBUG:teuthology.orchestra.run.smithi115:> cat /etc/os-release 2024-05-08T21:35:12.853 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="Red Hat Enterprise Linux" 2024-05-08T21:35:12.853 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="8.6 (Ootpa)" 2024-05-08T21:35:12.853 INFO:teuthology.orchestra.run.smithi115.stdout:ID="rhel" 2024-05-08T21:35:12.853 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="fedora" 2024-05-08T21:35:12.853 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="8.6" 2024-05-08T21:35:12.853 INFO:teuthology.orchestra.run.smithi115.stdout:PLATFORM_ID="platform:el8" 2024-05-08T21:35:12.853 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-05-08T21:35:12.853 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31" 2024-05-08T21:35:12.853 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-05-08T21:35:12.853 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://www.redhat.com/" 2024-05-08T21:35:12.853 INFO:teuthology.orchestra.run.smithi115.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-05-08T21:35:12.853 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-08T21:35:12.854 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-08T21:35:12.854 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-05-08T21:35:12.854 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-05-08T21:35:12.854 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-05-08T21:35:12.854 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-05-08T21:35:12.854 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server 2024-05-08T21:35:12.871 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-08T21:35:12.880 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-08T21:35:12.885 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-08T21:35:12.886 DEBUG:teuthology.orchestra.run.smithi073:> test '!' -e /home/ubuntu/cephtest 2024-05-08T21:35:12.888 DEBUG:teuthology.orchestra.run.smithi115:> test '!' -e /home/ubuntu/cephtest 2024-05-08T21:35:12.911 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-08T21:35:12.916 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-08T21:35:12.916 DEBUG:teuthology.orchestra.run.smithi073:> test -z $(ls -A /var/lib/ceph) 2024-05-08T21:35:12.951 DEBUG:teuthology.orchestra.run.smithi115:> test -z $(ls -A /var/lib/ceph) 2024-05-08T21:35:12.980 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-08T21:35:13.030 INFO:teuthology.run_tasks:Running task kernel... 2024-05-08T21:35:13.075 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-05-08T21:35:13.075 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-05-08T21:35:13.075 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-05-08T21:35:13.076 DEBUG:teuthology.orchestra.run.smithi073:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-08T21:35:13.093 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T21:35:13.094 DEBUG:teuthology.orchestra.run.smithi073:> uname -r 2024-05-08T21:35:13.157 INFO:teuthology.orchestra.run.smithi073.stdout:4.18.0-513.9.1.el8_9.x86_64 2024-05-08T21:35:13.158 INFO:teuthology.task.kernel:Running kernel on smithi073: 4.18.0-513.9.1.el8_9.x86_64 2024-05-08T21:35:13.158 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum install -y kernel 2024-05-08T21:35:14.687 INFO:teuthology.orchestra.run.smithi073.stdout:Updating Subscription Management repositories. 2024-05-08T21:35:14.688 INFO:teuthology.orchestra.run.smithi073.stdout:Unable to read consumer identity 2024-05-08T21:35:15.017 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:35:15.017 INFO:teuthology.orchestra.run.smithi073.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-05-08T21:35:15.017 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:35:16.920 INFO:teuthology.orchestra.run.smithi073.stdout:Copr repo for python3-asyncssh owned by ceph 15 kB/s | 3.5 kB 00:00 2024-05-08T21:35:32.347 INFO:teuthology.orchestra.run.smithi073.stdout:Extra Packages for Enterprise Linux 1.1 MB/s | 16 MB 00:15 2024-05-08T21:35:35.994 INFO:teuthology.orchestra.run.smithi073.stdout:lab-extras 326 kB/s | 24 kB 00:00 2024-05-08T21:35:36.746 INFO:teuthology.orchestra.run.smithi073.stdout:Package kernel-4.18.0-513.9.1.el8_9.x86_64 is already installed. 2024-05-08T21:35:36.747 INFO:teuthology.orchestra.run.smithi073.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2024-05-08T21:35:36.847 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-05-08T21:35:36.848 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2024-05-08T21:35:36.848 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-05-08T21:35:37.003 DEBUG:teuthology.orchestra.run.smithi073:> echo no | sudo yum reinstall kernel || true 2024-05-08T21:35:37.342 INFO:teuthology.orchestra.run.smithi073.stdout:Updating Subscription Management repositories. 2024-05-08T21:35:37.342 INFO:teuthology.orchestra.run.smithi073.stdout:Unable to read consumer identity 2024-05-08T21:35:37.544 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:35:37.544 INFO:teuthology.orchestra.run.smithi073.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-05-08T21:35:37.544 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:35:37.852 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:00:02 ago on Wed 08 May 2024 09:35:35 PM UTC. 2024-05-08T21:35:37.927 INFO:teuthology.orchestra.run.smithi073.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2024-05-08T21:35:37.928 INFO:teuthology.orchestra.run.smithi073.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2024-05-08T21:35:37.978 INFO:teuthology.orchestra.run.smithi073.stderr:Error: No packages marked for reinstall. 2024-05-08T21:35:38.025 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum reinstall -y kernel || true 2024-05-08T21:35:38.359 INFO:teuthology.orchestra.run.smithi073.stdout:Updating Subscription Management repositories. 2024-05-08T21:35:38.359 INFO:teuthology.orchestra.run.smithi073.stdout:Unable to read consumer identity 2024-05-08T21:35:38.661 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:35:38.661 INFO:teuthology.orchestra.run.smithi073.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-05-08T21:35:38.662 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:35:38.959 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:00:03 ago on Wed 08 May 2024 09:35:35 PM UTC. 2024-05-08T21:35:39.020 INFO:teuthology.orchestra.run.smithi073.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2024-05-08T21:35:39.020 INFO:teuthology.orchestra.run.smithi073.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2024-05-08T21:35:39.061 INFO:teuthology.orchestra.run.smithi073.stderr:Error: No packages marked for reinstall. 2024-05-08T21:35:39.107 DEBUG:teuthology.orchestra.run.smithi073:> rpm -q kernel | sort -rV | head -n 1 2024-05-08T21:35:39.277 INFO:teuthology.orchestra.run.smithi073.stdout:kernel-4.18.0-513.9.1.el8_9.x86_64 2024-05-08T21:35:39.278 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-513.9.1.el8_9.x86_64 2024-05-08T21:35:39.278 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-05-08T21:35:39.278 DEBUG:teuthology.parallel:result is None 2024-05-08T21:35:39.278 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-08T21:35:39.285 INFO:teuthology.task.internal:Creating test directory... 2024-05-08T21:35:39.285 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-08T21:35:39.287 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-08T21:35:39.308 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-08T21:35:39.314 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-08T21:35:39.323 INFO:teuthology.task.internal:Creating archive directory... 2024-05-08T21:35:39.323 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-08T21:35:39.344 DEBUG:teuthology.orchestra.run.smithi115:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-08T21:35:39.378 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-08T21:35:39.385 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-08T21:35:39.386 DEBUG:teuthology.orchestra.run.smithi115:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-08T21:35:39.428 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T21:35:39.429 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-08T21:35:39.431 DEBUG:teuthology.orchestra.run.smithi115:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-08T21:35:39.462 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T21:35:39.477 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T21:35:39.508 INFO:teuthology.orchestra.run.smithi115.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T21:35:39.526 INFO:teuthology.orchestra.run.smithi115.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T21:35:39.527 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-08T21:35:39.535 INFO:teuthology.task.internal:Configuring sudo... 2024-05-08T21:35:39.535 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-08T21:35:39.537 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-08T21:35:39.596 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-08T21:35:39.605 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-08T21:35:39.606 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-08T21:35:39.608 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-08T21:35:39.654 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T21:35:39.707 DEBUG:teuthology.orchestra.run.smithi073:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T21:35:39.770 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T21:35:39.813 DEBUG:teuthology.orchestra.run.smithi073:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T21:35:39.855 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-05-08T21:35:39.855 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-08T21:35:39.921 DEBUG:teuthology.orchestra.run.smithi115:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T21:35:39.964 DEBUG:teuthology.orchestra.run.smithi115:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T21:35:40.019 DEBUG:teuthology.orchestra.run.smithi115:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T21:35:40.107 DEBUG:teuthology.orchestra.run.smithi115:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T21:35:40.147 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-08T21:35:40.147 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-08T21:35:40.214 DEBUG:teuthology.orchestra.run.smithi073:> sudo service rsyslog restart 2024-05-08T21:35:40.217 DEBUG:teuthology.orchestra.run.smithi115:> sudo service rsyslog restart 2024-05-08T21:35:40.266 INFO:teuthology.orchestra.run.smithi073.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T21:35:40.307 INFO:teuthology.orchestra.run.smithi115.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T21:35:40.791 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-08T21:35:40.820 INFO:teuthology.task.internal:Starting timer... 2024-05-08T21:35:40.820 INFO:teuthology.run_tasks:Running task pcp... 2024-05-08T21:35:40.840 INFO:teuthology.run_tasks:Running task selinux... 2024-05-08T21:35:40.856 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-05-08T21:35:40.856 DEBUG:teuthology.orchestra.run.smithi073:> sudo service auditd rotate 2024-05-08T21:35:40.946 INFO:teuthology.orchestra.run.smithi073.stdout:Rotating logs: 2024-05-08T21:35:40.948 DEBUG:teuthology.orchestra.run.smithi115:> sudo service auditd rotate 2024-05-08T21:35:41.020 INFO:teuthology.orchestra.run.smithi115.stdout:Rotating logs: 2024-05-08T21:35:41.021 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-08T21:35:41.021 DEBUG:teuthology.orchestra.run.smithi073:> /usr/sbin/getenforce 2024-05-08T21:35:41.051 INFO:teuthology.orchestra.run.smithi073.stdout:Permissive 2024-05-08T21:35:41.051 DEBUG:teuthology.orchestra.run.smithi115:> /usr/sbin/getenforce 2024-05-08T21:35:41.076 INFO:teuthology.orchestra.run.smithi115.stdout:Permissive 2024-05-08T21:35:41.076 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi073.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi115.front.sepia.ceph.com': 'permissive'} 2024-05-08T21:35:41.076 DEBUG:teuthology.orchestra.run.smithi073:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-08T21:35:41.120 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T21:35:41.121 DEBUG:teuthology.orchestra.run.smithi115:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-08T21:35:41.148 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T21:35:41.148 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-08T21:35:41.149 DEBUG:teuthology.orchestra.run.smithi073:> sudo /usr/sbin/setenforce permissive 2024-05-08T21:35:41.189 DEBUG:teuthology.orchestra.run.smithi115:> sudo /usr/sbin/setenforce permissive 2024-05-08T21:35:41.250 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-08T21:35:41.264 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-05-08T21:35:41.272 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-05-08T21:35:41.424 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-08T21:35:41.440 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-08T21:35:41.442 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi073.front.sepia.ceph.com,smithi115.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-08T21:45:52.942 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi073.front.sepia.ceph.com'), Remote(name='ubuntu@smithi115.front.sepia.ceph.com')] 2024-05-08T21:45:52.943 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-05-08T21:45:52.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T21:45:53.023 DEBUG:teuthology.orchestra.run.smithi073:> true 2024-05-08T21:45:53.092 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-05-08T21:45:53.092 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-05-08T21:45:53.093 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T21:45:53.169 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-05-08T21:45:53.236 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-05-08T21:45:53.237 INFO:teuthology.run_tasks:Running task clock... 2024-05-08T21:45:53.247 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-08T21:45:53.248 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-08T21:45:53.248 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T21:45:53.250 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-08T21:45:53.250 DEBUG:teuthology.orchestra.run.smithi115:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T21:45:53.280 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-08T21:45:53.296 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-08T21:45:53.311 INFO:teuthology.orchestra.run.smithi115.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-08T21:45:53.327 INFO:teuthology.orchestra.run.smithi115.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-08T21:45:53.374 INFO:teuthology.orchestra.run.smithi073.stderr:sudo: ntpd: command not found 2024-05-08T21:45:53.386 INFO:teuthology.orchestra.run.smithi073.stdout:506 Cannot talk to daemon 2024-05-08T21:45:53.400 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-08T21:45:53.408 INFO:teuthology.orchestra.run.smithi115.stderr:sudo: ntpd: command not found 2024-05-08T21:45:53.415 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-08T21:45:53.420 INFO:teuthology.orchestra.run.smithi115.stdout:506 Cannot talk to daemon 2024-05-08T21:45:53.436 INFO:teuthology.orchestra.run.smithi115.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-08T21:45:53.450 INFO:teuthology.orchestra.run.smithi115.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-08T21:45:53.489 INFO:teuthology.orchestra.run.smithi073.stderr:bash: ntpq: command not found 2024-05-08T21:45:53.493 INFO:teuthology.orchestra.run.smithi073.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T21:45:53.493 INFO:teuthology.orchestra.run.smithi073.stdout:=============================================================================== 2024-05-08T21:45:53.493 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T21:45:53.493 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T21:45:53.493 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T21:45:53.493 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T21:45:53.524 INFO:teuthology.orchestra.run.smithi115.stderr:bash: ntpq: command not found 2024-05-08T21:45:53.527 INFO:teuthology.orchestra.run.smithi115.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T21:45:53.527 INFO:teuthology.orchestra.run.smithi115.stdout:=============================================================================== 2024-05-08T21:45:53.527 INFO:teuthology.orchestra.run.smithi115.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T21:45:53.527 INFO:teuthology.orchestra.run.smithi115.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T21:45:53.527 INFO:teuthology.orchestra.run.smithi115.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T21:45:53.527 INFO:teuthology.orchestra.run.smithi115.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T21:45:53.528 INFO:teuthology.run_tasks:Running task install... 2024-05-08T21:45:53.537 DEBUG:teuthology.task.install:project ceph 2024-05-08T21:45:53.537 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34'}} 2024-05-08T21:45:53.537 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34'} 2024-05-08T21:45:53.537 INFO:teuthology.task.install:Using flavor: default 2024-05-08T21:45:53.543 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-08T21:45:53.543 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-05-08T21:45:53.543 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34', 'tag': None, 'wait_for_package': False} 2024-05-08T21:45:53.544 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T21:45:53.546 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34', 'tag': None, 'wait_for_package': False} 2024-05-08T21:45:53.546 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T21:45:53.688 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/ 2024-05-08T21:45:53.688 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1322.gd21e4f96 2024-05-08T21:45:53.759 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/ 2024-05-08T21:45:53.760 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1322.gd21e4f96 2024-05-08T21:45:53.798 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-08T21:45:53.798 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-05-08T21:45:53.798 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-08T21:45:53.833 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-08T21:45:53.833 DEBUG:teuthology.orchestra.run.smithi073:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d21e4f961318b56f0d915caa2490c3711bf13c34/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-08T21:45:53.901 DEBUG:teuthology.orchestra.run.smithi073:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-08T21:45:53.924 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-08T21:45:53.925 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-08T21:45:53.925 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-08T21:45:53.954 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-08T21:45:53.954 DEBUG:teuthology.orchestra.run.smithi115:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d21e4f961318b56f0d915caa2490c3711bf13c34/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-08T21:45:53.979 DEBUG:teuthology.orchestra.run.smithi073:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-08T21:45:54.022 DEBUG:teuthology.orchestra.run.smithi115:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-08T21:45:54.045 INFO:teuthology.orchestra.run.smithi073.stdout:check_obsoletes = 1 2024-05-08T21:45:54.047 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum clean all 2024-05-08T21:45:54.100 DEBUG:teuthology.orchestra.run.smithi115:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-08T21:45:54.167 INFO:teuthology.orchestra.run.smithi115.stdout:check_obsoletes = 1 2024-05-08T21:45:54.168 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum clean all 2024-05-08T21:45:54.424 INFO:teuthology.orchestra.run.smithi073.stdout:Updating Subscription Management repositories. 2024-05-08T21:45:54.547 INFO:teuthology.orchestra.run.smithi115.stdout:Updating Subscription Management repositories. 2024-05-08T21:45:55.743 INFO:teuthology.orchestra.run.smithi073.stdout:63 files removed 2024-05-08T21:45:55.759 INFO:teuthology.orchestra.run.smithi115.stdout:63 files removed 2024-05-08T21:45:55.795 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-08T21:45:55.810 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-08T21:45:56.132 INFO:teuthology.orchestra.run.smithi073.stdout:Updating Subscription Management repositories. 2024-05-08T21:45:56.144 INFO:teuthology.orchestra.run.smithi115.stdout:Updating Subscription Management repositories. 2024-05-08T21:45:57.876 INFO:teuthology.orchestra.run.smithi073.stdout:ceph packages for x86_64 230 kB/s | 80 kB 00:00 2024-05-08T21:45:57.965 INFO:teuthology.orchestra.run.smithi115.stdout:ceph packages for x86_64 248 kB/s | 80 kB 00:00 2024-05-08T21:45:58.261 INFO:teuthology.orchestra.run.smithi073.stdout:ceph noarch packages 33 kB/s | 11 kB 00:00 2024-05-08T21:45:58.341 INFO:teuthology.orchestra.run.smithi115.stdout:ceph noarch packages 33 kB/s | 11 kB 00:00 2024-05-08T21:45:58.570 INFO:teuthology.orchestra.run.smithi073.stdout:ceph source packages 5.3 kB/s | 1.5 kB 00:00 2024-05-08T21:45:58.666 INFO:teuthology.orchestra.run.smithi115.stdout:ceph source packages 5.0 kB/s | 1.5 kB 00:00 2024-05-08T21:45:58.745 INFO:teuthology.orchestra.run.smithi073.stdout:Copr repo for python3-asyncssh owned by ceph 23 kB/s | 3.5 kB 00:00 2024-05-08T21:45:58.817 INFO:teuthology.orchestra.run.smithi115.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2024-05-08T21:46:00.238 INFO:teuthology.orchestra.run.smithi073.stdout:Extra Packages for Enterprise Linux 11 MB/s | 16 MB 00:01 2024-05-08T21:46:01.104 INFO:teuthology.orchestra.run.smithi115.stdout:Extra Packages for Enterprise Linux 7.2 MB/s | 16 MB 00:02 2024-05-08T21:46:03.855 INFO:teuthology.orchestra.run.smithi073.stdout:lab-extras 424 kB/s | 24 kB 00:00 2024-05-08T21:46:04.693 INFO:teuthology.orchestra.run.smithi115.stdout:lab-extras 490 kB/s | 24 kB 00:00 2024-05-08T21:46:05.273 INFO:teuthology.orchestra.run.smithi073.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 50 MB/s | 67 MB 00:01 2024-05-08T21:46:06.078 INFO:teuthology.orchestra.run.smithi115.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 51 MB/s | 67 MB 00:01 2024-05-08T21:46:16.174 INFO:teuthology.orchestra.run.smithi073.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 48 MB/s | 61 MB 00:01 2024-05-08T21:46:16.236 INFO:teuthology.orchestra.run.smithi115.stdout:Red Hat CodeReady Linux Builder for RHEL 8 x86_ 16 MB/s | 8.8 MB 00:00 2024-05-08T21:46:19.288 INFO:teuthology.orchestra.run.smithi115.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 46 MB/s | 61 MB 00:01 2024-05-08T21:46:27.283 INFO:teuthology.orchestra.run.smithi073.stdout:Red Hat CodeReady Linux Builder for RHEL 8 x86_ 14 MB/s | 8.8 MB 00:00 2024-05-08T21:46:34.937 INFO:teuthology.orchestra.run.smithi073.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-05-08T21:46:34.939 INFO:teuthology.orchestra.run.smithi073.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-05-08T21:46:34.962 INFO:teuthology.orchestra.run.smithi073.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2024-05-08T21:46:34.963 INFO:teuthology.orchestra.run.smithi073.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2024-05-08T21:46:34.965 INFO:teuthology.orchestra.run.smithi073.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2024-05-08T21:46:34.967 INFO:teuthology.orchestra.run.smithi073.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2024-05-08T21:46:34.970 INFO:teuthology.orchestra.run.smithi073.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2024-05-08T21:46:34.975 INFO:teuthology.orchestra.run.smithi073.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2024-05-08T21:46:34.977 INFO:teuthology.orchestra.run.smithi073.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2024-05-08T21:46:35.069 INFO:teuthology.orchestra.run.smithi115.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-05-08T21:46:35.070 INFO:teuthology.orchestra.run.smithi115.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-05-08T21:46:35.089 INFO:teuthology.orchestra.run.smithi115.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2024-05-08T21:46:35.090 INFO:teuthology.orchestra.run.smithi115.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2024-05-08T21:46:35.091 INFO:teuthology.orchestra.run.smithi115.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2024-05-08T21:46:35.093 INFO:teuthology.orchestra.run.smithi115.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2024-05-08T21:46:35.096 INFO:teuthology.orchestra.run.smithi115.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2024-05-08T21:46:35.100 INFO:teuthology.orchestra.run.smithi115.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2024-05-08T21:46:35.101 INFO:teuthology.orchestra.run.smithi115.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2024-05-08T21:46:35.206 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-05-08T21:46:35.220 INFO:teuthology.orchestra.run.smithi073.stdout:=================================================================================================================================== 2024-05-08T21:46:35.221 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2024-05-08T21:46:35.221 INFO:teuthology.orchestra.run.smithi073.stdout:=================================================================================================================================== 2024-05-08T21:46:35.221 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-05-08T21:46:35.221 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-15.el8_9 rhel-8-for-x86_64-baseos-rpms 144 k 2024-05-08T21:46:35.221 INFO:teuthology.orchestra.run.smithi073.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2024-05-08T21:46:35.221 INFO:teuthology.orchestra.run.smithi073.stdout: ceph x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 6.4 k 2024-05-08T21:46:35.221 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-base x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 5.5 M 2024-05-08T21:46:35.221 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-fuse x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 860 k 2024-05-08T21:46:35.221 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 166 k 2024-05-08T21:46:35.221 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 1.6 M 2024-05-08T21:46:35.221 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 138 k 2024-05-08T21:46:35.221 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 3.5 M 2024-05-08T21:46:35.222 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 7.4 M 2024-05-08T21:46:35.222 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-rook noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 49 k 2024-05-08T21:46:35.222 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-radosgw x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 13 M 2024-05-08T21:46:35.222 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-test x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 47 M 2024-05-08T21:46:35.222 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-volume noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 263 k 2024-05-08T21:46:35.222 INFO:teuthology.orchestra.run.smithi073.stdout: cephadm noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 170 k 2024-05-08T21:46:35.222 INFO:teuthology.orchestra.run.smithi073.stdout: cephfs-mirror x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 261 k 2024-05-08T21:46:35.222 INFO:teuthology.orchestra.run.smithi073.stdout: cephfs-top noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 18 k 2024-05-08T21:46:35.222 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 62 k 2024-05-08T21:46:35.222 INFO:teuthology.orchestra.run.smithi073.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2024-05-08T21:46:35.222 INFO:teuthology.orchestra.run.smithi073.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2024-05-08T21:46:35.223 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs-devel x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 31 k 2024-05-08T21:46:35.223 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs2 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 782 k 2024-05-08T21:46:35.223 INFO:teuthology.orchestra.run.smithi073.stdout: librados-devel x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 139 k 2024-05-08T21:46:35.223 INFO:teuthology.orchestra.run.smithi073.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2024-05-08T21:46:35.223 INFO:teuthology.orchestra.run.smithi073.stdout: libuuid-devel x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 100 k 2024-05-08T21:46:35.223 INFO:teuthology.orchestra.run.smithi073.stdout: openssl-devel x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 2.3 M 2024-05-08T21:46:35.223 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 1.5 M 2024-05-08T21:46:35.223 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-contrib x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 812 k 2024-05-08T21:46:35.223 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-server x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 5.1 M 2024-05-08T21:46:35.223 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cephfs x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 197 k 2024-05-08T21:46:35.223 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rados x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 370 k 2024-05-08T21:46:35.223 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rbd x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 365 k 2024-05-08T21:46:35.223 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rgw x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 107 k 2024-05-08T21:46:35.224 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-fuse x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 95 k 2024-05-08T21:46:35.224 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-mirror x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 3.5 M 2024-05-08T21:46:35.224 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-nbd x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 181 k 2024-05-08T21:46:35.224 INFO:teuthology.orchestra.run.smithi073.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 73 k 2024-05-08T21:46:35.224 INFO:teuthology.orchestra.run.smithi073.stdout:Upgrading: 2024-05-08T21:46:35.224 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-libelf x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 232 k 2024-05-08T21:46:35.224 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-libs x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 303 k 2024-05-08T21:46:35.224 INFO:teuthology.orchestra.run.smithi073.stdout: iproute x86_64 6.2.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 854 k 2024-05-08T21:46:35.224 INFO:teuthology.orchestra.run.smithi073.stdout: libblkid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 221 k 2024-05-08T21:46:35.224 INFO:teuthology.orchestra.run.smithi073.stdout: libfdisk x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 254 k 2024-05-08T21:46:35.224 INFO:teuthology.orchestra.run.smithi073.stdout: libmount x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 237 k 2024-05-08T21:46:35.224 INFO:teuthology.orchestra.run.smithi073.stdout: librados2 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 3.7 M 2024-05-08T21:46:35.224 INFO:teuthology.orchestra.run.smithi073.stdout: librbd1 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 3.6 M 2024-05-08T21:46:35.224 INFO:teuthology.orchestra.run.smithi073.stdout: libsmartcols x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 180 k 2024-05-08T21:46:35.224 INFO:teuthology.orchestra.run.smithi073.stdout: libuuid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 99 k 2024-05-08T21:46:35.225 INFO:teuthology.orchestra.run.smithi073.stdout: openssl x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 711 k 2024-05-08T21:46:35.225 INFO:teuthology.orchestra.run.smithi073.stdout: openssl-libs x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 1.5 M 2024-05-08T21:46:35.225 INFO:teuthology.orchestra.run.smithi073.stdout: util-linux x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 2.5 M 2024-05-08T21:46:35.225 INFO:teuthology.orchestra.run.smithi073.stdout: util-linux-user x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 103 k 2024-05-08T21:46:35.225 INFO:teuthology.orchestra.run.smithi073.stdout: xfsdump x86_64 3.1.8-7.el8_9 rhel-8-for-x86_64-baseos-rpms 333 k 2024-05-08T21:46:35.225 INFO:teuthology.orchestra.run.smithi073.stdout: xfsprogs x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 1.1 M 2024-05-08T21:46:35.225 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2024-05-08T21:46:35.225 INFO:teuthology.orchestra.run.smithi073.stdout: automake noarch 1.16.1-8.el8 rhel-8-for-x86_64-appstream-rpms 714 k 2024-05-08T21:46:35.225 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-common x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 22 M 2024-05-08T21:46:35.225 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 24 k 2024-05-08T21:46:35.225 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mds x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 2.3 M 2024-05-08T21:46:35.225 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 245 k 2024-05-08T21:46:35.226 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mon x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 4.8 M 2024-05-08T21:46:35.226 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-osd x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 18 M 2024-05-08T21:46:35.226 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 16 k 2024-05-08T21:46:35.226 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-selinux x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 24 k 2024-05-08T21:46:35.226 INFO:teuthology.orchestra.run.smithi073.stdout: fuse x86_64 2.9.7-17.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2024-05-08T21:46:35.226 INFO:teuthology.orchestra.run.smithi073.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-05-08T21:46:35.226 INFO:teuthology.orchestra.run.smithi073.stdout: jq x86_64 1.6-7.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2024-05-08T21:46:35.226 INFO:teuthology.orchestra.run.smithi073.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2024-05-08T21:46:35.226 INFO:teuthology.orchestra.run.smithi073.stdout: krb5-devel x86_64 1.18.2-26.el8_9 rhel-8-for-x86_64-baseos-rpms 562 k 2024-05-08T21:46:35.226 INFO:teuthology.orchestra.run.smithi073.stdout: libcephsqlite x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 142 k 2024-05-08T21:46:35.226 INFO:teuthology.orchestra.run.smithi073.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2024-05-08T21:46:35.226 INFO:teuthology.orchestra.run.smithi073.stdout: libgfortran x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 645 k 2024-05-08T21:46:35.226 INFO:teuthology.orchestra.run.smithi073.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-05-08T21:46:35.226 INFO:teuthology.orchestra.run.smithi073.stdout: libpq x86_64 13.11-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2024-05-08T21:46:35.226 INFO:teuthology.orchestra.run.smithi073.stdout: libquadmath x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 172 k 2024-05-08T21:46:35.227 INFO:teuthology.orchestra.run.smithi073.stdout: librabbitmq x86_64 0.9.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 47 k 2024-05-08T21:46:35.227 INFO:teuthology.orchestra.run.smithi073.stdout: libradosstriper1 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 474 k 2024-05-08T21:46:35.227 INFO:teuthology.orchestra.run.smithi073.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2024-05-08T21:46:35.227 INFO:teuthology.orchestra.run.smithi073.stdout: librgw2 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 6.5 M 2024-05-08T21:46:35.227 INFO:teuthology.orchestra.run.smithi073.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2024-05-08T21:46:35.227 INFO:teuthology.orchestra.run.smithi073.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2024-05-08T21:46:35.227 INFO:teuthology.orchestra.run.smithi073.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-05-08T21:46:35.227 INFO:teuthology.orchestra.run.smithi073.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2024-05-08T21:46:35.227 INFO:teuthology.orchestra.run.smithi073.stdout: libzstd-devel x86_64 1.4.4-1.el8 rhel-8-for-x86_64-baseos-rpms 44 k 2024-05-08T21:46:35.227 INFO:teuthology.orchestra.run.smithi073.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2024-05-08T21:46:35.227 INFO:teuthology.orchestra.run.smithi073.stdout: oniguruma x86_64 6.8.2-2.1.el8_9 rhel-8-for-x86_64-appstream-rpms 188 k 2024-05-08T21:46:35.227 INFO:teuthology.orchestra.run.smithi073.stdout: openblas x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.0 M 2024-05-08T21:46:35.227 INFO:teuthology.orchestra.run.smithi073.stdout: openblas-threads x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.2 M 2024-05-08T21:46:35.227 INFO:teuthology.orchestra.run.smithi073.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2024-05-08T21:46:35.227 INFO:teuthology.orchestra.run.smithi073.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2024-05-08T21:46:35.228 INFO:teuthology.orchestra.run.smithi073.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2024-05-08T21:46:35.228 INFO:teuthology.orchestra.run.smithi073.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-05-08T21:46:35.228 INFO:teuthology.orchestra.run.smithi073.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2024-05-08T21:46:35.228 INFO:teuthology.orchestra.run.smithi073.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-05-08T21:46:35.228 INFO:teuthology.orchestra.run.smithi073.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-05-08T21:46:35.228 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-05-08T21:46:35.228 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-argparse x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 45 k 2024-05-08T21:46:35.228 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-common x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 129 k 2024-05-08T21:46:35.228 INFO:teuthology.orchestra.run.smithi073.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-05-08T21:46:35.228 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cffi x86_64 1.11.5-6.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2024-05-08T21:46:35.228 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-05-08T21:46:35.228 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-05-08T21:46:35.228 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cryptography x86_64 3.2.1-7.el8_9 rhel-8-for-x86_64-baseos-rpms 559 k 2024-05-08T21:46:35.228 INFO:teuthology.orchestra.run.smithi073.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-05-08T21:46:35.228 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-05-08T21:46:35.228 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-05-08T21:46:35.229 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2024-05-08T21:46:35.229 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2024-05-08T21:46:35.229 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2024-05-08T21:46:35.229 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-05-08T21:46:35.229 INFO:teuthology.orchestra.run.smithi073.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-05-08T21:46:35.229 INFO:teuthology.orchestra.run.smithi073.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-05-08T21:46:35.229 INFO:teuthology.orchestra.run.smithi073.stdout: python3-mako noarch 1.0.6-14.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2024-05-08T21:46:35.229 INFO:teuthology.orchestra.run.smithi073.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2024-05-08T21:46:35.229 INFO:teuthology.orchestra.run.smithi073.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-05-08T21:46:35.229 INFO:teuthology.orchestra.run.smithi073.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-05-08T21:46:35.229 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-05-08T21:46:35.229 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2024-05-08T21:46:35.229 INFO:teuthology.orchestra.run.smithi073.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2024-05-08T21:46:35.229 INFO:teuthology.orchestra.run.smithi073.stdout: python3-packaging noarch 16.8-9.el8 codeready-builder-for-rhel-8-x86_64-rpms 48 k 2024-05-08T21:46:35.229 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-05-08T21:46:35.229 INFO:teuthology.orchestra.run.smithi073.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-05-08T21:46:35.230 INFO:teuthology.orchestra.run.smithi073.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2024-05-08T21:46:35.230 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2024-05-08T21:46:35.230 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2024-05-08T21:46:35.230 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2024-05-08T21:46:35.230 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2024-05-08T21:46:35.230 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pytz noarch 2017.2-11.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2024-05-08T21:46:35.230 INFO:teuthology.orchestra.run.smithi073.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-05-08T21:46:35.230 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-05-08T21:46:35.230 INFO:teuthology.orchestra.run.smithi073.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-05-08T21:46:35.230 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-05-08T21:46:35.230 INFO:teuthology.orchestra.run.smithi073.stdout: python3-scipy x86_64 1.0.0-21.module+el8.9.0+20976+d3c38525 rhel-8-for-x86_64-appstream-rpms 14 M 2024-05-08T21:46:35.230 INFO:teuthology.orchestra.run.smithi073.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-05-08T21:46:35.230 INFO:teuthology.orchestra.run.smithi073.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-05-08T21:46:35.231 INFO:teuthology.orchestra.run.smithi073.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-05-08T21:46:35.231 INFO:teuthology.orchestra.run.smithi073.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-05-08T21:46:35.231 INFO:teuthology.orchestra.run.smithi073.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-05-08T21:46:35.231 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-05-08T21:46:35.231 INFO:teuthology.orchestra.run.smithi073.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-05-08T21:46:35.231 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-05-08T21:46:35.231 INFO:teuthology.orchestra.run.smithi073.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2024-05-08T21:46:35.231 INFO:teuthology.orchestra.run.smithi073.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-05-08T21:46:35.231 INFO:teuthology.orchestra.run.smithi073.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2024-05-08T21:46:35.231 INFO:teuthology.orchestra.run.smithi073.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-05-08T21:46:35.231 INFO:teuthology.orchestra.run.smithi073.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2024-05-08T21:46:35.231 INFO:teuthology.orchestra.run.smithi073.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2024-05-08T21:46:35.231 INFO:teuthology.orchestra.run.smithi073.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2024-05-08T21:46:35.231 INFO:teuthology.orchestra.run.smithi073.stdout:Enabling module streams: 2024-05-08T21:46:35.231 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql 10 2024-05-08T21:46:35.231 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:46:35.232 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-05-08T21:46:35.232 INFO:teuthology.orchestra.run.smithi073.stdout:=================================================================================================================================== 2024-05-08T21:46:35.232 INFO:teuthology.orchestra.run.smithi073.stdout:Install 130 Packages 2024-05-08T21:46:35.232 INFO:teuthology.orchestra.run.smithi073.stdout:Upgrade 16 Packages 2024-05-08T21:46:35.232 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:46:35.232 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 215 M 2024-05-08T21:46:35.232 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-05-08T21:46:35.315 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-05-08T21:46:35.329 INFO:teuthology.orchestra.run.smithi115.stdout:=================================================================================================================================== 2024-05-08T21:46:35.329 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repository Size 2024-05-08T21:46:35.329 INFO:teuthology.orchestra.run.smithi115.stdout:=================================================================================================================================== 2024-05-08T21:46:35.329 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-05-08T21:46:35.329 INFO:teuthology.orchestra.run.smithi115.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-15.el8_9 rhel-8-for-x86_64-baseos-rpms 144 k 2024-05-08T21:46:35.329 INFO:teuthology.orchestra.run.smithi115.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2024-05-08T21:46:35.329 INFO:teuthology.orchestra.run.smithi115.stdout: ceph x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 6.4 k 2024-05-08T21:46:35.330 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-base x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 5.5 M 2024-05-08T21:46:35.330 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-fuse x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 860 k 2024-05-08T21:46:35.330 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 166 k 2024-05-08T21:46:35.330 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 1.6 M 2024-05-08T21:46:35.330 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 138 k 2024-05-08T21:46:35.330 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 3.5 M 2024-05-08T21:46:35.330 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 7.4 M 2024-05-08T21:46:35.330 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-rook noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 49 k 2024-05-08T21:46:35.330 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-radosgw x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 13 M 2024-05-08T21:46:35.330 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-test x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 47 M 2024-05-08T21:46:35.330 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-volume noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 263 k 2024-05-08T21:46:35.330 INFO:teuthology.orchestra.run.smithi115.stdout: cephadm noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 170 k 2024-05-08T21:46:35.331 INFO:teuthology.orchestra.run.smithi115.stdout: cephfs-mirror x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 261 k 2024-05-08T21:46:35.331 INFO:teuthology.orchestra.run.smithi115.stdout: cephfs-top noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 18 k 2024-05-08T21:46:35.331 INFO:teuthology.orchestra.run.smithi115.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 62 k 2024-05-08T21:46:35.331 INFO:teuthology.orchestra.run.smithi115.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2024-05-08T21:46:35.331 INFO:teuthology.orchestra.run.smithi115.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2024-05-08T21:46:35.331 INFO:teuthology.orchestra.run.smithi115.stdout: libcephfs-devel x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 31 k 2024-05-08T21:46:35.331 INFO:teuthology.orchestra.run.smithi115.stdout: libcephfs2 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 782 k 2024-05-08T21:46:35.331 INFO:teuthology.orchestra.run.smithi115.stdout: librados-devel x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 139 k 2024-05-08T21:46:35.331 INFO:teuthology.orchestra.run.smithi115.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2024-05-08T21:46:35.331 INFO:teuthology.orchestra.run.smithi115.stdout: libuuid-devel x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 100 k 2024-05-08T21:46:35.331 INFO:teuthology.orchestra.run.smithi115.stdout: openssl-devel x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 2.3 M 2024-05-08T21:46:35.331 INFO:teuthology.orchestra.run.smithi115.stdout: postgresql x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 1.5 M 2024-05-08T21:46:35.331 INFO:teuthology.orchestra.run.smithi115.stdout: postgresql-contrib x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 812 k 2024-05-08T21:46:35.331 INFO:teuthology.orchestra.run.smithi115.stdout: postgresql-server x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 5.1 M 2024-05-08T21:46:35.331 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cephfs x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 197 k 2024-05-08T21:46:35.332 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rados x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 370 k 2024-05-08T21:46:35.332 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rbd x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 365 k 2024-05-08T21:46:35.332 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rgw x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 107 k 2024-05-08T21:46:35.332 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-fuse x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 95 k 2024-05-08T21:46:35.332 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-mirror x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 3.5 M 2024-05-08T21:46:35.332 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-nbd x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 181 k 2024-05-08T21:46:35.332 INFO:teuthology.orchestra.run.smithi115.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 73 k 2024-05-08T21:46:35.332 INFO:teuthology.orchestra.run.smithi115.stdout:Upgrading: 2024-05-08T21:46:35.332 INFO:teuthology.orchestra.run.smithi115.stdout: elfutils-libelf x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 232 k 2024-05-08T21:46:35.332 INFO:teuthology.orchestra.run.smithi115.stdout: elfutils-libs x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 303 k 2024-05-08T21:46:35.332 INFO:teuthology.orchestra.run.smithi115.stdout: iproute x86_64 6.2.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 854 k 2024-05-08T21:46:35.332 INFO:teuthology.orchestra.run.smithi115.stdout: libblkid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 221 k 2024-05-08T21:46:35.332 INFO:teuthology.orchestra.run.smithi115.stdout: libfdisk x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 254 k 2024-05-08T21:46:35.333 INFO:teuthology.orchestra.run.smithi115.stdout: libmount x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 237 k 2024-05-08T21:46:35.333 INFO:teuthology.orchestra.run.smithi115.stdout: librados2 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 3.7 M 2024-05-08T21:46:35.333 INFO:teuthology.orchestra.run.smithi115.stdout: librbd1 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 3.6 M 2024-05-08T21:46:35.333 INFO:teuthology.orchestra.run.smithi115.stdout: libsmartcols x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 180 k 2024-05-08T21:46:35.333 INFO:teuthology.orchestra.run.smithi115.stdout: libuuid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 99 k 2024-05-08T21:46:35.333 INFO:teuthology.orchestra.run.smithi115.stdout: openssl x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 711 k 2024-05-08T21:46:35.333 INFO:teuthology.orchestra.run.smithi115.stdout: openssl-libs x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 1.5 M 2024-05-08T21:46:35.333 INFO:teuthology.orchestra.run.smithi115.stdout: util-linux x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 2.5 M 2024-05-08T21:46:35.333 INFO:teuthology.orchestra.run.smithi115.stdout: util-linux-user x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 103 k 2024-05-08T21:46:35.333 INFO:teuthology.orchestra.run.smithi115.stdout: xfsdump x86_64 3.1.8-7.el8_9 rhel-8-for-x86_64-baseos-rpms 333 k 2024-05-08T21:46:35.333 INFO:teuthology.orchestra.run.smithi115.stdout: xfsprogs x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 1.1 M 2024-05-08T21:46:35.333 INFO:teuthology.orchestra.run.smithi115.stdout:Installing dependencies: 2024-05-08T21:46:35.333 INFO:teuthology.orchestra.run.smithi115.stdout: automake noarch 1.16.1-8.el8 rhel-8-for-x86_64-appstream-rpms 714 k 2024-05-08T21:46:35.333 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-common x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 22 M 2024-05-08T21:46:35.334 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 24 k 2024-05-08T21:46:35.334 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mds x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 2.3 M 2024-05-08T21:46:35.334 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 245 k 2024-05-08T21:46:35.334 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mon x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 4.8 M 2024-05-08T21:46:35.334 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-osd x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 18 M 2024-05-08T21:46:35.334 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 16 k 2024-05-08T21:46:35.334 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-selinux x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 24 k 2024-05-08T21:46:35.334 INFO:teuthology.orchestra.run.smithi115.stdout: fuse x86_64 2.9.7-17.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2024-05-08T21:46:35.334 INFO:teuthology.orchestra.run.smithi115.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-05-08T21:46:35.334 INFO:teuthology.orchestra.run.smithi115.stdout: jq x86_64 1.6-7.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2024-05-08T21:46:35.334 INFO:teuthology.orchestra.run.smithi115.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2024-05-08T21:46:35.334 INFO:teuthology.orchestra.run.smithi115.stdout: krb5-devel x86_64 1.18.2-26.el8_9 rhel-8-for-x86_64-baseos-rpms 562 k 2024-05-08T21:46:35.334 INFO:teuthology.orchestra.run.smithi115.stdout: libcephsqlite x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 142 k 2024-05-08T21:46:35.335 INFO:teuthology.orchestra.run.smithi115.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2024-05-08T21:46:35.335 INFO:teuthology.orchestra.run.smithi115.stdout: libgfortran x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 645 k 2024-05-08T21:46:35.335 INFO:teuthology.orchestra.run.smithi115.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-05-08T21:46:35.335 INFO:teuthology.orchestra.run.smithi115.stdout: libpq x86_64 13.11-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2024-05-08T21:46:35.335 INFO:teuthology.orchestra.run.smithi115.stdout: libquadmath x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 172 k 2024-05-08T21:46:35.335 INFO:teuthology.orchestra.run.smithi115.stdout: librabbitmq x86_64 0.9.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 47 k 2024-05-08T21:46:35.335 INFO:teuthology.orchestra.run.smithi115.stdout: libradosstriper1 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 474 k 2024-05-08T21:46:35.335 INFO:teuthology.orchestra.run.smithi115.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2024-05-08T21:46:35.335 INFO:teuthology.orchestra.run.smithi115.stdout: librgw2 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 6.5 M 2024-05-08T21:46:35.336 INFO:teuthology.orchestra.run.smithi115.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2024-05-08T21:46:35.336 INFO:teuthology.orchestra.run.smithi115.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2024-05-08T21:46:35.336 INFO:teuthology.orchestra.run.smithi115.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-05-08T21:46:35.336 INFO:teuthology.orchestra.run.smithi115.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2024-05-08T21:46:35.336 INFO:teuthology.orchestra.run.smithi115.stdout: libzstd-devel x86_64 1.4.4-1.el8 rhel-8-for-x86_64-baseos-rpms 44 k 2024-05-08T21:46:35.336 INFO:teuthology.orchestra.run.smithi115.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2024-05-08T21:46:35.336 INFO:teuthology.orchestra.run.smithi115.stdout: oniguruma x86_64 6.8.2-2.1.el8_9 rhel-8-for-x86_64-appstream-rpms 188 k 2024-05-08T21:46:35.336 INFO:teuthology.orchestra.run.smithi115.stdout: openblas x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.0 M 2024-05-08T21:46:35.336 INFO:teuthology.orchestra.run.smithi115.stdout: openblas-threads x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.2 M 2024-05-08T21:46:35.336 INFO:teuthology.orchestra.run.smithi115.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2024-05-08T21:46:35.336 INFO:teuthology.orchestra.run.smithi115.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2024-05-08T21:46:35.336 INFO:teuthology.orchestra.run.smithi115.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2024-05-08T21:46:35.337 INFO:teuthology.orchestra.run.smithi115.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-05-08T21:46:35.337 INFO:teuthology.orchestra.run.smithi115.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2024-05-08T21:46:35.337 INFO:teuthology.orchestra.run.smithi115.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-05-08T21:46:35.337 INFO:teuthology.orchestra.run.smithi115.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-05-08T21:46:35.337 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-05-08T21:46:35.337 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ceph-argparse x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 45 k 2024-05-08T21:46:35.337 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ceph-common x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 129 k 2024-05-08T21:46:35.337 INFO:teuthology.orchestra.run.smithi115.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-05-08T21:46:35.337 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cffi x86_64 1.11.5-6.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2024-05-08T21:46:35.337 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-05-08T21:46:35.337 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-05-08T21:46:35.337 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cryptography x86_64 3.2.1-7.el8_9 rhel-8-for-x86_64-baseos-rpms 559 k 2024-05-08T21:46:35.337 INFO:teuthology.orchestra.run.smithi115.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-05-08T21:46:35.337 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-05-08T21:46:35.337 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-05-08T21:46:35.338 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2024-05-08T21:46:35.338 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2024-05-08T21:46:35.338 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2024-05-08T21:46:35.338 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-05-08T21:46:35.338 INFO:teuthology.orchestra.run.smithi115.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-05-08T21:46:35.338 INFO:teuthology.orchestra.run.smithi115.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-05-08T21:46:35.338 INFO:teuthology.orchestra.run.smithi115.stdout: python3-mako noarch 1.0.6-14.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2024-05-08T21:46:35.338 INFO:teuthology.orchestra.run.smithi115.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2024-05-08T21:46:35.338 INFO:teuthology.orchestra.run.smithi115.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-05-08T21:46:35.338 INFO:teuthology.orchestra.run.smithi115.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-05-08T21:46:35.338 INFO:teuthology.orchestra.run.smithi115.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-05-08T21:46:35.338 INFO:teuthology.orchestra.run.smithi115.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2024-05-08T21:46:35.338 INFO:teuthology.orchestra.run.smithi115.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2024-05-08T21:46:35.338 INFO:teuthology.orchestra.run.smithi115.stdout: python3-packaging noarch 16.8-9.el8 codeready-builder-for-rhel-8-x86_64-rpms 48 k 2024-05-08T21:46:35.339 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-05-08T21:46:35.339 INFO:teuthology.orchestra.run.smithi115.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-05-08T21:46:35.339 INFO:teuthology.orchestra.run.smithi115.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2024-05-08T21:46:35.339 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2024-05-08T21:46:35.339 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2024-05-08T21:46:35.339 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2024-05-08T21:46:35.339 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2024-05-08T21:46:35.339 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pytz noarch 2017.2-11.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2024-05-08T21:46:35.339 INFO:teuthology.orchestra.run.smithi115.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-05-08T21:46:35.339 INFO:teuthology.orchestra.run.smithi115.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-05-08T21:46:35.339 INFO:teuthology.orchestra.run.smithi115.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-05-08T21:46:35.339 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-05-08T21:46:35.339 INFO:teuthology.orchestra.run.smithi115.stdout: python3-scipy x86_64 1.0.0-21.module+el8.9.0+20976+d3c38525 rhel-8-for-x86_64-appstream-rpms 14 M 2024-05-08T21:46:35.341 INFO:teuthology.orchestra.run.smithi115.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-05-08T21:46:35.341 INFO:teuthology.orchestra.run.smithi115.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-05-08T21:46:35.341 INFO:teuthology.orchestra.run.smithi115.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-05-08T21:46:35.341 INFO:teuthology.orchestra.run.smithi115.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-05-08T21:46:35.341 INFO:teuthology.orchestra.run.smithi115.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-05-08T21:46:35.341 INFO:teuthology.orchestra.run.smithi115.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-05-08T21:46:35.341 INFO:teuthology.orchestra.run.smithi115.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-05-08T21:46:35.341 INFO:teuthology.orchestra.run.smithi115.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-05-08T21:46:35.342 INFO:teuthology.orchestra.run.smithi115.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2024-05-08T21:46:35.342 INFO:teuthology.orchestra.run.smithi115.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-05-08T21:46:35.342 INFO:teuthology.orchestra.run.smithi115.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2024-05-08T21:46:35.342 INFO:teuthology.orchestra.run.smithi115.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-05-08T21:46:35.342 INFO:teuthology.orchestra.run.smithi115.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2024-05-08T21:46:35.342 INFO:teuthology.orchestra.run.smithi115.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2024-05-08T21:46:35.342 INFO:teuthology.orchestra.run.smithi115.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2024-05-08T21:46:35.342 INFO:teuthology.orchestra.run.smithi115.stdout:Enabling module streams: 2024-05-08T21:46:35.342 INFO:teuthology.orchestra.run.smithi115.stdout: postgresql 10 2024-05-08T21:46:35.342 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-08T21:46:35.342 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-05-08T21:46:35.342 INFO:teuthology.orchestra.run.smithi115.stdout:=================================================================================================================================== 2024-05-08T21:46:35.342 INFO:teuthology.orchestra.run.smithi115.stdout:Install 130 Packages 2024-05-08T21:46:35.342 INFO:teuthology.orchestra.run.smithi115.stdout:Upgrade 16 Packages 2024-05-08T21:46:35.343 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-08T21:46:35.343 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 215 M 2024-05-08T21:46:35.343 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-05-08T21:46:35.602 INFO:teuthology.orchestra.run.smithi115.stdout:(1/146): ceph-18.2.2-1322.gd21e4f96.el8.x86_64. 50 kB/s | 6.4 kB 00:00 2024-05-08T21:46:35.718 INFO:teuthology.orchestra.run.smithi073.stdout:(1/146): ceph-18.2.2-1322.gd21e4f96.el8.x86_64. 50 kB/s | 6.4 kB 00:00 2024-05-08T21:46:35.803 INFO:teuthology.orchestra.run.smithi115.stdout:(2/146): ceph-fuse-18.2.2-1322.gd21e4f96.el8.x8 4.2 MB/s | 860 kB 00:00 2024-05-08T21:46:35.861 INFO:teuthology.orchestra.run.smithi115.stdout:(3/146): ceph-immutable-object-cache-18.2.2-132 2.8 MB/s | 166 kB 00:00 2024-05-08T21:46:35.993 INFO:teuthology.orchestra.run.smithi073.stdout:(2/146): ceph-fuse-18.2.2-1322.gd21e4f96.el8.x8 3.1 MB/s | 860 kB 00:00 2024-05-08T21:46:36.077 INFO:teuthology.orchestra.run.smithi073.stdout:(3/146): ceph-immutable-object-cache-18.2.2-132 1.9 MB/s | 166 kB 00:00 2024-05-08T21:46:36.353 INFO:teuthology.orchestra.run.smithi115.stdout:(4/146): ceph-mds-18.2.2-1322.gd21e4f96.el8.x86 4.6 MB/s | 2.3 MB 00:00 2024-05-08T21:46:36.652 INFO:teuthology.orchestra.run.smithi073.stdout:(4/146): ceph-mds-18.2.2-1322.gd21e4f96.el8.x86 3.9 MB/s | 2.3 MB 00:00 2024-05-08T21:46:36.811 INFO:teuthology.orchestra.run.smithi115.stdout:(5/146): ceph-mgr-18.2.2-1322.gd21e4f96.el8.x86 3.4 MB/s | 1.6 MB 00:00 2024-05-08T21:46:36.944 INFO:teuthology.orchestra.run.smithi073.stdout:(5/146): ceph-mgr-18.2.2-1322.gd21e4f96.el8.x86 5.4 MB/s | 1.6 MB 00:00 2024-05-08T21:46:37.212 INFO:teuthology.orchestra.run.smithi115.stdout:(6/146): ceph-base-18.2.2-1322.gd21e4f96.el8.x8 3.2 MB/s | 5.5 MB 00:01 2024-05-08T21:46:37.453 INFO:teuthology.orchestra.run.smithi073.stdout:(6/146): ceph-base-18.2.2-1322.gd21e4f96.el8.x8 3.0 MB/s | 5.5 MB 00:01 2024-05-08T21:46:37.720 INFO:teuthology.orchestra.run.smithi073.stdout:(7/146): ceph-mon-18.2.2-1322.gd21e4f96.el8.x86 6.2 MB/s | 4.8 MB 00:00 2024-05-08T21:46:38.612 INFO:teuthology.orchestra.run.smithi115.stdout:(7/146): ceph-common-18.2.2-1322.gd21e4f96.el8. 6.9 MB/s | 22 MB 00:03 2024-05-08T21:46:38.679 INFO:teuthology.orchestra.run.smithi115.stdout:(8/146): ceph-mon-18.2.2-1322.gd21e4f96.el8.x86 2.6 MB/s | 4.8 MB 00:01 2024-05-08T21:46:38.754 INFO:teuthology.orchestra.run.smithi115.stdout:(9/146): ceph-selinux-18.2.2-1322.gd21e4f96.el8 324 kB/s | 24 kB 00:00 2024-05-08T21:46:39.220 INFO:teuthology.orchestra.run.smithi073.stdout:(8/146): ceph-common-18.2.2-1322.gd21e4f96.el8. 6.0 MB/s | 22 MB 00:03 2024-05-08T21:46:39.303 INFO:teuthology.orchestra.run.smithi073.stdout:(9/146): ceph-selinux-18.2.2-1322.gd21e4f96.el8 292 kB/s | 24 kB 00:00 2024-05-08T21:46:39.862 INFO:teuthology.orchestra.run.smithi073.stdout:(10/146): ceph-radosgw-18.2.2-1322.gd21e4f96.el 6.1 MB/s | 13 MB 00:02 2024-05-08T21:46:39.945 INFO:teuthology.orchestra.run.smithi073.stdout:(11/146): cephfs-mirror-18.2.2-1322.gd21e4f96.e 3.1 MB/s | 261 kB 00:00 2024-05-08T21:46:40.062 INFO:teuthology.orchestra.run.smithi073.stdout:(12/146): libcephfs-devel-18.2.2-1322.gd21e4f96 265 kB/s | 31 kB 00:00 2024-05-08T21:46:40.221 INFO:teuthology.orchestra.run.smithi073.stdout:(13/146): libcephfs2-18.2.2-1322.gd21e4f96.el8. 4.8 MB/s | 782 kB 00:00 2024-05-08T21:46:40.296 INFO:teuthology.orchestra.run.smithi073.stdout:(14/146): libcephsqlite-18.2.2-1322.gd21e4f96.e 1.8 MB/s | 142 kB 00:00 2024-05-08T21:46:40.380 INFO:teuthology.orchestra.run.smithi073.stdout:(15/146): librados-devel-18.2.2-1322.gd21e4f96. 1.6 MB/s | 139 kB 00:00 2024-05-08T21:46:40.455 INFO:teuthology.orchestra.run.smithi073.stdout:(16/146): libradosstriper1-18.2.2-1322.gd21e4f9 6.2 MB/s | 474 kB 00:00 2024-05-08T21:46:40.488 INFO:teuthology.orchestra.run.smithi115.stdout:(10/146): ceph-radosgw-18.2.2-1322.gd21e4f96.el 7.0 MB/s | 13 MB 00:01 2024-05-08T21:46:40.646 INFO:teuthology.orchestra.run.smithi115.stdout:(11/146): cephfs-mirror-18.2.2-1322.gd21e4f96.e 1.6 MB/s | 261 kB 00:00 2024-05-08T21:46:40.746 INFO:teuthology.orchestra.run.smithi115.stdout:(12/146): libcephfs-devel-18.2.2-1322.gd21e4f96 309 kB/s | 31 kB 00:00 2024-05-08T21:46:40.922 INFO:teuthology.orchestra.run.smithi115.stdout:(13/146): libcephfs2-18.2.2-1322.gd21e4f96.el8. 4.4 MB/s | 782 kB 00:00 2024-05-08T21:46:41.046 INFO:teuthology.orchestra.run.smithi115.stdout:(14/146): libcephsqlite-18.2.2-1322.gd21e4f96.e 1.1 MB/s | 142 kB 00:00 2024-05-08T21:46:41.147 INFO:teuthology.orchestra.run.smithi115.stdout:(15/146): librados-devel-18.2.2-1322.gd21e4f96. 1.3 MB/s | 139 kB 00:00 2024-05-08T21:46:41.314 INFO:teuthology.orchestra.run.smithi115.stdout:(16/146): libradosstriper1-18.2.2-1322.gd21e4f9 2.8 MB/s | 474 kB 00:00 2024-05-08T21:46:41.372 INFO:teuthology.orchestra.run.smithi073.stdout:(17/146): librgw2-18.2.2-1322.gd21e4f96.el8.x86 7.1 MB/s | 6.5 MB 00:00 2024-05-08T21:46:41.581 INFO:teuthology.orchestra.run.smithi073.stdout:(18/146): ceph-osd-18.2.2-1322.gd21e4f96.el8.x8 4.5 MB/s | 18 MB 00:04 2024-05-08T21:46:41.606 INFO:teuthology.orchestra.run.smithi073.stdout:(19/146): python3-ceph-argparse-18.2.2-1322.gd2 191 kB/s | 45 kB 00:00 2024-05-08T21:46:41.673 INFO:teuthology.orchestra.run.smithi073.stdout:(20/146): python3-ceph-common-18.2.2-1322.gd21e 1.4 MB/s | 129 kB 00:00 2024-05-08T21:46:41.707 INFO:teuthology.orchestra.run.smithi073.stdout:(21/146): python3-cephfs-18.2.2-1322.gd21e4f96. 1.9 MB/s | 197 kB 00:00 2024-05-08T21:46:41.773 INFO:teuthology.orchestra.run.smithi073.stdout:(22/146): python3-rados-18.2.2-1322.gd21e4f96.e 3.6 MB/s | 370 kB 00:00 2024-05-08T21:46:41.799 INFO:teuthology.orchestra.run.smithi073.stdout:(23/146): python3-rbd-18.2.2-1322.gd21e4f96.el8 3.9 MB/s | 365 kB 00:00 2024-05-08T21:46:41.883 INFO:teuthology.orchestra.run.smithi073.stdout:(24/146): python3-rgw-18.2.2-1322.gd21e4f96.el8 982 kB/s | 107 kB 00:00 2024-05-08T21:46:41.908 INFO:teuthology.orchestra.run.smithi073.stdout:(25/146): rbd-fuse-18.2.2-1322.gd21e4f96.el8.x8 875 kB/s | 95 kB 00:00 2024-05-08T21:46:42.008 INFO:teuthology.orchestra.run.smithi073.stdout:(26/146): rbd-nbd-18.2.2-1322.gd21e4f96.el8.x86 1.8 MB/s | 181 kB 00:00 2024-05-08T21:46:42.075 INFO:teuthology.orchestra.run.smithi073.stdout:(27/146): ceph-grafana-dashboards-18.2.2-1322.g 364 kB/s | 24 kB 00:00 2024-05-08T21:46:42.089 INFO:teuthology.orchestra.run.smithi115.stdout:(17/146): librgw2-18.2.2-1322.gd21e4f96.el8.x86 8.4 MB/s | 6.5 MB 00:00 2024-05-08T21:46:42.165 INFO:teuthology.orchestra.run.smithi115.stdout:(18/146): python3-ceph-argparse-18.2.2-1322.gd2 596 kB/s | 45 kB 00:00 2024-05-08T21:46:42.167 INFO:teuthology.orchestra.run.smithi073.stdout:(28/146): ceph-mgr-cephadm-18.2.2-1322.gd21e4f9 1.5 MB/s | 138 kB 00:00 2024-05-08T21:46:42.231 INFO:teuthology.orchestra.run.smithi115.stdout:(19/146): python3-ceph-common-18.2.2-1322.gd21e 1.9 MB/s | 129 kB 00:00 2024-05-08T21:46:42.332 INFO:teuthology.orchestra.run.smithi115.stdout:(20/146): python3-cephfs-18.2.2-1322.gd21e4f96. 1.9 MB/s | 197 kB 00:00 2024-05-08T21:46:42.440 INFO:teuthology.orchestra.run.smithi115.stdout:(21/146): python3-rados-18.2.2-1322.gd21e4f96.e 3.3 MB/s | 370 kB 00:00 2024-05-08T21:46:42.526 INFO:teuthology.orchestra.run.smithi073.stdout:(29/146): rbd-mirror-18.2.2-1322.gd21e4f96.el8. 5.4 MB/s | 3.5 MB 00:00 2024-05-08T21:46:42.532 INFO:teuthology.orchestra.run.smithi115.stdout:(22/146): python3-rbd-18.2.2-1322.gd21e4f96.el8 3.9 MB/s | 365 kB 00:00 2024-05-08T21:46:42.632 INFO:teuthology.orchestra.run.smithi115.stdout:(23/146): python3-rgw-18.2.2-1322.gd21e4f96.el8 1.0 MB/s | 107 kB 00:00 2024-05-08T21:46:42.668 INFO:teuthology.orchestra.run.smithi073.stdout:(30/146): ceph-mgr-dashboard-18.2.2-1322.gd21e4 7.1 MB/s | 3.5 MB 00:00 2024-05-08T21:46:42.700 INFO:teuthology.orchestra.run.smithi115.stdout:(24/146): rbd-fuse-18.2.2-1322.gd21e4f96.el8.x8 1.4 MB/s | 95 kB 00:00 2024-05-08T21:46:42.768 INFO:teuthology.orchestra.run.smithi073.stdout:(31/146): ceph-mgr-modules-core-18.2.2-1322.gd2 2.4 MB/s | 245 kB 00:00 2024-05-08T21:46:42.868 INFO:teuthology.orchestra.run.smithi073.stdout:(32/146): ceph-mgr-rook-18.2.2-1322.gd21e4f96.e 492 kB/s | 49 kB 00:00 2024-05-08T21:46:42.952 INFO:teuthology.orchestra.run.smithi073.stdout:(33/146): ceph-prometheus-alerts-18.2.2-1322.gd 196 kB/s | 16 kB 00:00 2024-05-08T21:46:43.069 INFO:teuthology.orchestra.run.smithi073.stdout:(34/146): ceph-volume-18.2.2-1322.gd21e4f96.el8 2.2 MB/s | 263 kB 00:00 2024-05-08T21:46:43.153 INFO:teuthology.orchestra.run.smithi073.stdout:(35/146): cephadm-18.2.2-1322.gd21e4f96.el8.noa 2.0 MB/s | 170 kB 00:00 2024-05-08T21:46:43.213 INFO:teuthology.orchestra.run.smithi073.stdout:(36/146): cephfs-top-18.2.2-1322.gd21e4f96.el8. 310 kB/s | 18 kB 00:00 2024-05-08T21:46:43.225 INFO:teuthology.orchestra.run.smithi115.stdout:(25/146): rbd-mirror-18.2.2-1322.gd21e4f96.el8. 6.6 MB/s | 3.5 MB 00:00 2024-05-08T21:46:43.400 INFO:teuthology.orchestra.run.smithi115.stdout:(26/146): ceph-osd-18.2.2-1322.gd21e4f96.el8.x8 3.0 MB/s | 18 MB 00:06 2024-05-08T21:46:43.417 INFO:teuthology.orchestra.run.smithi115.stdout:(27/146): rbd-nbd-18.2.2-1322.gd21e4f96.el8.x86 944 kB/s | 181 kB 00:00 2024-05-08T21:46:43.503 INFO:teuthology.orchestra.run.smithi115.stdout:(28/146): ceph-grafana-dashboards-18.2.2-1322.g 243 kB/s | 24 kB 00:00 2024-05-08T21:46:43.526 INFO:teuthology.orchestra.run.smithi115.stdout:(29/146): ceph-mgr-cephadm-18.2.2-1322.gd21e4f9 1.2 MB/s | 138 kB 00:00 2024-05-08T21:46:43.536 INFO:teuthology.orchestra.run.smithi073.stdout:(37/146): gperftools-libs-2.7-9.el8.x86_64.rpm 943 kB/s | 306 kB 00:00 2024-05-08T21:46:43.652 INFO:teuthology.orchestra.run.smithi073.stdout:(38/146): liboath-2.6.2-3.el8.x86_64.rpm 512 kB/s | 59 kB 00:00 2024-05-08T21:46:43.754 INFO:teuthology.orchestra.run.smithi073.stdout:(39/146): ceph-mgr-diskprediction-local-18.2.2- 6.0 MB/s | 7.4 MB 00:01 2024-05-08T21:46:43.779 INFO:teuthology.orchestra.run.smithi073.stdout:(40/146): libunwind-1.3.1-3.el8.x86_64.rpm 592 kB/s | 75 kB 00:00 2024-05-08T21:46:43.846 INFO:teuthology.orchestra.run.smithi073.stdout:(41/146): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 656 kB/s | 44 kB 00:00 2024-05-08T21:46:43.955 INFO:teuthology.orchestra.run.smithi073.stdout:(42/146): python3-beautifulsoup4-4.6.3-2.el8.1. 1.7 MB/s | 185 kB 00:00 2024-05-08T21:46:44.030 INFO:teuthology.orchestra.run.smithi073.stdout:(43/146): python3-cachetools-3.1.1-4.el8.noarch 445 kB/s | 33 kB 00:00 2024-05-08T21:46:44.097 INFO:teuthology.orchestra.run.smithi073.stdout:(44/146): python3-certifi-2018.10.15-7.el8.noar 245 kB/s | 16 kB 00:00 2024-05-08T21:46:44.131 INFO:teuthology.orchestra.run.smithi073.stdout:(45/146): python3-asyncssh-2.7.0-2.el8.noarch.r 1.2 MB/s | 476 kB 00:00 2024-05-08T21:46:44.164 INFO:teuthology.orchestra.run.smithi073.stdout:(46/146): python3-cheroot-8.5.2-1.el8.noarch.rp 2.5 MB/s | 173 kB 00:00 2024-05-08T21:46:44.206 INFO:teuthology.orchestra.run.smithi073.stdout:(47/146): python3-cherrypy-18.4.0-1.el8.noarch. 5.0 MB/s | 384 kB 00:00 2024-05-08T21:46:44.265 INFO:teuthology.orchestra.run.smithi073.stdout:(48/146): python3-google-auth-1.1.1-10.el8.noar 809 kB/s | 81 kB 00:00 2024-05-08T21:46:44.290 INFO:teuthology.orchestra.run.smithi073.stdout:(49/146): python3-jaraco-6.2-6.el8.noarch.rpm 133 kB/s | 11 kB 00:00 2024-05-08T21:46:44.341 INFO:teuthology.orchestra.run.smithi073.stdout:(50/146): python3-jaraco-functools-2.0-4.el8.no 234 kB/s | 18 kB 00:00 2024-05-08T21:46:44.351 INFO:teuthology.orchestra.run.smithi115.stdout:(30/146): ceph-mgr-diskprediction-local-18.2.2- 9.0 MB/s | 7.4 MB 00:00 2024-05-08T21:46:44.416 INFO:teuthology.orchestra.run.smithi073.stdout:(51/146): python3-logutils-0.3.5-11.el8.noarch. 650 kB/s | 49 kB 00:00 2024-05-08T21:46:44.418 INFO:teuthology.orchestra.run.smithi115.stdout:(31/146): ceph-mgr-modules-core-18.2.2-1322.gd2 3.6 MB/s | 245 kB 00:00 2024-05-08T21:46:44.458 INFO:teuthology.orchestra.run.smithi073.stdout:(52/146): python3-kubernetes-11.0.0-6.el8.noarc 7.0 MB/s | 1.2 MB 00:00 2024-05-08T21:46:44.468 INFO:teuthology.orchestra.run.smithi115.stdout:(32/146): ceph-mgr-dashboard-18.2.2-1322.gd21e4 3.6 MB/s | 3.5 MB 00:00 2024-05-08T21:46:44.491 INFO:teuthology.orchestra.run.smithi073.stdout:(53/146): python3-more-itertools-7.2.0-3.el8.no 781 kB/s | 59 kB 00:00 2024-05-08T21:46:44.493 INFO:teuthology.orchestra.run.smithi115.stdout:(33/146): ceph-mgr-rook-18.2.2-1322.gd21e4f96.e 655 kB/s | 49 kB 00:00 2024-05-08T21:46:44.535 INFO:teuthology.orchestra.run.smithi115.stdout:(34/146): ceph-prometheus-alerts-18.2.2-1322.gd 244 kB/s | 16 kB 00:00 2024-05-08T21:46:44.561 INFO:teuthology.orchestra.run.smithi115.stdout:(35/146): ceph-volume-18.2.2-1322.gd21e4f96.el8 3.8 MB/s | 263 kB 00:00 2024-05-08T21:46:44.562 INFO:teuthology.orchestra.run.smithi073.stdout:(54/146): python3-natsort-7.1.1-2.el8.noarch.rp 576 kB/s | 60 kB 00:00 2024-05-08T21:46:44.613 INFO:teuthology.orchestra.run.smithi115.stdout:(36/146): cephadm-18.2.2-1322.gd21e4f96.el8.noa 2.2 MB/s | 170 kB 00:00 2024-05-08T21:46:44.630 INFO:teuthology.orchestra.run.smithi115.stdout:(37/146): cephfs-top-18.2.2-1322.gd21e4f96.el8. 262 kB/s | 18 kB 00:00 2024-05-08T21:46:44.709 INFO:teuthology.orchestra.run.smithi073.stdout:(55/146): python3-pecan-1.3.2-9.el8.noarch.rpm 1.3 MB/s | 283 kB 00:00 2024-05-08T21:46:44.942 INFO:teuthology.orchestra.run.smithi073.stdout:(56/146): python3-portend-2.6-1.el8.noarch.rpm 41 kB/s | 16 kB 00:00 2024-05-08T21:46:44.964 INFO:teuthology.orchestra.run.smithi115.stdout:(38/146): liboath-2.6.2-3.el8.x86_64.rpm 176 kB/s | 59 kB 00:00 2024-05-08T21:46:44.967 INFO:teuthology.orchestra.run.smithi073.stdout:(57/146): python3-repoze-lru-0.7-6.el8.noarch.r 130 kB/s | 34 kB 00:00 2024-05-08T21:46:45.122 INFO:teuthology.orchestra.run.smithi115.stdout:(39/146): gperftools-libs-2.7-9.el8.x86_64.rpm 602 kB/s | 306 kB 00:00 2024-05-08T21:46:45.307 INFO:teuthology.orchestra.run.smithi115.stdout:(40/146): libunwind-1.3.1-3.el8.x86_64.rpm 219 kB/s | 75 kB 00:00 2024-05-08T21:46:45.418 INFO:teuthology.orchestra.run.smithi073.stdout:(58/146): ceph-test-18.2.2-1322.gd21e4f96.el8.x 7.7 MB/s | 47 MB 00:06 2024-05-08T21:46:45.443 INFO:teuthology.orchestra.run.smithi073.stdout:(59/146): python3-rsa-4.9-2.el8.noarch.rpm 135 kB/s | 64 kB 00:00 2024-05-08T21:46:45.468 INFO:teuthology.orchestra.run.smithi073.stdout:(60/146): python3-routes-2.4.1-12.el8.noarch.rp 374 kB/s | 196 kB 00:00 2024-05-08T21:46:45.511 INFO:teuthology.orchestra.run.smithi073.stdout:(61/146): python3-singledispatch-3.4.0.3-18.el8 357 kB/s | 24 kB 00:00 2024-05-08T21:46:45.538 INFO:teuthology.orchestra.run.smithi073.stdout:(62/146): python3-tempora-1.14.1-5.el8.noarch.r 437 kB/s | 29 kB 00:00 2024-05-08T21:46:45.578 INFO:teuthology.orchestra.run.smithi073.stdout:(63/146): python3-trustme-0.6.0-4.el8.noarch.rp 412 kB/s | 27 kB 00:00 2024-05-08T21:46:45.603 INFO:teuthology.orchestra.run.smithi073.stdout:(64/146): python3-simplegeneric-0.8.1-17.el8.no 101 kB/s | 19 kB 00:00 2024-05-08T21:46:45.682 INFO:teuthology.orchestra.run.smithi073.stdout:(65/146): python3-webob-1.8.5-1.el8.1.noarch.rp 2.4 MB/s | 251 kB 00:00 2024-05-08T21:46:45.703 INFO:teuthology.orchestra.run.smithi073.stdout:(66/146): python3-waitress-1.4.3-1.el8.noarch.r 1.5 MB/s | 255 kB 00:00 2024-05-08T21:46:45.731 INFO:teuthology.orchestra.run.smithi115.stdout:(41/146): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 103 kB/s | 44 kB 00:00 2024-05-08T21:46:45.737 INFO:teuthology.orchestra.run.smithi073.stdout:(67/146): python3-websocket-client-0.56.0-5.el8 458 kB/s | 61 kB 00:00 2024-05-08T21:46:45.756 INFO:teuthology.orchestra.run.smithi115.stdout:(42/146): python3-asyncssh-2.7.0-2.el8.noarch.r 751 kB/s | 476 kB 00:00 2024-05-08T21:46:45.762 INFO:teuthology.orchestra.run.smithi073.stdout:(68/146): python3-webtest-2.0.33-1.el8.noarch.r 1.0 MB/s | 85 kB 00:00 2024-05-08T21:46:45.788 INFO:teuthology.orchestra.run.smithi073.stdout:(69/146): python3-zc-lockfile-2.0-2.el8.noarch. 273 kB/s | 23 kB 00:00 2024-05-08T21:46:45.813 INFO:teuthology.orchestra.run.smithi073.stdout:(70/146): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.4 MB/s | 70 kB 00:00 2024-05-08T21:46:45.997 INFO:teuthology.orchestra.run.smithi073.stdout:(71/146): libverto-devel-0.3.0-5.el8.x86_64.rpm 86 kB/s | 18 kB 00:00 2024-05-08T21:46:46.015 INFO:teuthology.orchestra.run.smithi115.stdout:(43/146): python3-cachetools-3.1.1-4.el8.noarch 128 kB/s | 33 kB 00:00 2024-05-08T21:46:46.022 INFO:teuthology.orchestra.run.smithi073.stdout:(72/146): python3-jwt-1.6.1-2.el8.noarch.rpm 210 kB/s | 43 kB 00:00 2024-05-08T21:46:46.064 INFO:teuthology.orchestra.run.smithi073.stdout:(73/146): thrift-0.13.0-2.el8.x86_64.rpm 5.3 MB/s | 1.7 MB 00:00 2024-05-08T21:46:46.122 INFO:teuthology.orchestra.run.smithi073.stdout:(74/146): python3-oauthlib-2.1.0-1.el8.noarch.r 1.2 MB/s | 155 kB 00:00 2024-05-08T21:46:46.149 INFO:teuthology.orchestra.run.smithi115.stdout:(44/146): python3-beautifulsoup4-4.6.3-2.el8.1. 444 kB/s | 185 kB 00:00 2024-05-08T21:46:46.214 INFO:teuthology.orchestra.run.smithi073.stdout:(75/146): python3-pycparser-2.14-14.el8.noarch. 568 kB/s | 109 kB 00:00 2024-05-08T21:46:46.240 INFO:teuthology.orchestra.run.smithi073.stdout:(76/146): python3-requests-oauthlib-1.0.0-1.el8 243 kB/s | 43 kB 00:00 2024-05-08T21:46:46.298 INFO:teuthology.orchestra.run.smithi073.stdout:(77/146): libaio-devel-0.3.112-1.el8.x86_64.rpm 106 kB/s | 19 kB 00:00 2024-05-08T21:46:46.307 INFO:teuthology.orchestra.run.smithi115.stdout:(45/146): python3-certifi-2018.10.15-7.el8.noar 56 kB/s | 16 kB 00:00 2024-05-08T21:46:46.374 INFO:teuthology.orchestra.run.smithi073.stdout:(78/146): libzstd-devel-1.4.4-1.el8.x86_64.rpm 276 kB/s | 44 kB 00:00 2024-05-08T21:46:46.432 INFO:teuthology.orchestra.run.smithi073.stdout:(79/146): pcre2-devel-10.32-2.el8.x86_64.rpm 3.1 MB/s | 605 kB 00:00 2024-05-08T21:46:46.491 INFO:teuthology.orchestra.run.smithi073.stdout:(80/146): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.8 MB/s | 220 kB 00:00 2024-05-08T21:46:46.524 INFO:teuthology.orchestra.run.smithi073.stdout:(81/146): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.0 MB/s | 229 kB 00:00 2024-05-08T21:46:46.541 INFO:teuthology.orchestra.run.smithi115.stdout:(46/146): python3-cheroot-8.5.2-1.el8.noarch.rp 441 kB/s | 173 kB 00:00 2024-05-08T21:46:46.608 INFO:teuthology.orchestra.run.smithi073.stdout:(82/146): libselinux-devel-2.9-5.el8.x86_64.rpm 1.1 MB/s | 200 kB 00:00 2024-05-08T21:46:46.634 INFO:teuthology.orchestra.run.smithi073.stdout:(83/146): libsepol-devel-2.9-3.el8.x86_64.rpm 800 kB/s | 87 kB 00:00 2024-05-08T21:46:46.650 INFO:teuthology.orchestra.run.smithi073.stdout:(84/146): keyutils-libs-devel-1.5.10-9.el8.x86_ 302 kB/s | 48 kB 00:00 2024-05-08T21:46:46.667 INFO:teuthology.orchestra.run.smithi073.stdout:(85/146): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 981 kB/s | 58 kB 00:00 2024-05-08T21:46:46.743 INFO:teuthology.orchestra.run.smithi073.stdout:(86/146): libcom_err-devel-1.45.6-4.el8.x86_64. 355 kB/s | 39 kB 00:00 2024-05-08T21:46:46.774 INFO:teuthology.orchestra.run.smithi115.stdout:(47/146): python3-cherrypy-18.4.0-1.el8.noarch. 824 kB/s | 384 kB 00:00 2024-05-08T21:46:46.785 INFO:teuthology.orchestra.run.smithi073.stdout:(87/146): fuse-2.9.7-17.el8.x86_64.rpm 620 kB/s | 83 kB 00:00 2024-05-08T21:46:46.818 INFO:teuthology.orchestra.run.smithi073.stdout:(88/146): libgfortran-8.5.0-20.el8.x86_64.rpm 4.2 MB/s | 645 kB 00:00 2024-05-08T21:46:46.867 INFO:teuthology.orchestra.run.smithi073.stdout:(89/146): libquadmath-8.5.0-20.el8.x86_64.rpm 1.4 MB/s | 172 kB 00:00 2024-05-08T21:46:46.917 INFO:teuthology.orchestra.run.smithi115.stdout:(48/146): python3-google-auth-1.1.1-10.el8.noar 216 kB/s | 81 kB 00:00 2024-05-08T21:46:46.919 INFO:teuthology.orchestra.run.smithi073.stdout:(90/146): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 725 kB/s | 73 kB 00:00 2024-05-08T21:46:46.944 INFO:teuthology.orchestra.run.smithi073.stdout:(91/146): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.5 MB/s | 238 kB 00:00 2024-05-08T21:46:47.003 INFO:teuthology.orchestra.run.smithi073.stdout:(92/146): elfutils-libelf-devel-0.189-3.el8.x86 455 kB/s | 62 kB 00:00 2024-05-08T21:46:47.036 INFO:teuthology.orchestra.run.smithi073.stdout:(93/146): krb5-devel-1.18.2-26.el8_9.x86_64.rpm 4.7 MB/s | 562 kB 00:00 2024-05-08T21:46:47.095 INFO:teuthology.orchestra.run.smithi073.stdout:(94/146): librabbitmq-0.9.0-5.el8_9.x86_64.rpm 513 kB/s | 47 kB 00:00 2024-05-08T21:46:47.137 INFO:teuthology.orchestra.run.smithi073.stdout:(95/146): openssl-devel-1.1.1k-12.el8_9.x86_64. 12 MB/s | 2.3 MB 00:00 2024-05-08T21:46:47.187 INFO:teuthology.orchestra.run.smithi073.stdout:(96/146): python3-cryptography-3.2.1-7.el8_9.x8 3.6 MB/s | 559 kB 00:00 2024-05-08T21:46:47.212 INFO:teuthology.orchestra.run.smithi073.stdout:(97/146): NetworkManager-initscripts-updown-1.4 1.2 MB/s | 144 kB 00:00 2024-05-08T21:46:47.288 INFO:teuthology.orchestra.run.smithi073.stdout:(98/146): libuuid-devel-2.32.1-44.el8_9.1.x86_6 663 kB/s | 100 kB 00:00 2024-05-08T21:46:47.321 INFO:teuthology.orchestra.run.smithi073.stdout:(99/146): python3-jsonpointer-1.10-11.el8.noarc 150 kB/s | 20 kB 00:00 2024-05-08T21:46:47.388 INFO:teuthology.orchestra.run.smithi073.stdout:(100/146): python3-prettytable-0.7.2-14.el8.noa 250 kB/s | 44 kB 00:00 2024-05-08T21:46:47.425 INFO:teuthology.orchestra.run.smithi115.stdout:(49/146): ceph-test-18.2.2-1322.gd21e4f96.el8.x 5.4 MB/s | 47 MB 00:08 2024-05-08T21:46:47.450 INFO:teuthology.orchestra.run.smithi115.stdout:(50/146): python3-jaraco-6.2-6.el8.noarch.rpm 16 kB/s | 11 kB 00:00 2024-05-08T21:46:47.480 INFO:teuthology.orchestra.run.smithi073.stdout:(101/146): python3-jsonpatch-1.21-2.el8.noarch. 167 kB/s | 27 kB 00:00 2024-05-08T21:46:47.505 INFO:teuthology.orchestra.run.smithi073.stdout:(102/146): python3-pyasn1-modules-0.3.7-6.el8.n 506 kB/s | 110 kB 00:00 2024-05-08T21:46:47.531 INFO:teuthology.orchestra.run.smithi073.stdout:(103/146): python3-pyasn1-0.3.7-6.el8.noarch.rp 889 kB/s | 126 kB 00:00 2024-05-08T21:46:47.606 INFO:teuthology.orchestra.run.smithi073.stdout:(104/146): python3-werkzeug-0.12.2-4.el8.noarch 3.6 MB/s | 457 kB 00:00 2024-05-08T21:46:47.633 INFO:teuthology.orchestra.run.smithi115.stdout:(51/146): python3-jaraco-functools-2.0-4.el8.no 25 kB/s | 18 kB 00:00 2024-05-08T21:46:47.656 INFO:teuthology.orchestra.run.smithi073.stdout:(105/146): bison-3.0.4-10.el8.x86_64.rpm 4.5 MB/s | 688 kB 00:00 2024-05-08T21:46:47.682 INFO:teuthology.orchestra.run.smithi073.stdout:(106/146): flex-2.6.1-9.el8.x86_64.rpm 2.1 MB/s | 320 kB 00:00 2024-05-08T21:46:47.724 INFO:teuthology.orchestra.run.smithi073.stdout:(107/146): libtool-2.4.6-25.el8.x86_64.rpm 5.9 MB/s | 709 kB 00:00 2024-05-08T21:46:47.786 INFO:teuthology.orchestra.run.smithi115.stdout:(52/146): python3-logutils-0.3.5-11.el8.noarch. 146 kB/s | 49 kB 00:00 2024-05-08T21:46:47.799 INFO:teuthology.orchestra.run.smithi073.stdout:(108/146): python3-markupsafe-0.23-19.el8.x86_6 273 kB/s | 39 kB 00:00 2024-05-08T21:46:47.824 INFO:teuthology.orchestra.run.smithi073.stdout:(109/146): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.8 MB/s | 259 kB 00:00 2024-05-08T21:46:47.850 INFO:teuthology.orchestra.run.smithi073.stdout:(110/146): uuid-1.6.2-43.el8.x86_64.rpm 510 kB/s | 64 kB 00:00 2024-05-08T21:46:47.933 INFO:teuthology.orchestra.run.smithi073.stdout:(111/146): python3-pyOpenSSL-19.0.0-1.el8.noarc 773 kB/s | 103 kB 00:00 2024-05-08T21:46:47.968 INFO:teuthology.orchestra.run.smithi115.stdout:(53/146): python3-more-itertools-7.2.0-3.el8.no 175 kB/s | 59 kB 00:00 2024-05-08T21:46:48.035 INFO:teuthology.orchestra.run.smithi115.stdout:(54/146): python3-kubernetes-11.0.0-6.el8.noarc 1.9 MB/s | 1.2 MB 00:00 2024-05-08T21:46:48.082 INFO:teuthology.orchestra.run.smithi073.stdout:(112/146): python3-jinja2-2.10.1-3.el8.noarch.r 2.3 MB/s | 538 kB 00:00 2024-05-08T21:46:48.127 INFO:teuthology.orchestra.run.smithi115.stdout:(55/146): python3-natsort-7.1.1-2.el8.noarch.rp 176 kB/s | 60 kB 00:00 2024-05-08T21:46:48.150 INFO:teuthology.orchestra.run.smithi073.stdout:(113/146): python3-babel-2.5.1-7.el8.noarch.rpm 15 MB/s | 4.8 MB 00:00 2024-05-08T21:46:48.242 INFO:teuthology.orchestra.run.smithi073.stdout:(114/146): python3-numpy-1.14.3-10.el8.x86_64.r 12 MB/s | 3.7 MB 00:00 2024-05-08T21:46:48.311 INFO:teuthology.orchestra.run.smithi115.stdout:(56/146): python3-portend-2.6-1.el8.noarch.rpm 57 kB/s | 16 kB 00:00 2024-05-08T21:46:48.334 INFO:teuthology.orchestra.run.smithi073.stdout:(115/146): python3-numpy-f2py-1.14.3-10.el8.x86 1.2 MB/s | 225 kB 00:00 2024-05-08T21:46:48.377 INFO:teuthology.orchestra.run.smithi115.stdout:(57/146): python3-repoze-lru-0.7-6.el8.noarch.r 134 kB/s | 34 kB 00:00 2024-05-08T21:46:48.394 INFO:teuthology.orchestra.run.smithi073.stdout:(116/146): socat-1.7.4.1-1.el8.x86_64.rpm 1.0 MB/s | 323 kB 00:00 2024-05-08T21:46:48.435 INFO:teuthology.orchestra.run.smithi073.stdout:(117/146): librdkafka-0.11.4-3.el8.x86_64.rpm 1.8 MB/s | 354 kB 00:00 2024-05-08T21:46:48.453 INFO:teuthology.orchestra.run.smithi115.stdout:(58/146): python3-pecan-1.3.2-9.el8.noarch.rpm 584 kB/s | 283 kB 00:00 2024-05-08T21:46:48.577 INFO:teuthology.orchestra.run.smithi073.stdout:(118/146): openblas-threads-0.3.15-6.el8.x86_64 21 MB/s | 5.2 MB 00:00 2024-05-08T21:46:48.602 INFO:teuthology.orchestra.run.smithi073.stdout:(119/146): python3-mako-1.0.6-14.el8.noarch.rpm 755 kB/s | 157 kB 00:00 2024-05-08T21:46:48.703 INFO:teuthology.orchestra.run.smithi115.stdout:(59/146): python3-rsa-4.9-2.el8.noarch.rpm 197 kB/s | 64 kB 00:00 2024-05-08T21:46:48.728 INFO:teuthology.orchestra.run.smithi115.stdout:(60/146): python3-simplegeneric-0.8.1-17.el8.no 68 kB/s | 19 kB 00:00 2024-05-08T21:46:48.735 INFO:teuthology.orchestra.run.smithi073.stdout:(120/146): openblas-0.3.15-6.el8.x86_64.rpm 17 MB/s | 5.0 MB 00:00 2024-05-08T21:46:48.753 INFO:teuthology.orchestra.run.smithi115.stdout:(61/146): python3-routes-2.4.1-12.el8.noarch.rp 444 kB/s | 196 kB 00:00 2024-05-08T21:46:48.761 INFO:teuthology.orchestra.run.smithi073.stdout:(121/146): libpq-13.11-1.el8.x86_64.rpm 1.2 MB/s | 198 kB 00:00 2024-05-08T21:46:48.803 INFO:teuthology.orchestra.run.smithi073.stdout:(122/146): automake-1.16.1-8.el8.noarch.rpm 3.1 MB/s | 714 kB 00:00 2024-05-08T21:46:48.878 INFO:teuthology.orchestra.run.smithi073.stdout:(123/146): jq-1.6-7.el8.x86_64.rpm 1.4 MB/s | 202 kB 00:00 2024-05-08T21:46:48.903 INFO:teuthology.orchestra.run.smithi073.stdout:(124/146): python3-pytz-2017.2-11.el8.noarch.rp 382 kB/s | 54 kB 00:00 2024-05-08T21:46:48.954 INFO:teuthology.orchestra.run.smithi115.stdout:(62/146): python3-singledispatch-3.4.0.3-18.el8 95 kB/s | 24 kB 00:00 2024-05-08T21:46:48.987 INFO:teuthology.orchestra.run.smithi115.stdout:(63/146): python3-tempora-1.14.1-5.el8.noarch.r 113 kB/s | 29 kB 00:00 2024-05-08T21:46:49.012 INFO:teuthology.orchestra.run.smithi115.stdout:(64/146): python3-trustme-0.6.0-4.el8.noarch.rp 106 kB/s | 27 kB 00:00 2024-05-08T21:46:49.053 INFO:teuthology.orchestra.run.smithi073.stdout:(125/146): oniguruma-6.8.2-2.1.el8_9.x86_64.rpm 1.0 MB/s | 188 kB 00:00 2024-05-08T21:46:49.104 INFO:teuthology.orchestra.run.smithi073.stdout:(126/146): postgresql-10.23-4.module+el8.9.0+21 7.5 MB/s | 1.5 MB 00:00 2024-05-08T21:46:49.179 INFO:teuthology.orchestra.run.smithi073.stdout:(127/146): postgresql-contrib-10.23-4.module+el 6.3 MB/s | 812 kB 00:00 2024-05-08T21:46:49.338 INFO:teuthology.orchestra.run.smithi115.stdout:(65/146): python3-websocket-client-0.56.0-5.el8 188 kB/s | 61 kB 00:00 2024-05-08T21:46:49.363 INFO:teuthology.orchestra.run.smithi073.stdout:(128/146): python3-scipy-1.0.0-21.module+el8.9. 24 MB/s | 14 MB 00:00 2024-05-08T21:46:49.388 INFO:teuthology.orchestra.run.smithi073.stdout:(129/146): python3-packaging-16.8-9.el8.noarch. 231 kB/s | 48 kB 00:00 2024-05-08T21:46:49.477 INFO:teuthology.orchestra.run.smithi115.stdout:(66/146): python3-waitress-1.4.3-1.el8.noarch.r 488 kB/s | 255 kB 00:00 2024-05-08T21:46:49.497 INFO:teuthology.orchestra.run.smithi073.stdout:(130/146): postgresql-server-10.23-4.module+el8 13 MB/s | 5.1 MB 00:00 2024-05-08T21:46:49.513 INFO:teuthology.orchestra.run.smithi115.stdout:(67/146): python3-webob-1.8.5-1.el8.1.noarch.rp 478 kB/s | 251 kB 00:00 2024-05-08T21:46:49.655 INFO:teuthology.orchestra.run.smithi115.stdout:(68/146): python3-webtest-2.0.33-1.el8.noarch.r 269 kB/s | 85 kB 00:00 2024-05-08T21:46:49.656 INFO:teuthology.orchestra.run.smithi073.stdout:(131/146): elfutils-libelf-0.189-3.el8.x86_64.r 1.4 MB/s | 232 kB 00:00 2024-05-08T21:46:49.681 INFO:teuthology.orchestra.run.smithi115.stdout:(69/146): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2024-05-08T21:46:49.722 INFO:teuthology.orchestra.run.smithi115.stdout:(70/146): python3-zc-lockfile-2.0-2.el8.noarch. 93 kB/s | 23 kB 00:00 2024-05-08T21:46:49.747 INFO:teuthology.orchestra.run.smithi073.stdout:(132/146): librados2-18.2.2-1322.gd21e4f96.el8. 9.6 MB/s | 3.7 MB 00:00 2024-05-08T21:46:49.806 INFO:teuthology.orchestra.run.smithi073.stdout:(133/146): elfutils-libs-0.189-3.el8.x86_64.rpm 2.0 MB/s | 303 kB 00:00 2024-05-08T21:46:49.873 INFO:teuthology.orchestra.run.smithi115.stdout:(71/146): libverto-devel-0.3.0-5.el8.x86_64.rpm 93 kB/s | 18 kB 00:00 2024-05-08T21:46:49.898 INFO:teuthology.orchestra.run.smithi115.stdout:(72/146): python3-jwt-1.6.1-2.el8.noarch.rpm 251 kB/s | 43 kB 00:00 2024-05-08T21:46:49.929 INFO:teuthology.orchestra.run.smithi073.stdout:(134/146): iproute-6.2.0-5.el8_9.x86_64.rpm 4.6 MB/s | 854 kB 00:00 2024-05-08T21:46:49.957 INFO:teuthology.orchestra.run.smithi115.stdout:(73/146): python3-oauthlib-2.1.0-1.el8.noarch.r 1.8 MB/s | 155 kB 00:00 2024-05-08T21:46:49.990 INFO:teuthology.orchestra.run.smithi073.stdout:(135/146): librbd1-18.2.2-1322.gd21e4f96.el8.x8 5.9 MB/s | 3.6 MB 00:00 2024-05-08T21:46:49.998 INFO:teuthology.orchestra.run.smithi115.stdout:(74/146): python3-pycparser-2.14-14.el8.noarch. 1.1 MB/s | 109 kB 00:00 2024-05-08T21:46:50.024 INFO:teuthology.orchestra.run.smithi073.stdout:(136/146): openssl-1.1.1k-12.el8_9.x86_64.rpm 3.2 MB/s | 711 kB 00:00 2024-05-08T21:46:50.074 INFO:teuthology.orchestra.run.smithi073.stdout:(137/146): openssl-libs-1.1.1k-12.el8_9.x86_64. 10 MB/s | 1.5 MB 00:00 2024-05-08T21:46:50.124 INFO:teuthology.orchestra.run.smithi115.stdout:(75/146): python3-requests-oauthlib-1.0.0-1.el8 256 kB/s | 43 kB 00:00 2024-05-08T21:46:50.182 INFO:teuthology.orchestra.run.smithi073.stdout:(138/146): xfsdump-3.1.8-7.el8_9.x86_64.rpm 1.7 MB/s | 333 kB 00:00 2024-05-08T21:46:50.199 INFO:teuthology.orchestra.run.smithi115.stdout:(76/146): libaio-devel-0.3.112-1.el8.x86_64.rpm 93 kB/s | 19 kB 00:00 2024-05-08T21:46:50.233 INFO:teuthology.orchestra.run.smithi115.stdout:(77/146): libzstd-devel-1.4.4-1.el8.x86_64.rpm 404 kB/s | 44 kB 00:00 2024-05-08T21:46:50.275 INFO:teuthology.orchestra.run.smithi115.stdout:(78/146): thrift-0.13.0-2.el8.x86_64.rpm 2.3 MB/s | 1.7 MB 00:00 2024-05-08T21:46:50.358 INFO:teuthology.orchestra.run.smithi073.stdout:(139/146): libblkid-2.32.1-44.el8_9.1.x86_64.rp 778 kB/s | 221 kB 00:00 2024-05-08T21:46:50.383 INFO:teuthology.orchestra.run.smithi073.stdout:(140/146): libfdisk-2.32.1-44.el8_9.1.x86_64.rp 1.2 MB/s | 254 kB 00:00 2024-05-08T21:46:50.387 INFO:teuthology.orchestra.run.smithi115.stdout:(79/146): pcre2-devel-10.32-2.el8.x86_64.rpm 3.2 MB/s | 605 kB 00:00 2024-05-08T21:46:50.417 INFO:teuthology.orchestra.run.smithi073.stdout:(141/146): xfsprogs-5.0.0-12.el8.x86_64.rpm 2.7 MB/s | 1.1 MB 00:00 2024-05-08T21:46:50.417 INFO:teuthology.orchestra.run.smithi115.stdout:(80/146): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.2 MB/s | 229 kB 00:00 2024-05-08T21:46:50.451 INFO:teuthology.orchestra.run.smithi115.stdout:(81/146): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.2 MB/s | 220 kB 00:00 2024-05-08T21:46:50.467 INFO:teuthology.orchestra.run.smithi073.stdout:(142/146): libmount-2.32.1-44.el8_9.1.x86_64.rp 2.1 MB/s | 237 kB 00:00 2024-05-08T21:46:50.527 INFO:teuthology.orchestra.run.smithi115.stdout:(82/146): libselinux-devel-2.9-5.el8.x86_64.rpm 1.4 MB/s | 200 kB 00:00 2024-05-08T21:46:50.527 INFO:teuthology.orchestra.run.smithi073.stdout:(143/146): libsmartcols-2.32.1-44.el8_9.1.x86_6 1.2 MB/s | 180 kB 00:00 2024-05-08T21:46:50.569 INFO:teuthology.orchestra.run.smithi115.stdout:(83/146): keyutils-libs-devel-1.5.10-9.el8.x86_ 320 kB/s | 48 kB 00:00 2024-05-08T21:46:50.584 INFO:teuthology.orchestra.run.smithi073.stdout:(144/146): libuuid-2.32.1-44.el8_9.1.x86_64.rpm 593 kB/s | 99 kB 00:00 2024-05-08T21:46:50.610 INFO:teuthology.orchestra.run.smithi115.stdout:(84/146): libsepol-devel-2.9-3.el8.x86_64.rpm 548 kB/s | 87 kB 00:00 2024-05-08T21:46:50.652 INFO:teuthology.orchestra.run.smithi073.stdout:(145/146): util-linux-2.32.1-44.el8_9.1.x86_64. 13 MB/s | 2.5 MB 00:00 2024-05-08T21:46:50.676 INFO:teuthology.orchestra.run.smithi073.stdout:(146/146): util-linux-user-2.32.1-44.el8_9.1.x8 692 kB/s | 103 kB 00:00 2024-05-08T21:46:50.679 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-05-08T21:46:50.679 INFO:teuthology.orchestra.run.smithi073.stdout:Total 14 MB/s | 215 MB 00:15 2024-05-08T21:46:50.719 INFO:teuthology.orchestra.run.smithi115.stdout:(85/146): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 300 kB/s | 58 kB 00:00 2024-05-08T21:46:50.744 INFO:teuthology.orchestra.run.smithi115.stdout:(86/146): libcom_err-devel-1.45.6-4.el8.x86_64. 220 kB/s | 39 kB 00:00 2024-05-08T21:46:50.761 INFO:teuthology.orchestra.run.smithi115.stdout:(87/146): fuse-2.9.7-17.el8.x86_64.rpm 551 kB/s | 83 kB 00:00 2024-05-08T21:46:50.836 INFO:teuthology.orchestra.run.smithi115.stdout:(88/146): libgfortran-8.5.0-20.el8.x86_64.rpm 5.4 MB/s | 645 kB 00:00 2024-05-08T21:46:50.878 INFO:teuthology.orchestra.run.smithi115.stdout:(89/146): libquadmath-8.5.0-20.el8.x86_64.rpm 1.3 MB/s | 172 kB 00:00 2024-05-08T21:46:50.920 INFO:teuthology.orchestra.run.smithi115.stdout:(90/146): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.5 MB/s | 238 kB 00:00 2024-05-08T21:46:50.954 INFO:teuthology.orchestra.run.smithi115.stdout:(91/146): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 618 kB/s | 73 kB 00:00 2024-05-08T21:46:51.029 INFO:teuthology.orchestra.run.smithi115.stdout:(92/146): elfutils-libelf-devel-0.189-3.el8.x86 409 kB/s | 62 kB 00:00 2024-05-08T21:46:51.063 INFO:teuthology.orchestra.run.smithi115.stdout:(93/146): krb5-devel-1.18.2-26.el8_9.x86_64.rpm 3.9 MB/s | 562 kB 00:00 2024-05-08T21:46:51.371 INFO:teuthology.orchestra.run.smithi115.stdout:(94/146): openssl-devel-1.1.1k-12.el8_9.x86_64. 5.6 MB/s | 2.3 MB 00:00 2024-05-08T21:46:51.397 INFO:teuthology.orchestra.run.smithi115.stdout:(95/146): librabbitmq-0.9.0-5.el8_9.x86_64.rpm 128 kB/s | 47 kB 00:00 2024-05-08T21:46:51.438 INFO:teuthology.orchestra.run.smithi115.stdout:(96/146): python3-cryptography-3.2.1-7.el8_9.x8 1.5 MB/s | 559 kB 00:00 2024-05-08T21:46:51.506 INFO:teuthology.orchestra.run.smithi115.stdout:(97/146): NetworkManager-initscripts-updown-1.4 1.1 MB/s | 144 kB 00:00 2024-05-08T21:46:51.531 INFO:teuthology.orchestra.run.smithi115.stdout:(98/146): libuuid-devel-2.32.1-44.el8_9.1.x86_6 747 kB/s | 100 kB 00:00 2024-05-08T21:46:51.556 INFO:teuthology.orchestra.run.smithi115.stdout:(99/146): python3-packaging-16.8-9.el8.noarch.r 411 kB/s | 48 kB 00:00 2024-05-08T21:46:51.671 INFO:teuthology.orchestra.run.smithi115.stdout:(100/146): python3-prettytable-0.7.2-14.el8.noa 314 kB/s | 44 kB 00:00 2024-05-08T21:46:51.698 INFO:teuthology.orchestra.run.smithi115.stdout:(101/146): python3-jsonpointer-1.10-11.el8.noar 104 kB/s | 20 kB 00:00 2024-05-08T21:46:51.723 INFO:teuthology.orchestra.run.smithi115.stdout:(102/146): python3-pyasn1-modules-0.3.7-6.el8.n 659 kB/s | 110 kB 00:00 2024-05-08T21:46:51.788 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-05-08T21:46:51.799 INFO:teuthology.orchestra.run.smithi115.stdout:(103/146): python3-jsonpatch-1.21-2.el8.noarch. 208 kB/s | 27 kB 00:00 2024-05-08T21:46:51.832 INFO:teuthology.orchestra.run.smithi115.stdout:(104/146): python3-pyasn1-0.3.7-6.el8.noarch.rp 945 kB/s | 126 kB 00:00 2024-05-08T21:46:51.866 INFO:teuthology.orchestra.run.smithi115.stdout:(105/146): python3-werkzeug-0.12.2-4.el8.noarch 3.1 MB/s | 457 kB 00:00 2024-05-08T21:46:51.983 INFO:teuthology.orchestra.run.smithi115.stdout:(106/146): bison-3.0.4-10.el8.x86_64.rpm 3.7 MB/s | 688 kB 00:00 2024-05-08T21:46:52.025 INFO:teuthology.orchestra.run.smithi115.stdout:(107/146): flex-2.6.1-9.el8.x86_64.rpm 1.6 MB/s | 320 kB 00:00 2024-05-08T21:46:52.067 INFO:teuthology.orchestra.run.smithi115.stdout:(108/146): libtool-2.4.6-25.el8.x86_64.rpm 3.4 MB/s | 709 kB 00:00 2024-05-08T21:46:52.092 INFO:teuthology.orchestra.run.smithi115.stdout:(109/146): python3-markupsafe-0.23-19.el8.x86_6 357 kB/s | 39 kB 00:00 2024-05-08T21:46:52.159 INFO:teuthology.orchestra.run.smithi115.stdout:(110/146): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.9 MB/s | 259 kB 00:00 2024-05-08T21:46:52.184 INFO:teuthology.orchestra.run.smithi115.stdout:(111/146): uuid-1.6.2-43.el8.x86_64.rpm 546 kB/s | 64 kB 00:00 2024-05-08T21:46:52.190 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-05-08T21:46:52.190 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-05-08T21:46:52.235 INFO:teuthology.orchestra.run.smithi115.stdout:(112/146): python3-pyOpenSSL-19.0.0-1.el8.noarc 727 kB/s | 103 kB 00:00 2024-05-08T21:46:52.352 INFO:teuthology.orchestra.run.smithi115.stdout:(113/146): python3-babel-2.5.1-7.el8.noarch.rpm 25 MB/s | 4.8 MB 00:00 2024-05-08T21:46:52.385 INFO:teuthology.orchestra.run.smithi115.stdout:(114/146): python3-jinja2-2.10.1-3.el8.noarch.r 2.6 MB/s | 538 kB 00:00 2024-05-08T21:46:52.527 INFO:teuthology.orchestra.run.smithi115.stdout:(115/146): python3-numpy-1.14.3-10.el8.x86_64.r 13 MB/s | 3.7 MB 00:00 2024-05-08T21:46:52.544 INFO:teuthology.orchestra.run.smithi115.stdout:(116/146): python3-numpy-f2py-1.14.3-10.el8.x86 1.4 MB/s | 225 kB 00:00 2024-05-08T21:46:52.603 INFO:teuthology.orchestra.run.smithi115.stdout:(117/146): socat-1.7.4.1-1.el8.x86_64.rpm 1.3 MB/s | 323 kB 00:00 2024-05-08T21:46:52.669 INFO:teuthology.orchestra.run.smithi115.stdout:(118/146): librdkafka-0.11.4-3.el8.x86_64.rpm 2.4 MB/s | 354 kB 00:00 2024-05-08T21:46:52.720 INFO:teuthology.orchestra.run.smithi115.stdout:(119/146): python3-mako-1.0.6-14.el8.noarch.rpm 1.3 MB/s | 157 kB 00:00 2024-05-08T21:46:52.829 INFO:teuthology.orchestra.run.smithi115.stdout:(120/146): openblas-threads-0.3.15-6.el8.x86_64 18 MB/s | 5.2 MB 00:00 2024-05-08T21:46:52.913 INFO:teuthology.orchestra.run.smithi115.stdout:(121/146): automake-1.16.1-8.el8.noarch.rpm 3.6 MB/s | 714 kB 00:00 2024-05-08T21:46:52.996 INFO:teuthology.orchestra.run.smithi115.stdout:(122/146): openblas-0.3.15-6.el8.x86_64.rpm 15 MB/s | 5.0 MB 00:00 2024-05-08T21:46:53.038 INFO:teuthology.orchestra.run.smithi115.stdout:(123/146): libpq-13.11-1.el8.x86_64.rpm 948 kB/s | 198 kB 00:00 2024-05-08T21:46:53.080 INFO:teuthology.orchestra.run.smithi115.stdout:(124/146): jq-1.6-7.el8.x86_64.rpm 1.2 MB/s | 202 kB 00:00 2024-05-08T21:46:53.105 INFO:teuthology.orchestra.run.smithi115.stdout:(125/146): python3-pytz-2017.2-11.el8.noarch.rp 498 kB/s | 54 kB 00:00 2024-05-08T21:46:53.231 INFO:teuthology.orchestra.run.smithi115.stdout:(126/146): oniguruma-6.8.2-2.1.el8_9.x86_64.rpm 1.2 MB/s | 188 kB 00:00 2024-05-08T21:46:53.281 INFO:teuthology.orchestra.run.smithi115.stdout:(127/146): postgresql-10.23-4.module+el8.9.0+21 8.6 MB/s | 1.5 MB 00:00 2024-05-08T21:46:53.331 INFO:teuthology.orchestra.run.smithi115.stdout:(128/146): postgresql-contrib-10.23-4.module+el 7.9 MB/s | 812 kB 00:00 2024-05-08T21:46:53.405 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-05-08T21:46:53.416 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-05-08T21:46:53.531 INFO:teuthology.orchestra.run.smithi115.stdout:(129/146): python3-scipy-1.0.0-21.module+el8.9. 28 MB/s | 14 MB 00:00 2024-05-08T21:46:53.640 INFO:teuthology.orchestra.run.smithi115.stdout:(130/146): postgresql-server-10.23-4.module+el8 14 MB/s | 5.1 MB 00:00 2024-05-08T21:46:53.865 INFO:teuthology.orchestra.run.smithi115.stdout:(131/146): librados2-18.2.2-1322.gd21e4f96.el8. 6.9 MB/s | 3.7 MB 00:00 2024-05-08T21:46:53.882 INFO:teuthology.orchestra.run.smithi115.stdout:(132/146): elfutils-libelf-0.189-3.el8.x86_64.r 960 kB/s | 232 kB 00:00 2024-05-08T21:46:53.990 INFO:teuthology.orchestra.run.smithi115.stdout:(133/146): elfutils-libs-0.189-3.el8.x86_64.rpm 2.4 MB/s | 303 kB 00:00 2024-05-08T21:46:54.058 INFO:teuthology.orchestra.run.smithi115.stdout:(134/146): iproute-6.2.0-5.el8_9.x86_64.rpm 4.8 MB/s | 854 kB 00:00 2024-05-08T21:46:54.150 INFO:teuthology.orchestra.run.smithi115.stdout:(135/146): openssl-1.1.1k-12.el8_9.x86_64.rpm 4.4 MB/s | 711 kB 00:00 2024-05-08T21:46:54.216 INFO:teuthology.orchestra.run.smithi115.stdout:(136/146): openssl-libs-1.1.1k-12.el8_9.x86_64. 9.3 MB/s | 1.5 MB 00:00 2024-05-08T21:46:54.325 INFO:teuthology.orchestra.run.smithi115.stdout:(137/146): xfsdump-3.1.8-7.el8_9.x86_64.rpm 1.9 MB/s | 333 kB 00:00 2024-05-08T21:46:54.384 INFO:teuthology.orchestra.run.smithi115.stdout:(138/146): librbd1-18.2.2-1322.gd21e4f96.el8.x8 4.2 MB/s | 3.6 MB 00:00 2024-05-08T21:46:54.442 INFO:teuthology.orchestra.run.smithi115.stdout:(139/146): xfsprogs-5.0.0-12.el8.x86_64.rpm 4.7 MB/s | 1.1 MB 00:00 2024-05-08T21:46:54.501 INFO:teuthology.orchestra.run.smithi115.stdout:(140/146): libblkid-2.32.1-44.el8_9.1.x86_64.rp 1.2 MB/s | 221 kB 00:00 2024-05-08T21:46:54.526 INFO:teuthology.orchestra.run.smithi115.stdout:(141/146): libfdisk-2.32.1-44.el8_9.1.x86_64.rp 1.7 MB/s | 254 kB 00:00 2024-05-08T21:46:54.552 INFO:teuthology.orchestra.run.smithi115.stdout:(142/146): libmount-2.32.1-44.el8_9.1.x86_64.rp 2.1 MB/s | 237 kB 00:00 2024-05-08T21:46:54.668 INFO:teuthology.orchestra.run.smithi115.stdout:(143/146): libsmartcols-2.32.1-44.el8_9.1.x86_6 1.0 MB/s | 180 kB 00:00 2024-05-08T21:46:54.760 INFO:teuthology.orchestra.run.smithi115.stdout:(144/146): util-linux-2.32.1-44.el8_9.1.x86_64. 12 MB/s | 2.5 MB 00:00 2024-05-08T21:46:54.777 INFO:teuthology.orchestra.run.smithi115.stdout:(145/146): libuuid-2.32.1-44.el8_9.1.x86_64.rpm 395 kB/s | 99 kB 00:00 2024-05-08T21:46:54.827 INFO:teuthology.orchestra.run.smithi115.stdout:(146/146): util-linux-user-2.32.1-44.el8_9.1.x8 647 kB/s | 103 kB 00:00 2024-05-08T21:46:54.830 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-05-08T21:46:54.830 INFO:teuthology.orchestra.run.smithi115.stdout:Total 11 MB/s | 215 MB 00:19 2024-05-08T21:46:55.812 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-05-08T21:46:56.207 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-05-08T21:46:56.208 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-05-08T21:46:57.409 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-05-08T21:46:57.419 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-05-08T21:46:59.583 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-05-08T21:46:59.718 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/1 2024-05-08T21:46:59.983 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/162 2024-05-08T21:47:00.199 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/162 2024-05-08T21:47:00.396 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/162 2024-05-08T21:47:00.591 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : libuuid-2.32.1-44.el8_9.1.x86_64 3/162 2024-05-08T21:47:00.669 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libuuid-2.32.1-44.el8_9.1.x86_64 3/162 2024-05-08T21:47:00.858 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : libblkid-2.32.1-44.el8_9.1.x86_64 4/162 2024-05-08T21:47:00.922 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libblkid-2.32.1-44.el8_9.1.x86_64 4/162 2024-05-08T21:47:01.346 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/162 2024-05-08T21:47:01.574 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librabbitmq-0.9.0-5.el8_9.x86_64 6/162 2024-05-08T21:47:01.792 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 7/162 2024-05-08T21:47:01.881 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 7/162 2024-05-08T21:47:02.100 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/162 2024-05-08T21:47:02.506 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/162 2024-05-08T21:47:02.726 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : librados2-2:18.2.2-1322.gd21e4f96.el8.x86_64 9/162 2024-05-08T21:47:03.118 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librados2-2:18.2.2-1322.gd21e4f96.el8.x86_64 9/162 2024-05-08T21:47:03.325 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : librbd1-2:18.2.2-1322.gd21e4f96.el8.x86_64 10/162 2024-05-08T21:47:03.456 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librbd1-2:18.2.2-1322.gd21e4f96.el8.x86_64 10/162 2024-05-08T21:47:03.529 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-05-08T21:47:03.662 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/1 2024-05-08T21:47:03.672 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephfs2-2:18.2.2-1322.gd21e4f96.el8.x86_64 11/162 2024-05-08T21:47:03.768 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libcephfs2-2:18.2.2-1322.gd21e4f96.el8.x86_64 11/162 2024-05-08T21:47:03.932 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/162 2024-05-08T21:47:04.076 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rados-2:18.2.2-1322.gd21e4f96.el8.x86_64 12/162 2024-05-08T21:47:04.175 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/162 2024-05-08T21:47:04.341 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 13/162 2024-05-08T21:47:04.377 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/162 2024-05-08T21:47:04.425 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 13/162 2024-05-08T21:47:04.523 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : libuuid-2.32.1-44.el8_9.1.x86_64 3/162 2024-05-08T21:47:04.578 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libuuid-2.32.1-44.el8_9.1.x86_64 3/162 2024-05-08T21:47:04.639 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libpq-13.11-1.el8.x86_64 14/162 2024-05-08T21:47:04.756 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : libblkid-2.32.1-44.el8_9.1.x86_64 4/162 2024-05-08T21:47:04.806 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libblkid-2.32.1-44.el8_9.1.x86_64 4/162 2024-05-08T21:47:04.902 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 15/162 2024-05-08T21:47:05.027 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/162 2024-05-08T21:47:05.119 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 16/162 2024-05-08T21:47:05.272 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : librabbitmq-0.9.0-5.el8_9.x86_64 6/162 2024-05-08T21:47:05.415 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 7/162 2024-05-08T21:47:05.489 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 17/162 2024-05-08T21:47:05.513 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 7/162 2024-05-08T21:47:05.731 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/162 2024-05-08T21:47:05.745 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a 18/162 2024-05-08T21:47:05.874 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephsqlite-2:18.2.2-1322.gd21e4f96.el8.x86_64 19/162 2024-05-08T21:47:06.017 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1322.gd21e4f96.el8.x86_64 19/162 2024-05-08T21:47:06.122 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/162 2024-05-08T21:47:06.166 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libradosstriper1-2:18.2.2-1322.gd21e4f96.el8.x86 20/162 2024-05-08T21:47:06.265 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1322.gd21e4f96.el8.x86 20/162 2024-05-08T21:47:06.323 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : librados2-2:18.2.2-1322.gd21e4f96.el8.x86_64 9/162 2024-05-08T21:47:06.428 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 21/162 2024-05-08T21:47:06.702 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librados2-2:18.2.2-1322.gd21e4f96.el8.x86_64 9/162 2024-05-08T21:47:06.769 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 22/162 2024-05-08T21:47:06.914 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : librbd1-2:18.2.2-1322.gd21e4f96.el8.x86_64 10/162 2024-05-08T21:47:07.022 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librbd1-2:18.2.2-1322.gd21e4f96.el8.x86_64 10/162 2024-05-08T21:47:07.030 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 23/162 2024-05-08T21:47:07.197 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libcephfs2-2:18.2.2-1322.gd21e4f96.el8.x86_64 11/162 2024-05-08T21:47:07.218 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 24/162 2024-05-08T21:47:07.292 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libcephfs2-2:18.2.2-1322.gd21e4f96.el8.x86_64 11/162 2024-05-08T21:47:07.333 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 24/162 2024-05-08T21:47:07.524 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 25/162 2024-05-08T21:47:07.600 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-rados-2:18.2.2-1322.gd21e4f96.el8.x86_64 12/162 2024-05-08T21:47:07.980 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 13/162 2024-05-08T21:47:08.067 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 13/162 2024-05-08T21:47:08.152 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 25/162 2024-05-08T21:47:08.270 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libpq-13.11-1.el8.x86_64 14/162 2024-05-08T21:47:08.349 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : openblas-threads-0.3.15-6.el8.x86_64 26/162 2024-05-08T21:47:08.536 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 15/162 2024-05-08T21:47:08.709 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 16/162 2024-05-08T21:47:08.982 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: openblas-threads-0.3.15-6.el8.x86_64 26/162 2024-05-08T21:47:09.084 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 17/162 2024-05-08T21:47:09.182 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : openblas-0.3.15-6.el8.x86_64 27/162 2024-05-08T21:47:09.276 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a 18/162 2024-05-08T21:47:09.439 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libcephsqlite-2:18.2.2-1322.gd21e4f96.el8.x86_64 19/162 2024-05-08T21:47:09.542 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1322.gd21e4f96.el8.x86_64 19/162 2024-05-08T21:47:09.713 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libradosstriper1-2:18.2.2-1322.gd21e4f96.el8.x86 20/162 2024-05-08T21:47:09.790 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1322.gd21e4f96.el8.x86 20/162 2024-05-08T21:47:09.864 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: openblas-0.3.15-6.el8.x86_64 27/162 2024-05-08T21:47:09.984 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 21/162 2024-05-08T21:47:10.130 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 28/162 2024-05-08T21:47:10.256 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 22/162 2024-05-08T21:47:10.363 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 29/162 2024-05-08T21:47:10.477 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 23/162 2024-05-08T21:47:10.651 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 30/162 2024-05-08T21:47:10.672 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 24/162 2024-05-08T21:47:10.807 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 24/162 2024-05-08T21:47:10.855 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-ceph-common-2:18.2.2-1322.gd21e4f96.el8. 31/162 2024-05-08T21:47:10.988 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 25/162 2024-05-08T21:47:11.018 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-ceph-argparse-2:18.2.2-1322.gd21e4f96.el 32/162 2024-05-08T21:47:11.330 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cephfs-2:18.2.2-1322.gd21e4f96.el8.x86_6 33/162 2024-05-08T21:47:11.557 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 34/162 2024-05-08T21:47:11.604 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 25/162 2024-05-08T21:47:11.813 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : openblas-threads-0.3.15-6.el8.x86_64 26/162 2024-05-08T21:47:12.400 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: openblas-threads-0.3.15-6.el8.x86_64 26/162 2024-05-08T21:47:12.604 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : openblas-0.3.15-6.el8.x86_64 27/162 2024-05-08T21:47:13.289 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: openblas-0.3.15-6.el8.x86_64 27/162 2024-05-08T21:47:13.305 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 34/162 2024-05-08T21:47:13.569 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 28/162 2024-05-08T21:47:13.684 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 35/162 2024-05-08T21:47:13.785 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 29/162 2024-05-08T21:47:14.082 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 30/162 2024-05-08T21:47:14.236 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-ceph-common-2:18.2.2-1322.gd21e4f96.el8. 31/162 2024-05-08T21:47:14.407 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-ceph-argparse-2:18.2.2-1322.gd21e4f96.el 32/162 2024-05-08T21:47:14.650 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 36/162 2024-05-08T21:47:14.708 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cephfs-2:18.2.2-1322.gd21e4f96.el8.x86_6 33/162 2024-05-08T21:47:14.929 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 34/162 2024-05-08T21:47:15.011 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 37/162 2024-05-08T21:47:15.256 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 38/162 2024-05-08T21:47:15.526 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rsa-4.9-2.el8.noarch 39/162 2024-05-08T21:47:15.743 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 40/162 2024-05-08T21:47:16.004 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 41/162 2024-05-08T21:47:16.205 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librados-devel-2:18.2.2-1322.gd21e4f96.el8.x86_6 42/162 2024-05-08T21:47:16.431 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : libfdisk-2.32.1-44.el8_9.1.x86_64 43/162 2024-05-08T21:47:16.510 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libfdisk-2.32.1-44.el8_9.1.x86_64 43/162 2024-05-08T21:47:16.665 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 34/162 2024-05-08T21:47:16.723 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : libmount-2.32.1-44.el8_9.1.x86_64 44/162 2024-05-08T21:47:16.795 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libmount-2.32.1-44.el8_9.1.x86_64 44/162 2024-05-08T21:47:17.023 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 35/162 2024-05-08T21:47:17.437 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libuuid-devel-2.32.1-44.el8_9.1.x86_64 45/162 2024-05-08T21:47:17.684 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 46/162 2024-05-08T21:47:17.939 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : libsmartcols-2.32.1-44.el8_9.1.x86_64 47/162 2024-05-08T21:47:17.986 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 36/162 2024-05-08T21:47:18.332 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 37/162 2024-05-08T21:47:18.386 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libsmartcols-2.32.1-44.el8_9.1.x86_64 47/162 2024-05-08T21:47:18.563 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 38/162 2024-05-08T21:47:18.782 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : util-linux-2.32.1-44.el8_9.1.x86_64 48/162 2024-05-08T21:47:18.782 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-rsa-4.9-2.el8.noarch 39/162 2024-05-08T21:47:18.808 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: util-linux-2.32.1-44.el8_9.1.x86_64 48/162 2024-05-08T21:47:19.005 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 40/162 2024-05-08T21:47:19.025 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-packaging-16.8-9.el8.noarch 49/162 2024-05-08T21:47:19.228 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-rbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 41/162 2024-05-08T21:47:19.256 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : oniguruma-6.8.2-2.1.el8_9.x86_64 50/162 2024-05-08T21:47:19.333 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: oniguruma-6.8.2-2.1.el8_9.x86_64 50/162 2024-05-08T21:47:19.419 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : librados-devel-2:18.2.2-1322.gd21e4f96.el8.x86_6 42/162 2024-05-08T21:47:19.642 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : jq-1.6-7.el8.x86_64 51/162 2024-05-08T21:47:19.711 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : libfdisk-2.32.1-44.el8_9.1.x86_64 43/162 2024-05-08T21:47:19.792 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libfdisk-2.32.1-44.el8_9.1.x86_64 43/162 2024-05-08T21:47:19.865 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : automake-1.16.1-8.el8.noarch 52/162 2024-05-08T21:47:19.978 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : libmount-2.32.1-44.el8_9.1.x86_64 44/162 2024-05-08T21:47:20.039 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : uuid-1.6.2-43.el8.x86_64 53/162 2024-05-08T21:47:20.043 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libmount-2.32.1-44.el8_9.1.x86_64 44/162 2024-05-08T21:47:20.111 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 53/162 2024-05-08T21:47:20.273 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libuuid-devel-2.32.1-44.el8_9.1.x86_64 45/162 2024-05-08T21:47:20.295 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 54/162 2024-05-08T21:47:20.479 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 55/162 2024-05-08T21:47:20.522 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 46/162 2024-05-08T21:47:20.649 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 56/162 2024-05-08T21:47:20.770 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : libsmartcols-2.32.1-44.el8_9.1.x86_64 47/162 2024-05-08T21:47:20.893 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : fuse-2.9.7-17.el8.x86_64 57/162 2024-05-08T21:47:21.137 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 58/162 2024-05-08T21:47:21.220 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libsmartcols-2.32.1-44.el8_9.1.x86_64 47/162 2024-05-08T21:47:21.352 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 59/162 2024-05-08T21:47:21.525 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 60/162 2024-05-08T21:47:21.578 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : util-linux-2.32.1-44.el8_9.1.x86_64 48/162 2024-05-08T21:47:21.605 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: util-linux-2.32.1-44.el8_9.1.x86_64 48/162 2024-05-08T21:47:21.751 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 61/162 2024-05-08T21:47:21.828 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : oniguruma-6.8.2-2.1.el8_9.x86_64 49/162 2024-05-08T21:47:21.908 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: oniguruma-6.8.2-2.1.el8_9.x86_64 49/162 2024-05-08T21:47:22.058 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 62/162 2024-05-08T21:47:22.197 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : jq-1.6-7.el8.x86_64 50/162 2024-05-08T21:47:22.360 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 63/162 2024-05-08T21:47:22.428 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : automake-1.16.1-8.el8.noarch 51/162 2024-05-08T21:47:22.644 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 64/162 2024-05-08T21:47:22.652 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : uuid-1.6.2-43.el8.x86_64 52/162 2024-05-08T21:47:22.727 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 52/162 2024-05-08T21:47:22.810 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 65/162 2024-05-08T21:47:22.917 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 53/162 2024-05-08T21:47:23.024 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 66/162 2024-05-08T21:47:23.093 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 54/162 2024-05-08T21:47:23.261 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 55/162 2024-05-08T21:47:23.412 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-packaging-16.8-9.el8.noarch 56/162 2024-05-08T21:47:23.454 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 67/162 2024-05-08T21:47:23.631 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : fuse-2.9.7-17.el8.x86_64 57/162 2024-05-08T21:47:23.800 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cryptography-3.2.1-7.el8_9.x86_64 68/162 2024-05-08T21:47:23.858 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 58/162 2024-05-08T21:47:24.023 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 59/162 2024-05-08T21:47:24.055 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 69/162 2024-05-08T21:47:24.222 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 60/162 2024-05-08T21:47:24.271 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 70/162 2024-05-08T21:47:24.448 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 61/162 2024-05-08T21:47:24.481 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 71/162 2024-05-08T21:47:24.742 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 72/162 2024-05-08T21:47:24.757 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 62/162 2024-05-08T21:47:25.024 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 63/162 2024-05-08T21:47:25.026 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 73/162 2024-05-08T21:47:25.264 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 74/162 2024-05-08T21:47:25.265 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 64/162 2024-05-08T21:47:25.456 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 65/162 2024-05-08T21:47:25.515 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 75/162 2024-05-08T21:47:25.670 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 66/162 2024-05-08T21:47:25.710 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 76/162 2024-05-08T21:47:25.989 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : krb5-devel-1.18.2-26.el8_9.x86_64 77/162 2024-05-08T21:47:26.011 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 67/162 2024-05-08T21:47:26.171 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 78/162 2024-05-08T21:47:26.354 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 79/162 2024-05-08T21:47:26.363 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cryptography-3.2.1-7.el8_9.x86_64 68/162 2024-05-08T21:47:26.630 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 80/162 2024-05-08T21:47:26.650 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 69/162 2024-05-08T21:47:26.852 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 81/162 2024-05-08T21:47:26.909 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 70/162 2024-05-08T21:47:27.077 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 71/162 2024-05-08T21:47:27.100 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 82/162 2024-05-08T21:47:27.265 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 83/162 2024-05-08T21:47:27.313 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 72/162 2024-05-08T21:47:27.520 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 84/162 2024-05-08T21:47:27.573 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 73/162 2024-05-08T21:47:27.774 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 85/162 2024-05-08T21:47:27.810 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 74/162 2024-05-08T21:47:28.016 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 86/162 2024-05-08T21:47:28.087 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 75/162 2024-05-08T21:47:28.174 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 87/162 2024-05-08T21:47:28.264 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 76/162 2024-05-08T21:47:28.352 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 88/162 2024-05-08T21:47:28.544 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : krb5-devel-1.18.2-26.el8_9.x86_64 77/162 2024-05-08T21:47:28.574 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 89/162 2024-05-08T21:47:28.742 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 78/162 2024-05-08T21:47:28.774 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 90/162 2024-05-08T21:47:28.921 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 79/162 2024-05-08T21:47:29.001 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 91/162 2024-05-08T21:47:29.196 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 80/162 2024-05-08T21:47:29.290 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-portend-2.6-1.el8.noarch 92/162 2024-05-08T21:47:29.416 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 81/162 2024-05-08T21:47:29.545 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 93/162 2024-05-08T21:47:29.589 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 82/162 2024-05-08T21:47:29.737 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 94/162 2024-05-08T21:47:29.770 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 83/162 2024-05-08T21:47:29.995 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 95/162 2024-05-08T21:47:30.027 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 84/162 2024-05-08T21:47:30.247 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 85/162 2024-05-08T21:47:30.450 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 86/162 2024-05-08T21:47:30.629 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 87/162 2024-05-08T21:47:30.765 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 88/162 2024-05-08T21:47:30.997 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 89/162 2024-05-08T21:47:31.076 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 96/162 2024-05-08T21:47:31.237 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 90/162 2024-05-08T21:47:31.425 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 91/162 2024-05-08T21:47:31.425 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 97/162 2024-05-08T21:47:31.711 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 98/162 2024-05-08T21:47:31.712 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-portend-2.6-1.el8.noarch 92/162 2024-05-08T21:47:31.958 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 93/162 2024-05-08T21:47:32.098 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 99/162 2024-05-08T21:47:32.166 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 94/162 2024-05-08T21:47:32.367 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 95/162 2024-05-08T21:47:32.421 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 100/162 2024-05-08T21:47:32.637 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 101/162 2024-05-08T21:47:33.456 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 96/162 2024-05-08T21:47:33.795 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 97/162 2024-05-08T21:47:33.869 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 102/162 2024-05-08T21:47:34.024 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 98/162 2024-05-08T21:47:34.045 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librgw2-2:18.2.2-1322.gd21e4f96.el8.x86_64 103/162 2024-05-08T21:47:34.121 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librgw2-2:18.2.2-1322.gd21e4f96.el8.x86_64 103/162 2024-05-08T21:47:34.334 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 99/162 2024-05-08T21:47:34.337 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 104/162 2024-05-08T21:47:34.625 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 100/162 2024-05-08T21:47:34.827 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 101/162 2024-05-08T21:47:35.606 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 102/162 2024-05-08T21:47:35.733 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : librgw2-2:18.2.2-1322.gd21e4f96.el8.x86_64 103/162 2024-05-08T21:47:35.845 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librgw2-2:18.2.2-1322.gd21e4f96.el8.x86_64 103/162 2024-05-08T21:47:36.092 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-rgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 104/162 2024-05-08T21:47:38.131 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 105/162 2024-05-08T21:47:38.725 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 105/162 2024-05-08T21:47:39.322 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 105/162 2024-05-08T21:47:39.678 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-base-2:18.2.2-1322.gd21e4f96.el8.x86_64 106/162 2024-05-08T21:47:39.752 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-base-2:18.2.2-1322.gd21e4f96.el8.x86_64 106/162 2024-05-08T21:47:39.793 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 105/162 2024-05-08T21:47:39.970 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-selinux-2:18.2.2-1322.gd21e4f96.el8.x86_64 107/162 2024-05-08T21:47:40.074 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 105/162 2024-05-08T21:47:40.666 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 105/162 2024-05-08T21:47:41.007 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-base-2:18.2.2-1322.gd21e4f96.el8.x86_64 106/162 2024-05-08T21:47:41.072 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-base-2:18.2.2-1322.gd21e4f96.el8.x86_64 106/162 2024-05-08T21:47:41.248 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-selinux-2:18.2.2-1322.gd21e4f96.el8.x86_64 107/162 2024-05-08T21:47:59.200 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1322.gd21e4f96.el8.x86_64 107/162 2024-05-08T21:47:59.200 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /sys 2024-05-08T21:47:59.201 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /proc 2024-05-08T21:47:59.201 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /dev 2024-05-08T21:47:59.201 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /run 2024-05-08T21:47:59.201 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /mnt 2024-05-08T21:47:59.201 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /var/tmp 2024-05-08T21:47:59.201 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /home 2024-05-08T21:47:59.201 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /tmp 2024-05-08T21:47:59.201 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /dev 2024-05-08T21:47:59.201 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:47:59.592 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-volume-2:18.2.2-1322.gd21e4f96.el8.noarch 108/162 2024-05-08T21:48:00.691 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1322.gd21e4f96.el8.x86_64 107/162 2024-05-08T21:48:00.691 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /sys 2024-05-08T21:48:00.692 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /proc 2024-05-08T21:48:00.692 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /dev 2024-05-08T21:48:00.692 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /run 2024-05-08T21:48:00.692 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /mnt 2024-05-08T21:48:00.692 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /var/tmp 2024-05-08T21:48:00.692 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /home 2024-05-08T21:48:00.692 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /tmp 2024-05-08T21:48:00.692 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /dev 2024-05-08T21:48:00.692 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-08T21:48:01.053 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-volume-2:18.2.2-1322.gd21e4f96.el8.noarch 108/162 2024-05-08T21:48:01.231 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-volume-2:18.2.2-1322.gd21e4f96.el8.noarch 108/162 2024-05-08T21:48:01.508 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-osd-2:18.2.2-1322.gd21e4f96.el8.x86_64 109/162 2024-05-08T21:48:01.728 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-osd-2:18.2.2-1322.gd21e4f96.el8.x86_64 109/162 2024-05-08T21:48:01.958 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mds-2:18.2.2-1322.gd21e4f96.el8.x86_64 110/162 2024-05-08T21:48:02.434 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mds-2:18.2.2-1322.gd21e4f96.el8.x86_64 110/162 2024-05-08T21:48:02.616 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mon-2:18.2.2-1322.gd21e4f96.el8.x86_64 111/162 2024-05-08T21:48:02.635 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mon-2:18.2.2-1322.gd21e4f96.el8.x86_64 111/162 2024-05-08T21:48:02.692 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-volume-2:18.2.2-1322.gd21e4f96.el8.noarch 108/162 2024-05-08T21:48:02.894 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-osd-2:18.2.2-1322.gd21e4f96.el8.x86_64 109/162 2024-05-08T21:48:03.112 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-osd-2:18.2.2-1322.gd21e4f96.el8.x86_64 109/162 2024-05-08T21:48:03.294 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mds-2:18.2.2-1322.gd21e4f96.el8.x86_64 110/162 2024-05-08T21:48:03.770 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mds-2:18.2.2-1322.gd21e4f96.el8.x86_64 110/162 2024-05-08T21:48:03.954 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mon-2:18.2.2-1322.gd21e4f96.el8.x86_64 111/162 2024-05-08T21:48:03.969 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mon-2:18.2.2-1322.gd21e4f96.el8.x86_64 111/162 2024-05-08T21:48:04.519 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 112/162 2024-05-08T21:48:04.685 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 112/162 2024-05-08T21:48:04.839 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1322.gd21e4f96.e 113/162 2024-05-08T21:48:05.075 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1322.gd21e4f96. 114/162 2024-05-08T21:48:05.365 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1322.gd21e4f96.el8.noa 115/162 2024-05-08T21:48:05.806 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 112/162 2024-05-08T21:48:05.980 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 112/162 2024-05-08T21:48:06.149 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1322.gd21e4f96.e 113/162 2024-05-08T21:48:06.388 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1322.gd21e4f96.el8.noa 115/162 2024-05-08T21:48:06.441 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1322.gd21e4f96. 114/162 2024-05-08T21:48:06.656 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1322.gd21e4f96.el8.n 116/162 2024-05-08T21:48:06.719 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1322.gd21e4f96.el8.noa 115/162 2024-05-08T21:48:07.619 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1322.gd21e4f96.el8.n 116/162 2024-05-08T21:48:07.744 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1322.gd21e4f96.el8.noa 115/162 2024-05-08T21:48:07.823 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1322.gd21 117/162 2024-05-08T21:48:07.917 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1322.gd21 117/162 2024-05-08T21:48:08.009 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1322.gd21e4f96.el8.n 116/162 2024-05-08T21:48:08.302 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1322.gd21e4f96.el 118/162 2024-05-08T21:48:08.523 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-2:18.2.2-1322.gd21e4f96.el8.x86_64 119/162 2024-05-08T21:48:08.562 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1322.gd21e4f96.el8.x86_64 119/162 2024-05-08T21:48:08.765 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-rook-2:18.2.2-1322.gd21e4f96.el8.noarch 120/162 2024-05-08T21:48:08.777 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1322.gd21e4f96.el8.noarch 120/162 2024-05-08T21:48:08.976 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1322.gd21e4f96.el8.n 116/162 2024-05-08T21:48:09.159 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1322.gd21 117/162 2024-05-08T21:48:09.253 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1322.gd21 117/162 2024-05-08T21:48:09.663 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1322.gd21e4f96.el 118/162 2024-05-08T21:48:09.835 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-2:18.2.2-1322.gd21e4f96.el8.x86_64 119/162 2024-05-08T21:48:09.872 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1322.gd21e4f96.el8.x86_64 119/162 2024-05-08T21:48:10.050 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-2:18.2.2-1322.gd21e4f96.el8.x86_64 121/162 2024-05-08T21:48:10.217 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-rook-2:18.2.2-1322.gd21e4f96.el8.noarch 120/162 2024-05-08T21:48:10.228 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1322.gd21e4f96.el8.noarch 120/162 2024-05-08T21:48:10.281 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-radosgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 122/162 2024-05-08T21:48:10.316 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 122/162 2024-05-08T21:48:10.532 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1322.gd21e4 123/162 2024-05-08T21:48:10.575 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1322.gd21e4 123/162 2024-05-08T21:48:10.790 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : cephfs-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 124/162 2024-05-08T21:48:11.136 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: cephfs-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 124/162 2024-05-08T21:48:11.298 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 125/162 2024-05-08T21:48:11.513 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-2:18.2.2-1322.gd21e4f96.el8.x86_64 121/162 2024-05-08T21:48:11.709 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-radosgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 122/162 2024-05-08T21:48:11.744 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 122/162 2024-05-08T21:48:11.942 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1322.gd21e4 123/162 2024-05-08T21:48:11.984 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1322.gd21e4 123/162 2024-05-08T21:48:12.167 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : cephfs-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 124/162 2024-05-08T21:48:12.513 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: cephfs-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 124/162 2024-05-08T21:48:12.659 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : rbd-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 125/162 2024-05-08T21:48:15.751 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 125/162 2024-05-08T21:48:16.715 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-test-2:18.2.2-1322.gd21e4f96.el8.x86_64 126/162 2024-05-08T21:48:17.052 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : openssl-devel-1:1.1.1k-12.el8_9.x86_64 127/162 2024-05-08T21:48:17.110 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 125/162 2024-05-08T21:48:17.355 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 128/162 2024-05-08T21:48:17.749 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 129/162 2024-05-08T21:48:18.086 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-test-2:18.2.2-1322.gd21e4f96.el8.x86_64 126/162 2024-05-08T21:48:18.100 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : postgresql-contrib-10.23-4.module+el8.9.0+21317+ 130/162 2024-05-08T21:48:18.314 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libtool-2.4.6-25.el8.x86_64 131/162 2024-05-08T21:48:18.328 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 131/162 2024-05-08T21:48:18.420 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : openssl-devel-1:1.1.1k-12.el8_9.x86_64 127/162 2024-05-08T21:48:18.574 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : util-linux-user-2.32.1-44.el8_9.1.x86_64 132/162 2024-05-08T21:48:18.724 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 128/162 2024-05-08T21:48:18.736 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 133/162 2024-05-08T21:48:18.948 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephfs-devel-2:18.2.2-1322.gd21e4f96.el8.x86_ 134/162 2024-05-08T21:48:19.127 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 129/162 2024-05-08T21:48:19.468 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : postgresql-contrib-10.23-4.module+el8.9.0+21317+ 130/162 2024-05-08T21:48:19.665 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libtool-2.4.6-25.el8.x86_64 131/162 2024-05-08T21:48:19.679 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 131/162 2024-05-08T21:48:19.909 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : util-linux-user-2.32.1-44.el8_9.1.x86_64 132/162 2024-05-08T21:48:20.098 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 133/162 2024-05-08T21:48:20.300 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libcephfs-devel-2:18.2.2-1322.gd21e4f96.el8.x86_ 134/162 2024-05-08T21:48:21.261 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-05-08T21:48:21.564 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-05-08T21:48:21.602 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-05-08T21:48:22.043 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 136/162 2024-05-08T21:48:22.395 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : iproute-6.2.0-5.el8_9.x86_64 137/162 2024-05-08T21:48:22.610 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-05-08T21:48:22.659 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : xfsdump-3.1.8-7.el8_9.x86_64 138/162 2024-05-08T21:48:22.880 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : cephfs-top-2:18.2.2-1322.gd21e4f96.el8.noarch 139/162 2024-05-08T21:48:22.923 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-05-08T21:48:22.961 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-05-08T21:48:23.104 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 140/162 2024-05-08T21:48:23.392 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-nbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 141/162 2024-05-08T21:48:23.405 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 136/162 2024-05-08T21:48:23.741 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : openssl-1:1.1.1k-12.el8_9.x86_64 142/162 2024-05-08T21:48:23.746 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : iproute-6.2.0-5.el8_9.x86_64 137/162 2024-05-08T21:48:23.979 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flex-2.6.1-9.el8.x86_64 143/162 2024-05-08T21:48:24.027 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : xfsdump-3.1.8-7.el8_9.x86_64 138/162 2024-05-08T21:48:24.058 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 143/162 2024-05-08T21:48:24.256 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : cephfs-top-2:18.2.2-1322.gd21e4f96.el8.noarch 139/162 2024-05-08T21:48:24.296 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : bison-3.0.4-10.el8.x86_64 144/162 2024-05-08T21:48:24.311 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 144/162 2024-05-08T21:48:24.479 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : NetworkManager-initscripts-updown-1:1.40.16-15.e 145/162 2024-05-08T21:48:24.489 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : rbd-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 140/162 2024-05-08T21:48:24.489 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-15.e 145/162 2024-05-08T21:48:24.698 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 146/162 2024-05-08T21:48:24.782 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : rbd-nbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 141/162 2024-05-08T21:48:24.925 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : elfutils-libs-0.186-1.el8.x86_64 147/162 2024-05-08T21:48:25.123 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 148/162 2024-05-08T21:48:25.126 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : openssl-1:1.1.1k-12.el8_9.x86_64 142/162 2024-05-08T21:48:25.300 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 149/162 2024-05-08T21:48:25.300 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 150/162 2024-05-08T21:48:25.358 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : flex-2.6.1-9.el8.x86_64 143/162 2024-05-08T21:48:25.439 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 143/162 2024-05-08T21:48:25.591 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 150/162 2024-05-08T21:48:25.591 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 151/162 2024-05-08T21:48:25.689 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : bison-3.0.4-10.el8.x86_64 144/162 2024-05-08T21:48:25.702 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 144/162 2024-05-08T21:48:25.825 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 151/162 2024-05-08T21:48:25.825 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 152/162 2024-05-08T21:48:25.855 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : NetworkManager-initscripts-updown-1:1.40.16-15.e 145/162 2024-05-08T21:48:25.864 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-15.e 145/162 2024-05-08T21:48:26.068 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 152/162 2024-05-08T21:48:26.074 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 146/162 2024-05-08T21:48:26.244 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : elfutils-libs-0.186-1.el8.x86_64 147/162 2024-05-08T21:48:26.314 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 153/162 2024-05-08T21:48:26.474 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 148/162 2024-05-08T21:48:26.522 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : util-linux-user-2.32.1-35.el8.x86_64 154/162 2024-05-08T21:48:26.651 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 149/162 2024-05-08T21:48:26.651 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 150/162 2024-05-08T21:48:26.789 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : util-linux-2.32.1-35.el8.x86_64 155/162 2024-05-08T21:48:26.789 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : libfdisk-2.32.1-35.el8.x86_64 156/162 2024-05-08T21:48:26.933 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 150/162 2024-05-08T21:48:26.933 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 151/162 2024-05-08T21:48:27.040 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libfdisk-2.32.1-35.el8.x86_64 156/162 2024-05-08T21:48:27.040 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : libmount-2.32.1-35.el8.x86_64 157/162 2024-05-08T21:48:27.117 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 151/162 2024-05-08T21:48:27.117 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 152/162 2024-05-08T21:48:27.248 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libmount-2.32.1-35.el8.x86_64 157/162 2024-05-08T21:48:27.248 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : libblkid-2.32.1-35.el8.x86_64 158/162 2024-05-08T21:48:27.370 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 152/162 2024-05-08T21:48:27.506 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libblkid-2.32.1-35.el8.x86_64 158/162 2024-05-08T21:48:27.507 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : libuuid-2.32.1-35.el8.x86_64 159/162 2024-05-08T21:48:27.615 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 153/162 2024-05-08T21:48:27.781 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libuuid-2.32.1-35.el8.x86_64 159/162 2024-05-08T21:48:27.781 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : libsmartcols-2.32.1-35.el8.x86_64 160/162 2024-05-08T21:48:27.782 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : util-linux-user-2.32.1-35.el8.x86_64 154/162 2024-05-08T21:48:28.039 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libsmartcols-2.32.1-35.el8.x86_64 160/162 2024-05-08T21:48:28.040 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : util-linux-2.32.1-35.el8.x86_64 155/162 2024-05-08T21:48:28.040 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : libfdisk-2.32.1-35.el8.x86_64 156/162 2024-05-08T21:48:28.231 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : elfutils-libelf-0.186-1.el8.x86_64 161/162 2024-05-08T21:48:28.231 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 162/162 2024-05-08T21:48:28.282 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libfdisk-2.32.1-35.el8.x86_64 156/162 2024-05-08T21:48:28.283 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : libmount-2.32.1-35.el8.x86_64 157/162 2024-05-08T21:48:28.540 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libmount-2.32.1-35.el8.x86_64 157/162 2024-05-08T21:48:28.541 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : libblkid-2.32.1-35.el8.x86_64 158/162 2024-05-08T21:48:28.760 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libblkid-2.32.1-35.el8.x86_64 158/162 2024-05-08T21:48:28.761 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : libuuid-2.32.1-35.el8.x86_64 159/162 2024-05-08T21:48:28.982 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libuuid-2.32.1-35.el8.x86_64 159/162 2024-05-08T21:48:28.982 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : libsmartcols-2.32.1-35.el8.x86_64 160/162 2024-05-08T21:48:29.155 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 162/162 2024-05-08T21:48:29.155 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-2:18.2.2-1322.gd21e4f96.el8.x86_64 1/162 2024-05-08T21:48:29.155 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-base-2:18.2.2-1322.gd21e4f96.el8.x86_64 2/162 2024-05-08T21:48:29.155 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 3/162 2024-05-08T21:48:29.155 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 4/162 2024-05-08T21:48:29.155 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1322.gd21e4 5/162 2024-05-08T21:48:29.155 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mds-2:18.2.2-1322.gd21e4f96.el8.x86_64 6/162 2024-05-08T21:48:29.155 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-2:18.2.2-1322.gd21e4f96.el8.x86_64 7/162 2024-05-08T21:48:29.155 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mon-2:18.2.2-1322.gd21e4f96.el8.x86_64 8/162 2024-05-08T21:48:29.155 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-osd-2:18.2.2-1322.gd21e4f96.el8.x86_64 9/162 2024-05-08T21:48:29.156 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-radosgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 10/162 2024-05-08T21:48:29.156 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-selinux-2:18.2.2-1322.gd21e4f96.el8.x86_64 11/162 2024-05-08T21:48:29.156 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-test-2:18.2.2-1322.gd21e4f96.el8.x86_64 12/162 2024-05-08T21:48:29.156 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : cephfs-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 13/162 2024-05-08T21:48:29.156 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephfs-devel-2:18.2.2-1322.gd21e4f96.el8.x86_ 14/162 2024-05-08T21:48:29.156 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephfs2-2:18.2.2-1322.gd21e4f96.el8.x86_64 15/162 2024-05-08T21:48:29.156 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephsqlite-2:18.2.2-1322.gd21e4f96.el8.x86_64 16/162 2024-05-08T21:48:29.156 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados-devel-2:18.2.2-1322.gd21e4f96.el8.x86_6 17/162 2024-05-08T21:48:29.156 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libradosstriper1-2:18.2.2-1322.gd21e4f96.el8.x86 18/162 2024-05-08T21:48:29.156 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librgw2-2:18.2.2-1322.gd21e4f96.el8.x86_64 19/162 2024-05-08T21:48:29.156 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1322.gd21e4f96.el 20/162 2024-05-08T21:48:29.156 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-ceph-common-2:18.2.2-1322.gd21e4f96.el8. 21/162 2024-05-08T21:48:29.156 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cephfs-2:18.2.2-1322.gd21e4f96.el8.x86_6 22/162 2024-05-08T21:48:29.156 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rados-2:18.2.2-1322.gd21e4f96.el8.x86_64 23/162 2024-05-08T21:48:29.157 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 24/162 2024-05-08T21:48:29.157 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 25/162 2024-05-08T21:48:29.157 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 26/162 2024-05-08T21:48:29.157 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 27/162 2024-05-08T21:48:29.157 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-nbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 28/162 2024-05-08T21:48:29.157 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1322.gd21e4f96. 29/162 2024-05-08T21:48:29.157 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1322.gd21e4f96.el8.noa 30/162 2024-05-08T21:48:29.157 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1322.gd21e4f96.el8.n 31/162 2024-05-08T21:48:29.169 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1322.gd21 32/162 2024-05-08T21:48:29.169 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1322.gd21e4f96.el 33/162 2024-05-08T21:48:29.169 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1322.gd21e4f96.el8.noarch 34/162 2024-05-08T21:48:29.169 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1322.gd21e4f96.e 35/162 2024-05-08T21:48:29.169 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-volume-2:18.2.2-1322.gd21e4f96.el8.noarch 36/162 2024-05-08T21:48:29.169 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 37/162 2024-05-08T21:48:29.170 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : cephfs-top-2:18.2.2-1322.gd21e4f96.el8.noarch 38/162 2024-05-08T21:48:29.170 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/162 2024-05-08T21:48:29.170 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/162 2024-05-08T21:48:29.170 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/162 2024-05-08T21:48:29.170 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/162 2024-05-08T21:48:29.170 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/162 2024-05-08T21:48:29.170 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/162 2024-05-08T21:48:29.170 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/162 2024-05-08T21:48:29.170 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/162 2024-05-08T21:48:29.170 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/162 2024-05-08T21:48:29.170 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/162 2024-05-08T21:48:29.170 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/162 2024-05-08T21:48:29.171 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/162 2024-05-08T21:48:29.171 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/162 2024-05-08T21:48:29.171 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/162 2024-05-08T21:48:29.171 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/162 2024-05-08T21:48:29.171 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/162 2024-05-08T21:48:29.171 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/162 2024-05-08T21:48:29.171 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/162 2024-05-08T21:48:29.171 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/162 2024-05-08T21:48:29.171 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/162 2024-05-08T21:48:29.171 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/162 2024-05-08T21:48:29.171 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/162 2024-05-08T21:48:29.171 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/162 2024-05-08T21:48:29.171 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/162 2024-05-08T21:48:29.171 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/162 2024-05-08T21:48:29.172 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/162 2024-05-08T21:48:29.172 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/162 2024-05-08T21:48:29.172 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/162 2024-05-08T21:48:29.172 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/162 2024-05-08T21:48:29.172 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/162 2024-05-08T21:48:29.172 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/162 2024-05-08T21:48:29.172 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/162 2024-05-08T21:48:29.172 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/162 2024-05-08T21:48:29.172 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 72/162 2024-05-08T21:48:29.172 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 73/162 2024-05-08T21:48:29.172 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 74/162 2024-05-08T21:48:29.172 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 75/162 2024-05-08T21:48:29.172 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 76/162 2024-05-08T21:48:29.173 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 77/162 2024-05-08T21:48:29.173 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 78/162 2024-05-08T21:48:29.173 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 79/162 2024-05-08T21:48:29.173 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/162 2024-05-08T21:48:29.173 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 81/162 2024-05-08T21:48:29.173 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 82/162 2024-05-08T21:48:29.173 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 83/162 2024-05-08T21:48:29.173 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 84/162 2024-05-08T21:48:29.173 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 85/162 2024-05-08T21:48:29.173 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 86/162 2024-05-08T21:48:29.173 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 87/162 2024-05-08T21:48:29.173 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 88/162 2024-05-08T21:48:29.173 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 89/162 2024-05-08T21:48:29.173 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 90/162 2024-05-08T21:48:29.174 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 91/162 2024-05-08T21:48:29.174 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 92/162 2024-05-08T21:48:29.174 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : krb5-devel-1.18.2-26.el8_9.x86_64 93/162 2024-05-08T21:48:29.174 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8_9.x86_64 94/162 2024-05-08T21:48:29.174 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librabbitmq-0.9.0-5.el8_9.x86_64 95/162 2024-05-08T21:48:29.174 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cryptography-3.2.1-7.el8_9.x86_64 96/162 2024-05-08T21:48:29.174 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-15.e 97/162 2024-05-08T21:48:29.174 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libuuid-devel-2.32.1-44.el8_9.1.x86_64 98/162 2024-05-08T21:48:29.174 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 99/162 2024-05-08T21:48:29.174 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 100/162 2024-05-08T21:48:29.174 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 101/162 2024-05-08T21:48:29.174 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 102/162 2024-05-08T21:48:29.174 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 103/162 2024-05-08T21:48:29.174 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 104/162 2024-05-08T21:48:29.175 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : bison-3.0.4-10.el8.x86_64 105/162 2024-05-08T21:48:29.175 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flex-2.6.1-9.el8.x86_64 106/162 2024-05-08T21:48:29.175 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 107/162 2024-05-08T21:48:29.175 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 108/162 2024-05-08T21:48:29.175 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 109/162 2024-05-08T21:48:29.175 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 110/162 2024-05-08T21:48:29.175 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 111/162 2024-05-08T21:48:29.175 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 112/162 2024-05-08T21:48:29.175 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 113/162 2024-05-08T21:48:29.175 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 114/162 2024-05-08T21:48:29.175 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 115/162 2024-05-08T21:48:29.175 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 116/162 2024-05-08T21:48:29.175 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 117/162 2024-05-08T21:48:29.175 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openblas-threads-0.3.15-6.el8.x86_64 118/162 2024-05-08T21:48:29.176 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 119/162 2024-05-08T21:48:29.176 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openblas-0.3.15-6.el8.x86_64 120/162 2024-05-08T21:48:29.176 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : automake-1.16.1-8.el8.noarch 121/162 2024-05-08T21:48:29.176 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libpq-13.11-1.el8.x86_64 122/162 2024-05-08T21:48:29.176 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : jq-1.6-7.el8.x86_64 123/162 2024-05-08T21:48:29.176 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 124/162 2024-05-08T21:48:29.176 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 125/162 2024-05-08T21:48:29.176 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : oniguruma-6.8.2-2.1.el8_9.x86_64 126/162 2024-05-08T21:48:29.176 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a 127/162 2024-05-08T21:48:29.176 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : postgresql-contrib-10.23-4.module+el8.9.0+21317+ 128/162 2024-05-08T21:48:29.176 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : postgresql-server-10.23-4.module+el8.9.0+21317+d 129/162 2024-05-08T21:48:29.176 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-packaging-16.8-9.el8.noarch 130/162 2024-05-08T21:48:29.176 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados2-2:18.2.2-1322.gd21e4f96.el8.x86_64 131/162 2024-05-08T21:48:29.176 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 132/162 2024-05-08T21:48:29.177 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librbd1-2:18.2.2-1322.gd21e4f96.el8.x86_64 133/162 2024-05-08T21:48:29.177 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 134/162 2024-05-08T21:48:29.177 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 135/162 2024-05-08T21:48:29.177 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : elfutils-libelf-0.186-1.el8.x86_64 136/162 2024-05-08T21:48:29.177 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 137/162 2024-05-08T21:48:29.177 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : elfutils-libs-0.186-1.el8.x86_64 138/162 2024-05-08T21:48:29.177 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : iproute-6.2.0-5.el8_9.x86_64 139/162 2024-05-08T21:48:29.177 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 140/162 2024-05-08T21:48:29.177 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openssl-1:1.1.1k-12.el8_9.x86_64 141/162 2024-05-08T21:48:29.177 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 142/162 2024-05-08T21:48:29.177 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8_9.x86_64 143/162 2024-05-08T21:48:29.177 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 144/162 2024-05-08T21:48:29.177 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xfsdump-3.1.8-7.el8_9.x86_64 145/162 2024-05-08T21:48:29.177 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 146/162 2024-05-08T21:48:29.178 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 147/162 2024-05-08T21:48:29.178 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 148/162 2024-05-08T21:48:29.178 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libblkid-2.32.1-44.el8_9.1.x86_64 149/162 2024-05-08T21:48:29.178 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libblkid-2.32.1-35.el8.x86_64 150/162 2024-05-08T21:48:29.178 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libfdisk-2.32.1-44.el8_9.1.x86_64 151/162 2024-05-08T21:48:29.178 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libfdisk-2.32.1-35.el8.x86_64 152/162 2024-05-08T21:48:29.178 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libmount-2.32.1-44.el8_9.1.x86_64 153/162 2024-05-08T21:48:29.178 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libmount-2.32.1-35.el8.x86_64 154/162 2024-05-08T21:48:29.178 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libsmartcols-2.32.1-44.el8_9.1.x86_64 155/162 2024-05-08T21:48:29.178 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libsmartcols-2.32.1-35.el8.x86_64 156/162 2024-05-08T21:48:29.178 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libuuid-2.32.1-44.el8_9.1.x86_64 157/162 2024-05-08T21:48:29.178 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libuuid-2.32.1-35.el8.x86_64 158/162 2024-05-08T21:48:29.178 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : util-linux-2.32.1-44.el8_9.1.x86_64 159/162 2024-05-08T21:48:29.179 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : util-linux-2.32.1-35.el8.x86_64 160/162 2024-05-08T21:48:29.179 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : util-linux-user-2.32.1-44.el8_9.1.x86_64 161/162 2024-05-08T21:48:29.198 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libsmartcols-2.32.1-35.el8.x86_64 160/162 2024-05-08T21:48:29.407 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : elfutils-libelf-0.186-1.el8.x86_64 161/162 2024-05-08T21:48:29.407 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 162/162 2024-05-08T21:48:30.306 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 162/162 2024-05-08T21:48:30.307 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-2:18.2.2-1322.gd21e4f96.el8.x86_64 1/162 2024-05-08T21:48:30.307 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-base-2:18.2.2-1322.gd21e4f96.el8.x86_64 2/162 2024-05-08T21:48:30.307 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 3/162 2024-05-08T21:48:30.307 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 4/162 2024-05-08T21:48:30.307 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1322.gd21e4 5/162 2024-05-08T21:48:30.307 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mds-2:18.2.2-1322.gd21e4f96.el8.x86_64 6/162 2024-05-08T21:48:30.307 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-2:18.2.2-1322.gd21e4f96.el8.x86_64 7/162 2024-05-08T21:48:30.307 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mon-2:18.2.2-1322.gd21e4f96.el8.x86_64 8/162 2024-05-08T21:48:30.307 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-osd-2:18.2.2-1322.gd21e4f96.el8.x86_64 9/162 2024-05-08T21:48:30.307 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-radosgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 10/162 2024-05-08T21:48:30.307 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-selinux-2:18.2.2-1322.gd21e4f96.el8.x86_64 11/162 2024-05-08T21:48:30.307 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-test-2:18.2.2-1322.gd21e4f96.el8.x86_64 12/162 2024-05-08T21:48:30.307 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : cephfs-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 13/162 2024-05-08T21:48:30.308 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libcephfs-devel-2:18.2.2-1322.gd21e4f96.el8.x86_ 14/162 2024-05-08T21:48:30.308 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libcephfs2-2:18.2.2-1322.gd21e4f96.el8.x86_64 15/162 2024-05-08T21:48:30.308 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libcephsqlite-2:18.2.2-1322.gd21e4f96.el8.x86_64 16/162 2024-05-08T21:48:30.308 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librados-devel-2:18.2.2-1322.gd21e4f96.el8.x86_6 17/162 2024-05-08T21:48:30.308 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libradosstriper1-2:18.2.2-1322.gd21e4f96.el8.x86 18/162 2024-05-08T21:48:30.308 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librgw2-2:18.2.2-1322.gd21e4f96.el8.x86_64 19/162 2024-05-08T21:48:30.308 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1322.gd21e4f96.el 20/162 2024-05-08T21:48:30.308 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-ceph-common-2:18.2.2-1322.gd21e4f96.el8. 21/162 2024-05-08T21:48:30.308 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cephfs-2:18.2.2-1322.gd21e4f96.el8.x86_6 22/162 2024-05-08T21:48:30.308 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-rados-2:18.2.2-1322.gd21e4f96.el8.x86_64 23/162 2024-05-08T21:48:30.308 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-rbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 24/162 2024-05-08T21:48:30.308 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-rgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 25/162 2024-05-08T21:48:30.308 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : rbd-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 26/162 2024-05-08T21:48:30.308 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : rbd-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 27/162 2024-05-08T21:48:30.321 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : rbd-nbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 28/162 2024-05-08T21:48:30.321 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1322.gd21e4f96. 29/162 2024-05-08T21:48:30.321 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1322.gd21e4f96.el8.noa 30/162 2024-05-08T21:48:30.321 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1322.gd21e4f96.el8.n 31/162 2024-05-08T21:48:30.321 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1322.gd21 32/162 2024-05-08T21:48:30.321 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1322.gd21e4f96.el 33/162 2024-05-08T21:48:30.321 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1322.gd21e4f96.el8.noarch 34/162 2024-05-08T21:48:30.322 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1322.gd21e4f96.e 35/162 2024-05-08T21:48:30.322 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-volume-2:18.2.2-1322.gd21e4f96.el8.noarch 36/162 2024-05-08T21:48:30.322 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 37/162 2024-05-08T21:48:30.322 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : cephfs-top-2:18.2.2-1322.gd21e4f96.el8.noarch 38/162 2024-05-08T21:48:30.322 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/162 2024-05-08T21:48:30.322 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/162 2024-05-08T21:48:30.322 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/162 2024-05-08T21:48:30.322 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/162 2024-05-08T21:48:30.322 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/162 2024-05-08T21:48:30.322 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/162 2024-05-08T21:48:30.322 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/162 2024-05-08T21:48:30.322 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/162 2024-05-08T21:48:30.322 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/162 2024-05-08T21:48:30.323 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/162 2024-05-08T21:48:30.323 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/162 2024-05-08T21:48:30.323 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/162 2024-05-08T21:48:30.323 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/162 2024-05-08T21:48:30.323 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/162 2024-05-08T21:48:30.323 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/162 2024-05-08T21:48:30.323 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/162 2024-05-08T21:48:30.323 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/162 2024-05-08T21:48:30.323 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/162 2024-05-08T21:48:30.323 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/162 2024-05-08T21:48:30.323 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/162 2024-05-08T21:48:30.323 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/162 2024-05-08T21:48:30.323 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/162 2024-05-08T21:48:30.323 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/162 2024-05-08T21:48:30.324 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/162 2024-05-08T21:48:30.324 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/162 2024-05-08T21:48:30.324 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/162 2024-05-08T21:48:30.324 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/162 2024-05-08T21:48:30.324 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/162 2024-05-08T21:48:30.324 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/162 2024-05-08T21:48:30.324 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/162 2024-05-08T21:48:30.324 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/162 2024-05-08T21:48:30.324 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/162 2024-05-08T21:48:30.324 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/162 2024-05-08T21:48:30.324 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 72/162 2024-05-08T21:48:30.324 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 73/162 2024-05-08T21:48:30.324 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 74/162 2024-05-08T21:48:30.325 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 75/162 2024-05-08T21:48:30.325 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 76/162 2024-05-08T21:48:30.325 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 77/162 2024-05-08T21:48:30.325 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 78/162 2024-05-08T21:48:30.325 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 79/162 2024-05-08T21:48:30.325 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/162 2024-05-08T21:48:30.325 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 81/162 2024-05-08T21:48:30.325 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 82/162 2024-05-08T21:48:30.325 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 83/162 2024-05-08T21:48:30.325 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 84/162 2024-05-08T21:48:30.325 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 85/162 2024-05-08T21:48:30.325 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 86/162 2024-05-08T21:48:30.326 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 87/162 2024-05-08T21:48:30.326 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 88/162 2024-05-08T21:48:30.326 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 89/162 2024-05-08T21:48:30.326 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 90/162 2024-05-08T21:48:30.326 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 91/162 2024-05-08T21:48:30.326 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 92/162 2024-05-08T21:48:30.326 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : krb5-devel-1.18.2-26.el8_9.x86_64 93/162 2024-05-08T21:48:30.326 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8_9.x86_64 94/162 2024-05-08T21:48:30.326 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librabbitmq-0.9.0-5.el8_9.x86_64 95/162 2024-05-08T21:48:30.326 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cryptography-3.2.1-7.el8_9.x86_64 96/162 2024-05-08T21:48:30.326 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-15.e 97/162 2024-05-08T21:48:30.326 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libuuid-devel-2.32.1-44.el8_9.1.x86_64 98/162 2024-05-08T21:48:30.326 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-packaging-16.8-9.el8.noarch 99/162 2024-05-08T21:48:30.326 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 100/162 2024-05-08T21:48:30.327 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 101/162 2024-05-08T21:48:30.327 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 102/162 2024-05-08T21:48:30.327 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 103/162 2024-05-08T21:48:30.327 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 104/162 2024-05-08T21:48:30.327 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 105/162 2024-05-08T21:48:30.327 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : bison-3.0.4-10.el8.x86_64 106/162 2024-05-08T21:48:30.327 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : flex-2.6.1-9.el8.x86_64 107/162 2024-05-08T21:48:30.327 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 108/162 2024-05-08T21:48:30.327 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 109/162 2024-05-08T21:48:30.327 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 110/162 2024-05-08T21:48:30.327 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 111/162 2024-05-08T21:48:30.327 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 112/162 2024-05-08T21:48:30.327 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 113/162 2024-05-08T21:48:30.327 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 114/162 2024-05-08T21:48:30.328 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 115/162 2024-05-08T21:48:30.328 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 116/162 2024-05-08T21:48:30.328 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 117/162 2024-05-08T21:48:30.328 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 118/162 2024-05-08T21:48:30.328 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : openblas-threads-0.3.15-6.el8.x86_64 119/162 2024-05-08T21:48:30.328 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 120/162 2024-05-08T21:48:30.328 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : openblas-0.3.15-6.el8.x86_64 121/162 2024-05-08T21:48:30.328 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : automake-1.16.1-8.el8.noarch 122/162 2024-05-08T21:48:30.328 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libpq-13.11-1.el8.x86_64 123/162 2024-05-08T21:48:30.328 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : jq-1.6-7.el8.x86_64 124/162 2024-05-08T21:48:30.328 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 125/162 2024-05-08T21:48:30.328 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 126/162 2024-05-08T21:48:30.328 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : oniguruma-6.8.2-2.1.el8_9.x86_64 127/162 2024-05-08T21:48:30.328 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a 128/162 2024-05-08T21:48:30.328 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : postgresql-contrib-10.23-4.module+el8.9.0+21317+ 129/162 2024-05-08T21:48:30.329 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : postgresql-server-10.23-4.module+el8.9.0+21317+d 130/162 2024-05-08T21:48:30.329 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librados2-2:18.2.2-1322.gd21e4f96.el8.x86_64 131/162 2024-05-08T21:48:30.329 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 132/162 2024-05-08T21:48:30.329 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librbd1-2:18.2.2-1322.gd21e4f96.el8.x86_64 133/162 2024-05-08T21:48:30.329 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 134/162 2024-05-08T21:48:30.329 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 135/162 2024-05-08T21:48:30.329 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : elfutils-libelf-0.186-1.el8.x86_64 136/162 2024-05-08T21:48:30.329 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 137/162 2024-05-08T21:48:30.329 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : elfutils-libs-0.186-1.el8.x86_64 138/162 2024-05-08T21:48:30.329 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : iproute-6.2.0-5.el8_9.x86_64 139/162 2024-05-08T21:48:30.329 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 140/162 2024-05-08T21:48:30.329 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : openssl-1:1.1.1k-12.el8_9.x86_64 141/162 2024-05-08T21:48:30.329 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 142/162 2024-05-08T21:48:30.329 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8_9.x86_64 143/162 2024-05-08T21:48:30.330 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 144/162 2024-05-08T21:48:30.330 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : xfsdump-3.1.8-7.el8_9.x86_64 145/162 2024-05-08T21:48:30.330 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 146/162 2024-05-08T21:48:30.330 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 147/162 2024-05-08T21:48:30.330 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 148/162 2024-05-08T21:48:30.330 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libblkid-2.32.1-44.el8_9.1.x86_64 149/162 2024-05-08T21:48:30.330 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libblkid-2.32.1-35.el8.x86_64 150/162 2024-05-08T21:48:30.330 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libfdisk-2.32.1-44.el8_9.1.x86_64 151/162 2024-05-08T21:48:30.330 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libfdisk-2.32.1-35.el8.x86_64 152/162 2024-05-08T21:48:30.330 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libmount-2.32.1-44.el8_9.1.x86_64 153/162 2024-05-08T21:48:30.330 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libmount-2.32.1-35.el8.x86_64 154/162 2024-05-08T21:48:30.330 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libsmartcols-2.32.1-44.el8_9.1.x86_64 155/162 2024-05-08T21:48:30.330 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libsmartcols-2.32.1-35.el8.x86_64 156/162 2024-05-08T21:48:30.330 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libuuid-2.32.1-44.el8_9.1.x86_64 157/162 2024-05-08T21:48:30.331 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libuuid-2.32.1-35.el8.x86_64 158/162 2024-05-08T21:48:30.331 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : util-linux-2.32.1-44.el8_9.1.x86_64 159/162 2024-05-08T21:48:30.331 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : util-linux-2.32.1-35.el8.x86_64 160/162 2024-05-08T21:48:30.331 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : util-linux-user-2.32.1-44.el8_9.1.x86_64 161/162 2024-05-08T21:48:45.679 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : util-linux-user-2.32.1-35.el8.x86_64 162/162 2024-05-08T21:48:45.680 INFO:teuthology.orchestra.run.smithi073.stdout:Installed products updated. 2024-05-08T21:48:46.323 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:48:46.323 INFO:teuthology.orchestra.run.smithi073.stdout:Upgraded: 2024-05-08T21:48:46.323 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-libelf-0.189-3.el8.x86_64 2024-05-08T21:48:46.323 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-libs-0.189-3.el8.x86_64 2024-05-08T21:48:46.323 INFO:teuthology.orchestra.run.smithi073.stdout: iproute-6.2.0-5.el8_9.x86_64 2024-05-08T21:48:46.324 INFO:teuthology.orchestra.run.smithi073.stdout: libblkid-2.32.1-44.el8_9.1.x86_64 2024-05-08T21:48:46.324 INFO:teuthology.orchestra.run.smithi073.stdout: libfdisk-2.32.1-44.el8_9.1.x86_64 2024-05-08T21:48:46.324 INFO:teuthology.orchestra.run.smithi073.stdout: libmount-2.32.1-44.el8_9.1.x86_64 2024-05-08T21:48:46.324 INFO:teuthology.orchestra.run.smithi073.stdout: librados2-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:48:46.324 INFO:teuthology.orchestra.run.smithi073.stdout: librbd1-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:48:46.324 INFO:teuthology.orchestra.run.smithi073.stdout: libsmartcols-2.32.1-44.el8_9.1.x86_64 2024-05-08T21:48:46.324 INFO:teuthology.orchestra.run.smithi073.stdout: libuuid-2.32.1-44.el8_9.1.x86_64 2024-05-08T21:48:46.324 INFO:teuthology.orchestra.run.smithi073.stdout: openssl-1:1.1.1k-12.el8_9.x86_64 2024-05-08T21:48:46.324 INFO:teuthology.orchestra.run.smithi073.stdout: openssl-libs-1:1.1.1k-12.el8_9.x86_64 2024-05-08T21:48:46.324 INFO:teuthology.orchestra.run.smithi073.stdout: util-linux-2.32.1-44.el8_9.1.x86_64 2024-05-08T21:48:46.324 INFO:teuthology.orchestra.run.smithi073.stdout: util-linux-user-2.32.1-44.el8_9.1.x86_64 2024-05-08T21:48:46.324 INFO:teuthology.orchestra.run.smithi073.stdout: xfsdump-3.1.8-7.el8_9.x86_64 2024-05-08T21:48:46.324 INFO:teuthology.orchestra.run.smithi073.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-05-08T21:48:46.324 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-05-08T21:48:46.325 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-initscripts-updown-1:1.40.16-15.el8_9.noarch 2024-05-08T21:48:46.325 INFO:teuthology.orchestra.run.smithi073.stdout: automake-1.16.1-8.el8.noarch 2024-05-08T21:48:46.325 INFO:teuthology.orchestra.run.smithi073.stdout: bison-3.0.4-10.el8.x86_64 2024-05-08T21:48:46.325 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:48:46.325 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-base-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:48:46.325 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:48:46.325 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:48:46.325 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-grafana-dashboards-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T21:48:46.325 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-immutable-object-cache-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:48:46.325 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mds-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:48:46.325 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:48:46.325 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T21:48:46.325 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-dashboard-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T21:48:46.325 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T21:48:46.326 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-modules-core-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T21:48:46.326 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-rook-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T21:48:46.326 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mon-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:48:46.326 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-osd-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:48:46.326 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-prometheus-alerts-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T21:48:46.326 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-radosgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:48:46.326 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-selinux-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:48:46.326 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-test-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:48:46.326 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-volume-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T21:48:46.326 INFO:teuthology.orchestra.run.smithi073.stdout: cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T21:48:46.326 INFO:teuthology.orchestra.run.smithi073.stdout: cephfs-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:48:46.326 INFO:teuthology.orchestra.run.smithi073.stdout: cephfs-top-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T21:48:46.327 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2024-05-08T21:48:46.327 INFO:teuthology.orchestra.run.smithi073.stdout: flex-2.6.1-9.el8.x86_64 2024-05-08T21:48:46.327 INFO:teuthology.orchestra.run.smithi073.stdout: fuse-2.9.7-17.el8.x86_64 2024-05-08T21:48:46.327 INFO:teuthology.orchestra.run.smithi073.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-05-08T21:48:46.327 INFO:teuthology.orchestra.run.smithi073.stdout: jq-1.6-7.el8.x86_64 2024-05-08T21:48:46.327 INFO:teuthology.orchestra.run.smithi073.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-05-08T21:48:46.327 INFO:teuthology.orchestra.run.smithi073.stdout: krb5-devel-1.18.2-26.el8_9.x86_64 2024-05-08T21:48:46.327 INFO:teuthology.orchestra.run.smithi073.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-05-08T21:48:46.327 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs-devel-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:48:46.327 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs2-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:48:46.327 INFO:teuthology.orchestra.run.smithi073.stdout: libcephsqlite-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:48:46.327 INFO:teuthology.orchestra.run.smithi073.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2024-05-08T21:48:46.327 INFO:teuthology.orchestra.run.smithi073.stdout: libgfortran-8.5.0-20.el8.x86_64 2024-05-08T21:48:46.327 INFO:teuthology.orchestra.run.smithi073.stdout: liboath-2.6.2-3.el8.x86_64 2024-05-08T21:48:46.327 INFO:teuthology.orchestra.run.smithi073.stdout: libpq-13.11-1.el8.x86_64 2024-05-08T21:48:46.328 INFO:teuthology.orchestra.run.smithi073.stdout: libquadmath-8.5.0-20.el8.x86_64 2024-05-08T21:48:46.328 INFO:teuthology.orchestra.run.smithi073.stdout: librabbitmq-0.9.0-5.el8_9.x86_64 2024-05-08T21:48:46.328 INFO:teuthology.orchestra.run.smithi073.stdout: librados-devel-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:48:46.328 INFO:teuthology.orchestra.run.smithi073.stdout: libradosstriper1-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:48:46.328 INFO:teuthology.orchestra.run.smithi073.stdout: librdkafka-0.11.4-3.el8.x86_64 2024-05-08T21:48:46.328 INFO:teuthology.orchestra.run.smithi073.stdout: librgw2-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:48:46.328 INFO:teuthology.orchestra.run.smithi073.stdout: libselinux-devel-2.9-5.el8.x86_64 2024-05-08T21:48:46.328 INFO:teuthology.orchestra.run.smithi073.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-05-08T21:48:46.328 INFO:teuthology.orchestra.run.smithi073.stdout: libtool-2.4.6-25.el8.x86_64 2024-05-08T21:48:46.328 INFO:teuthology.orchestra.run.smithi073.stdout: libunwind-1.3.1-3.el8.x86_64 2024-05-08T21:48:46.328 INFO:teuthology.orchestra.run.smithi073.stdout: libuuid-devel-2.32.1-44.el8_9.1.x86_64 2024-05-08T21:48:46.328 INFO:teuthology.orchestra.run.smithi073.stdout: libverto-devel-0.3.0-5.el8.x86_64 2024-05-08T21:48:46.328 INFO:teuthology.orchestra.run.smithi073.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-05-08T21:48:46.328 INFO:teuthology.orchestra.run.smithi073.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-05-08T21:48:46.329 INFO:teuthology.orchestra.run.smithi073.stdout: oniguruma-6.8.2-2.1.el8_9.x86_64 2024-05-08T21:48:46.329 INFO:teuthology.orchestra.run.smithi073.stdout: openblas-0.3.15-6.el8.x86_64 2024-05-08T21:48:46.329 INFO:teuthology.orchestra.run.smithi073.stdout: openblas-threads-0.3.15-6.el8.x86_64 2024-05-08T21:48:46.329 INFO:teuthology.orchestra.run.smithi073.stdout: openssl-devel-1:1.1.1k-12.el8_9.x86_64 2024-05-08T21:48:46.329 INFO:teuthology.orchestra.run.smithi073.stdout: pcre2-devel-10.32-2.el8.x86_64 2024-05-08T21:48:46.329 INFO:teuthology.orchestra.run.smithi073.stdout: pcre2-utf16-10.32-2.el8.x86_64 2024-05-08T21:48:46.329 INFO:teuthology.orchestra.run.smithi073.stdout: pcre2-utf32-10.32-2.el8.x86_64 2024-05-08T21:48:46.329 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-05-08T21:48:46.329 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-contrib-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-05-08T21:48:46.329 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-server-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-05-08T21:48:46.329 INFO:teuthology.orchestra.run.smithi073.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-05-08T21:48:46.329 INFO:teuthology.orchestra.run.smithi073.stdout: python3-babel-2.5.1-7.el8.noarch 2024-05-08T21:48:46.329 INFO:teuthology.orchestra.run.smithi073.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-05-08T21:48:46.329 INFO:teuthology.orchestra.run.smithi073.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-05-08T21:48:46.329 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-05-08T21:48:46.330 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-argparse-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:48:46.330 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:48:46.330 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cephfs-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:48:46.330 INFO:teuthology.orchestra.run.smithi073.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-05-08T21:48:46.330 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-05-08T21:48:46.330 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-05-08T21:48:46.330 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-05-08T21:48:46.330 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cryptography-3.2.1-7.el8_9.x86_64 2024-05-08T21:48:46.330 INFO:teuthology.orchestra.run.smithi073.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-05-08T21:48:46.330 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-6.2-6.el8.noarch 2024-05-08T21:48:46.330 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-05-08T21:48:46.330 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jinja2-2.10.1-3.el8.noarch 2024-05-08T21:48:46.330 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-05-08T21:48:46.331 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-05-08T21:48:46.331 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-05-08T21:48:46.331 INFO:teuthology.orchestra.run.smithi073.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-05-08T21:48:46.331 INFO:teuthology.orchestra.run.smithi073.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-05-08T21:48:46.331 INFO:teuthology.orchestra.run.smithi073.stdout: python3-mako-1.0.6-14.el8.noarch 2024-05-08T21:48:46.331 INFO:teuthology.orchestra.run.smithi073.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-05-08T21:48:46.331 INFO:teuthology.orchestra.run.smithi073.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-05-08T21:48:46.331 INFO:teuthology.orchestra.run.smithi073.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-05-08T21:48:46.331 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-05-08T21:48:46.331 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-05-08T21:48:46.331 INFO:teuthology.orchestra.run.smithi073.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-05-08T21:48:46.331 INFO:teuthology.orchestra.run.smithi073.stdout: python3-packaging-16.8-9.el8.noarch 2024-05-08T21:48:46.331 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-05-08T21:48:46.332 INFO:teuthology.orchestra.run.smithi073.stdout: python3-portend-2.6-1.el8.noarch 2024-05-08T21:48:46.332 INFO:teuthology.orchestra.run.smithi073.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-05-08T21:48:46.332 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-05-08T21:48:46.332 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-05-08T21:48:46.332 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-05-08T21:48:46.332 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pycparser-2.14-14.el8.noarch 2024-05-08T21:48:46.332 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pytz-2017.2-11.el8.noarch 2024-05-08T21:48:46.332 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rados-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:48:46.332 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:48:46.332 INFO:teuthology.orchestra.run.smithi073.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-05-08T21:48:46.332 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-05-08T21:48:46.332 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:48:46.332 INFO:teuthology.orchestra.run.smithi073.stdout: python3-routes-2.4.1-12.el8.noarch 2024-05-08T21:48:46.332 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rsa-4.9-2.el8.noarch 2024-05-08T21:48:46.332 INFO:teuthology.orchestra.run.smithi073.stdout: python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c38525.x86_64 2024-05-08T21:48:46.333 INFO:teuthology.orchestra.run.smithi073.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-05-08T21:48:46.333 INFO:teuthology.orchestra.run.smithi073.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-05-08T21:48:46.333 INFO:teuthology.orchestra.run.smithi073.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-05-08T21:48:46.333 INFO:teuthology.orchestra.run.smithi073.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-05-08T21:48:46.333 INFO:teuthology.orchestra.run.smithi073.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-05-08T21:48:46.333 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-05-08T21:48:46.333 INFO:teuthology.orchestra.run.smithi073.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-05-08T21:48:46.333 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-05-08T21:48:46.333 INFO:teuthology.orchestra.run.smithi073.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-05-08T21:48:46.333 INFO:teuthology.orchestra.run.smithi073.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-05-08T21:48:46.333 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:48:46.333 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:48:46.333 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-nbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:48:46.333 INFO:teuthology.orchestra.run.smithi073.stdout: socat-1.7.4.1-1.el8.x86_64 2024-05-08T21:48:46.333 INFO:teuthology.orchestra.run.smithi073.stdout: thrift-0.13.0-2.el8.x86_64 2024-05-08T21:48:46.334 INFO:teuthology.orchestra.run.smithi073.stdout: uuid-1.6.2-43.el8.x86_64 2024-05-08T21:48:46.334 INFO:teuthology.orchestra.run.smithi073.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-05-08T21:48:46.334 INFO:teuthology.orchestra.run.smithi073.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-05-08T21:48:46.334 INFO:teuthology.orchestra.run.smithi073.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2024-05-08T21:48:46.334 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:48:46.334 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-05-08T21:48:46.542 DEBUG:teuthology.parallel:result is None 2024-05-08T21:48:47.278 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : util-linux-user-2.32.1-35.el8.x86_64 162/162 2024-05-08T21:48:47.278 INFO:teuthology.orchestra.run.smithi115.stdout:Installed products updated. 2024-05-08T21:48:47.886 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-08T21:48:47.886 INFO:teuthology.orchestra.run.smithi115.stdout:Upgraded: 2024-05-08T21:48:47.886 INFO:teuthology.orchestra.run.smithi115.stdout: elfutils-libelf-0.189-3.el8.x86_64 2024-05-08T21:48:47.886 INFO:teuthology.orchestra.run.smithi115.stdout: elfutils-libs-0.189-3.el8.x86_64 2024-05-08T21:48:47.886 INFO:teuthology.orchestra.run.smithi115.stdout: iproute-6.2.0-5.el8_9.x86_64 2024-05-08T21:48:47.887 INFO:teuthology.orchestra.run.smithi115.stdout: libblkid-2.32.1-44.el8_9.1.x86_64 2024-05-08T21:48:47.887 INFO:teuthology.orchestra.run.smithi115.stdout: libfdisk-2.32.1-44.el8_9.1.x86_64 2024-05-08T21:48:47.887 INFO:teuthology.orchestra.run.smithi115.stdout: libmount-2.32.1-44.el8_9.1.x86_64 2024-05-08T21:48:47.887 INFO:teuthology.orchestra.run.smithi115.stdout: librados2-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:48:47.887 INFO:teuthology.orchestra.run.smithi115.stdout: librbd1-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:48:47.887 INFO:teuthology.orchestra.run.smithi115.stdout: libsmartcols-2.32.1-44.el8_9.1.x86_64 2024-05-08T21:48:47.887 INFO:teuthology.orchestra.run.smithi115.stdout: libuuid-2.32.1-44.el8_9.1.x86_64 2024-05-08T21:48:47.887 INFO:teuthology.orchestra.run.smithi115.stdout: openssl-1:1.1.1k-12.el8_9.x86_64 2024-05-08T21:48:47.887 INFO:teuthology.orchestra.run.smithi115.stdout: openssl-libs-1:1.1.1k-12.el8_9.x86_64 2024-05-08T21:48:47.887 INFO:teuthology.orchestra.run.smithi115.stdout: util-linux-2.32.1-44.el8_9.1.x86_64 2024-05-08T21:48:47.887 INFO:teuthology.orchestra.run.smithi115.stdout: util-linux-user-2.32.1-44.el8_9.1.x86_64 2024-05-08T21:48:47.887 INFO:teuthology.orchestra.run.smithi115.stdout: xfsdump-3.1.8-7.el8_9.x86_64 2024-05-08T21:48:47.887 INFO:teuthology.orchestra.run.smithi115.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-05-08T21:48:47.887 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-05-08T21:48:47.888 INFO:teuthology.orchestra.run.smithi115.stdout: NetworkManager-initscripts-updown-1:1.40.16-15.el8_9.noarch 2024-05-08T21:48:47.888 INFO:teuthology.orchestra.run.smithi115.stdout: automake-1.16.1-8.el8.noarch 2024-05-08T21:48:47.888 INFO:teuthology.orchestra.run.smithi115.stdout: bison-3.0.4-10.el8.x86_64 2024-05-08T21:48:47.888 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:48:47.888 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-base-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:48:47.888 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:48:47.888 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:48:47.888 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-grafana-dashboards-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T21:48:47.888 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-immutable-object-cache-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:48:47.888 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mds-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:48:47.888 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:48:47.888 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T21:48:47.888 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-dashboard-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T21:48:47.888 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T21:48:47.889 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-modules-core-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T21:48:47.889 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-rook-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T21:48:47.889 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mon-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:48:47.889 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-osd-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:48:47.889 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-prometheus-alerts-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T21:48:47.889 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-radosgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:48:47.889 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-selinux-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:48:47.889 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-test-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:48:47.889 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-volume-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T21:48:47.889 INFO:teuthology.orchestra.run.smithi115.stdout: cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T21:48:47.889 INFO:teuthology.orchestra.run.smithi115.stdout: cephfs-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:48:47.889 INFO:teuthology.orchestra.run.smithi115.stdout: cephfs-top-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T21:48:47.889 INFO:teuthology.orchestra.run.smithi115.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2024-05-08T21:48:47.889 INFO:teuthology.orchestra.run.smithi115.stdout: flex-2.6.1-9.el8.x86_64 2024-05-08T21:48:47.890 INFO:teuthology.orchestra.run.smithi115.stdout: fuse-2.9.7-17.el8.x86_64 2024-05-08T21:48:47.890 INFO:teuthology.orchestra.run.smithi115.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-05-08T21:48:47.890 INFO:teuthology.orchestra.run.smithi115.stdout: jq-1.6-7.el8.x86_64 2024-05-08T21:48:47.890 INFO:teuthology.orchestra.run.smithi115.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-05-08T21:48:47.890 INFO:teuthology.orchestra.run.smithi115.stdout: krb5-devel-1.18.2-26.el8_9.x86_64 2024-05-08T21:48:47.890 INFO:teuthology.orchestra.run.smithi115.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-05-08T21:48:47.890 INFO:teuthology.orchestra.run.smithi115.stdout: libcephfs-devel-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:48:47.890 INFO:teuthology.orchestra.run.smithi115.stdout: libcephfs2-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:48:47.890 INFO:teuthology.orchestra.run.smithi115.stdout: libcephsqlite-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:48:47.890 INFO:teuthology.orchestra.run.smithi115.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2024-05-08T21:48:47.890 INFO:teuthology.orchestra.run.smithi115.stdout: libgfortran-8.5.0-20.el8.x86_64 2024-05-08T21:48:47.890 INFO:teuthology.orchestra.run.smithi115.stdout: liboath-2.6.2-3.el8.x86_64 2024-05-08T21:48:47.890 INFO:teuthology.orchestra.run.smithi115.stdout: libpq-13.11-1.el8.x86_64 2024-05-08T21:48:47.891 INFO:teuthology.orchestra.run.smithi115.stdout: libquadmath-8.5.0-20.el8.x86_64 2024-05-08T21:48:47.891 INFO:teuthology.orchestra.run.smithi115.stdout: librabbitmq-0.9.0-5.el8_9.x86_64 2024-05-08T21:48:47.891 INFO:teuthology.orchestra.run.smithi115.stdout: librados-devel-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:48:47.891 INFO:teuthology.orchestra.run.smithi115.stdout: libradosstriper1-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:48:47.891 INFO:teuthology.orchestra.run.smithi115.stdout: librdkafka-0.11.4-3.el8.x86_64 2024-05-08T21:48:47.891 INFO:teuthology.orchestra.run.smithi115.stdout: librgw2-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:48:47.891 INFO:teuthology.orchestra.run.smithi115.stdout: libselinux-devel-2.9-5.el8.x86_64 2024-05-08T21:48:47.891 INFO:teuthology.orchestra.run.smithi115.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-05-08T21:48:47.891 INFO:teuthology.orchestra.run.smithi115.stdout: libtool-2.4.6-25.el8.x86_64 2024-05-08T21:48:47.891 INFO:teuthology.orchestra.run.smithi115.stdout: libunwind-1.3.1-3.el8.x86_64 2024-05-08T21:48:47.891 INFO:teuthology.orchestra.run.smithi115.stdout: libuuid-devel-2.32.1-44.el8_9.1.x86_64 2024-05-08T21:48:47.891 INFO:teuthology.orchestra.run.smithi115.stdout: libverto-devel-0.3.0-5.el8.x86_64 2024-05-08T21:48:47.891 INFO:teuthology.orchestra.run.smithi115.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-05-08T21:48:47.891 INFO:teuthology.orchestra.run.smithi115.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-05-08T21:48:47.892 INFO:teuthology.orchestra.run.smithi115.stdout: oniguruma-6.8.2-2.1.el8_9.x86_64 2024-05-08T21:48:47.892 INFO:teuthology.orchestra.run.smithi115.stdout: openblas-0.3.15-6.el8.x86_64 2024-05-08T21:48:47.892 INFO:teuthology.orchestra.run.smithi115.stdout: openblas-threads-0.3.15-6.el8.x86_64 2024-05-08T21:48:47.892 INFO:teuthology.orchestra.run.smithi115.stdout: openssl-devel-1:1.1.1k-12.el8_9.x86_64 2024-05-08T21:48:47.892 INFO:teuthology.orchestra.run.smithi115.stdout: pcre2-devel-10.32-2.el8.x86_64 2024-05-08T21:48:47.892 INFO:teuthology.orchestra.run.smithi115.stdout: pcre2-utf16-10.32-2.el8.x86_64 2024-05-08T21:48:47.892 INFO:teuthology.orchestra.run.smithi115.stdout: pcre2-utf32-10.32-2.el8.x86_64 2024-05-08T21:48:47.892 INFO:teuthology.orchestra.run.smithi115.stdout: postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-05-08T21:48:47.892 INFO:teuthology.orchestra.run.smithi115.stdout: postgresql-contrib-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-05-08T21:48:47.892 INFO:teuthology.orchestra.run.smithi115.stdout: postgresql-server-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-05-08T21:48:47.892 INFO:teuthology.orchestra.run.smithi115.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-05-08T21:48:47.892 INFO:teuthology.orchestra.run.smithi115.stdout: python3-babel-2.5.1-7.el8.noarch 2024-05-08T21:48:47.892 INFO:teuthology.orchestra.run.smithi115.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-05-08T21:48:47.892 INFO:teuthology.orchestra.run.smithi115.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-05-08T21:48:47.893 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-05-08T21:48:47.893 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ceph-argparse-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:48:47.893 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:48:47.893 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cephfs-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:48:47.893 INFO:teuthology.orchestra.run.smithi115.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-05-08T21:48:47.893 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-05-08T21:48:47.893 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-05-08T21:48:47.893 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-05-08T21:48:47.893 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cryptography-3.2.1-7.el8_9.x86_64 2024-05-08T21:48:47.893 INFO:teuthology.orchestra.run.smithi115.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-05-08T21:48:47.893 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-6.2-6.el8.noarch 2024-05-08T21:48:47.893 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-05-08T21:48:47.893 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jinja2-2.10.1-3.el8.noarch 2024-05-08T21:48:47.893 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-05-08T21:48:47.893 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-05-08T21:48:47.894 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-05-08T21:48:47.894 INFO:teuthology.orchestra.run.smithi115.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-05-08T21:48:47.894 INFO:teuthology.orchestra.run.smithi115.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-05-08T21:48:47.894 INFO:teuthology.orchestra.run.smithi115.stdout: python3-mako-1.0.6-14.el8.noarch 2024-05-08T21:48:47.894 INFO:teuthology.orchestra.run.smithi115.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-05-08T21:48:47.894 INFO:teuthology.orchestra.run.smithi115.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-05-08T21:48:47.894 INFO:teuthology.orchestra.run.smithi115.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-05-08T21:48:47.894 INFO:teuthology.orchestra.run.smithi115.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-05-08T21:48:47.894 INFO:teuthology.orchestra.run.smithi115.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-05-08T21:48:47.894 INFO:teuthology.orchestra.run.smithi115.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-05-08T21:48:47.894 INFO:teuthology.orchestra.run.smithi115.stdout: python3-packaging-16.8-9.el8.noarch 2024-05-08T21:48:47.894 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-05-08T21:48:47.894 INFO:teuthology.orchestra.run.smithi115.stdout: python3-portend-2.6-1.el8.noarch 2024-05-08T21:48:47.895 INFO:teuthology.orchestra.run.smithi115.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-05-08T21:48:47.895 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-05-08T21:48:47.895 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-05-08T21:48:47.895 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-05-08T21:48:47.895 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pycparser-2.14-14.el8.noarch 2024-05-08T21:48:47.895 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pytz-2017.2-11.el8.noarch 2024-05-08T21:48:47.895 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rados-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:48:47.895 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:48:47.895 INFO:teuthology.orchestra.run.smithi115.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-05-08T21:48:47.895 INFO:teuthology.orchestra.run.smithi115.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-05-08T21:48:47.895 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:48:47.895 INFO:teuthology.orchestra.run.smithi115.stdout: python3-routes-2.4.1-12.el8.noarch 2024-05-08T21:48:47.895 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rsa-4.9-2.el8.noarch 2024-05-08T21:48:47.896 INFO:teuthology.orchestra.run.smithi115.stdout: python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c38525.x86_64 2024-05-08T21:48:47.896 INFO:teuthology.orchestra.run.smithi115.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-05-08T21:48:47.896 INFO:teuthology.orchestra.run.smithi115.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-05-08T21:48:47.896 INFO:teuthology.orchestra.run.smithi115.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-05-08T21:48:47.896 INFO:teuthology.orchestra.run.smithi115.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-05-08T21:48:47.896 INFO:teuthology.orchestra.run.smithi115.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-05-08T21:48:47.896 INFO:teuthology.orchestra.run.smithi115.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-05-08T21:48:47.896 INFO:teuthology.orchestra.run.smithi115.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-05-08T21:48:47.896 INFO:teuthology.orchestra.run.smithi115.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-05-08T21:48:47.896 INFO:teuthology.orchestra.run.smithi115.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-05-08T21:48:47.896 INFO:teuthology.orchestra.run.smithi115.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-05-08T21:48:47.896 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:48:47.896 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:48:47.896 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-nbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:48:47.897 INFO:teuthology.orchestra.run.smithi115.stdout: socat-1.7.4.1-1.el8.x86_64 2024-05-08T21:48:47.897 INFO:teuthology.orchestra.run.smithi115.stdout: thrift-0.13.0-2.el8.x86_64 2024-05-08T21:48:47.897 INFO:teuthology.orchestra.run.smithi115.stdout: uuid-1.6.2-43.el8.x86_64 2024-05-08T21:48:47.897 INFO:teuthology.orchestra.run.smithi115.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-05-08T21:48:47.897 INFO:teuthology.orchestra.run.smithi115.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-05-08T21:48:47.897 INFO:teuthology.orchestra.run.smithi115.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2024-05-08T21:48:47.897 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-08T21:48:47.897 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-05-08T21:48:48.098 DEBUG:teuthology.parallel:result is None 2024-05-08T21:48:48.099 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T21:48:48.247 DEBUG:teuthology.orchestra.run.smithi073:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-08T21:48:48.276 INFO:teuthology.orchestra.run.smithi073.stdout:18.2.2-1322.gd21e4f96.el8 2024-05-08T21:48:48.277 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1322.gd21e4f96.el8 2024-05-08T21:48:48.277 INFO:teuthology.task.install:The correct ceph version 18.2.2-1322.gd21e4f96 is installed. 2024-05-08T21:48:48.279 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T21:48:48.501 DEBUG:teuthology.orchestra.run.smithi115:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-08T21:48:48.526 INFO:teuthology.orchestra.run.smithi115.stdout:18.2.2-1322.gd21e4f96.el8 2024-05-08T21:48:48.526 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1322.gd21e4f96.el8 2024-05-08T21:48:48.526 INFO:teuthology.task.install:The correct ceph version 18.2.2-1322.gd21e4f96 is installed. 2024-05-08T21:48:48.528 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-08T21:48:48.528 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-05-08T21:48:48.528 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-08T21:48:48.580 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-08T21:48:48.580 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-08T21:48:48.623 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-08T21:48:48.623 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-05-08T21:48:48.623 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/daemon-helper 2024-05-08T21:48:48.656 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-08T21:48:48.728 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-08T21:48:48.728 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/usr/bin/daemon-helper 2024-05-08T21:48:48.755 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-08T21:48:48.822 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-08T21:48:48.822 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-05-08T21:48:48.822 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-08T21:48:48.854 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-08T21:48:48.925 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-08T21:48:48.925 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-08T21:48:48.951 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-08T21:48:49.019 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-08T21:48:49.019 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-05-08T21:48:49.019 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/stdin-killer 2024-05-08T21:48:49.050 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-08T21:48:49.121 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-08T21:48:49.121 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/usr/bin/stdin-killer 2024-05-08T21:48:49.147 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-08T21:48:49.215 INFO:teuthology.run_tasks:Running task ceph... 2024-05-08T21:48:49.298 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-05-08T21:48:49.299 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 777 /var/log/ceph 2024-05-08T21:48:49.301 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 777 /var/log/ceph 2024-05-08T21:48:49.329 INFO:tasks.ceph:Disabling ceph logrotate... 2024-05-08T21:48:49.329 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-08T21:48:49.372 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-08T21:48:49.399 INFO:tasks.ceph:Creating extra log directories... 2024-05-08T21:48:49.400 DEBUG:teuthology.orchestra.run.smithi073:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-08T21:48:49.442 DEBUG:teuthology.orchestra.run.smithi115:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-08T21:48:49.476 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-05-08T21:48:49.476 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-05-08T21:48:49.476 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-05-08T21:48:49.477 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-05-08T21:48:49.477 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-08T21:48:49.528 DEBUG:teuthology.orchestra.run.smithi073:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-08T21:48:49.639 DEBUG:teuthology.orchestra.run.smithi073:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-08T21:48:49.667 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-08T21:48:49.668 DEBUG:teuthology.orchestra.run.smithi115:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-08T21:48:49.686 DEBUG:teuthology.orchestra.run.smithi115:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-08T21:48:49.801 DEBUG:teuthology.orchestra.run.smithi115:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-08T21:48:49.834 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-05-08T21:48:49.834 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': False, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'Replacing daemon mds'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-05-08T21:48:49.834 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698071', 'branch': 'wip-pdonnell-testing-20240508.150423-reef', 'description': 'fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mds 2-workunit/suites/iozone}}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7698071', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20240508.150423-reef'}, 'ceph': {'cephfs': {'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': False, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'Replacing daemon mds'], 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20240508.150423-reef', 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 65, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 2738, 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34', 'sleep_before_teardown': 0, 'subset': '17/512', 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20240508.150423-reef', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_d21e4f961318b56f0d915caa2490c3711bf13c34/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi073.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMNHXp0Ryi/1ytQZqIM3SOH+8DhGtXTzEg/l+93RUx+Vv8qM1MLlxHYKRZma10Ts+sLXTO98WGUSfAS4wFAtYIY=', 'smithi115.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHLE/vb+S6WqvNONnrPyOxyp/zwZg+puKVWdjhXDFgEyduobG6aAegLjI6LPOgfZx9SkZulbHGcVV3C8v1d9A8o='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': False, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'Replacing daemon mds'], 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'mds_thrash': None}, {'workunit': {'clients': {'all': ['suites/iozone.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '1ae7ad82388e92a475afff437d49054826c019a1', 'timestamp': '2024-05-08_19:22:21', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-05-08T21:48:49.835 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-08T21:48:49.837 DEBUG:teuthology.orchestra.run.smithi115:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-08T21:48:49.886 DEBUG:teuthology.orchestra.run.smithi073:> sudo install -d -m0777 -- /var/run/ceph 2024-05-08T21:48:49.895 DEBUG:teuthology.orchestra.run.smithi115:> sudo install -d -m0777 -- /var/run/ceph 2024-05-08T21:48:49.953 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-05-08T21:48:49.953 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/scratch_devs of=/dev/stdout 2024-05-08T21:48:49.977 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-08T21:48:49.977 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_1 2024-05-08T21:48:50.034 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-08T21:48:50.034 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T21:48:50.034 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 6h/6d Inode: 173960 Links: 1 2024-05-08T21:48:50.034 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T21:48:50.034 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T21:48:50.034 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-05-08 21:48:28.799853266 +0000 2024-05-08T21:48:50.034 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-05-08 21:45:07.234847144 +0000 2024-05-08T21:48:50.034 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-05-08 21:45:07.234847144 +0000 2024-05-08T21:48:50.035 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: - 2024-05-08T21:48:50.035 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-08T21:48:50.098 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-05-08T21:48:50.099 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-05-08T21:48:50.099 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000250575 s, 2.0 MB/s 2024-05-08T21:48:50.100 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-08T21:48:50.158 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_2 2024-05-08T21:48:50.217 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-08T21:48:50.217 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T21:48:50.217 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 6h/6d Inode: 174947 Links: 1 2024-05-08T21:48:50.217 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T21:48:50.217 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T21:48:50.218 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-05-08 21:48:28.799853266 +0000 2024-05-08T21:48:50.218 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-05-08 21:45:07.586839290 +0000 2024-05-08T21:48:50.218 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-05-08 21:45:07.586839290 +0000 2024-05-08T21:48:50.218 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: - 2024-05-08T21:48:50.219 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-08T21:48:50.282 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-05-08T21:48:50.282 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-05-08T21:48:50.283 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000207565 s, 2.5 MB/s 2024-05-08T21:48:50.283 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-08T21:48:50.341 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_3 2024-05-08T21:48:50.399 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-08T21:48:50.399 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T21:48:50.399 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 6h/6d Inode: 175018 Links: 1 2024-05-08T21:48:50.399 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T21:48:50.399 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T21:48:50.399 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-05-08 21:48:28.799853266 +0000 2024-05-08T21:48:50.399 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-05-08 21:45:07.934831525 +0000 2024-05-08T21:48:50.399 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-05-08 21:45:07.934831525 +0000 2024-05-08T21:48:50.399 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: - 2024-05-08T21:48:50.399 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-08T21:48:50.464 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-05-08T21:48:50.464 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-05-08T21:48:50.464 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000195653 s, 2.6 MB/s 2024-05-08T21:48:50.465 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-08T21:48:50.523 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_4 2024-05-08T21:48:50.581 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-08T21:48:50.581 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T21:48:50.581 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 6h/6d Inode: 178100 Links: 1 2024-05-08T21:48:50.581 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T21:48:50.581 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T21:48:50.581 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-05-08 21:48:28.799853266 +0000 2024-05-08T21:48:50.581 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-05-08 21:45:08.299823381 +0000 2024-05-08T21:48:50.582 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-05-08 21:45:08.299823381 +0000 2024-05-08T21:48:50.582 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: - 2024-05-08T21:48:50.582 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-08T21:48:50.647 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-05-08T21:48:50.647 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-05-08T21:48:50.647 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.00024493 s, 2.1 MB/s 2024-05-08T21:48:50.648 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-08T21:48:50.706 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-08T21:48:50.707 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-08T21:48:50.707 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/scratch_devs of=/dev/stdout 2024-05-08T21:48:50.728 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-08T21:48:50.728 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_1 2024-05-08T21:48:50.789 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-08T21:48:50.789 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T21:48:50.789 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 6h/6d Inode: 177964 Links: 1 2024-05-08T21:48:50.789 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T21:48:50.789 INFO:teuthology.orchestra.run.smithi115.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T21:48:50.789 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2024-05-08 21:48:29.928545410 +0000 2024-05-08T21:48:50.789 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2024-05-08 21:45:07.481202359 +0000 2024-05-08T21:48:50.790 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2024-05-08 21:45:07.481202359 +0000 2024-05-08T21:48:50.790 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: - 2024-05-08T21:48:50.790 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-08T21:48:50.861 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2024-05-08T21:48:50.861 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2024-05-08T21:48:50.861 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.000294955 s, 1.7 MB/s 2024-05-08T21:48:50.862 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-08T21:48:50.924 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_2 2024-05-08T21:48:50.985 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-08T21:48:50.985 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T21:48:50.985 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 6h/6d Inode: 180850 Links: 1 2024-05-08T21:48:50.985 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T21:48:50.985 INFO:teuthology.orchestra.run.smithi115.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T21:48:50.986 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2024-05-08 21:48:29.928545410 +0000 2024-05-08T21:48:50.986 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2024-05-08 21:45:07.812196321 +0000 2024-05-08T21:48:50.986 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2024-05-08 21:45:07.812196321 +0000 2024-05-08T21:48:50.986 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: - 2024-05-08T21:48:50.986 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-08T21:48:51.056 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2024-05-08T21:48:51.056 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2024-05-08T21:48:51.056 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.000231778 s, 2.2 MB/s 2024-05-08T21:48:51.058 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-08T21:48:51.117 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_3 2024-05-08T21:48:51.176 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-08T21:48:51.176 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T21:48:51.176 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 6h/6d Inode: 183335 Links: 1 2024-05-08T21:48:51.177 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T21:48:51.177 INFO:teuthology.orchestra.run.smithi115.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T21:48:51.177 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2024-05-08 21:48:29.928545410 +0000 2024-05-08T21:48:51.177 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2024-05-08 21:45:08.167189846 +0000 2024-05-08T21:48:51.177 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2024-05-08 21:45:08.167189846 +0000 2024-05-08T21:48:51.177 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: - 2024-05-08T21:48:51.178 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-08T21:48:51.244 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2024-05-08T21:48:51.244 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2024-05-08T21:48:51.244 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.000181401 s, 2.8 MB/s 2024-05-08T21:48:51.245 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-08T21:48:51.304 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_4 2024-05-08T21:48:51.363 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-08T21:48:51.363 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T21:48:51.363 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 6h/6d Inode: 183404 Links: 1 2024-05-08T21:48:51.363 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T21:48:51.363 INFO:teuthology.orchestra.run.smithi115.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T21:48:51.363 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2024-05-08 21:48:29.928545410 +0000 2024-05-08T21:48:51.363 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2024-05-08 21:45:08.517183462 +0000 2024-05-08T21:48:51.363 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2024-05-08 21:45:08.517183462 +0000 2024-05-08T21:48:51.363 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: - 2024-05-08T21:48:51.363 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-08T21:48:51.429 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2024-05-08T21:48:51.429 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2024-05-08T21:48:51.429 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.000234731 s, 2.2 MB/s 2024-05-08T21:48:51.431 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-08T21:48:51.490 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-08T21:48:51.490 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi073.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi115.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-08T21:48:51.490 INFO:tasks.ceph:Generating config... 2024-05-08T21:48:51.492 INFO:tasks.ceph:[client] client mount timeout = 600 2024-05-08T21:48:51.492 INFO:tasks.ceph:[client] client_shutdown_timeout = 120 2024-05-08T21:48:51.492 INFO:tasks.ceph:[client] debug client = 20 2024-05-08T21:48:51.492 INFO:tasks.ceph:[client] debug ms = 1 2024-05-08T21:48:51.492 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-05-08T21:48:51.492 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-05-08T21:48:51.492 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-05-08T21:48:51.492 INFO:tasks.ceph:[mds] debug mds = 20 2024-05-08T21:48:51.492 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-05-08T21:48:51.492 INFO:tasks.ceph:[mds] debug ms = 1 2024-05-08T21:48:51.492 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2024-05-08T21:48:51.493 INFO:tasks.ceph:[mds] mds bal merge size = 5 2024-05-08T21:48:51.493 INFO:tasks.ceph:[mds] mds bal split bits = 3 2024-05-08T21:48:51.493 INFO:tasks.ceph:[mds] mds bal split size = 100 2024-05-08T21:48:51.493 INFO:tasks.ceph:[mds] mds debug frag = True 2024-05-08T21:48:51.493 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-05-08T21:48:51.493 INFO:tasks.ceph:[mds] mds oft prefetch dirfrags = False 2024-05-08T21:48:51.494 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-05-08T21:48:51.494 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-05-08T21:48:51.494 INFO:tasks.ceph:[mds] mds_dir_prefetch = True 2024-05-08T21:48:51.494 INFO:tasks.ceph:[mds] mds_sleep_rank_change = 5000000.0 2024-05-08T21:48:51.494 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-05-08T21:48:51.494 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-05-08T21:48:51.494 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-05-08T21:48:51.494 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-05-08T21:48:51.494 INFO:tasks.ceph:[mgr] debug ms = 1 2024-05-08T21:48:51.494 INFO:tasks.ceph:[mon] debug mon = 20 2024-05-08T21:48:51.494 INFO:tasks.ceph:[mon] debug ms = 1 2024-05-08T21:48:51.494 INFO:tasks.ceph:[mon] debug paxos = 20 2024-05-08T21:48:51.494 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-05-08T21:48:51.495 INFO:tasks.ceph:[osd] bdev async discard = True 2024-05-08T21:48:51.495 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-05-08T21:48:51.495 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-05-08T21:48:51.495 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-05-08T21:48:51.495 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-05-08T21:48:51.495 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-05-08T21:48:51.496 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-05-08T21:48:51.496 INFO:tasks.ceph:[osd] debug ms = 1 2024-05-08T21:48:51.496 INFO:tasks.ceph:[osd] debug osd = 20 2024-05-08T21:48:51.496 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-05-08T21:48:51.496 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-05-08T21:48:51.496 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-05-08T21:48:51.496 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-05-08T21:48:51.496 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-05-08T21:48:51.496 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-05-08T21:48:51.496 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-05-08T21:48:51.496 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-05-08T21:48:51.496 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-05-08T21:48:51.496 INFO:tasks.ceph:Setting up mon.a... 2024-05-08T21:48:51.497 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-05-08T21:48:51.555 INFO:teuthology.orchestra.run.smithi073.stdout:creating /etc/ceph/ceph.keyring 2024-05-08T21:48:51.558 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-05-08T21:48:51.606 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-08T21:48:51.633 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.73'), ('mon.b', '172.21.15.115'), ('mon.c', '[v2:172.21.15.115:3301,v1:172.21.15.115:6790]')] 2024-05-08T21:48:51.634 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.73,172.21.15.115,[v2:172.21.15.115:3301,v1:172.21.15.115:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': False, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-05-08T21:48:51.635 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-05-08T21:48:51.635 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-05-08T21:48:51.691 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.73 --add b 172.21.15.115 --addv c '[v2:172.21.15.115:3301,v1:172.21.15.115:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-05-08T21:48:51.779 INFO:teuthology.orchestra.run.smithi073.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-05-08T21:48:51.779 INFO:teuthology.orchestra.run.smithi073.stdout:monmaptool: generated fsid 143164b7-c9c7-4737-a494-7dafa5a3320c 2024-05-08T21:48:51.779 INFO:teuthology.orchestra.run.smithi073.stdout:setting min_mon_release = pacific 2024-05-08T21:48:51.779 INFO:teuthology.orchestra.run.smithi073.stdout:epoch 0 2024-05-08T21:48:51.779 INFO:teuthology.orchestra.run.smithi073.stdout:fsid 143164b7-c9c7-4737-a494-7dafa5a3320c 2024-05-08T21:48:51.779 INFO:teuthology.orchestra.run.smithi073.stdout:last_changed 2024-05-08T21:48:51.779307+0000 2024-05-08T21:48:51.779 INFO:teuthology.orchestra.run.smithi073.stdout:created 2024-05-08T21:48:51.779307+0000 2024-05-08T21:48:51.779 INFO:teuthology.orchestra.run.smithi073.stdout:min_mon_release 16 (pacific) 2024-05-08T21:48:51.779 INFO:teuthology.orchestra.run.smithi073.stdout:election_strategy: 1 2024-05-08T21:48:51.779 INFO:teuthology.orchestra.run.smithi073.stdout:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-05-08T21:48:51.780 INFO:teuthology.orchestra.run.smithi073.stdout:1: [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] mon.b 2024-05-08T21:48:51.780 INFO:teuthology.orchestra.run.smithi073.stdout:2: [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] mon.c 2024-05-08T21:48:51.780 INFO:teuthology.orchestra.run.smithi073.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-05-08T21:48:51.781 DEBUG:teuthology.orchestra.run.smithi073:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-05-08T21:48:51.797 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 143164b7-c9c7-4737-a494-7dafa5a3320c... 2024-05-08T21:48:51.798 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-08T21:48:51.840 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-08T21:48:51.882 INFO:teuthology.orchestra.run.smithi073.stdout:[global] 2024-05-08T21:48:51.883 INFO:teuthology.orchestra.run.smithi073.stdout: chdir = "" 2024-05-08T21:48:51.883 INFO:teuthology.orchestra.run.smithi073.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-08T21:48:51.883 INFO:teuthology.orchestra.run.smithi073.stdout: auth supported = cephx 2024-05-08T21:48:51.883 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:48:51.883 INFO:teuthology.orchestra.run.smithi073.stdout: filestore xattr use omap = true 2024-05-08T21:48:51.883 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:48:51.883 INFO:teuthology.orchestra.run.smithi073.stdout: mon clock drift allowed = 1.000 2024-05-08T21:48:51.883 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:48:51.883 INFO:teuthology.orchestra.run.smithi073.stdout: osd crush chooseleaf type = 0 2024-05-08T21:48:51.884 INFO:teuthology.orchestra.run.smithi073.stdout: auth debug = true 2024-05-08T21:48:51.884 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:48:51.884 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on old message = true 2024-05-08T21:48:51.884 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on bug = true 2024-05-08T21:48:51.884 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:48:51.884 INFO:teuthology.orchestra.run.smithi073.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-08T21:48:51.884 INFO:teuthology.orchestra.run.smithi073.stdout: mon pg warn max object skew = 0 2024-05-08T21:48:51.884 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:48:51.884 INFO:teuthology.orchestra.run.smithi073.stdout: # disable pg_autoscaler by default for new pools 2024-05-08T21:48:51.884 INFO:teuthology.orchestra.run.smithi073.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-08T21:48:51.884 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:48:51.884 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default size = 2 2024-05-08T21:48:51.884 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:48:51.884 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow primary affinity = true 2024-05-08T21:48:51.885 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow pg remap = true 2024-05-08T21:48:51.885 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on legacy crush tunables = false 2024-05-08T21:48:51.885 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on crush straw calc version zero = false 2024-05-08T21:48:51.885 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on no sortbitwise = false 2024-05-08T21:48:51.885 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on osd down out interval zero = false 2024-05-08T21:48:51.885 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on too few osds = false 2024-05-08T21:48:51.885 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-08T21:48:51.885 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-08T21:48:51.885 INFO:teuthology.orchestra.run.smithi073.stdout: mon_allow_pool_size_one = true 2024-05-08T21:48:51.885 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:48:51.886 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-08T21:48:51.886 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:48:51.886 INFO:teuthology.orchestra.run.smithi073.stdout: osd default data pool replay window = 5 2024-05-08T21:48:51.886 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:48:51.886 INFO:teuthology.orchestra.run.smithi073.stdout: mon allow pool delete = true 2024-05-08T21:48:51.886 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:48:51.886 INFO:teuthology.orchestra.run.smithi073.stdout: mon cluster log file level = debug 2024-05-08T21:48:51.886 INFO:teuthology.orchestra.run.smithi073.stdout: debug asserts on shutdown = true 2024-05-08T21:48:51.886 INFO:teuthology.orchestra.run.smithi073.stdout: mon health detail to clog = false 2024-05-08T21:48:51.886 INFO:teuthology.orchestra.run.smithi073.stdout: mon host = "172.21.15.73,172.21.15.115,[v2:172.21.15.115:3301,v1:172.21.15.115:6790]" 2024-05-08T21:48:51.886 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on skipped message = False 2024-05-08T21:48:51.886 INFO:teuthology.orchestra.run.smithi073.stdout: fsid = 143164b7-c9c7-4737-a494-7dafa5a3320c 2024-05-08T21:48:51.886 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:48:51.886 INFO:teuthology.orchestra.run.smithi073.stdout:[osd] 2024-05-08T21:48:51.887 INFO:teuthology.orchestra.run.smithi073.stdout: osd journal size = 100 2024-05-08T21:48:51.887 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:48:51.887 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub load threshold = 5.0 2024-05-08T21:48:51.887 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub max interval = 600 2024-05-08T21:48:51.887 INFO:teuthology.orchestra.run.smithi073.stdout: osd mclock profile = high_recovery_ops 2024-05-08T21:48:51.887 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:48:51.887 INFO:teuthology.orchestra.run.smithi073.stdout: osd recover clone overlap = true 2024-05-08T21:48:51.887 INFO:teuthology.orchestra.run.smithi073.stdout: osd recovery max chunk = 1048576 2024-05-08T21:48:51.887 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:48:51.887 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug shutdown = true 2024-05-08T21:48:51.887 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug op order = true 2024-05-08T21:48:51.887 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug verify stray on activate = true 2024-05-08T21:48:51.887 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:48:51.887 INFO:teuthology.orchestra.run.smithi073.stdout: osd open classes on start = true 2024-05-08T21:48:51.887 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug pg log writeout = true 2024-05-08T21:48:51.888 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:48:51.888 INFO:teuthology.orchestra.run.smithi073.stdout: osd deep scrub update digest min age = 30 2024-05-08T21:48:51.888 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:48:51.888 INFO:teuthology.orchestra.run.smithi073.stdout: osd map max advance = 10 2024-05-08T21:48:51.888 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:48:51.888 INFO:teuthology.orchestra.run.smithi073.stdout: journal zero on create = true 2024-05-08T21:48:51.888 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:48:51.888 INFO:teuthology.orchestra.run.smithi073.stdout: filestore ondisk finisher threads = 3 2024-05-08T21:48:51.888 INFO:teuthology.orchestra.run.smithi073.stdout: filestore apply finisher threads = 3 2024-05-08T21:48:51.888 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:48:51.888 INFO:teuthology.orchestra.run.smithi073.stdout: bdev debug aio = true 2024-05-08T21:48:51.888 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug misdirected ops = true 2024-05-08T21:48:51.888 INFO:teuthology.orchestra.run.smithi073.stdout: bdev async discard = True 2024-05-08T21:48:51.888 INFO:teuthology.orchestra.run.smithi073.stdout: bdev enable discard = True 2024-05-08T21:48:51.888 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore allocator = bitmap 2024-05-08T21:48:51.889 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore block size = 96636764160 2024-05-08T21:48:51.889 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore fsck on mount = True 2024-05-08T21:48:51.889 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluefs = 1/20 2024-05-08T21:48:51.889 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluestore = 1/20 2024-05-08T21:48:51.889 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-05-08T21:48:51.889 INFO:teuthology.orchestra.run.smithi073.stdout: debug osd = 20 2024-05-08T21:48:51.889 INFO:teuthology.orchestra.run.smithi073.stdout: debug rocksdb = 4/10 2024-05-08T21:48:51.889 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd backfillfull_ratio = 0.85 2024-05-08T21:48:51.889 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd full ratio = 0.9 2024-05-08T21:48:51.889 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd nearfull ratio = 0.8 2024-05-08T21:48:51.889 INFO:teuthology.orchestra.run.smithi073.stdout: osd blocked scrub grace period = 3600 2024-05-08T21:48:51.889 INFO:teuthology.orchestra.run.smithi073.stdout: osd failsafe full ratio = 0.95 2024-05-08T21:48:51.889 INFO:teuthology.orchestra.run.smithi073.stdout: osd max markdown count = 1000 2024-05-08T21:48:51.889 INFO:teuthology.orchestra.run.smithi073.stdout: osd objectstore = bluestore 2024-05-08T21:48:51.889 INFO:teuthology.orchestra.run.smithi073.stdout: osd op complaint time = 180 2024-05-08T21:48:51.890 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:48:51.890 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr] 2024-05-08T21:48:51.890 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-05-08T21:48:51.890 INFO:teuthology.orchestra.run.smithi073.stdout: debug mgr = 20 2024-05-08T21:48:51.890 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2024-05-08T21:48:51.890 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2024-05-08T21:48:51.890 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2024-05-08T21:48:51.890 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2024-05-08T21:48:51.890 INFO:teuthology.orchestra.run.smithi073.stdout: mgr/telemetry/nag = false 2024-05-08T21:48:51.890 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:48:51.890 INFO:teuthology.orchestra.run.smithi073.stdout:[mon] 2024-05-08T21:48:51.890 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-05-08T21:48:51.890 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2024-05-08T21:48:51.890 INFO:teuthology.orchestra.run.smithi073.stdout: debug paxos = 20 2024-05-08T21:48:51.890 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2024-05-08T21:48:51.891 INFO:teuthology.orchestra.run.smithi073.stdout: mon data avail warn = 5 2024-05-08T21:48:51.891 INFO:teuthology.orchestra.run.smithi073.stdout: mon mgr mkfs grace = 240 2024-05-08T21:48:51.891 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2024-05-08T21:48:51.891 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd reporter subtree level = osd 2024-05-08T21:48:51.891 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd prime pg temp = true 2024-05-08T21:48:51.891 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2024-05-08T21:48:51.891 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:48:51.891 INFO:teuthology.orchestra.run.smithi073.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-08T21:48:51.891 INFO:teuthology.orchestra.run.smithi073.stdout: auth mon ticket ttl = 660 # 11m 2024-05-08T21:48:51.891 INFO:teuthology.orchestra.run.smithi073.stdout: auth service ticket ttl = 240 # 4m 2024-05-08T21:48:51.891 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:48:51.891 INFO:teuthology.orchestra.run.smithi073.stdout: # don't complain about insecure global_id in the test suite 2024-05-08T21:48:51.891 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-08T21:48:51.891 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-08T21:48:51.891 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:48:51.892 INFO:teuthology.orchestra.run.smithi073.stdout: # 1m isn't quite enough 2024-05-08T21:48:51.892 INFO:teuthology.orchestra.run.smithi073.stdout: mon_down_mkfs_grace = 2m 2024-05-08T21:48:51.892 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:48:51.892 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_filestore_osds = false 2024-05-08T21:48:51.892 INFO:teuthology.orchestra.run.smithi073.stdout: mon op complaint time = 120 2024-05-08T21:48:51.892 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:48:51.892 INFO:teuthology.orchestra.run.smithi073.stdout:[client] 2024-05-08T21:48:51.892 INFO:teuthology.orchestra.run.smithi073.stdout: rgw cache enabled = true 2024-05-08T21:48:51.892 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable ops log = true 2024-05-08T21:48:51.892 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable usage log = true 2024-05-08T21:48:51.892 INFO:teuthology.orchestra.run.smithi073.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-08T21:48:51.893 INFO:teuthology.orchestra.run.smithi073.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-08T21:48:51.893 INFO:teuthology.orchestra.run.smithi073.stdout: client mount timeout = 600 2024-05-08T21:48:51.893 INFO:teuthology.orchestra.run.smithi073.stdout: client_shutdown_timeout = 120 2024-05-08T21:48:51.893 INFO:teuthology.orchestra.run.smithi073.stdout: debug client = 20 2024-05-08T21:48:51.893 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-05-08T21:48:51.893 INFO:teuthology.orchestra.run.smithi073.stdout: rados mon op timeout = 900 2024-05-08T21:48:51.893 INFO:teuthology.orchestra.run.smithi073.stdout: rados osd op timeout = 900 2024-05-08T21:48:51.894 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.a] 2024-05-08T21:48:51.894 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.b] 2024-05-08T21:48:51.894 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.c] 2024-05-08T21:48:51.894 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.a] 2024-05-08T21:48:51.894 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.c] 2024-05-08T21:48:51.894 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.e] 2024-05-08T21:48:51.894 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.b] 2024-05-08T21:48:51.894 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.d] 2024-05-08T21:48:51.894 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.f] 2024-05-08T21:48:51.894 INFO:teuthology.orchestra.run.smithi073.stdout:[mds] 2024-05-08T21:48:51.894 INFO:teuthology.orchestra.run.smithi073.stdout: debug mds = 20 2024-05-08T21:48:51.894 INFO:teuthology.orchestra.run.smithi073.stdout: debug mds balancer = 20 2024-05-08T21:48:51.894 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-05-08T21:48:51.894 INFO:teuthology.orchestra.run.smithi073.stdout: mds bal fragment size max = 10000 2024-05-08T21:48:51.895 INFO:teuthology.orchestra.run.smithi073.stdout: mds bal merge size = 5 2024-05-08T21:48:51.895 INFO:teuthology.orchestra.run.smithi073.stdout: mds bal split bits = 3 2024-05-08T21:48:51.895 INFO:teuthology.orchestra.run.smithi073.stdout: mds bal split size = 100 2024-05-08T21:48:51.895 INFO:teuthology.orchestra.run.smithi073.stdout: mds debug frag = True 2024-05-08T21:48:51.895 INFO:teuthology.orchestra.run.smithi073.stdout: mds debug scatterstat = True 2024-05-08T21:48:51.895 INFO:teuthology.orchestra.run.smithi073.stdout: mds oft prefetch dirfrags = False 2024-05-08T21:48:51.895 INFO:teuthology.orchestra.run.smithi073.stdout: mds op complaint time = 180 2024-05-08T21:48:51.895 INFO:teuthology.orchestra.run.smithi073.stdout: mds verify scatter = True 2024-05-08T21:48:51.895 INFO:teuthology.orchestra.run.smithi073.stdout: mds_dir_prefetch = True 2024-05-08T21:48:51.895 INFO:teuthology.orchestra.run.smithi073.stdout: mds_sleep_rank_change = 5000000.0 2024-05-08T21:48:51.895 INFO:teuthology.orchestra.run.smithi073.stdout: osd op complaint time = 180 2024-05-08T21:48:51.895 INFO:teuthology.orchestra.run.smithi073.stdout: rados mon op timeout = 900 2024-05-08T21:48:51.895 INFO:teuthology.orchestra.run.smithi073.stdout: rados osd op timeout = 900 2024-05-08T21:48:51.896 INFO:teuthology.orchestra.run.smithi115.stdout:[global] 2024-05-08T21:48:51.896 INFO:teuthology.orchestra.run.smithi115.stdout: chdir = "" 2024-05-08T21:48:51.896 INFO:teuthology.orchestra.run.smithi115.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-08T21:48:51.896 INFO:teuthology.orchestra.run.smithi115.stdout: auth supported = cephx 2024-05-08T21:48:51.897 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-08T21:48:51.897 INFO:teuthology.orchestra.run.smithi115.stdout: filestore xattr use omap = true 2024-05-08T21:48:51.897 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-08T21:48:51.897 INFO:teuthology.orchestra.run.smithi115.stdout: mon clock drift allowed = 1.000 2024-05-08T21:48:51.897 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-08T21:48:51.897 INFO:teuthology.orchestra.run.smithi115.stdout: osd crush chooseleaf type = 0 2024-05-08T21:48:51.897 INFO:teuthology.orchestra.run.smithi115.stdout: auth debug = true 2024-05-08T21:48:51.897 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-08T21:48:51.897 INFO:teuthology.orchestra.run.smithi115.stdout: ms die on old message = true 2024-05-08T21:48:51.897 INFO:teuthology.orchestra.run.smithi115.stdout: ms die on bug = true 2024-05-08T21:48:51.897 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-08T21:48:51.897 INFO:teuthology.orchestra.run.smithi115.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-08T21:48:51.898 INFO:teuthology.orchestra.run.smithi115.stdout: mon pg warn max object skew = 0 2024-05-08T21:48:51.898 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-08T21:48:51.898 INFO:teuthology.orchestra.run.smithi115.stdout: # disable pg_autoscaler by default for new pools 2024-05-08T21:48:51.898 INFO:teuthology.orchestra.run.smithi115.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-08T21:48:51.898 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-08T21:48:51.898 INFO:teuthology.orchestra.run.smithi115.stdout: osd pool default size = 2 2024-05-08T21:48:51.898 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-08T21:48:51.898 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd allow primary affinity = true 2024-05-08T21:48:51.898 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd allow pg remap = true 2024-05-08T21:48:51.898 INFO:teuthology.orchestra.run.smithi115.stdout: mon warn on legacy crush tunables = false 2024-05-08T21:48:51.898 INFO:teuthology.orchestra.run.smithi115.stdout: mon warn on crush straw calc version zero = false 2024-05-08T21:48:51.898 INFO:teuthology.orchestra.run.smithi115.stdout: mon warn on no sortbitwise = false 2024-05-08T21:48:51.898 INFO:teuthology.orchestra.run.smithi115.stdout: mon warn on osd down out interval zero = false 2024-05-08T21:48:51.899 INFO:teuthology.orchestra.run.smithi115.stdout: mon warn on too few osds = false 2024-05-08T21:48:51.899 INFO:teuthology.orchestra.run.smithi115.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-08T21:48:51.899 INFO:teuthology.orchestra.run.smithi115.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-08T21:48:51.899 INFO:teuthology.orchestra.run.smithi115.stdout: mon_allow_pool_size_one = true 2024-05-08T21:48:51.899 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-08T21:48:51.899 INFO:teuthology.orchestra.run.smithi115.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-08T21:48:51.899 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-08T21:48:51.899 INFO:teuthology.orchestra.run.smithi115.stdout: osd default data pool replay window = 5 2024-05-08T21:48:51.899 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-08T21:48:51.899 INFO:teuthology.orchestra.run.smithi115.stdout: mon allow pool delete = true 2024-05-08T21:48:51.899 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-08T21:48:51.899 INFO:teuthology.orchestra.run.smithi115.stdout: mon cluster log file level = debug 2024-05-08T21:48:51.899 INFO:teuthology.orchestra.run.smithi115.stdout: debug asserts on shutdown = true 2024-05-08T21:48:51.899 INFO:teuthology.orchestra.run.smithi115.stdout: mon health detail to clog = false 2024-05-08T21:48:51.899 INFO:teuthology.orchestra.run.smithi115.stdout: mon host = "172.21.15.73,172.21.15.115,[v2:172.21.15.115:3301,v1:172.21.15.115:6790]" 2024-05-08T21:48:51.900 INFO:teuthology.orchestra.run.smithi115.stdout: ms die on skipped message = False 2024-05-08T21:48:51.900 INFO:teuthology.orchestra.run.smithi115.stdout: fsid = 143164b7-c9c7-4737-a494-7dafa5a3320c 2024-05-08T21:48:51.900 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-08T21:48:51.900 INFO:teuthology.orchestra.run.smithi115.stdout:[osd] 2024-05-08T21:48:51.900 INFO:teuthology.orchestra.run.smithi115.stdout: osd journal size = 100 2024-05-08T21:48:51.900 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-08T21:48:51.900 INFO:teuthology.orchestra.run.smithi115.stdout: osd scrub load threshold = 5.0 2024-05-08T21:48:51.900 INFO:teuthology.orchestra.run.smithi115.stdout: osd scrub max interval = 600 2024-05-08T21:48:51.900 INFO:teuthology.orchestra.run.smithi115.stdout: osd mclock profile = high_recovery_ops 2024-05-08T21:48:51.900 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-08T21:48:51.900 INFO:teuthology.orchestra.run.smithi115.stdout: osd recover clone overlap = true 2024-05-08T21:48:51.900 INFO:teuthology.orchestra.run.smithi115.stdout: osd recovery max chunk = 1048576 2024-05-08T21:48:51.900 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-08T21:48:51.900 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug shutdown = true 2024-05-08T21:48:51.900 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug op order = true 2024-05-08T21:48:51.901 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug verify stray on activate = true 2024-05-08T21:48:51.901 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-08T21:48:51.901 INFO:teuthology.orchestra.run.smithi115.stdout: osd open classes on start = true 2024-05-08T21:48:51.901 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug pg log writeout = true 2024-05-08T21:48:51.901 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-08T21:48:51.901 INFO:teuthology.orchestra.run.smithi115.stdout: osd deep scrub update digest min age = 30 2024-05-08T21:48:51.901 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-08T21:48:51.901 INFO:teuthology.orchestra.run.smithi115.stdout: osd map max advance = 10 2024-05-08T21:48:51.901 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-08T21:48:51.901 INFO:teuthology.orchestra.run.smithi115.stdout: journal zero on create = true 2024-05-08T21:48:51.901 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-08T21:48:51.901 INFO:teuthology.orchestra.run.smithi115.stdout: filestore ondisk finisher threads = 3 2024-05-08T21:48:51.901 INFO:teuthology.orchestra.run.smithi115.stdout: filestore apply finisher threads = 3 2024-05-08T21:48:51.901 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-08T21:48:51.901 INFO:teuthology.orchestra.run.smithi115.stdout: bdev debug aio = true 2024-05-08T21:48:51.902 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug misdirected ops = true 2024-05-08T21:48:51.902 INFO:teuthology.orchestra.run.smithi115.stdout: bdev async discard = True 2024-05-08T21:48:51.902 INFO:teuthology.orchestra.run.smithi115.stdout: bdev enable discard = True 2024-05-08T21:48:51.902 INFO:teuthology.orchestra.run.smithi115.stdout: bluestore allocator = bitmap 2024-05-08T21:48:51.902 INFO:teuthology.orchestra.run.smithi115.stdout: bluestore block size = 96636764160 2024-05-08T21:48:51.903 INFO:teuthology.orchestra.run.smithi115.stdout: bluestore fsck on mount = True 2024-05-08T21:48:51.903 INFO:teuthology.orchestra.run.smithi115.stdout: debug bluefs = 1/20 2024-05-08T21:48:51.903 INFO:teuthology.orchestra.run.smithi115.stdout: debug bluestore = 1/20 2024-05-08T21:48:51.903 INFO:teuthology.orchestra.run.smithi115.stdout: debug ms = 1 2024-05-08T21:48:51.903 INFO:teuthology.orchestra.run.smithi115.stdout: debug osd = 20 2024-05-08T21:48:51.903 INFO:teuthology.orchestra.run.smithi115.stdout: debug rocksdb = 4/10 2024-05-08T21:48:51.903 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd backfillfull_ratio = 0.85 2024-05-08T21:48:51.903 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd full ratio = 0.9 2024-05-08T21:48:51.903 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd nearfull ratio = 0.8 2024-05-08T21:48:51.903 INFO:teuthology.orchestra.run.smithi115.stdout: osd blocked scrub grace period = 3600 2024-05-08T21:48:51.903 INFO:teuthology.orchestra.run.smithi115.stdout: osd failsafe full ratio = 0.95 2024-05-08T21:48:51.903 INFO:teuthology.orchestra.run.smithi115.stdout: osd max markdown count = 1000 2024-05-08T21:48:51.903 INFO:teuthology.orchestra.run.smithi115.stdout: osd objectstore = bluestore 2024-05-08T21:48:51.904 INFO:teuthology.orchestra.run.smithi115.stdout: osd op complaint time = 180 2024-05-08T21:48:51.904 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-08T21:48:51.904 INFO:teuthology.orchestra.run.smithi115.stdout:[mgr] 2024-05-08T21:48:51.904 INFO:teuthology.orchestra.run.smithi115.stdout: debug ms = 1 2024-05-08T21:48:51.904 INFO:teuthology.orchestra.run.smithi115.stdout: debug mgr = 20 2024-05-08T21:48:51.904 INFO:teuthology.orchestra.run.smithi115.stdout: debug mon = 20 2024-05-08T21:48:51.904 INFO:teuthology.orchestra.run.smithi115.stdout: debug auth = 20 2024-05-08T21:48:51.904 INFO:teuthology.orchestra.run.smithi115.stdout: mon reweight min pgs per osd = 4 2024-05-08T21:48:51.904 INFO:teuthology.orchestra.run.smithi115.stdout: mon reweight min bytes per osd = 10 2024-05-08T21:48:51.904 INFO:teuthology.orchestra.run.smithi115.stdout: mgr/telemetry/nag = false 2024-05-08T21:48:51.904 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-08T21:48:51.904 INFO:teuthology.orchestra.run.smithi115.stdout:[mon] 2024-05-08T21:48:51.904 INFO:teuthology.orchestra.run.smithi115.stdout: debug ms = 1 2024-05-08T21:48:51.904 INFO:teuthology.orchestra.run.smithi115.stdout: debug mon = 20 2024-05-08T21:48:51.904 INFO:teuthology.orchestra.run.smithi115.stdout: debug paxos = 20 2024-05-08T21:48:51.905 INFO:teuthology.orchestra.run.smithi115.stdout: debug auth = 20 2024-05-08T21:48:51.905 INFO:teuthology.orchestra.run.smithi115.stdout: mon data avail warn = 5 2024-05-08T21:48:51.905 INFO:teuthology.orchestra.run.smithi115.stdout: mon mgr mkfs grace = 240 2024-05-08T21:48:51.905 INFO:teuthology.orchestra.run.smithi115.stdout: mon reweight min pgs per osd = 4 2024-05-08T21:48:51.905 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd reporter subtree level = osd 2024-05-08T21:48:51.905 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd prime pg temp = true 2024-05-08T21:48:51.905 INFO:teuthology.orchestra.run.smithi115.stdout: mon reweight min bytes per osd = 10 2024-05-08T21:48:51.905 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-08T21:48:51.905 INFO:teuthology.orchestra.run.smithi115.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-08T21:48:51.905 INFO:teuthology.orchestra.run.smithi115.stdout: auth mon ticket ttl = 660 # 11m 2024-05-08T21:48:51.905 INFO:teuthology.orchestra.run.smithi115.stdout: auth service ticket ttl = 240 # 4m 2024-05-08T21:48:51.905 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-08T21:48:51.905 INFO:teuthology.orchestra.run.smithi115.stdout: # don't complain about insecure global_id in the test suite 2024-05-08T21:48:51.905 INFO:teuthology.orchestra.run.smithi115.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-08T21:48:51.905 INFO:teuthology.orchestra.run.smithi115.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-08T21:48:51.906 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-08T21:48:51.906 INFO:teuthology.orchestra.run.smithi115.stdout: # 1m isn't quite enough 2024-05-08T21:48:51.906 INFO:teuthology.orchestra.run.smithi115.stdout: mon_down_mkfs_grace = 2m 2024-05-08T21:48:51.906 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-08T21:48:51.906 INFO:teuthology.orchestra.run.smithi115.stdout: mon_warn_on_filestore_osds = false 2024-05-08T21:48:51.906 INFO:teuthology.orchestra.run.smithi115.stdout: mon op complaint time = 120 2024-05-08T21:48:51.906 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-08T21:48:51.906 INFO:teuthology.orchestra.run.smithi115.stdout:[client] 2024-05-08T21:48:51.906 INFO:teuthology.orchestra.run.smithi115.stdout: rgw cache enabled = true 2024-05-08T21:48:51.906 INFO:teuthology.orchestra.run.smithi115.stdout: rgw enable ops log = true 2024-05-08T21:48:51.906 INFO:teuthology.orchestra.run.smithi115.stdout: rgw enable usage log = true 2024-05-08T21:48:51.906 INFO:teuthology.orchestra.run.smithi115.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-08T21:48:51.906 INFO:teuthology.orchestra.run.smithi115.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-08T21:48:51.907 INFO:teuthology.orchestra.run.smithi115.stdout: client mount timeout = 600 2024-05-08T21:48:51.907 INFO:teuthology.orchestra.run.smithi115.stdout: client_shutdown_timeout = 120 2024-05-08T21:48:51.907 INFO:teuthology.orchestra.run.smithi115.stdout: debug client = 20 2024-05-08T21:48:51.907 INFO:teuthology.orchestra.run.smithi115.stdout: debug ms = 1 2024-05-08T21:48:51.907 INFO:teuthology.orchestra.run.smithi115.stdout: rados mon op timeout = 900 2024-05-08T21:48:51.907 INFO:teuthology.orchestra.run.smithi115.stdout: rados osd op timeout = 900 2024-05-08T21:48:51.907 INFO:teuthology.orchestra.run.smithi115.stdout:[mon.a] 2024-05-08T21:48:51.907 INFO:teuthology.orchestra.run.smithi115.stdout:[mon.b] 2024-05-08T21:48:51.907 INFO:teuthology.orchestra.run.smithi115.stdout:[mon.c] 2024-05-08T21:48:51.907 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.a] 2024-05-08T21:48:51.907 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.c] 2024-05-08T21:48:51.907 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.e] 2024-05-08T21:48:51.907 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.b] 2024-05-08T21:48:51.907 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.d] 2024-05-08T21:48:51.907 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.f] 2024-05-08T21:48:51.907 INFO:teuthology.orchestra.run.smithi115.stdout:[mds] 2024-05-08T21:48:51.908 INFO:teuthology.orchestra.run.smithi115.stdout: debug mds = 20 2024-05-08T21:48:51.908 INFO:teuthology.orchestra.run.smithi115.stdout: debug mds balancer = 20 2024-05-08T21:48:51.908 INFO:teuthology.orchestra.run.smithi115.stdout: debug ms = 1 2024-05-08T21:48:51.908 INFO:teuthology.orchestra.run.smithi115.stdout: mds bal fragment size max = 10000 2024-05-08T21:48:51.908 INFO:teuthology.orchestra.run.smithi115.stdout: mds bal merge size = 5 2024-05-08T21:48:51.908 INFO:teuthology.orchestra.run.smithi115.stdout: mds bal split bits = 3 2024-05-08T21:48:51.908 INFO:teuthology.orchestra.run.smithi115.stdout: mds bal split size = 100 2024-05-08T21:48:51.908 INFO:teuthology.orchestra.run.smithi115.stdout: mds debug frag = True 2024-05-08T21:48:51.908 INFO:teuthology.orchestra.run.smithi115.stdout: mds debug scatterstat = True 2024-05-08T21:48:51.908 INFO:teuthology.orchestra.run.smithi115.stdout: mds oft prefetch dirfrags = False 2024-05-08T21:48:51.908 INFO:teuthology.orchestra.run.smithi115.stdout: mds op complaint time = 180 2024-05-08T21:48:51.908 INFO:teuthology.orchestra.run.smithi115.stdout: mds verify scatter = True 2024-05-08T21:48:51.908 INFO:teuthology.orchestra.run.smithi115.stdout: mds_dir_prefetch = True 2024-05-08T21:48:51.908 INFO:teuthology.orchestra.run.smithi115.stdout: mds_sleep_rank_change = 5000000.0 2024-05-08T21:48:51.908 INFO:teuthology.orchestra.run.smithi115.stdout: osd op complaint time = 180 2024-05-08T21:48:51.909 INFO:teuthology.orchestra.run.smithi115.stdout: rados mon op timeout = 900 2024-05-08T21:48:51.909 INFO:teuthology.orchestra.run.smithi115.stdout: rados osd op timeout = 900 2024-05-08T21:48:51.910 INFO:tasks.ceph:Creating admin key on mon.a... 2024-05-08T21:48:51.910 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-05-08T21:48:52.007 INFO:tasks.ceph:Copying monmap to all nodes... 2024-05-08T21:48:52.007 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-05-08T21:48:52.007 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-05-08T21:48:52.023 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-05-08T21:48:52.024 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-05-08T21:48:52.080 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi073.front.sepia.ceph.com 2024-05-08T21:48:52.080 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-05-08T21:48:52.080 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-08T21:48:52.080 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-08T21:48:52.156 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-05-08T21:48:52.156 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-08T21:48:52.213 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi115.front.sepia.ceph.com 2024-05-08T21:48:52.214 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-08T21:48:52.214 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-08T21:48:52.214 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-08T21:48:52.255 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-08T21:48:52.255 DEBUG:teuthology.orchestra.run.smithi115:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-08T21:48:52.314 INFO:tasks.ceph:Setting up mon nodes... 2024-05-08T21:48:52.314 INFO:tasks.ceph:Setting up mgr nodes... 2024-05-08T21:48:52.314 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-05-08T21:48:52.368 INFO:teuthology.orchestra.run.smithi073.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-05-08T21:48:52.371 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-05-08T21:48:52.456 INFO:teuthology.orchestra.run.smithi115.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-05-08T21:48:52.459 INFO:tasks.ceph:Setting up mds nodes... 2024-05-08T21:48:52.459 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-05-08T21:48:52.513 INFO:teuthology.orchestra.run.smithi073.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-05-08T21:48:52.516 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-05-08T21:48:52.542 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-05-08T21:48:52.636 INFO:teuthology.orchestra.run.smithi073.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-05-08T21:48:52.639 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-05-08T21:48:52.665 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-05-08T21:48:52.759 INFO:teuthology.orchestra.run.smithi073.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-05-08T21:48:52.762 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-05-08T21:48:52.788 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-05-08T21:48:52.849 INFO:teuthology.orchestra.run.smithi115.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-05-08T21:48:52.852 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-05-08T21:48:52.879 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-05-08T21:48:52.976 INFO:teuthology.orchestra.run.smithi115.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-05-08T21:48:52.979 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-05-08T21:48:53.006 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-05-08T21:48:53.099 INFO:teuthology.orchestra.run.smithi115.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-05-08T21:48:53.102 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-05-08T21:48:53.128 INFO:tasks.ceph_client:Setting up client nodes... 2024-05-08T21:48:53.129 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-08T21:48:53.173 INFO:teuthology.orchestra.run.smithi073.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-05-08T21:48:53.187 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-05-08T21:48:53.187 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi073.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi115.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-08T21:48:53.187 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-05-08T21:48:53.213 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-08T21:48:53.213 INFO:tasks.ceph:role: osd.0 2024-05-08T21:48:53.213 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi073.front.sepia.ceph.com 2024-05-08T21:48:53.214 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-08T21:48:53.287 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T21:48:53.287 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T21:48:53.287 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T21:48:53.287 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-08T21:48:53.287 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T21:48:53.288 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2024-05-08T21:48:53.288 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T21:48:53.288 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-08T21:48:53.288 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T21:48:53.288 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T21:48:53.724 INFO:teuthology.orchestra.run.smithi073.stdout:Discarding blocks...Done. 2024-05-08T21:48:53.725 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2024-05-08T21:48:53.726 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-05-08T21:48:53.897 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-05-08T21:48:53.930 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-05-08T21:48:53.998 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-08T21:48:53.998 INFO:tasks.ceph:role: osd.1 2024-05-08T21:48:53.998 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi073.front.sepia.ceph.com 2024-05-08T21:48:53.998 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-08T21:48:54.071 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T21:48:54.071 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T21:48:54.072 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T21:48:54.072 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-08T21:48:54.072 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T21:48:54.072 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2024-05-08T21:48:54.072 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T21:48:54.072 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-08T21:48:54.072 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T21:48:54.072 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T21:48:54.502 INFO:teuthology.orchestra.run.smithi073.stdout:Discarding blocks...Done. 2024-05-08T21:48:54.504 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2024-05-08T21:48:54.504 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-05-08T21:48:54.616 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-05-08T21:48:54.647 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-05-08T21:48:54.713 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-08T21:48:54.713 INFO:tasks.ceph:role: osd.2 2024-05-08T21:48:54.714 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi073.front.sepia.ceph.com 2024-05-08T21:48:54.714 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-08T21:48:54.788 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T21:48:54.788 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T21:48:54.788 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T21:48:54.788 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-08T21:48:54.788 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T21:48:54.788 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2024-05-08T21:48:54.788 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T21:48:54.788 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-08T21:48:54.789 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T21:48:54.789 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T21:48:55.238 INFO:teuthology.orchestra.run.smithi073.stdout:Discarding blocks...Done. 2024-05-08T21:48:55.239 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2024-05-08T21:48:55.240 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-05-08T21:48:55.420 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-05-08T21:48:55.451 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-05-08T21:48:55.517 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-08T21:48:55.518 INFO:tasks.ceph:role: osd.3 2024-05-08T21:48:55.518 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi073.front.sepia.ceph.com 2024-05-08T21:48:55.518 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-08T21:48:55.592 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T21:48:55.592 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T21:48:55.592 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T21:48:55.592 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-08T21:48:55.592 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T21:48:55.593 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2024-05-08T21:48:55.593 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T21:48:55.593 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-08T21:48:55.593 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T21:48:55.593 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T21:48:56.035 INFO:teuthology.orchestra.run.smithi073.stdout:Discarding blocks...Done. 2024-05-08T21:48:56.037 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2024-05-08T21:48:56.037 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-05-08T21:48:56.201 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-05-08T21:48:56.232 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T21:48:56.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:48:56.319+0000 7fdf7f8997c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-05-08T21:48:56.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:48:56.319+0000 7fdf7f8997c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-05-08T21:48:56.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:48:56.319+0000 7fdf7f8997c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-08T21:48:56.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:48:56.319+0000 7fdf7f8997c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-08T21:48:56.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:48:56.319+0000 7fdf7f8997c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-08T21:48:56.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:48:56.320+0000 7fdf7f8997c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-05-08T21:48:59.179 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-08T21:48:59.214 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T21:48:59.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:48:59.310+0000 7fc42b79d7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-05-08T21:48:59.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:48:59.310+0000 7fc42b79d7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-05-08T21:48:59.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:48:59.310+0000 7fc42b79d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-08T21:48:59.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:48:59.310+0000 7fc42b79d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-08T21:48:59.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:48:59.310+0000 7fc42b79d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-08T21:48:59.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:48:59.311+0000 7fc42b79d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-05-08T21:49:02.160 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-08T21:49:02.190 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T21:49:02.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:02.280+0000 7fd6e14387c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-05-08T21:49:02.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:02.281+0000 7fd6e14387c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-05-08T21:49:02.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:02.281+0000 7fd6e14387c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-08T21:49:02.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:02.281+0000 7fd6e14387c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-08T21:49:02.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:02.281+0000 7fd6e14387c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-08T21:49:02.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:02.281+0000 7fd6e14387c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-05-08T21:49:05.132 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-08T21:49:05.165 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T21:49:05.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:05.259+0000 7f272ebdc7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-05-08T21:49:05.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:05.260+0000 7f272ebdc7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-05-08T21:49:05.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:05.260+0000 7f272ebdc7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-08T21:49:05.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:05.260+0000 7f272ebdc7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-08T21:49:05.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:05.260+0000 7f272ebdc7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-08T21:49:05.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:05.260+0000 7f272ebdc7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-05-08T21:49:08.109 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-08T21:49:08.142 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-05-08T21:49:08.175 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-08T21:49:08.175 INFO:tasks.ceph:role: osd.4 2024-05-08T21:49:08.175 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi115.front.sepia.ceph.com 2024-05-08T21:49:08.175 DEBUG:teuthology.orchestra.run.smithi115:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-08T21:49:08.254 INFO:teuthology.orchestra.run.smithi115.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T21:49:08.254 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T21:49:08.254 INFO:teuthology.orchestra.run.smithi115.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T21:49:08.254 INFO:teuthology.orchestra.run.smithi115.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-08T21:49:08.254 INFO:teuthology.orchestra.run.smithi115.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T21:49:08.254 INFO:teuthology.orchestra.run.smithi115.stdout: = sunit=0 swidth=0 blks 2024-05-08T21:49:08.254 INFO:teuthology.orchestra.run.smithi115.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T21:49:08.255 INFO:teuthology.orchestra.run.smithi115.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-08T21:49:08.255 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T21:49:08.255 INFO:teuthology.orchestra.run.smithi115.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T21:49:08.690 INFO:teuthology.orchestra.run.smithi115.stdout:Discarding blocks...Done. 2024-05-08T21:49:08.692 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi115.front.sepia.ceph.com -o noatime 2024-05-08T21:49:08.692 DEBUG:teuthology.orchestra.run.smithi115:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-05-08T21:49:08.880 DEBUG:teuthology.orchestra.run.smithi115:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-05-08T21:49:08.919 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-05-08T21:49:08.991 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-08T21:49:08.991 INFO:tasks.ceph:role: osd.5 2024-05-08T21:49:08.991 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi115.front.sepia.ceph.com 2024-05-08T21:49:08.991 DEBUG:teuthology.orchestra.run.smithi115:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-08T21:49:09.068 INFO:teuthology.orchestra.run.smithi115.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T21:49:09.069 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T21:49:09.069 INFO:teuthology.orchestra.run.smithi115.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T21:49:09.069 INFO:teuthology.orchestra.run.smithi115.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-08T21:49:09.069 INFO:teuthology.orchestra.run.smithi115.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T21:49:09.069 INFO:teuthology.orchestra.run.smithi115.stdout: = sunit=0 swidth=0 blks 2024-05-08T21:49:09.069 INFO:teuthology.orchestra.run.smithi115.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T21:49:09.069 INFO:teuthology.orchestra.run.smithi115.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-08T21:49:09.069 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T21:49:09.069 INFO:teuthology.orchestra.run.smithi115.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T21:49:09.488 INFO:teuthology.orchestra.run.smithi115.stdout:Discarding blocks...Done. 2024-05-08T21:49:09.490 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi115.front.sepia.ceph.com -o noatime 2024-05-08T21:49:09.490 DEBUG:teuthology.orchestra.run.smithi115:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-05-08T21:49:09.605 DEBUG:teuthology.orchestra.run.smithi115:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-05-08T21:49:09.639 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-05-08T21:49:09.709 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-08T21:49:09.709 INFO:tasks.ceph:role: osd.6 2024-05-08T21:49:09.709 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi115.front.sepia.ceph.com 2024-05-08T21:49:09.709 DEBUG:teuthology.orchestra.run.smithi115:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-08T21:49:09.785 INFO:teuthology.orchestra.run.smithi115.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T21:49:09.785 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T21:49:09.785 INFO:teuthology.orchestra.run.smithi115.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T21:49:09.785 INFO:teuthology.orchestra.run.smithi115.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-08T21:49:09.785 INFO:teuthology.orchestra.run.smithi115.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T21:49:09.785 INFO:teuthology.orchestra.run.smithi115.stdout: = sunit=0 swidth=0 blks 2024-05-08T21:49:09.785 INFO:teuthology.orchestra.run.smithi115.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T21:49:09.785 INFO:teuthology.orchestra.run.smithi115.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-08T21:49:09.785 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T21:49:09.785 INFO:teuthology.orchestra.run.smithi115.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T21:49:10.234 INFO:teuthology.orchestra.run.smithi115.stdout:Discarding blocks...Done. 2024-05-08T21:49:10.236 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi115.front.sepia.ceph.com -o noatime 2024-05-08T21:49:10.237 DEBUG:teuthology.orchestra.run.smithi115:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-05-08T21:49:10.413 DEBUG:teuthology.orchestra.run.smithi115:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-05-08T21:49:10.448 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-05-08T21:49:10.517 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-08T21:49:10.517 INFO:tasks.ceph:role: osd.7 2024-05-08T21:49:10.517 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi115.front.sepia.ceph.com 2024-05-08T21:49:10.518 DEBUG:teuthology.orchestra.run.smithi115:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-08T21:49:10.592 INFO:teuthology.orchestra.run.smithi115.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T21:49:10.592 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T21:49:10.592 INFO:teuthology.orchestra.run.smithi115.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T21:49:10.592 INFO:teuthology.orchestra.run.smithi115.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-08T21:49:10.592 INFO:teuthology.orchestra.run.smithi115.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T21:49:10.592 INFO:teuthology.orchestra.run.smithi115.stdout: = sunit=0 swidth=0 blks 2024-05-08T21:49:10.592 INFO:teuthology.orchestra.run.smithi115.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T21:49:10.592 INFO:teuthology.orchestra.run.smithi115.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-08T21:49:10.593 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T21:49:10.593 INFO:teuthology.orchestra.run.smithi115.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T21:49:11.032 INFO:teuthology.orchestra.run.smithi115.stdout:Discarding blocks...Done. 2024-05-08T21:49:11.034 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi115.front.sepia.ceph.com -o noatime 2024-05-08T21:49:11.034 DEBUG:teuthology.orchestra.run.smithi115:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-05-08T21:49:11.222 DEBUG:teuthology.orchestra.run.smithi115:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-05-08T21:49:11.255 DEBUG:teuthology.orchestra.run.smithi115:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T21:49:11.345 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:11.343+0000 7ff765c357c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-05-08T21:49:11.345 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:11.344+0000 7ff765c357c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-05-08T21:49:11.345 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:11.344+0000 7ff765c357c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-08T21:49:11.346 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:11.344+0000 7ff765c357c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-08T21:49:11.346 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:11.344+0000 7ff765c357c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-08T21:49:11.346 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:11.344+0000 7ff765c357c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-05-08T21:49:14.202 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-08T21:49:14.234 DEBUG:teuthology.orchestra.run.smithi115:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T21:49:14.327 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:14.326+0000 7fd58447e7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-05-08T21:49:14.327 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:14.326+0000 7fd58447e7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-05-08T21:49:14.327 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:14.326+0000 7fd58447e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-08T21:49:14.327 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:14.326+0000 7fd58447e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-08T21:49:14.328 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:14.326+0000 7fd58447e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-08T21:49:14.328 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:14.327+0000 7fd58447e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-05-08T21:49:17.174 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-08T21:49:17.207 DEBUG:teuthology.orchestra.run.smithi115:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T21:49:17.301 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:17.299+0000 7f3bfb92d7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-05-08T21:49:17.301 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:17.299+0000 7f3bfb92d7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-05-08T21:49:17.301 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:17.300+0000 7f3bfb92d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-08T21:49:17.301 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:17.300+0000 7f3bfb92d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-08T21:49:17.301 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:17.300+0000 7f3bfb92d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-08T21:49:17.301 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:17.300+0000 7f3bfb92d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-05-08T21:49:19.836 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:49:19.839 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:49:20.149 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-05-08T21:49:20.177 DEBUG:teuthology.orchestra.run.smithi115:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T21:49:20.265 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:20.264+0000 7fbce620d7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-05-08T21:49:20.266 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:20.264+0000 7fbce620d7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-05-08T21:49:20.266 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:20.264+0000 7fbce620d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-08T21:49:20.266 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:20.264+0000 7fbce620d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-08T21:49:20.266 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:20.264+0000 7fbce620d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-08T21:49:20.266 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:20.265+0000 7fbce620d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-05-08T21:49:23.117 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-05-08T21:49:23.149 INFO:tasks.ceph:Reading keys from all nodes... 2024-05-08T21:49:23.149 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-05-08T21:49:23.149 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-05-08T21:49:23.185 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-05-08T21:49:23.185 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-05-08T21:49:23.257 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-05-08T21:49:23.257 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-05-08T21:49:23.330 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-05-08T21:49:23.330 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-05-08T21:49:23.403 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-05-08T21:49:23.404 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-05-08T21:49:23.476 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-05-08T21:49:23.476 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-05-08T21:49:23.549 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-05-08T21:49:23.549 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-05-08T21:49:23.622 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-05-08T21:49:23.622 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-05-08T21:49:23.695 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-08T21:49:23.695 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-05-08T21:49:23.727 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-08T21:49:23.728 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-05-08T21:49:23.800 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-08T21:49:23.800 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-05-08T21:49:23.871 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-08T21:49:23.871 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-05-08T21:49:23.943 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-08T21:49:23.943 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-05-08T21:49:24.013 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-08T21:49:24.013 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-05-08T21:49:24.083 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-08T21:49:24.083 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-05-08T21:49:24.151 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-08T21:49:24.151 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-05-08T21:49:24.221 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-05-08T21:49:24.221 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-05-08T21:49:24.242 INFO:tasks.ceph:Adding keys to all mons... 2024-05-08T21:49:24.242 DEBUG:teuthology.orchestra.run.smithi073:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-08T21:49:24.284 DEBUG:teuthology.orchestra.run.smithi115:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-08T21:49:24.311 INFO:teuthology.orchestra.run.smithi115.stdout:[mgr.y] 2024-05-08T21:49:24.311 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQBE8ztm0KH8FRAAruV7+jZ7N8CM+HcK7D4TmA== 2024-05-08T21:49:24.311 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.a] 2024-05-08T21:49:24.311 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQBE8ztmQXGlHhAAI1by1goHddjoq0MOiXRzaA== 2024-05-08T21:49:24.311 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.c] 2024-05-08T21:49:24.311 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQBE8ztms5P4JRAAWcERw9tbDpv2CaZjX3xzKg== 2024-05-08T21:49:24.311 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.e] 2024-05-08T21:49:24.311 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQBE8ztmew9PLRAAHPkG39lB2E+ML7mPwcZswQ== 2024-05-08T21:49:24.311 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.0] 2024-05-08T21:49:24.311 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQBI8ztmbbYaExAAQohk5OZRPkV/m1sVCUgncQ== 2024-05-08T21:49:24.311 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.1] 2024-05-08T21:49:24.312 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQBL8ztmjrqGEhAA8NLIFGbOq1Yu7PcgboGx2Q== 2024-05-08T21:49:24.312 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.2] 2024-05-08T21:49:24.312 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQBO8ztmaF7BEBAArFdfjDnn9PGFId0tC4enRg== 2024-05-08T21:49:24.312 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.3] 2024-05-08T21:49:24.312 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQBR8ztmC6WCDxAA4c8WPOM50AcI7hulN6+xuQ== 2024-05-08T21:49:24.312 INFO:teuthology.orchestra.run.smithi115.stdout:[mgr.x] 2024-05-08T21:49:24.312 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQBE8ztmQ9A2GxAA4Bc/GbdWSBIH+kfr4KapmA== 2024-05-08T21:49:24.312 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.b] 2024-05-08T21:49:24.312 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQBE8ztm5/+oMhAAimNKpaTVihYRB3vSMunhtA== 2024-05-08T21:49:24.312 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.d] 2024-05-08T21:49:24.312 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQBE8ztmvNg+OhAAdRtThfhfSKiHduLxG/aL0Q== 2024-05-08T21:49:24.312 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.f] 2024-05-08T21:49:24.312 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQBF8ztmca76BRAAhNdJzw1L8jN3FCW9t0558Q== 2024-05-08T21:49:24.312 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.4] 2024-05-08T21:49:24.312 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQBX8ztmLVCTFBAA+hLxZvzrT6ROo0jqClSLtg== 2024-05-08T21:49:24.313 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.5] 2024-05-08T21:49:24.313 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQBa8ztm+b6JExAA3qeMelLt3sYw2iKJA8Xo0Q== 2024-05-08T21:49:24.313 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.6] 2024-05-08T21:49:24.313 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQBd8ztm12vxERAAo9QGfa4U6KCJI5CgdVr2CA== 2024-05-08T21:49:24.313 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.7] 2024-05-08T21:49:24.313 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQBg8ztmgk7ZDxAA34hXCZ9dmqWMCs0YMOntaA== 2024-05-08T21:49:24.313 INFO:teuthology.orchestra.run.smithi115.stdout:[client.0] 2024-05-08T21:49:24.313 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQBF8ztm0/NhChAAtF0pa9VLyoL4kYmnjaWPYQ== 2024-05-08T21:49:24.315 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr.y] 2024-05-08T21:49:24.315 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBE8ztm0KH8FRAAruV7+jZ7N8CM+HcK7D4TmA== 2024-05-08T21:49:24.315 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.a] 2024-05-08T21:49:24.315 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBE8ztmQXGlHhAAI1by1goHddjoq0MOiXRzaA== 2024-05-08T21:49:24.315 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.c] 2024-05-08T21:49:24.315 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBE8ztms5P4JRAAWcERw9tbDpv2CaZjX3xzKg== 2024-05-08T21:49:24.315 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.e] 2024-05-08T21:49:24.315 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBE8ztmew9PLRAAHPkG39lB2E+ML7mPwcZswQ== 2024-05-08T21:49:24.315 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.0] 2024-05-08T21:49:24.315 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBI8ztmbbYaExAAQohk5OZRPkV/m1sVCUgncQ== 2024-05-08T21:49:24.315 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.1] 2024-05-08T21:49:24.316 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBL8ztmjrqGEhAA8NLIFGbOq1Yu7PcgboGx2Q== 2024-05-08T21:49:24.316 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.2] 2024-05-08T21:49:24.316 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBO8ztmaF7BEBAArFdfjDnn9PGFId0tC4enRg== 2024-05-08T21:49:24.316 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.3] 2024-05-08T21:49:24.316 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBR8ztmC6WCDxAA4c8WPOM50AcI7hulN6+xuQ== 2024-05-08T21:49:24.316 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr.x] 2024-05-08T21:49:24.316 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBE8ztmQ9A2GxAA4Bc/GbdWSBIH+kfr4KapmA== 2024-05-08T21:49:24.316 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.b] 2024-05-08T21:49:24.316 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBE8ztm5/+oMhAAimNKpaTVihYRB3vSMunhtA== 2024-05-08T21:49:24.316 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.d] 2024-05-08T21:49:24.316 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBE8ztmvNg+OhAAdRtThfhfSKiHduLxG/aL0Q== 2024-05-08T21:49:24.316 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.f] 2024-05-08T21:49:24.316 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBF8ztmca76BRAAhNdJzw1L8jN3FCW9t0558Q== 2024-05-08T21:49:24.316 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.4] 2024-05-08T21:49:24.317 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBX8ztmLVCTFBAA+hLxZvzrT6ROo0jqClSLtg== 2024-05-08T21:49:24.317 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.5] 2024-05-08T21:49:24.317 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBa8ztm+b6JExAA3qeMelLt3sYw2iKJA8Xo0Q== 2024-05-08T21:49:24.317 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.6] 2024-05-08T21:49:24.317 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBd8ztm12vxERAAo9QGfa4U6KCJI5CgdVr2CA== 2024-05-08T21:49:24.317 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.7] 2024-05-08T21:49:24.317 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBg8ztmgk7ZDxAA34hXCZ9dmqWMCs0YMOntaA== 2024-05-08T21:49:24.317 INFO:teuthology.orchestra.run.smithi073.stdout:[client.0] 2024-05-08T21:49:24.317 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBF8ztm0/NhChAAtF0pa9VLyoL4kYmnjaWPYQ== 2024-05-08T21:49:24.317 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-08T21:49:24.358 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-08T21:49:24.416 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T21:49:24.418 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T21:49:24.475 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T21:49:24.477 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T21:49:24.534 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T21:49:24.536 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T21:49:24.593 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T21:49:24.595 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T21:49:24.648 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T21:49:24.650 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T21:49:24.703 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T21:49:24.705 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T21:49:24.758 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T21:49:24.761 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T21:49:24.815 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-08T21:49:24.817 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-08T21:49:24.872 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T21:49:24.875 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T21:49:24.931 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T21:49:24.933 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T21:49:24.990 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T21:49:24.992 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T21:49:25.048 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T21:49:25.050 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T21:49:25.103 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T21:49:25.105 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T21:49:25.159 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T21:49:25.161 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T21:49:25.214 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T21:49:25.216 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T21:49:25.269 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-08T21:49:25.272 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-08T21:49:25.328 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-05-08T21:49:25.329 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-05-08T21:49:25.356 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-08T21:49:25.454 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-05-08T21:49:25.481 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-05-08T21:49:25.508 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-08T21:49:25.608 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-05-08T21:49:25.635 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-05-08T21:49:25.702 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-08T21:49:25.800 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-05-08T21:49:25.827 DEBUG:teuthology.orchestra.run.smithi073:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-08T21:49:25.829 DEBUG:teuthology.orchestra.run.smithi115:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-08T21:49:25.883 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-05-08T21:49:25.884 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-08T21:49:25.884 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-05-08T21:49:25.887 INFO:tasks.ceph.mon.a:Started 2024-05-08T21:49:25.887 INFO:tasks.ceph.mon.b:Restarting daemon 2024-05-08T21:49:25.887 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-05-08T21:49:25.926 INFO:tasks.ceph.mon.b:Started 2024-05-08T21:49:25.926 INFO:tasks.ceph.mon.c:Restarting daemon 2024-05-08T21:49:25.926 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-05-08T21:49:25.928 INFO:tasks.ceph.mon.c:Started 2024-05-08T21:49:25.928 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-05-08T21:49:25.928 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-05-08T21:49:25.928 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-05-08T21:49:25.931 INFO:tasks.ceph.mgr.y:Started 2024-05-08T21:49:25.931 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-05-08T21:49:25.931 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-05-08T21:49:25.933 INFO:tasks.ceph.mgr.x:Started 2024-05-08T21:49:25.933 INFO:tasks.ceph:Setting crush tunables to default 2024-05-08T21:49:25.933 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd crush tunables default 2024-05-08T21:49:26.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.055+0000 7f3002fb1700 1 Processor -- start 2024-05-08T21:49:26.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.055+0000 7f3002fb1700 1 -- start start 2024-05-08T21:49:26.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.056+0000 7f3002fb1700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2ffc14e330 0x7f2ffc0c8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:26.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.056+0000 7f3002fb1700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2ffc14e710 0x7f2ffc1579e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:26.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.056+0000 7f3002fb1700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ffc072280 con 0x7f2ffc0729f0 2024-05-08T21:49:26.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.056+0000 7f3002fb1700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ffc0c6e20 con 0x7f2ffc14e330 2024-05-08T21:49:26.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.056+0000 7f3002fb1700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ffc072560 con 0x7f2ffc14e710 2024-05-08T21:49:26.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.056+0000 7f3000d4d700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2ffc14e330 0x7f2ffc0c8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:26.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.056+0000 7f3000d4d700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2ffc14e330 0x7f2ffc0c8ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:40408/0 (socket says 172.21.15.73:40408) 2024-05-08T21:49:26.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.056+0000 7f3000d4d700 1 -- 172.21.15.73:0/3385487514 learned_addr learned my addr 172.21.15.73:0/3385487514 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:26.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.056+0000 7f2ffbfff700 1 --2- 172.21.15.73:0/3385487514 >> v2:172.21.15.115:3300/0 conn(0x7f2ffc14e710 0x7f2ffc1579e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:26.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.057+0000 7f3000d4d700 1 -- 172.21.15.73:0/3385487514 >> v2:172.21.15.73:3300/0 conn(0x7f2ffc14e330 msgr2=0x7f2ffc0c8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T21:49:26.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.057+0000 7f3000d4d700 1 -- 172.21.15.73:0/3385487514 >> v2:172.21.15.73:3300/0 conn(0x7f2ffc14e330 msgr2=0x7f2ffc0c8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T21:49:26.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.057+0000 7f3000d4d700 1 --2- 172.21.15.73:0/3385487514 >> v2:172.21.15.73:3300/0 conn(0x7f2ffc14e330 0x7f2ffc0c8ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T21:49:26.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.057+0000 7f3000d4d700 1 --2- 172.21.15.73:0/3385487514 >> v2:172.21.15.73:3300/0 conn(0x7f2ffc14e330 0x7f2ffc0c8ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T21:49:26.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.057+0000 7f2ffbfff700 1 -- 172.21.15.73:0/3385487514 >> v2:172.21.15.115:3300/0 conn(0x7f2ffc14e710 msgr2=0x7f2ffc1579e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T21:49:26.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.057+0000 7f2ffbfff700 1 -- 172.21.15.73:0/3385487514 >> v2:172.21.15.115:3300/0 conn(0x7f2ffc14e710 msgr2=0x7f2ffc1579e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T21:49:26.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.057+0000 7f2ffbfff700 1 --2- 172.21.15.73:0/3385487514 >> v2:172.21.15.115:3300/0 conn(0x7f2ffc14e710 0x7f2ffc1579e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T21:49:26.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.057+0000 7f2ffbfff700 1 --2- 172.21.15.73:0/3385487514 >> v2:172.21.15.115:3300/0 conn(0x7f2ffc14e710 0x7f2ffc1579e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T21:49:26.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.240+0000 7f2ffb7fe700 1 -- 172.21.15.73:0/3385487514 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3850046334 0 0) 0x7f2ffc072280 con 0x7f2ffc0729f0 2024-05-08T21:49:26.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.240+0000 7f2ffb7fe700 1 -- 172.21.15.73:0/3385487514 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fe80035b0 con 0x7f2ffc0729f0 2024-05-08T21:49:26.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.245+0000 7f2ffb7fe700 1 -- 172.21.15.73:0/3385487514 <== mon.1 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2551109073 0 0) 0x7f2fe80035b0 con 0x7f2ffc0729f0 2024-05-08T21:49:26.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.245+0000 7f2ffb7fe700 1 -- 172.21.15.73:0/3385487514 >> v2:172.21.15.115:3300/0 conn(0x7f2ffc14e710 msgr2=0x7f2ffc1579e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T21:49:26.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.245+0000 7f2ffb7fe700 1 --2- 172.21.15.73:0/3385487514 >> v2:172.21.15.115:3300/0 conn(0x7f2ffc14e710 0x7f2ffc1579e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:26.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.245+0000 7f2ffb7fe700 1 -- 172.21.15.73:0/3385487514 >> v2:172.21.15.73:3300/0 conn(0x7f2ffc14e330 msgr2=0x7f2ffc0c8ae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T21:49:26.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.245+0000 7f2ffb7fe700 1 --2- 172.21.15.73:0/3385487514 >> v2:172.21.15.73:3300/0 conn(0x7f2ffc14e330 0x7f2ffc0c8ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:26.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.245+0000 7f2ffb7fe700 1 -- 172.21.15.73:0/3385487514 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ffc0c9860 con 0x7f2ffc0729f0 2024-05-08T21:49:26.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.245+0000 7f2ffb7fe700 1 -- 172.21.15.73:0/3385487514 <== mon.1 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 953298616 0 0) 0x7f2fec001670 con 0x7f2ffc0729f0 2024-05-08T21:49:26.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.245+0000 7f2ffb7fe700 1 -- 172.21.15.73:0/3385487514 >> v1:172.21.15.115:6789/0 conn(0x7f2ffc0729f0 legacy=0x7f2ffc0c5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:26.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.245+0000 7f2ffb7fe700 1 --2- 172.21.15.73:0/3385487514 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fe8003a50 0x7f2fe8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:26.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.245+0000 7f2ffb7fe700 1 --2- 172.21.15.73:0/3385487514 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2fe8004850 0x7f2fe8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:26.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.245+0000 7f2ffb7fe700 1 --2- 172.21.15.73:0/3385487514 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2fe8005260 0x7f2fe800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:26.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.245+0000 7f2ffb7fe700 1 -- 172.21.15.73:0/3385487514 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ffc0c6e20 con 0x7f2fe8005260 2024-05-08T21:49:26.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.245+0000 7f2ffb7fe700 1 -- 172.21.15.73:0/3385487514 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ffc072560 con 0x7f2fe8003a50 2024-05-08T21:49:26.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.245+0000 7f2ffb7fe700 1 -- 172.21.15.73:0/3385487514 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe800c210 con 0x7f2fe8004850 2024-05-08T21:49:26.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.245+0000 7f3000d4d700 1 --2- 172.21.15.73:0/3385487514 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fe8003a50 0x7f2fe8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:26.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.245+0000 7f300154e700 1 --2- 172.21.15.73:0/3385487514 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2fe8005260 0x7f2fe800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:26.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.245+0000 7f2ffbfff700 1 --2- 172.21.15.73:0/3385487514 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2fe8004850 0x7f2fe8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:26.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.246+0000 7f3000d4d700 1 -- 172.21.15.73:0/3385487514 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2fe8004850 msgr2=0x7f2fe8004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:26.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.246+0000 7f3000d4d700 1 --2- 172.21.15.73:0/3385487514 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2fe8004850 0x7f2fe8004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:26.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.246+0000 7f3000d4d700 1 -- 172.21.15.73:0/3385487514 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2fe8005260 msgr2=0x7f2fe800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:26.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.246+0000 7f3000d4d700 1 --2- 172.21.15.73:0/3385487514 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2fe8005260 0x7f2fe800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:26.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.246+0000 7f300154e700 1 -- 172.21.15.73:0/3385487514 reap_dead start 2024-05-08T21:49:26.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.246+0000 7f3000d4d700 1 -- 172.21.15.73:0/3385487514 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fe80035b0 con 0x7f2fe8003a50 2024-05-08T21:49:26.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.246+0000 7f2ffbfff700 1 --2- 172.21.15.73:0/3385487514 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2fe8004850 0x7f2fe8004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:49:26.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.246+0000 7f3000d4d700 1 --2- 172.21.15.73:0/3385487514 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fe8003a50 0x7f2fe8003e70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2ff4009cc0 tx=0x7f2fe8005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e57bba51261f0bf1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:26.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.247+0000 7f2ffb7fe700 1 -- 172.21.15.73:0/3385487514 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff4017070 con 0x7f2fe8003a50 2024-05-08T21:49:26.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.247+0000 7f2ffb7fe700 1 -- 172.21.15.73:0/3385487514 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ff400f040 con 0x7f2fe8003a50 2024-05-08T21:49:26.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.247+0000 7f2ffb7fe700 1 -- 172.21.15.73:0/3385487514 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff4003c60 con 0x7f2fe8003a50 2024-05-08T21:49:26.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.248+0000 7f3002fb1700 1 -- 172.21.15.73:0/3385487514 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fe8003a50 msgr2=0x7f2fe8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:26.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.248+0000 7f3002fb1700 1 --2- 172.21.15.73:0/3385487514 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fe8003a50 0x7f2fe8003e70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2ff4009cc0 tx=0x7f2fe8005880 comp rx=0 tx=0).stop 2024-05-08T21:49:26.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.248+0000 7f3002fb1700 1 -- 172.21.15.73:0/3385487514 shutdown_connections 2024-05-08T21:49:26.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.248+0000 7f3002fb1700 1 --2- 172.21.15.73:0/3385487514 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fe8003a50 0x7f2fe8003e70 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:26.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.248+0000 7f3002fb1700 1 -- 172.21.15.73:0/3385487514 >> 172.21.15.73:0/3385487514 conn(0x7f2ffc066ab0 msgr2=0x7f2ffc06f550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:26.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.248+0000 7f3002fb1700 1 -- 172.21.15.73:0/3385487514 shutdown_connections 2024-05-08T21:49:26.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.248+0000 7f3002fb1700 1 -- 172.21.15.73:0/3385487514 wait complete. 2024-05-08T21:49:26.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.249+0000 7f3002fb1700 1 Processor -- start 2024-05-08T21:49:26.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.249+0000 7f3002fb1700 1 -- start start 2024-05-08T21:49:26.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.250+0000 7f3002fb1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2fe8003a50 0x7f2ffc145010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:26.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.250+0000 7f3002fb1700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ffc1595b0 0x7f2ffc15ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:26.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.250+0000 7f3002fb1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2ffc155630 0x7f2ffc15b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:26.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.250+0000 7f3002fb1700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ffc156eb0 con 0x7f2fe8003a50 2024-05-08T21:49:26.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.250+0000 7f3002fb1700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ffc147570 con 0x7f2ffc1595b0 2024-05-08T21:49:26.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.250+0000 7f3002fb1700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ffc1ef2c0 con 0x7f2ffc155630 2024-05-08T21:49:26.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.250+0000 7f3000d4d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2fe8003a50 0x7f2ffc145010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:26.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.250+0000 7f3000d4d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2fe8003a50 0x7f2ffc145010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:40462/0 (socket says 172.21.15.73:40462) 2024-05-08T21:49:26.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.250+0000 7f3000d4d700 1 -- 172.21.15.73:0/3154980405 learned_addr learned my addr 172.21.15.73:0/3154980405 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:26.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.250+0000 7f300154e700 1 --2- 172.21.15.73:0/3154980405 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2ffc155630 0x7f2ffc15b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:26.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.250+0000 7f2ffbfff700 1 --2- 172.21.15.73:0/3154980405 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ffc1595b0 0x7f2ffc15ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:26.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.250+0000 7f3000d4d700 1 -- 172.21.15.73:0/3154980405 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2ffc155630 msgr2=0x7f2ffc15b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:26.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.250+0000 7f3000d4d700 1 --2- 172.21.15.73:0/3154980405 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2ffc155630 0x7f2ffc15b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:26.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.250+0000 7f3000d4d700 1 -- 172.21.15.73:0/3154980405 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ffc1595b0 msgr2=0x7f2ffc15ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:26.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.250+0000 7f3000d4d700 1 --2- 172.21.15.73:0/3154980405 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ffc1595b0 0x7f2ffc15ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:26.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.250+0000 7f3000d4d700 1 -- 172.21.15.73:0/3154980405 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ffc148570 con 0x7f2fe8003a50 2024-05-08T21:49:26.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.250+0000 7f3000d4d700 1 --2- 172.21.15.73:0/3154980405 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2fe8003a50 0x7f2ffc145010 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2fe800c1e0 tx=0x7f2ff4004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:26.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.250+0000 7f2ff97fa700 1 -- 172.21.15.73:0/3154980405 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff4017040 con 0x7f2fe8003a50 2024-05-08T21:49:26.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.251+0000 7f2ff97fa700 1 -- 172.21.15.73:0/3154980405 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ff4004450 con 0x7f2fe8003a50 2024-05-08T21:49:26.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.251+0000 7f3002fb1700 1 -- 172.21.15.73:0/3154980405 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ffc147810 con 0x7f2fe8003a50 2024-05-08T21:49:26.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.251+0000 7f2ff97fa700 1 -- 172.21.15.73:0/3154980405 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff4007000 con 0x7f2fe8003a50 2024-05-08T21:49:26.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.251+0000 7f3002fb1700 1 -- 172.21.15.73:0/3154980405 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ffc145550 con 0x7f2fe8003a50 2024-05-08T21:49:26.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.251+0000 7f2ff97fa700 1 -- 172.21.15.73:0/3154980405 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f2ff4004800 con 0x7f2fe8003a50 2024-05-08T21:49:26.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.251+0000 7f2ff97fa700 1 -- 172.21.15.73:0/3154980405 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f2ff401d450 con 0x7f2fe8003a50 2024-05-08T21:49:26.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.251+0000 7f3002fb1700 1 -- 172.21.15.73:0/3154980405 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ffc147d30 con 0x7f2fe8003a50 2024-05-08T21:49:26.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.254+0000 7f2ff97fa700 1 -- 172.21.15.73:0/3154980405 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f2ff402d060 con 0x7f2fe8003a50 2024-05-08T21:49:26.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.334+0000 7f3002fb1700 1 -- 172.21.15.73:0/3154980405 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f2ffc1ef4e0 con 0x7f2fe8003a50 2024-05-08T21:49:26.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.336+0000 7f2ff97fa700 1 -- 172.21.15.73:0/3154980405 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f2ffc1ef4e0 con 0x7f2fe8003a50 2024-05-08T21:49:26.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.337+0000 7f3002fb1700 1 -- 172.21.15.73:0/3154980405 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2fe8003a50 msgr2=0x7f2ffc145010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:26.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.337+0000 7f3002fb1700 1 --2- 172.21.15.73:0/3154980405 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2fe8003a50 0x7f2ffc145010 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2fe800c1e0 tx=0x7f2ff4004b40 comp rx=0 tx=0).stop 2024-05-08T21:49:26.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.337+0000 7f3002fb1700 1 -- 172.21.15.73:0/3154980405 shutdown_connections 2024-05-08T21:49:26.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.337+0000 7f3002fb1700 1 --2- 172.21.15.73:0/3154980405 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2ffc155630 0x7f2ffc15b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:26.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.337+0000 7f3002fb1700 1 --2- 172.21.15.73:0/3154980405 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2fe8003a50 0x7f2ffc145010 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:26.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.337+0000 7f3002fb1700 1 --2- 172.21.15.73:0/3154980405 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ffc1595b0 0x7f2ffc15ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:26.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.337+0000 7f3002fb1700 1 -- 172.21.15.73:0/3154980405 >> 172.21.15.73:0/3154980405 conn(0x7f2ffc066ab0 msgr2=0x7f2ffc06aac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:26.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.337+0000 7f3002fb1700 1 -- 172.21.15.73:0/3154980405 shutdown_connections 2024-05-08T21:49:26.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:26.337+0000 7f3002fb1700 1 -- 172.21.15.73:0/3154980405 wait complete. 2024-05-08T21:49:26.340 INFO:teuthology.orchestra.run.smithi073.stderr:adjusted tunables profile to default 2024-05-08T21:49:26.351 INFO:tasks.ceph:check_enable_crimson: False 2024-05-08T21:49:26.351 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-05-08T21:49:26.351 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-05-08T21:49:26.351 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-05-08T21:49:26.377 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-05-08T21:49:26.377 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-05-08T21:49:26.443 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-05-08T21:49:26.443 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-05-08T21:49:26.511 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-05-08T21:49:26.511 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-05-08T21:49:26.578 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-08T21:49:26.579 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-05-08T21:49:26.605 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-08T21:49:26.606 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-05-08T21:49:26.652 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-08T21:49:26.651+0000 7f54f189d200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-08T21:49:26.672 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-08T21:49:26.672 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-05-08T21:49:26.673 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-05-08T21:49:26.671+0000 7fabb85d6200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-08T21:49:26.737 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-08T21:49:26.738 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-05-08T21:49:26.744 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-08T21:49:26.743+0000 7f54f189d200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-08T21:49:26.750 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-05-08T21:49:26.749+0000 7fabb85d6200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-08T21:49:26.769 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph osd new 6b7439c1-daaa-44af-8333-a455f9e9dc67 0 2024-05-08T21:49:26.821 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-08T21:49:26.820+0000 7f54f189d200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-08T21:49:26.823 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-05-08T21:49:26.822+0000 7fabb85d6200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-08T21:49:26.892 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-05-08T21:49:26.891+0000 7fabb85d6200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-08T21:49:26.896 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-08T21:49:26.895+0000 7f54f189d200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-08T21:49:26.934 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:26.933+0000 7f6f7d684700 1 Processor -- start 2024-05-08T21:49:26.934 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:26.933+0000 7f6f7d684700 1 -- start start 2024-05-08T21:49:26.936 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:26.934+0000 7f6f7d684700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6f78150c50 0x7f6f78072a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:26.937 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:26.934+0000 7f6f7d684700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6f780cb250 0x7f6f780c9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:26.937 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:26.934+0000 7f6f7d684700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f780c3eb0 con 0x7f6f780ca140 2024-05-08T21:49:26.937 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:26.934+0000 7f6f7d684700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f780c3bd0 con 0x7f6f780cb250 2024-05-08T21:49:26.937 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:26.934+0000 7f6f7d684700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f780c5580 con 0x7f6f78150c50 2024-05-08T21:49:26.937 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:26.934+0000 7f6f76ffd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6f78150c50 0x7f6f78072a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:26.937 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:26.934+0000 7f6f76ffd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6f78150c50 0x7f6f78072a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:52354/0 (socket says 172.21.15.115:52354) 2024-05-08T21:49:26.938 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:26.934+0000 7f6f76ffd700 1 -- 172.21.15.115:0/3658971332 learned_addr learned my addr 172.21.15.115:0/3658971332 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-08T21:49:26.938 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:26.934+0000 7f6f767fc700 1 --2- 172.21.15.115:0/3658971332 >> v2:172.21.15.73:3300/0 conn(0x7f6f780cb250 0x7f6f780c9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:26.938 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:26.934+0000 7f6f76ffd700 1 -- 172.21.15.115:0/3658971332 >> v2:172.21.15.73:3300/0 conn(0x7f6f780cb250 msgr2=0x7f6f780c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:26.938 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:26.934+0000 7f6f76ffd700 1 --2- 172.21.15.115:0/3658971332 >> v2:172.21.15.73:3300/0 conn(0x7f6f780cb250 0x7f6f780c9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:26.938 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:26.934+0000 7f6f76ffd700 1 -- 172.21.15.115:0/3658971332 >> v1:172.21.15.73:6789/0 conn(0x7f6f780ca140 legacy=0x7f6f780cc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:26.938 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:26.934+0000 7f6f76ffd700 1 -- 172.21.15.115:0/3658971332 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f780c5860 con 0x7f6f78150c50 2024-05-08T21:49:26.939 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:26.934+0000 7f6f76ffd700 1 --2- 172.21.15.115:0/3658971332 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6f78150c50 0x7f6f78072a70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6f680098f0 tx=0x7f6f68009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f39072f1d296dbed server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:26.939 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:26.935+0000 7f6f75ffb700 1 -- 172.21.15.115:0/3658971332 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f68011830 con 0x7f6f78150c50 2024-05-08T21:49:26.939 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:26.935+0000 7f6f75ffb700 1 -- 172.21.15.115:0/3658971332 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f68011990 con 0x7f6f78150c50 2024-05-08T21:49:26.939 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:26.935+0000 7f6f75ffb700 1 -- 172.21.15.115:0/3658971332 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f68011d20 con 0x7f6f78150c50 2024-05-08T21:49:26.939 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:26.935+0000 7f6f7d684700 1 -- 172.21.15.115:0/3658971332 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6f78150c50 msgr2=0x7f6f78072a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:26.939 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:26.935+0000 7f6f7d684700 1 --2- 172.21.15.115:0/3658971332 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6f78150c50 0x7f6f78072a70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6f680098f0 tx=0x7f6f68009c00 comp rx=0 tx=0).stop 2024-05-08T21:49:26.939 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:26.935+0000 7f6f7d684700 1 -- 172.21.15.115:0/3658971332 shutdown_connections 2024-05-08T21:49:26.940 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:26.935+0000 7f6f7d684700 1 --2- 172.21.15.115:0/3658971332 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6f78150c50 0x7f6f78072a70 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:26.940 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:26.935+0000 7f6f7d684700 1 --2- 172.21.15.115:0/3658971332 >> v2:172.21.15.73:3300/0 conn(0x7f6f780cb250 0x7f6f780c9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:26.940 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:26.935+0000 7f6f7d684700 1 -- 172.21.15.115:0/3658971332 >> 172.21.15.115:0/3658971332 conn(0x7f6f7806bad0 msgr2=0x7f6f7806bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:26.940 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:26.935+0000 7f6f7d684700 1 -- 172.21.15.115:0/3658971332 shutdown_connections 2024-05-08T21:49:26.940 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:26.935+0000 7f6f7d684700 1 -- 172.21.15.115:0/3658971332 wait complete. 2024-05-08T21:49:26.945 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:26.936+0000 7f6f7d684700 1 Processor -- start 2024-05-08T21:49:26.945 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:26.937+0000 7f6f7d684700 1 -- start start 2024-05-08T21:49:26.946 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:26.937+0000 7f6f7d684700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f780ca140 0x7f6f7813eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:26.946 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:26.937+0000 7f6f7d684700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6f780cb250 0x7f6f781ef9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:26.946 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:26.937+0000 7f6f7d684700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6f78150c50 0x7f6f781efee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:26.946 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:26.937+0000 7f6f7d684700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7814b050 con 0x7f6f780ca140 2024-05-08T21:49:26.946 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:26.937+0000 7f6f7d684700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f781652b0 con 0x7f6f78150c50 2024-05-08T21:49:26.946 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:26.937+0000 7f6f7d684700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7814b280 con 0x7f6f780cb250 2024-05-08T21:49:26.946 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:26.937+0000 7f6f767fc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6f780cb250 0x7f6f781ef9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:26.946 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:26.937+0000 7f6f767fc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6f780cb250 0x7f6f781ef9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:52368/0 (socket says 172.21.15.115:52368) 2024-05-08T21:49:26.947 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:26.937+0000 7f6f767fc700 1 -- 172.21.15.115:0/1373907169 learned_addr learned my addr 172.21.15.115:0/1373907169 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-08T21:49:26.947 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:26.937+0000 7f6f777fe700 1 --2- 172.21.15.115:0/1373907169 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6f78150c50 0x7f6f781efee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:26.947 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:26.937+0000 7f6f76ffd700 1 --2- 172.21.15.115:0/1373907169 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f780ca140 0x7f6f7813eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:26.947 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:26.938+0000 7f6f767fc700 1 -- 172.21.15.115:0/1373907169 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6f78150c50 msgr2=0x7f6f781efee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:26.947 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:26.938+0000 7f6f767fc700 1 --2- 172.21.15.115:0/1373907169 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6f78150c50 0x7f6f781efee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:26.947 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:26.938+0000 7f6f767fc700 1 -- 172.21.15.115:0/1373907169 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f780ca140 msgr2=0x7f6f7813eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:26.947 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:26.938+0000 7f6f767fc700 1 --2- 172.21.15.115:0/1373907169 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f780ca140 0x7f6f7813eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:26.948 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:26.938+0000 7f6f767fc700 1 -- 172.21.15.115:0/1373907169 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f68009550 con 0x7f6f780cb250 2024-05-08T21:49:26.948 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:26.938+0000 7f6f777fe700 1 --2- 172.21.15.115:0/1373907169 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6f78150c50 0x7f6f781efee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:49:26.948 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:26.938+0000 7f6f76ffd700 1 --2- 172.21.15.115:0/1373907169 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f780ca140 0x7f6f7813eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:49:26.948 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:26.938+0000 7f6f767fc700 1 --2- 172.21.15.115:0/1373907169 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6f780cb250 0x7f6f781ef9a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c00e9b0 tx=0x7f6f6c00ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:26.948 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:26.938+0000 7f6f5f7fe700 1 -- 172.21.15.115:0/1373907169 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c009710 con 0x7f6f780cb250 2024-05-08T21:49:26.948 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:26.938+0000 7f6f5f7fe700 1 -- 172.21.15.115:0/1373907169 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f6c00ee50 con 0x7f6f780cb250 2024-05-08T21:49:26.948 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:26.938+0000 7f6f7d684700 1 -- 172.21.15.115:0/1373907169 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f78164cf0 con 0x7f6f780cb250 2024-05-08T21:49:26.949 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:26.938+0000 7f6f5f7fe700 1 -- 172.21.15.115:0/1373907169 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c00ca50 con 0x7f6f780cb250 2024-05-08T21:49:26.949 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:26.938+0000 7f6f7d684700 1 -- 172.21.15.115:0/1373907169 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f7813a090 con 0x7f6f780cb250 2024-05-08T21:49:26.949 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:26.939+0000 7f6f5f7fe700 1 -- 172.21.15.115:0/1373907169 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f6f6c013470 con 0x7f6f780cb250 2024-05-08T21:49:26.949 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:26.939+0000 7f6f5f7fe700 1 -- 172.21.15.115:0/1373907169 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f6f6c01c990 con 0x7f6f780cb250 2024-05-08T21:49:26.949 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:26.939+0000 7f6f7d684700 1 -- 172.21.15.115:0/1373907169 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f78139ef0 con 0x7f6f780cb250 2024-05-08T21:49:26.949 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:26.941+0000 7f6f5f7fe700 1 -- 172.21.15.115:0/1373907169 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f6f78139ef0 con 0x7f6f780cb250 2024-05-08T21:49:27.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.026+0000 7f6f7d684700 1 -- 172.21.15.115:0/1373907169 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6b7439c1-daaa-44af-8333-a455f9e9dc67", "id": 0} v 0) v1 -- 0x7f6f780c4440 con 0x7f6f780cb250 2024-05-08T21:49:27.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.029+0000 7f6f5f7fe700 1 -- 172.21.15.115:0/1373907169 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6b7439c1-daaa-44af-8333-a455f9e9dc67", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6f6c02a0b0 con 0x7f6f780cb250 2024-05-08T21:49:27.031 INFO:teuthology.orchestra.run.smithi115.stdout:0 2024-05-08T21:49:27.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.030+0000 7f6f7d684700 1 -- 172.21.15.115:0/1373907169 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6f780cb250 msgr2=0x7f6f781ef9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:27.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.030+0000 7f6f7d684700 1 --2- 172.21.15.115:0/1373907169 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6f780cb250 0x7f6f781ef9a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c00e9b0 tx=0x7f6f6c00ecc0 comp rx=0 tx=0).stop 2024-05-08T21:49:27.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.030+0000 7f6f7d684700 1 -- 172.21.15.115:0/1373907169 shutdown_connections 2024-05-08T21:49:27.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.030+0000 7f6f7d684700 1 --2- 172.21.15.115:0/1373907169 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6f78150c50 0x7f6f781efee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:27.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.030+0000 7f6f7d684700 1 --2- 172.21.15.115:0/1373907169 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f780ca140 0x7f6f7813eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:27.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.030+0000 7f6f7d684700 1 --2- 172.21.15.115:0/1373907169 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6f780cb250 0x7f6f781ef9a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:27.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.030+0000 7f6f7d684700 1 -- 172.21.15.115:0/1373907169 >> 172.21.15.115:0/1373907169 conn(0x7f6f7806bad0 msgr2=0x7f6f780cc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:27.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.030+0000 7f6f7d684700 1 -- 172.21.15.115:0/1373907169 shutdown_connections 2024-05-08T21:49:27.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.030+0000 7f6f7d684700 1 -- 172.21.15.115:0/1373907169 wait complete. 2024-05-08T21:49:27.043 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph osd new fb67886a-d7f7-45ac-832f-36c871c8a208 1 2024-05-08T21:49:27.065 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-05-08T21:49:27.064+0000 7fabb85d6200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-08T21:49:27.078 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-08T21:49:27.077+0000 7f54f189d200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-08T21:49:27.203 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.202+0000 7f034d91a700 1 Processor -- start 2024-05-08T21:49:27.203 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.202+0000 7f034d91a700 1 -- start start 2024-05-08T21:49:27.213 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.202+0000 7f034d91a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f03480c8180 0x7f03480724d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:27.213 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.202+0000 7f034d91a700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0348072a10 0x7f034806ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:27.213 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.202+0000 7f034d91a700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03480c7730 con 0x7f0348153ed0 2024-05-08T21:49:27.213 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.202+0000 7f034d91a700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03480cc370 con 0x7f0348072a10 2024-05-08T21:49:27.213 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.202+0000 7f034d91a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03481542b0 con 0x7f03480c8180 2024-05-08T21:49:27.213 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.203+0000 7f03467fc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f03480c8180 0x7f03480724d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:27.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.203+0000 7f03467fc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f03480c8180 0x7f03480724d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:52384/0 (socket says 172.21.15.115:52384) 2024-05-08T21:49:27.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.203+0000 7f03467fc700 1 -- 172.21.15.115:0/3968850465 learned_addr learned my addr 172.21.15.115:0/3968850465 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-08T21:49:27.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.203+0000 7f03477fe700 1 --2- 172.21.15.115:0/3968850465 >> v2:172.21.15.73:3300/0 conn(0x7f0348072a10 0x7f034806ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:27.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.203+0000 7f03467fc700 1 -- 172.21.15.115:0/3968850465 >> v2:172.21.15.73:3300/0 conn(0x7f0348072a10 msgr2=0x7f034806ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:27.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.203+0000 7f03467fc700 1 --2- 172.21.15.115:0/3968850465 >> v2:172.21.15.73:3300/0 conn(0x7f0348072a10 0x7f034806ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:27.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.203+0000 7f03467fc700 1 -- 172.21.15.115:0/3968850465 >> v1:172.21.15.73:6789/0 conn(0x7f0348153ed0 legacy=0x7f0348159b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:27.215 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.203+0000 7f03467fc700 1 -- 172.21.15.115:0/3968850465 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03480cc550 con 0x7f03480c8180 2024-05-08T21:49:27.215 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.203+0000 7f0345ffb700 1 -- 172.21.15.115:0/3968850465 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3384862616 0 0) 0x7f03480c7730 con 0x7f0348153ed0 2024-05-08T21:49:27.215 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.203+0000 7f03467fc700 1 --2- 172.21.15.115:0/3968850465 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f03480c8180 0x7f03480724d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f033c0098f0 tx=0x7f033c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12a14fc6ee743949 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:27.215 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.203+0000 7f0345ffb700 1 -- 172.21.15.115:0/3968850465 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033c011830 con 0x7f03480c8180 2024-05-08T21:49:27.215 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.203+0000 7f0345ffb700 1 -- 172.21.15.115:0/3968850465 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f033c011990 con 0x7f03480c8180 2024-05-08T21:49:27.215 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.203+0000 7f0345ffb700 1 -- 172.21.15.115:0/3968850465 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033c011d20 con 0x7f03480c8180 2024-05-08T21:49:27.216 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.204+0000 7f034d91a700 1 -- 172.21.15.115:0/3968850465 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f03480c8180 msgr2=0x7f03480724d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:27.216 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.204+0000 7f034d91a700 1 --2- 172.21.15.115:0/3968850465 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f03480c8180 0x7f03480724d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f033c0098f0 tx=0x7f033c009c00 comp rx=0 tx=0).stop 2024-05-08T21:49:27.216 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.204+0000 7f034d91a700 1 -- 172.21.15.115:0/3968850465 shutdown_connections 2024-05-08T21:49:27.216 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.204+0000 7f034d91a700 1 --2- 172.21.15.115:0/3968850465 >> v2:172.21.15.73:3300/0 conn(0x7f0348072a10 0x7f034806ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:27.216 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.204+0000 7f034d91a700 1 --2- 172.21.15.115:0/3968850465 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f03480c8180 0x7f03480724d0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:27.216 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.204+0000 7f034d91a700 1 -- 172.21.15.115:0/3968850465 >> 172.21.15.115:0/3968850465 conn(0x7f0348066ab0 msgr2=0x7f034806f550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:27.217 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.204+0000 7f034d91a700 1 -- 172.21.15.115:0/3968850465 shutdown_connections 2024-05-08T21:49:27.217 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.204+0000 7f034d91a700 1 -- 172.21.15.115:0/3968850465 wait complete. 2024-05-08T21:49:27.217 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.205+0000 7f034d91a700 1 Processor -- start 2024-05-08T21:49:27.217 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.205+0000 7f034d91a700 1 -- start start 2024-05-08T21:49:27.217 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.206+0000 7f034d91a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0348072a10 0x7f03481e6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:27.217 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.206+0000 7f034d91a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f03480c8180 0x7f034814e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:27.218 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.206+0000 7f034d91a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0348153ed0 0x7f034814e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:27.218 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.206+0000 7f034d91a700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03481599a0 con 0x7f0348153ed0 2024-05-08T21:49:27.218 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.206+0000 7f034d91a700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03481ef330 con 0x7f0348072a10 2024-05-08T21:49:27.218 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.206+0000 7f034d91a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03480c6860 con 0x7f03480c8180 2024-05-08T21:49:27.218 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.206+0000 7f0346ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0348072a10 0x7f03481e6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:27.218 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.206+0000 7f03467fc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f03480c8180 0x7f034814e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:27.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.206+0000 7f0346ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0348072a10 0x7f03481e6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54076/0 (socket says 172.21.15.115:54076) 2024-05-08T21:49:27.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.206+0000 7f03467fc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f03480c8180 0x7f034814e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:52392/0 (socket says 172.21.15.115:52392) 2024-05-08T21:49:27.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.206+0000 7f0346ffd700 1 -- 172.21.15.115:0/2036984132 learned_addr learned my addr 172.21.15.115:0/2036984132 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-08T21:49:27.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.206+0000 7f03477fe700 1 --2- 172.21.15.115:0/2036984132 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0348153ed0 0x7f034814e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:27.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.206+0000 7f03477fe700 1 -- 172.21.15.115:0/2036984132 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f03480c8180 msgr2=0x7f034814e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:27.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.206+0000 7f03477fe700 1 --2- 172.21.15.115:0/2036984132 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f03480c8180 0x7f034814e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:27.220 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.206+0000 7f03477fe700 1 -- 172.21.15.115:0/2036984132 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0348072a10 msgr2=0x7f03481e6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:27.220 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.206+0000 7f03477fe700 1 --2- 172.21.15.115:0/2036984132 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0348072a10 0x7f03481e6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:27.220 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.206+0000 7f03477fe700 1 -- 172.21.15.115:0/2036984132 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f033c009550 con 0x7f0348153ed0 2024-05-08T21:49:27.220 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.206+0000 7f03467fc700 1 --2- 172.21.15.115:0/2036984132 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f03480c8180 0x7f034814e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:49:27.220 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.206+0000 7f0346ffd700 1 --2- 172.21.15.115:0/2036984132 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0348072a10 0x7f03481e6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:49:27.220 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.207+0000 7f03477fe700 1 --2- 172.21.15.115:0/2036984132 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0348153ed0 0x7f034814e9a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f034000ef90 tx=0x7f034000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:27.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.207+0000 7f032ffff700 1 -- 172.21.15.115:0/2036984132 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034000cc90 con 0x7f0348153ed0 2024-05-08T21:49:27.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.207+0000 7f032ffff700 1 -- 172.21.15.115:0/2036984132 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f034000f040 con 0x7f0348153ed0 2024-05-08T21:49:27.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.207+0000 7f032ffff700 1 -- 172.21.15.115:0/2036984132 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03400146c0 con 0x7f0348153ed0 2024-05-08T21:49:27.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.207+0000 7f034d91a700 1 -- 172.21.15.115:0/2036984132 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03481f29d0 con 0x7f0348153ed0 2024-05-08T21:49:27.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.207+0000 7f034d91a700 1 -- 172.21.15.115:0/2036984132 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03481f2f90 con 0x7f0348153ed0 2024-05-08T21:49:27.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.207+0000 7f032ffff700 1 -- 172.21.15.115:0/2036984132 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f0340014b20 con 0x7f0348153ed0 2024-05-08T21:49:27.222 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.207+0000 7f032ffff700 1 -- 172.21.15.115:0/2036984132 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f034001ddd0 con 0x7f0348153ed0 2024-05-08T21:49:27.222 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.208+0000 7f034d91a700 1 -- 172.21.15.115:0/2036984132 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03481ef4a0 con 0x7f0348153ed0 2024-05-08T21:49:27.222 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.210+0000 7f032ffff700 1 -- 172.21.15.115:0/2036984132 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f034003bdc0 con 0x7f0348153ed0 2024-05-08T21:49:27.230 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-05-08T21:49:27.230+0000 7fabb85d6200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-08T21:49:27.259 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-08T21:49:27.258+0000 7f54f189d200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-08T21:49:27.297 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.296+0000 7f034d91a700 1 -- 172.21.15.115:0/2036984132 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd new", "uuid": "fb67886a-d7f7-45ac-832f-36c871c8a208", "id": 1} v 0) v1 -- 0x7f0348068130 con 0x7f0348153ed0 2024-05-08T21:49:27.304 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.304+0000 7f032ffff700 1 -- 172.21.15.115:0/2036984132 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fb67886a-d7f7-45ac-832f-36c871c8a208", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f034002a070 con 0x7f0348153ed0 2024-05-08T21:49:27.305 INFO:teuthology.orchestra.run.smithi115.stdout:1 2024-05-08T21:49:27.306 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.305+0000 7f034d91a700 1 -- 172.21.15.115:0/2036984132 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0348153ed0 msgr2=0x7f034814e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:27.306 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.305+0000 7f034d91a700 1 --2- 172.21.15.115:0/2036984132 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0348153ed0 0x7f034814e9a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f034000ef90 tx=0x7f034000c3a0 comp rx=0 tx=0).stop 2024-05-08T21:49:27.306 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.305+0000 7f034d91a700 1 -- 172.21.15.115:0/2036984132 shutdown_connections 2024-05-08T21:49:27.306 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.305+0000 7f034d91a700 1 --2- 172.21.15.115:0/2036984132 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0348153ed0 0x7f034814e9a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:27.306 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.305+0000 7f034d91a700 1 --2- 172.21.15.115:0/2036984132 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0348072a10 0x7f03481e6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:27.306 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.305+0000 7f034d91a700 1 --2- 172.21.15.115:0/2036984132 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f03480c8180 0x7f034814e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:27.306 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.305+0000 7f034d91a700 1 -- 172.21.15.115:0/2036984132 >> 172.21.15.115:0/2036984132 conn(0x7f0348066ab0 msgr2=0x7f03480c5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:27.307 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.305+0000 7f034d91a700 1 -- 172.21.15.115:0/2036984132 shutdown_connections 2024-05-08T21:49:27.307 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.305+0000 7f034d91a700 1 -- 172.21.15.115:0/2036984132 wait complete. 2024-05-08T21:49:27.318 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph osd new a5cd6e98-6621-473a-bfb8-5c648abbb563 2 2024-05-08T21:49:27.341 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-05-08T21:49:27.340+0000 7fabb85d6200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-08T21:49:27.375 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-08T21:49:27.374+0000 7f54f189d200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-08T21:49:27.437 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-05-08T21:49:27.436+0000 7fabb85d6200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-08T21:49:27.439 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.439+0000 7fdd45dfd700 1 Processor -- start 2024-05-08T21:49:27.440 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.439+0000 7fdd45dfd700 1 -- start start 2024-05-08T21:49:27.442 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.439+0000 7fdd45dfd700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdd4014e710 0x7fdd400c8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:27.442 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.439+0000 7fdd45dfd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd400729f0 0x7fdd400c5b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:27.442 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.439+0000 7fdd45dfd700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd40072280 con 0x7fdd4014e330 2024-05-08T21:49:27.442 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.439+0000 7fdd45dfd700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd400c6e20 con 0x7fdd4014e710 2024-05-08T21:49:27.443 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.439+0000 7fdd45dfd700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd40072560 con 0x7fdd400729f0 2024-05-08T21:49:27.443 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.439+0000 7fdd3ffff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd400729f0 0x7fdd400c5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:27.443 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.439+0000 7fdd3f7fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fdd4014e330 0x7fdd401579e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:37726/0 (socket says 172.21.15.115:37726) 2024-05-08T21:49:27.443 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.440+0000 7fdd3ffff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd400729f0 0x7fdd400c5b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:52404/0 (socket says 172.21.15.115:52404) 2024-05-08T21:49:27.443 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.440+0000 7fdd3f7fe700 1 -- 172.21.15.115:0/2038663693 learned_addr learned my addr 172.21.15.115:0/2038663693 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-08T21:49:27.443 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.440+0000 7fdd3effd700 1 --2- 172.21.15.115:0/2038663693 >> v2:172.21.15.73:3300/0 conn(0x7fdd4014e710 0x7fdd400c8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:27.443 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.440+0000 7fdd3ffff700 1 -- 172.21.15.115:0/2038663693 >> v2:172.21.15.73:3300/0 conn(0x7fdd4014e710 msgr2=0x7fdd400c8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:27.443 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.440+0000 7fdd3ffff700 1 --2- 172.21.15.115:0/2038663693 >> v2:172.21.15.73:3300/0 conn(0x7fdd4014e710 0x7fdd400c8ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:27.443 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.440+0000 7fdd3ffff700 1 -- 172.21.15.115:0/2038663693 >> v1:172.21.15.115:6789/0 conn(0x7fdd4014e330 legacy=0x7fdd401579e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:27.443 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.440+0000 7fdd3e7fc700 1 -- 172.21.15.115:0/2038663693 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 523997808 0 0) 0x7fdd40072280 con 0x7fdd4014e330 2024-05-08T21:49:27.443 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.440+0000 7fdd3ffff700 1 -- 172.21.15.115:0/2038663693 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd400c9860 con 0x7fdd400729f0 2024-05-08T21:49:27.443 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.440+0000 7fdd3ffff700 1 --2- 172.21.15.115:0/2038663693 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd400729f0 0x7fdd400c5b30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fdd38009d90 tx=0x7fdd3800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7546b8bd16fbde2c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:27.443 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.440+0000 7fdd3e7fc700 1 -- 172.21.15.115:0/2038663693 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3800e070 con 0x7fdd400729f0 2024-05-08T21:49:27.444 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.440+0000 7fdd3e7fc700 1 -- 172.21.15.115:0/2038663693 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd3800bb20 con 0x7fdd400729f0 2024-05-08T21:49:27.444 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.440+0000 7fdd3e7fc700 1 -- 172.21.15.115:0/2038663693 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd38012430 con 0x7fdd400729f0 2024-05-08T21:49:27.444 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.441+0000 7fdd45dfd700 1 -- 172.21.15.115:0/2038663693 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd400729f0 msgr2=0x7fdd400c5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:27.444 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.441+0000 7fdd45dfd700 1 --2- 172.21.15.115:0/2038663693 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd400729f0 0x7fdd400c5b30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fdd38009d90 tx=0x7fdd3800b330 comp rx=0 tx=0).stop 2024-05-08T21:49:27.444 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.441+0000 7fdd45dfd700 1 -- 172.21.15.115:0/2038663693 shutdown_connections 2024-05-08T21:49:27.444 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.441+0000 7fdd45dfd700 1 --2- 172.21.15.115:0/2038663693 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd400729f0 0x7fdd400c5b30 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:27.444 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.441+0000 7fdd45dfd700 1 --2- 172.21.15.115:0/2038663693 >> v2:172.21.15.73:3300/0 conn(0x7fdd4014e710 0x7fdd400c8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:27.444 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.441+0000 7fdd45dfd700 1 -- 172.21.15.115:0/2038663693 >> 172.21.15.115:0/2038663693 conn(0x7fdd40066ab0 msgr2=0x7fdd4006f550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:27.444 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.441+0000 7fdd45dfd700 1 -- 172.21.15.115:0/2038663693 shutdown_connections 2024-05-08T21:49:27.444 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.441+0000 7fdd45dfd700 1 -- 172.21.15.115:0/2038663693 wait complete. 2024-05-08T21:49:27.447 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.442+0000 7fdd45dfd700 1 Processor -- start 2024-05-08T21:49:27.447 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.442+0000 7fdd45dfd700 1 -- start start 2024-05-08T21:49:27.447 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.443+0000 7fdd45dfd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd400729f0 0x7fdd400c4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:27.447 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.443+0000 7fdd45dfd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd4014e330 0x7fdd40158ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:27.447 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.443+0000 7fdd45dfd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd4014c800 0x7fdd400cade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:27.447 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.443+0000 7fdd45dfd700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd400c4b50 con 0x7fdd400729f0 2024-05-08T21:49:27.447 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.443+0000 7fdd45dfd700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd40144820 con 0x7fdd4014e330 2024-05-08T21:49:27.447 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.443+0000 7fdd45dfd700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd400ca970 con 0x7fdd4014c800 2024-05-08T21:49:27.447 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.443+0000 7fdd3effd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd4014e330 0x7fdd40158ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:27.448 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.443+0000 7fdd3ffff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd4014c800 0x7fdd400cade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:27.448 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.443+0000 7fdd3effd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd4014e330 0x7fdd40158ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54088/0 (socket says 172.21.15.115:54088) 2024-05-08T21:49:27.448 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.443+0000 7fdd3effd700 1 -- 172.21.15.115:0/660016327 learned_addr learned my addr 172.21.15.115:0/660016327 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-08T21:49:27.448 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.443+0000 7fdd3f7fe700 1 --2- 172.21.15.115:0/660016327 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd400729f0 0x7fdd400c4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:27.448 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.443+0000 7fdd3effd700 1 -- 172.21.15.115:0/660016327 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd4014c800 msgr2=0x7fdd400cade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:27.448 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.443+0000 7fdd3effd700 1 --2- 172.21.15.115:0/660016327 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd4014c800 0x7fdd400cade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:27.448 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.443+0000 7fdd3effd700 1 -- 172.21.15.115:0/660016327 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd400729f0 msgr2=0x7fdd400c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:27.448 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.443+0000 7fdd3effd700 1 --2- 172.21.15.115:0/660016327 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd400729f0 0x7fdd400c4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:27.448 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.443+0000 7fdd3effd700 1 -- 172.21.15.115:0/660016327 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd38009a70 con 0x7fdd4014e330 2024-05-08T21:49:27.448 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.443+0000 7fdd3f7fe700 1 --2- 172.21.15.115:0/660016327 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd400729f0 0x7fdd400c4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:49:27.448 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.443+0000 7fdd3ffff700 1 --2- 172.21.15.115:0/660016327 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd4014c800 0x7fdd400cade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:49:27.448 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.443+0000 7fdd3effd700 1 --2- 172.21.15.115:0/660016327 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd4014e330 0x7fdd40158ba0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fdd3400e870 tx=0x7fdd3400eb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:27.448 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.444+0000 7fdd27fff700 1 -- 172.21.15.115:0/660016327 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd34009590 con 0x7fdd4014e330 2024-05-08T21:49:27.448 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.444+0000 7fdd27fff700 1 -- 172.21.15.115:0/660016327 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd34013680 con 0x7fdd4014e330 2024-05-08T21:49:27.448 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.444+0000 7fdd27fff700 1 -- 172.21.15.115:0/660016327 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd340139f0 con 0x7fdd4014e330 2024-05-08T21:49:27.449 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.444+0000 7fdd45dfd700 1 -- 172.21.15.115:0/660016327 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd400c45b0 con 0x7fdd4014e330 2024-05-08T21:49:27.449 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.444+0000 7fdd45dfd700 1 -- 172.21.15.115:0/660016327 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd4015ab00 con 0x7fdd4014e330 2024-05-08T21:49:27.449 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.444+0000 7fdd27fff700 1 -- 172.21.15.115:0/660016327 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fdd34005a20 con 0x7fdd4014e330 2024-05-08T21:49:27.449 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.444+0000 7fdd27fff700 1 -- 172.21.15.115:0/660016327 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fdd34006700 con 0x7fdd4014e330 2024-05-08T21:49:27.449 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.444+0000 7fdd45dfd700 1 -- 172.21.15.115:0/660016327 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd4015a960 con 0x7fdd4014e330 2024-05-08T21:49:27.449 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.447+0000 7fdd27fff700 1 -- 172.21.15.115:0/660016327 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7fdd4015a960 con 0x7fdd4014e330 2024-05-08T21:49:27.476 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-08T21:49:27.475+0000 7f54f189d200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-08T21:49:27.514 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-05-08T21:49:27.513+0000 7fabb85d6200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-08T21:49:27.532 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.531+0000 7fdd45dfd700 1 -- 172.21.15.115:0/660016327 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a5cd6e98-6621-473a-bfb8-5c648abbb563", "id": 2} v 0) v1 -- 0x7fdd400c6b10 con 0x7fdd4014e330 2024-05-08T21:49:27.540 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.539+0000 7fdd27fff700 1 -- 172.21.15.115:0/660016327 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a5cd6e98-6621-473a-bfb8-5c648abbb563", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fdd34021060 con 0x7fdd4014e330 2024-05-08T21:49:27.540 INFO:teuthology.orchestra.run.smithi115.stdout:2 2024-05-08T21:49:27.541 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.540+0000 7fdd45dfd700 1 -- 172.21.15.115:0/660016327 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd4014e330 msgr2=0x7fdd40158ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:27.541 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.540+0000 7fdd45dfd700 1 --2- 172.21.15.115:0/660016327 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd4014e330 0x7fdd40158ba0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fdd3400e870 tx=0x7fdd3400eb80 comp rx=0 tx=0).stop 2024-05-08T21:49:27.541 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.540+0000 7fdd45dfd700 1 -- 172.21.15.115:0/660016327 shutdown_connections 2024-05-08T21:49:27.541 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.540+0000 7fdd45dfd700 1 --2- 172.21.15.115:0/660016327 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd4014c800 0x7fdd400cade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:27.541 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.540+0000 7fdd45dfd700 1 --2- 172.21.15.115:0/660016327 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd400729f0 0x7fdd400c4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:27.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.540+0000 7fdd45dfd700 1 --2- 172.21.15.115:0/660016327 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd4014e330 0x7fdd40158ba0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:27.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.540+0000 7fdd45dfd700 1 -- 172.21.15.115:0/660016327 >> 172.21.15.115:0/660016327 conn(0x7fdd40066ab0 msgr2=0x7fdd40156290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:27.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.540+0000 7fdd45dfd700 1 -- 172.21.15.115:0/660016327 shutdown_connections 2024-05-08T21:49:27.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.540+0000 7fdd45dfd700 1 -- 172.21.15.115:0/660016327 wait complete. 2024-05-08T21:49:27.553 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph osd new 36927c20-4241-4f3b-91b5-a6a6f27598e9 3 2024-05-08T21:49:27.555 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-08T21:49:27.554+0000 7f54f189d200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-08T21:49:27.677 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.676+0000 7fdae2136700 1 Processor -- start 2024-05-08T21:49:27.677 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.676+0000 7fdae2136700 1 -- start start 2024-05-08T21:49:27.680 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.677+0000 7fdae2136700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdadc150c50 0x7fdadc072a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:27.680 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.677+0000 7fdae2136700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdadc0ca140 0x7fdadc0ca5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:27.680 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.677+0000 7fdae2136700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdadc0c3eb0 con 0x7fdadc0cb250 2024-05-08T21:49:27.680 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.677+0000 7fdae2136700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdadc0c9720 con 0x7fdadc150c50 2024-05-08T21:49:27.680 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.677+0000 7fdae2136700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdadc0c3bd0 con 0x7fdadc0ca140 2024-05-08T21:49:27.680 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.677+0000 7fdadbfff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdadc0ca140 0x7fdadc0ca5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:27.680 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.677+0000 7fdadbfff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdadc0ca140 0x7fdadc0ca5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:52412/0 (socket says 172.21.15.115:52412) 2024-05-08T21:49:27.680 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.677+0000 7fdadbfff700 1 -- 172.21.15.115:0/2813173119 learned_addr learned my addr 172.21.15.115:0/2813173119 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-08T21:49:27.680 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.677+0000 7fdadb7fe700 1 --2- 172.21.15.115:0/2813173119 >> v2:172.21.15.73:3300/0 conn(0x7fdadc150c50 0x7fdadc072a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:27.680 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.677+0000 7fdadbfff700 1 -- 172.21.15.115:0/2813173119 >> v2:172.21.15.73:3300/0 conn(0x7fdadc150c50 msgr2=0x7fdadc072a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:27.681 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.677+0000 7fdadbfff700 1 --2- 172.21.15.115:0/2813173119 >> v2:172.21.15.73:3300/0 conn(0x7fdadc150c50 0x7fdadc072a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:27.681 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.677+0000 7fdadbfff700 1 -- 172.21.15.115:0/2813173119 >> v1:172.21.15.73:6789/0 conn(0x7fdadc0cb250 legacy=0x7fdadc0c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:27.681 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.677+0000 7fdadbfff700 1 -- 172.21.15.115:0/2813173119 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdadc0c5580 con 0x7fdadc0ca140 2024-05-08T21:49:27.681 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.677+0000 7fdadbfff700 1 --2- 172.21.15.115:0/2813173119 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdadc0ca140 0x7fdadc0ca5d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fdacc00d150 tx=0x7fdacc00d460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64144225cbb5fe3d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:27.681 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.678+0000 7fdada7fc700 1 -- 172.21.15.115:0/2813173119 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdacc010070 con 0x7fdadc0ca140 2024-05-08T21:49:27.681 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.678+0000 7fdada7fc700 1 -- 172.21.15.115:0/2813173119 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdacc00dd10 con 0x7fdadc0ca140 2024-05-08T21:49:27.682 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.678+0000 7fdada7fc700 1 -- 172.21.15.115:0/2813173119 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdacc00b310 con 0x7fdadc0ca140 2024-05-08T21:49:27.682 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.678+0000 7fdae2136700 1 -- 172.21.15.115:0/2813173119 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdadc0ca140 msgr2=0x7fdadc0ca5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:27.682 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.678+0000 7fdae2136700 1 --2- 172.21.15.115:0/2813173119 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdadc0ca140 0x7fdadc0ca5d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fdacc00d150 tx=0x7fdacc00d460 comp rx=0 tx=0).stop 2024-05-08T21:49:27.682 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.678+0000 7fdae2136700 1 -- 172.21.15.115:0/2813173119 shutdown_connections 2024-05-08T21:49:27.682 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.678+0000 7fdae2136700 1 --2- 172.21.15.115:0/2813173119 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdadc0ca140 0x7fdadc0ca5d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:27.682 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.678+0000 7fdae2136700 1 --2- 172.21.15.115:0/2813173119 >> v2:172.21.15.73:3300/0 conn(0x7fdadc150c50 0x7fdadc072a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:27.682 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.678+0000 7fdae2136700 1 -- 172.21.15.115:0/2813173119 >> 172.21.15.115:0/2813173119 conn(0x7fdadc06bad0 msgr2=0x7fdadc06bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:27.682 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.678+0000 7fdae2136700 1 -- 172.21.15.115:0/2813173119 shutdown_connections 2024-05-08T21:49:27.682 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.678+0000 7fdae2136700 1 -- 172.21.15.115:0/2813173119 wait complete. 2024-05-08T21:49:27.685 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.680+0000 7fdae2136700 1 Processor -- start 2024-05-08T21:49:27.685 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.680+0000 7fdae2136700 1 -- start start 2024-05-08T21:49:27.685 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.681+0000 7fdae2136700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdadc0ca140 0x7fdadc140820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:27.685 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.681+0000 7fdae2136700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdadc0cb250 0x7fdadc1ee8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:27.685 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.681+0000 7fdae2136700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdadc150c50 0x7fdadc1eee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:27.685 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.681+0000 7fdae2136700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdadc1499c0 con 0x7fdadc150c50 2024-05-08T21:49:27.685 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.681+0000 7fdae2136700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdadc13ea80 con 0x7fdadc0ca140 2024-05-08T21:49:27.686 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.681+0000 7fdae2136700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdadc13ed60 con 0x7fdadc0cb250 2024-05-08T21:49:27.686 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.681+0000 7fdadb7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdadc0ca140 0x7fdadc140820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:27.686 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.681+0000 7fdadb7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdadc0ca140 0x7fdadc140820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54096/0 (socket says 172.21.15.115:54096) 2024-05-08T21:49:27.686 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.681+0000 7fdadb7fe700 1 -- 172.21.15.115:0/3518269112 learned_addr learned my addr 172.21.15.115:0/3518269112 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-08T21:49:27.686 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.681+0000 7fdadaffd700 1 --2- 172.21.15.115:0/3518269112 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdadc0cb250 0x7fdadc1ee8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:27.686 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.681+0000 7fdadbfff700 1 --2- 172.21.15.115:0/3518269112 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdadc150c50 0x7fdadc1eee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:27.686 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.681+0000 7fdadaffd700 1 -- 172.21.15.115:0/3518269112 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdadc0ca140 msgr2=0x7fdadc140820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:27.686 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.681+0000 7fdadaffd700 1 --2- 172.21.15.115:0/3518269112 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdadc0ca140 0x7fdadc140820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:27.686 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.681+0000 7fdadaffd700 1 -- 172.21.15.115:0/3518269112 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdadc150c50 msgr2=0x7fdadc1eee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:27.686 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.681+0000 7fdadaffd700 1 --2- 172.21.15.115:0/3518269112 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdadc150c50 0x7fdadc1eee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:27.686 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.681+0000 7fdadaffd700 1 -- 172.21.15.115:0/3518269112 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdacc00bd40 con 0x7fdadc0cb250 2024-05-08T21:49:27.687 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.681+0000 7fdadb7fe700 1 --2- 172.21.15.115:0/3518269112 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdadc0ca140 0x7fdadc140820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:49:27.687 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.681+0000 7fdadaffd700 1 --2- 172.21.15.115:0/3518269112 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdadc0cb250 0x7fdadc1ee8c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fdac400c450 tx=0x7fdac400c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:27.687 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.682+0000 7fdad3fff700 1 -- 172.21.15.115:0/3518269112 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac40052d0 con 0x7fdadc0cb250 2024-05-08T21:49:27.687 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.682+0000 7fdad3fff700 1 -- 172.21.15.115:0/3518269112 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdac4005430 con 0x7fdadc0cb250 2024-05-08T21:49:27.687 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.682+0000 7fdae2136700 1 -- 172.21.15.115:0/3518269112 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdadc149370 con 0x7fdadc0cb250 2024-05-08T21:49:27.687 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.682+0000 7fdad3fff700 1 -- 172.21.15.115:0/3518269112 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac40038c0 con 0x7fdadc0cb250 2024-05-08T21:49:27.687 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.682+0000 7fdae2136700 1 -- 172.21.15.115:0/3518269112 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdadc14a8d0 con 0x7fdadc0cb250 2024-05-08T21:49:27.687 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.682+0000 7fdad3fff700 1 -- 172.21.15.115:0/3518269112 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fdac4003d20 con 0x7fdadc0cb250 2024-05-08T21:49:27.687 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.682+0000 7fdad3fff700 1 -- 172.21.15.115:0/3518269112 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fdac4011c70 con 0x7fdadc0cb250 2024-05-08T21:49:27.687 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.683+0000 7fdae2136700 1 -- 172.21.15.115:0/3518269112 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdadc1491d0 con 0x7fdadc0cb250 2024-05-08T21:49:27.690 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.685+0000 7fdad3fff700 1 -- 172.21.15.115:0/3518269112 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7fdadc1491d0 con 0x7fdadc0cb250 2024-05-08T21:49:27.742 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-05-08T21:49:27.741+0000 7fabb85d6200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-08T21:49:27.804 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.803+0000 7fdae2136700 1 -- 172.21.15.115:0/3518269112 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd new", "uuid": "36927c20-4241-4f3b-91b5-a6a6f27598e9", "id": 3} v 0) v1 -- 0x7fdadc0c3540 con 0x7fdadc0cb250 2024-05-08T21:49:27.804 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-08T21:49:27.804+0000 7f54f189d200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-08T21:49:27.811 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.810+0000 7fdad3fff700 1 -- 172.21.15.115:0/3518269112 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "36927c20-4241-4f3b-91b5-a6a6f27598e9", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fdac4017070 con 0x7fdadc0cb250 2024-05-08T21:49:27.811 INFO:teuthology.orchestra.run.smithi115.stdout:3 2024-05-08T21:49:27.813 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.811+0000 7fdae2136700 1 -- 172.21.15.115:0/3518269112 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdadc0cb250 msgr2=0x7fdadc1ee8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:27.813 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.811+0000 7fdae2136700 1 --2- 172.21.15.115:0/3518269112 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdadc0cb250 0x7fdadc1ee8c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fdac400c450 tx=0x7fdac400c760 comp rx=0 tx=0).stop 2024-05-08T21:49:27.813 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.811+0000 7fdae2136700 1 -- 172.21.15.115:0/3518269112 shutdown_connections 2024-05-08T21:49:27.813 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.811+0000 7fdae2136700 1 --2- 172.21.15.115:0/3518269112 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdadc150c50 0x7fdadc1eee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:27.813 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.811+0000 7fdae2136700 1 --2- 172.21.15.115:0/3518269112 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdadc0ca140 0x7fdadc140820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:27.813 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.811+0000 7fdae2136700 1 --2- 172.21.15.115:0/3518269112 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdadc0cb250 0x7fdadc1ee8c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:27.813 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.811+0000 7fdae2136700 1 -- 172.21.15.115:0/3518269112 >> 172.21.15.115:0/3518269112 conn(0x7fdadc06bad0 msgr2=0x7fdadc145d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:27.813 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.811+0000 7fdae2136700 1 -- 172.21.15.115:0/3518269112 shutdown_connections 2024-05-08T21:49:27.813 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.811+0000 7fdae2136700 1 -- 172.21.15.115:0/3518269112 wait complete. 2024-05-08T21:49:27.814 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-05-08T21:49:27.812+0000 7fabb85d6200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-08T21:49:27.824 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph osd new 4ebe0a18-8216-4815-878a-39c39a6cd3fc 4 2024-05-08T21:49:27.880 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-08T21:49:27.879+0000 7f54f189d200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-08T21:49:27.945 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.944+0000 7f42cc54a700 1 Processor -- start 2024-05-08T21:49:27.946 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.944+0000 7f42cc54a700 1 -- start start 2024-05-08T21:49:27.948 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.945+0000 7f42cc54a700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f42c4072ba0 0x7f42c40c65b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:27.948 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.945+0000 7f42cc54a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f42c4071e40 0x7f42c406bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:27.948 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.945+0000 7f42cc54a700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42c4072290 con 0x7f42c4150b60 2024-05-08T21:49:27.948 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.945+0000 7f42cc54a700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42c40724f0 con 0x7f42c4072ba0 2024-05-08T21:49:27.948 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.945+0000 7f42cc54a700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42c40c3ac0 con 0x7f42c4071e40 2024-05-08T21:49:27.948 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.945+0000 7f42ca2e6700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f42c4150b60 0x7f42c4157200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:37730/0 (socket says 172.21.15.115:37730) 2024-05-08T21:49:27.948 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.945+0000 7f42caae7700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f42c4071e40 0x7f42c406bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:27.949 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.945+0000 7f42ca2e6700 1 -- 172.21.15.115:0/3650170582 learned_addr learned my addr 172.21.15.115:0/3650170582 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-08T21:49:27.949 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.946+0000 7f42c9ae5700 1 --2- 172.21.15.115:0/3650170582 >> v2:172.21.15.73:3300/0 conn(0x7f42c4072ba0 0x7f42c40c65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:27.949 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.946+0000 7f42caae7700 1 -- 172.21.15.115:0/3650170582 >> v2:172.21.15.73:3300/0 conn(0x7f42c4072ba0 msgr2=0x7f42c40c65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:27.949 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.946+0000 7f42caae7700 1 --2- 172.21.15.115:0/3650170582 >> v2:172.21.15.73:3300/0 conn(0x7f42c4072ba0 0x7f42c40c65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:27.949 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.946+0000 7f42caae7700 1 -- 172.21.15.115:0/3650170582 >> v1:172.21.15.115:6789/0 conn(0x7f42c4150b60 legacy=0x7f42c4157200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:27.949 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.946+0000 7f42caae7700 1 -- 172.21.15.115:0/3650170582 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c40c3da0 con 0x7f42c4071e40 2024-05-08T21:49:27.949 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.946+0000 7f42c92e4700 1 -- 172.21.15.115:0/3650170582 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1875779031 0 0) 0x7f42c4072290 con 0x7f42c4150b60 2024-05-08T21:49:27.949 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.946+0000 7f42c9ae5700 1 --2- 172.21.15.115:0/3650170582 >> v2:172.21.15.73:3300/0 conn(0x7f42c4072ba0 0x7f42c40c65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:49:27.949 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.946+0000 7f42caae7700 1 --2- 172.21.15.115:0/3650170582 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42c4071e40 0x7f42c406bad0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f42bc009d90 tx=0x7f42bc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15da00495f2a09d0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:27.949 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.946+0000 7f42c92e4700 1 -- 172.21.15.115:0/3650170582 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42bc00e070 con 0x7f42c4071e40 2024-05-08T21:49:27.949 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.946+0000 7f42c92e4700 1 -- 172.21.15.115:0/3650170582 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42bc00bb90 con 0x7f42c4071e40 2024-05-08T21:49:27.949 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.946+0000 7f42c92e4700 1 -- 172.21.15.115:0/3650170582 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42bc012430 con 0x7f42c4071e40 2024-05-08T21:49:27.949 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.947+0000 7f42cc54a700 1 -- 172.21.15.115:0/3650170582 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42c4071e40 msgr2=0x7f42c406bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:27.949 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.947+0000 7f42cc54a700 1 --2- 172.21.15.115:0/3650170582 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42c4071e40 0x7f42c406bad0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f42bc009d90 tx=0x7f42bc00b330 comp rx=0 tx=0).stop 2024-05-08T21:49:27.949 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.947+0000 7f42cc54a700 1 -- 172.21.15.115:0/3650170582 shutdown_connections 2024-05-08T21:49:27.950 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.947+0000 7f42cc54a700 1 --2- 172.21.15.115:0/3650170582 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42c4071e40 0x7f42c406bad0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:27.950 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.947+0000 7f42cc54a700 1 --2- 172.21.15.115:0/3650170582 >> v2:172.21.15.73:3300/0 conn(0x7f42c4072ba0 0x7f42c40c65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:27.950 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.947+0000 7f42cc54a700 1 -- 172.21.15.115:0/3650170582 >> 172.21.15.115:0/3650170582 conn(0x7f42c40cc420 msgr2=0x7f42c40cc800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:27.950 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.947+0000 7f42cc54a700 1 -- 172.21.15.115:0/3650170582 shutdown_connections 2024-05-08T21:49:27.950 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.947+0000 7f42cc54a700 1 -- 172.21.15.115:0/3650170582 wait complete. 2024-05-08T21:49:27.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.948+0000 7f42cc54a700 1 Processor -- start 2024-05-08T21:49:27.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.948+0000 7f42cc54a700 1 -- start start 2024-05-08T21:49:27.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.949+0000 7f42cc54a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42c4071e40 0x7f42c40cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:27.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.949+0000 7f42cc54a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f42c4072ba0 0x7f42c40c6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:27.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.949+0000 7f42cc54a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42c4150b60 0x7f42c40c7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:27.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.949+0000 7f42cc54a700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c41563e0 con 0x7f42c4150b60 2024-05-08T21:49:27.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.949+0000 7f42cc54a700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c41460e0 con 0x7f42c4071e40 2024-05-08T21:49:27.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.949+0000 7f42cc54a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42c40c8970 con 0x7f42c4072ba0 2024-05-08T21:49:27.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.949+0000 7f42ca2e6700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42c4071e40 0x7f42c40cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:27.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.949+0000 7f42c9ae5700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f42c4072ba0 0x7f42c40c6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:27.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.949+0000 7f42ca2e6700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42c4071e40 0x7f42c40cb4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54114/0 (socket says 172.21.15.115:54114) 2024-05-08T21:49:27.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.949+0000 7f42ca2e6700 1 -- 172.21.15.115:0/740585768 learned_addr learned my addr 172.21.15.115:0/740585768 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-08T21:49:27.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.949+0000 7f42caae7700 1 --2- 172.21.15.115:0/740585768 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42c4150b60 0x7f42c40c7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:27.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.949+0000 7f42c9ae5700 1 -- 172.21.15.115:0/740585768 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42c4071e40 msgr2=0x7f42c40cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:27.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.949+0000 7f42c9ae5700 1 --2- 172.21.15.115:0/740585768 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42c4071e40 0x7f42c40cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:27.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.949+0000 7f42c9ae5700 1 -- 172.21.15.115:0/740585768 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42c4150b60 msgr2=0x7f42c40c7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:27.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.949+0000 7f42c9ae5700 1 --2- 172.21.15.115:0/740585768 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42c4150b60 0x7f42c40c7330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:27.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.949+0000 7f42c9ae5700 1 -- 172.21.15.115:0/740585768 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42bc009a70 con 0x7f42c4072ba0 2024-05-08T21:49:27.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.949+0000 7f42ca2e6700 1 --2- 172.21.15.115:0/740585768 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42c4071e40 0x7f42c40cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:49:27.954 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.949+0000 7f42c9ae5700 1 --2- 172.21.15.115:0/740585768 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f42c4072ba0 0x7f42c40c6df0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f42b400e810 tx=0x7f42b400eb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:27.954 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.949+0000 7f42baffd700 1 -- 172.21.15.115:0/740585768 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b400c070 con 0x7f42c4072ba0 2024-05-08T21:49:27.954 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.949+0000 7f42baffd700 1 -- 172.21.15.115:0/740585768 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42b4004230 con 0x7f42c4072ba0 2024-05-08T21:49:27.954 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.949+0000 7f42cc54a700 1 -- 172.21.15.115:0/740585768 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42c41545c0 con 0x7f42c4072ba0 2024-05-08T21:49:27.954 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.949+0000 7f42baffd700 1 -- 172.21.15.115:0/740585768 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b40036a0 con 0x7f42c4072ba0 2024-05-08T21:49:27.954 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.950+0000 7f42cc54a700 1 -- 172.21.15.115:0/740585768 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42c40c83b0 con 0x7f42c4072ba0 2024-05-08T21:49:27.954 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.950+0000 7f42baffd700 1 -- 172.21.15.115:0/740585768 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f42b4003b00 con 0x7f42c4072ba0 2024-05-08T21:49:27.954 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.950+0000 7f42baffd700 1 -- 172.21.15.115:0/740585768 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f42b4013b40 con 0x7f42c4072ba0 2024-05-08T21:49:27.954 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.951+0000 7f42cc54a700 1 -- 172.21.15.115:0/740585768 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42c4068b80 con 0x7f42c4072ba0 2024-05-08T21:49:27.955 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:27.953+0000 7f42baffd700 1 -- 172.21.15.115:0/740585768 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f42b400f040 con 0x7f42c4072ba0 2024-05-08T21:49:28.037 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.036+0000 7f42cc54a700 1 -- 172.21.15.115:0/740585768 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd new", "uuid": "4ebe0a18-8216-4815-878a-39c39a6cd3fc", "id": 4} v 0) v1 -- 0x7f42c4072980 con 0x7f42c4072ba0 2024-05-08T21:49:28.046 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.044+0000 7f42baffd700 1 -- 172.21.15.115:0/740585768 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4ebe0a18-8216-4815-878a-39c39a6cd3fc", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f42b4013410 con 0x7f42c4072ba0 2024-05-08T21:49:28.046 INFO:teuthology.orchestra.run.smithi115.stdout:4 2024-05-08T21:49:28.047 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.045+0000 7f42cc54a700 1 -- 172.21.15.115:0/740585768 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f42c4072ba0 msgr2=0x7f42c40c6df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:28.047 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.045+0000 7f42cc54a700 1 --2- 172.21.15.115:0/740585768 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f42c4072ba0 0x7f42c40c6df0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f42b400e810 tx=0x7f42b400eb20 comp rx=0 tx=0).stop 2024-05-08T21:49:28.047 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.045+0000 7f42cc54a700 1 -- 172.21.15.115:0/740585768 shutdown_connections 2024-05-08T21:49:28.047 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.045+0000 7f42cc54a700 1 --2- 172.21.15.115:0/740585768 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42c4150b60 0x7f42c40c7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:28.047 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.045+0000 7f42cc54a700 1 --2- 172.21.15.115:0/740585768 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42c4071e40 0x7f42c40cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:28.048 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.045+0000 7f42cc54a700 1 --2- 172.21.15.115:0/740585768 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f42c4072ba0 0x7f42c40c6df0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:28.048 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.045+0000 7f42cc54a700 1 -- 172.21.15.115:0/740585768 >> 172.21.15.115:0/740585768 conn(0x7f42c40cc420 msgr2=0x7f42c40cc800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:28.048 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.045+0000 7f42cc54a700 1 -- 172.21.15.115:0/740585768 shutdown_connections 2024-05-08T21:49:28.048 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.045+0000 7f42cc54a700 1 -- 172.21.15.115:0/740585768 wait complete. 2024-05-08T21:49:28.057 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph osd new 957f0ac1-5f26-4f02-8c05-488e6b67ee37 5 2024-05-08T21:49:28.182 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.181+0000 7f495cd64700 1 Processor -- start 2024-05-08T21:49:28.183 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.181+0000 7f495cd64700 1 -- start start 2024-05-08T21:49:28.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.182+0000 7f495cd64700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4958072a70 0x7f4958162290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:28.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.182+0000 7f495cd64700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49580c3eb0 con 0x7f49580cb250 2024-05-08T21:49:28.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.182+0000 7f495cd64700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49580c9720 con 0x7f4958150c50 2024-05-08T21:49:28.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.182+0000 7f495cd64700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49580c3bd0 con 0x7f4958072a70 2024-05-08T21:49:28.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.183+0000 7f495659c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f4958150c50 0x7f49580c9010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:37740/0 (socket says 172.21.15.115:37740) 2024-05-08T21:49:28.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.183+0000 7f4956d9d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4958072a70 0x7f4958162290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:28.186 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.183+0000 7f495659c700 1 -- 172.21.15.115:0/3139705994 learned_addr learned my addr 172.21.15.115:0/3139705994 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-08T21:49:28.186 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.183+0000 7f495559a700 1 -- 172.21.15.115:0/3139705994 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 968305508 0 0) 0x7f49580c9720 con 0x7f4958150c50 2024-05-08T21:49:28.186 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.183+0000 7f495559a700 1 -- 172.21.15.115:0/3139705994 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49400035b0 con 0x7f4958150c50 2024-05-08T21:49:28.186 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.183+0000 7f4956d9d700 1 -- 172.21.15.115:0/3139705994 >> v1:172.21.15.115:6789/0 conn(0x7f4958150c50 legacy=0x7f49580c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:28.186 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.183+0000 7f4956d9d700 1 -- 172.21.15.115:0/3139705994 >> v1:172.21.15.73:6789/0 conn(0x7f49580cb250 legacy=0x7f49580ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:28.186 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.183+0000 7f495559a700 1 -- 172.21.15.115:0/3139705994 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 819615985 0 0) 0x7f49580c3eb0 con 0x7f49580cb250 2024-05-08T21:49:28.186 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.183+0000 7f4956d9d700 1 -- 172.21.15.115:0/3139705994 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49580c5580 con 0x7f4958072a70 2024-05-08T21:49:28.186 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.183+0000 7f4956d9d700 1 --2- 172.21.15.115:0/3139705994 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4958072a70 0x7f4958162290 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4950009dc0 tx=0x7f495000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ff59a246adf9e7c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:28.186 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.183+0000 7f495559a700 1 -- 172.21.15.115:0/3139705994 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495000e070 con 0x7f4958072a70 2024-05-08T21:49:28.186 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.183+0000 7f495559a700 1 -- 172.21.15.115:0/3139705994 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f495000bb20 con 0x7f4958072a70 2024-05-08T21:49:28.186 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.183+0000 7f495559a700 1 -- 172.21.15.115:0/3139705994 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495000bed0 con 0x7f4958072a70 2024-05-08T21:49:28.186 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.184+0000 7f495cd64700 1 -- 172.21.15.115:0/3139705994 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4958072a70 msgr2=0x7f4958162290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:28.186 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.184+0000 7f495cd64700 1 --2- 172.21.15.115:0/3139705994 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4958072a70 0x7f4958162290 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4950009dc0 tx=0x7f495000b330 comp rx=0 tx=0).stop 2024-05-08T21:49:28.186 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.184+0000 7f495cd64700 1 -- 172.21.15.115:0/3139705994 shutdown_connections 2024-05-08T21:49:28.187 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.184+0000 7f495cd64700 1 --2- 172.21.15.115:0/3139705994 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4958072a70 0x7f4958162290 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:28.187 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.184+0000 7f495cd64700 1 -- 172.21.15.115:0/3139705994 >> 172.21.15.115:0/3139705994 conn(0x7f495806bad0 msgr2=0x7f495806bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:28.187 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.184+0000 7f495cd64700 1 -- 172.21.15.115:0/3139705994 shutdown_connections 2024-05-08T21:49:28.187 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.184+0000 7f495cd64700 1 -- 172.21.15.115:0/3139705994 wait complete. 2024-05-08T21:49:28.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.185+0000 7f495cd64700 1 Processor -- start 2024-05-08T21:49:28.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.185+0000 7f495cd64700 1 -- start start 2024-05-08T21:49:28.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.186+0000 7f495cd64700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4958072a70 0x7f49581432c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:28.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.186+0000 7f495cd64700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f49580cb250 0x7f49580c9110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:28.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.186+0000 7f495cd64700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4958150c50 0x7f495806a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:28.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.186+0000 7f495cd64700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4958142ea0 con 0x7f49580cb250 2024-05-08T21:49:28.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.186+0000 7f495cd64700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f495814bdc0 con 0x7f4958072a70 2024-05-08T21:49:28.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.186+0000 7f495cd64700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49581543e0 con 0x7f4958150c50 2024-05-08T21:49:28.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.186+0000 7f495659c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4958072a70 0x7f49581432c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:28.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.186+0000 7f4956d9d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4958150c50 0x7f495806a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:28.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.186+0000 7f4956d9d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4958150c50 0x7f495806a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:52454/0 (socket says 172.21.15.115:52454) 2024-05-08T21:49:28.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.186+0000 7f495659c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4958072a70 0x7f49581432c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54124/0 (socket says 172.21.15.115:54124) 2024-05-08T21:49:28.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.186+0000 7f4956d9d700 1 -- 172.21.15.115:0/4090547922 learned_addr learned my addr 172.21.15.115:0/4090547922 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-08T21:49:28.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.186+0000 7f4955d9b700 1 --2- 172.21.15.115:0/4090547922 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f49580cb250 0x7f49580c9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:28.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.187+0000 7f495659c700 1 -- 172.21.15.115:0/4090547922 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4958150c50 msgr2=0x7f495806a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:28.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.187+0000 7f495659c700 1 --2- 172.21.15.115:0/4090547922 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4958150c50 0x7f495806a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:28.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.187+0000 7f495659c700 1 -- 172.21.15.115:0/4090547922 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f49580cb250 msgr2=0x7f49580c9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:28.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.187+0000 7f495659c700 1 --2- 172.21.15.115:0/4090547922 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f49580cb250 0x7f49580c9110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:28.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.187+0000 7f495659c700 1 -- 172.21.15.115:0/4090547922 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4950009a70 con 0x7f4958072a70 2024-05-08T21:49:28.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.187+0000 7f495659c700 1 --2- 172.21.15.115:0/4090547922 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4958072a70 0x7f49581432c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f494800c390 tx=0x7f494800c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:28.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.187+0000 7f4946ffd700 1 -- 172.21.15.115:0/4090547922 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4948005b40 con 0x7f4958072a70 2024-05-08T21:49:28.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.187+0000 7f4946ffd700 1 -- 172.21.15.115:0/4090547922 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4948005ca0 con 0x7f4958072a70 2024-05-08T21:49:28.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.187+0000 7f495cd64700 1 -- 172.21.15.115:0/4090547922 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49581e3960 con 0x7f4958072a70 2024-05-08T21:49:28.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.187+0000 7f4946ffd700 1 -- 172.21.15.115:0/4090547922 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4948007310 con 0x7f4958072a70 2024-05-08T21:49:28.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.187+0000 7f495cd64700 1 -- 172.21.15.115:0/4090547922 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49581f32f0 con 0x7f4958072a70 2024-05-08T21:49:28.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.187+0000 7f4946ffd700 1 -- 172.21.15.115:0/4090547922 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f494801c440 con 0x7f4958072a70 2024-05-08T21:49:28.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.187+0000 7f4946ffd700 1 -- 172.21.15.115:0/4090547922 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f4948007770 con 0x7f4958072a70 2024-05-08T21:49:28.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.188+0000 7f495cd64700 1 -- 172.21.15.115:0/4090547922 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4958143110 con 0x7f4958072a70 2024-05-08T21:49:28.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.190+0000 7f4946ffd700 1 -- 172.21.15.115:0/4090547922 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f49581e3960 con 0x7f4958072a70 2024-05-08T21:49:28.201 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-05-08T21:49:28.200+0000 7fabb85d6200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-08T21:49:28.290 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-08T21:49:28.289+0000 7f54f189d200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-08T21:49:28.292 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.291+0000 7f495cd64700 1 -- 172.21.15.115:0/4090547922 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd new", "uuid": "957f0ac1-5f26-4f02-8c05-488e6b67ee37", "id": 5} v 0) v1 -- 0x7f4958068b80 con 0x7f4958072a70 2024-05-08T21:49:28.301 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.299+0000 7f4946ffd700 1 -- 172.21.15.115:0/4090547922 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "957f0ac1-5f26-4f02-8c05-488e6b67ee37", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4948017070 con 0x7f4958072a70 2024-05-08T21:49:28.302 INFO:teuthology.orchestra.run.smithi115.stdout:5 2024-05-08T21:49:28.303 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.300+0000 7f495cd64700 1 -- 172.21.15.115:0/4090547922 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4958072a70 msgr2=0x7f49581432c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:28.303 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.300+0000 7f495cd64700 1 --2- 172.21.15.115:0/4090547922 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4958072a70 0x7f49581432c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f494800c390 tx=0x7f494800c6a0 comp rx=0 tx=0).stop 2024-05-08T21:49:28.303 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.300+0000 7f495cd64700 1 -- 172.21.15.115:0/4090547922 shutdown_connections 2024-05-08T21:49:28.303 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.300+0000 7f495cd64700 1 --2- 172.21.15.115:0/4090547922 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4958150c50 0x7f495806a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:28.303 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.300+0000 7f495cd64700 1 --2- 172.21.15.115:0/4090547922 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4958072a70 0x7f49581432c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:28.303 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.300+0000 7f495cd64700 1 --2- 172.21.15.115:0/4090547922 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f49580cb250 0x7f49580c9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:28.303 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.300+0000 7f495cd64700 1 -- 172.21.15.115:0/4090547922 >> 172.21.15.115:0/4090547922 conn(0x7f495806bad0 msgr2=0x7f495806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:28.303 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.300+0000 7f495cd64700 1 -- 172.21.15.115:0/4090547922 shutdown_connections 2024-05-08T21:49:28.303 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.300+0000 7f495cd64700 1 -- 172.21.15.115:0/4090547922 wait complete. 2024-05-08T21:49:28.314 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph osd new f5a6768f-ba7f-4f66-b335-0c303b158e3d 6 2024-05-08T21:49:28.435 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.434+0000 7f8d01031700 1 Processor -- start 2024-05-08T21:49:28.435 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.434+0000 7f8d01031700 1 -- start start 2024-05-08T21:49:28.438 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.435+0000 7f8d01031700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8cfc0cac40 0x7f8cfc0720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:28.439 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.435+0000 7f8d01031700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8cfc072630 0x7f8cfc15a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:28.439 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.435+0000 7f8d01031700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cfc0c9f90 con 0x7f8cfc153e20 2024-05-08T21:49:28.439 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.435+0000 7f8d01031700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cfc159c00 con 0x7f8cfc0cac40 2024-05-08T21:49:28.439 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.435+0000 7f8d01031700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cfc0ca250 con 0x7f8cfc072630 2024-05-08T21:49:28.439 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.435+0000 7f8cfb59e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8cfc072630 0x7f8cfc15a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:28.439 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.435+0000 7f8cfb59e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8cfc072630 0x7f8cfc15a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:52456/0 (socket says 172.21.15.115:52456) 2024-05-08T21:49:28.439 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.435+0000 7f8cfb59e700 1 -- 172.21.15.115:0/3293095295 learned_addr learned my addr 172.21.15.115:0/3293095295 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-08T21:49:28.439 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.435+0000 7f8cfa59c700 1 --2- 172.21.15.115:0/3293095295 >> v2:172.21.15.73:3300/0 conn(0x7f8cfc0cac40 0x7f8cfc0720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:28.439 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.436+0000 7f8cfb59e700 1 -- 172.21.15.115:0/3293095295 >> v2:172.21.15.73:3300/0 conn(0x7f8cfc0cac40 msgr2=0x7f8cfc0720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:28.439 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.436+0000 7f8cfb59e700 1 --2- 172.21.15.115:0/3293095295 >> v2:172.21.15.73:3300/0 conn(0x7f8cfc0cac40 0x7f8cfc0720f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:28.439 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.436+0000 7f8cfb59e700 1 -- 172.21.15.115:0/3293095295 >> v1:172.21.15.73:6789/0 conn(0x7f8cfc153e20 legacy=0x7f8cfc15dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:28.439 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.436+0000 7f8cfb59e700 1 -- 172.21.15.115:0/3293095295 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cfc0cb7e0 con 0x7f8cfc072630 2024-05-08T21:49:28.440 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.436+0000 7f8cfb59e700 1 --2- 172.21.15.115:0/3293095295 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8cfc072630 0x7f8cfc15a100 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8cf4009e50 tx=0x7f8cf400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=689f17b8a721f864 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:28.440 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.436+0000 7f8cf9d9b700 1 -- 172.21.15.115:0/3293095295 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf400e070 con 0x7f8cfc072630 2024-05-08T21:49:28.440 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.436+0000 7f8cf9d9b700 1 -- 172.21.15.115:0/3293095295 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf400b910 con 0x7f8cfc072630 2024-05-08T21:49:28.440 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.436+0000 7f8cf9d9b700 1 -- 172.21.15.115:0/3293095295 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf400bcc0 con 0x7f8cfc072630 2024-05-08T21:49:28.440 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.437+0000 7f8d01031700 1 -- 172.21.15.115:0/3293095295 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8cfc072630 msgr2=0x7f8cfc15a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:28.440 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.437+0000 7f8d01031700 1 --2- 172.21.15.115:0/3293095295 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8cfc072630 0x7f8cfc15a100 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8cf4009e50 tx=0x7f8cf400b330 comp rx=0 tx=0).stop 2024-05-08T21:49:28.440 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.437+0000 7f8d01031700 1 -- 172.21.15.115:0/3293095295 shutdown_connections 2024-05-08T21:49:28.440 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.437+0000 7f8d01031700 1 --2- 172.21.15.115:0/3293095295 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8cfc072630 0x7f8cfc15a100 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:28.440 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.437+0000 7f8d01031700 1 --2- 172.21.15.115:0/3293095295 >> v2:172.21.15.73:3300/0 conn(0x7f8cfc0cac40 0x7f8cfc0720f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:28.440 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.437+0000 7f8d01031700 1 -- 172.21.15.115:0/3293095295 >> 172.21.15.115:0/3293095295 conn(0x7f8cfc06be90 msgr2=0x7f8cfc06c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:28.440 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.437+0000 7f8d01031700 1 -- 172.21.15.115:0/3293095295 shutdown_connections 2024-05-08T21:49:28.441 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.437+0000 7f8d01031700 1 -- 172.21.15.115:0/3293095295 wait complete. 2024-05-08T21:49:28.443 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.438+0000 7f8d01031700 1 Processor -- start 2024-05-08T21:49:28.443 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.439+0000 7f8d01031700 1 -- start start 2024-05-08T21:49:28.443 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.439+0000 7f8d01031700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8cfc072630 0x7f8cfc1532a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:28.443 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.439+0000 7f8d01031700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8cfc0cac40 0x7f8cfc1f0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:28.444 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.439+0000 7f8d01031700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8cfc153e20 0x7f8cfc148390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:28.444 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.439+0000 7f8d01031700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cfc1f0570 con 0x7f8cfc153e20 2024-05-08T21:49:28.444 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.439+0000 7f8d01031700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cfc152cd0 con 0x7f8cfc072630 2024-05-08T21:49:28.444 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.439+0000 7f8d01031700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cfc152f70 con 0x7f8cfc0cac40 2024-05-08T21:49:28.444 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.439+0000 7f8cfa59c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8cfc0cac40 0x7f8cfc1f0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:28.444 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.439+0000 7f8cfad9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8cfc072630 0x7f8cfc1532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:28.444 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.439+0000 7f8cfa59c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8cfc0cac40 0x7f8cfc1f0030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:52458/0 (socket says 172.21.15.115:52458) 2024-05-08T21:49:28.444 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.439+0000 7f8cfa59c700 1 -- 172.21.15.115:0/1903126528 learned_addr learned my addr 172.21.15.115:0/1903126528 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-08T21:49:28.444 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.439+0000 7f8cfad9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8cfc072630 0x7f8cfc1532a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54128/0 (socket says 172.21.15.115:54128) 2024-05-08T21:49:28.444 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.439+0000 7f8cfb59e700 1 --2- 172.21.15.115:0/1903126528 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8cfc153e20 0x7f8cfc148390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:28.444 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.440+0000 7f8cfad9d700 1 -- 172.21.15.115:0/1903126528 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8cfc0cac40 msgr2=0x7f8cfc1f0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:28.444 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.440+0000 7f8cfad9d700 1 --2- 172.21.15.115:0/1903126528 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8cfc0cac40 0x7f8cfc1f0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:28.444 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.440+0000 7f8cfad9d700 1 -- 172.21.15.115:0/1903126528 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8cfc153e20 msgr2=0x7f8cfc148390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:28.444 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.440+0000 7f8cfad9d700 1 --2- 172.21.15.115:0/1903126528 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8cfc153e20 0x7f8cfc148390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:28.444 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.440+0000 7f8cfad9d700 1 -- 172.21.15.115:0/1903126528 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf4009b30 con 0x7f8cfc072630 2024-05-08T21:49:28.445 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.440+0000 7f8cfa59c700 1 --2- 172.21.15.115:0/1903126528 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8cfc0cac40 0x7f8cfc1f0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:49:28.445 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.440+0000 7f8cfad9d700 1 --2- 172.21.15.115:0/1903126528 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8cfc072630 0x7f8cfc1532a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8cec000f60 tx=0x7f8cec00c6e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:28.445 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.440+0000 7f8ce37fe700 1 -- 172.21.15.115:0/1903126528 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cec0052d0 con 0x7f8cfc072630 2024-05-08T21:49:28.445 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.440+0000 7f8ce37fe700 1 -- 172.21.15.115:0/1903126528 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cec005430 con 0x7f8cfc072630 2024-05-08T21:49:28.445 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.440+0000 7f8d01031700 1 -- 172.21.15.115:0/1903126528 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cfc1511b0 con 0x7f8cfc072630 2024-05-08T21:49:28.445 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.440+0000 7f8ce37fe700 1 -- 172.21.15.115:0/1903126528 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cec0038c0 con 0x7f8cfc072630 2024-05-08T21:49:28.445 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.440+0000 7f8d01031700 1 -- 172.21.15.115:0/1903126528 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cfc151770 con 0x7f8cfc072630 2024-05-08T21:49:28.445 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.440+0000 7f8ce37fe700 1 -- 172.21.15.115:0/1903126528 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f8cec01c440 con 0x7f8cfc072630 2024-05-08T21:49:28.445 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.440+0000 7f8ce37fe700 1 -- 172.21.15.115:0/1903126528 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f8cec012a10 con 0x7f8cfc072630 2024-05-08T21:49:28.445 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.441+0000 7f8d01031700 1 -- 172.21.15.115:0/1903126528 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cfc068b80 con 0x7f8cfc072630 2024-05-08T21:49:28.446 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.443+0000 7f8ce37fe700 1 -- 172.21.15.115:0/1903126528 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f8cec017070 con 0x7f8cfc072630 2024-05-08T21:49:28.523 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-05-08T21:49:28.522+0000 7fabb85d6200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-08T21:49:28.592 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.591+0000 7f8d01031700 1 -- 172.21.15.115:0/1903126528 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f5a6768f-ba7f-4f66-b335-0c303b158e3d", "id": 6} v 0) v1 -- 0x7f8cfc0cb240 con 0x7f8cfc072630 2024-05-08T21:49:28.603 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.602+0000 7f8ce37fe700 1 -- 172.21.15.115:0/1903126528 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f5a6768f-ba7f-4f66-b335-0c303b158e3d", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8cec012420 con 0x7f8cfc072630 2024-05-08T21:49:28.604 INFO:teuthology.orchestra.run.smithi115.stdout:6 2024-05-08T21:49:28.605 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.603+0000 7f8d01031700 1 -- 172.21.15.115:0/1903126528 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8cfc072630 msgr2=0x7f8cfc1532a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:28.605 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.603+0000 7f8d01031700 1 --2- 172.21.15.115:0/1903126528 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8cfc072630 0x7f8cfc1532a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8cec000f60 tx=0x7f8cec00c6e0 comp rx=0 tx=0).stop 2024-05-08T21:49:28.605 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.603+0000 7f8d01031700 1 -- 172.21.15.115:0/1903126528 shutdown_connections 2024-05-08T21:49:28.605 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.603+0000 7f8d01031700 1 --2- 172.21.15.115:0/1903126528 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8cfc153e20 0x7f8cfc148390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:28.605 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.603+0000 7f8d01031700 1 --2- 172.21.15.115:0/1903126528 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8cfc072630 0x7f8cfc1532a0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:28.605 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.603+0000 7f8d01031700 1 --2- 172.21.15.115:0/1903126528 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8cfc0cac40 0x7f8cfc1f0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:28.605 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.603+0000 7f8d01031700 1 -- 172.21.15.115:0/1903126528 >> 172.21.15.115:0/1903126528 conn(0x7f8cfc06be90 msgr2=0x7f8cfc1507b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:28.605 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.603+0000 7f8d01031700 1 -- 172.21.15.115:0/1903126528 shutdown_connections 2024-05-08T21:49:28.605 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.604+0000 7f8d01031700 1 -- 172.21.15.115:0/1903126528 wait complete. 2024-05-08T21:49:28.618 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph osd new f4187743-f9e6-42e6-aca9-0604a58db1ab 7 2024-05-08T21:49:28.675 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-08T21:49:28.674+0000 7f54f189d200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-08T21:49:28.682 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-05-08T21:49:28.681+0000 7fabb85d6200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-08T21:49:28.741 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.740+0000 7fda97061700 1 Processor -- start 2024-05-08T21:49:28.742 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.740+0000 7fda97061700 1 -- start start 2024-05-08T21:49:28.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.741+0000 7fda97061700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fda900c98e0 0x7fda900c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:28.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.741+0000 7fda97061700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fda90157c50 0x7fda901580e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:28.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.741+0000 7fda97061700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda90158620 con 0x7fda90151e10 2024-05-08T21:49:28.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.741+0000 7fda97061700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda900c8a70 con 0x7fda90157c50 2024-05-08T21:49:28.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.741+0000 7fda97061700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda9015b0f0 con 0x7fda900c98e0 2024-05-08T21:49:28.744 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.741+0000 7fda955fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fda90157c50 0x7fda901580e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:28.744 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.741+0000 7fda94dfd700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fda90151e10 0x7fda900c5920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:37742/0 (socket says 172.21.15.115:37742) 2024-05-08T21:49:28.744 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.741+0000 7fda94dfd700 1 -- 172.21.15.115:0/1707951798 learned_addr learned my addr 172.21.15.115:0/1707951798 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-08T21:49:28.744 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.741+0000 7fda8ffff700 1 --2- 172.21.15.115:0/1707951798 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fda900c98e0 0x7fda900c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:28.744 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.742+0000 7fda8ffff700 1 -- 172.21.15.115:0/1707951798 >> v2:172.21.15.115:3300/0 conn(0x7fda90157c50 msgr2=0x7fda901580e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:28.744 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.742+0000 7fda8ffff700 1 --2- 172.21.15.115:0/1707951798 >> v2:172.21.15.115:3300/0 conn(0x7fda90157c50 0x7fda901580e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:28.744 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.742+0000 7fda8ffff700 1 -- 172.21.15.115:0/1707951798 >> v1:172.21.15.115:6789/0 conn(0x7fda90151e10 legacy=0x7fda900c5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:28.744 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.742+0000 7fda8ffff700 1 -- 172.21.15.115:0/1707951798 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda9015b3b0 con 0x7fda900c98e0 2024-05-08T21:49:28.744 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.742+0000 7fda955fe700 1 --2- 172.21.15.115:0/1707951798 >> v2:172.21.15.115:3300/0 conn(0x7fda90157c50 0x7fda901580e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:49:28.744 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.742+0000 7fda8ffff700 1 --2- 172.21.15.115:0/1707951798 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fda900c98e0 0x7fda900c6c10 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fda7c009870 tx=0x7fda7c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69331bbb0ff86935 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:28.744 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.742+0000 7fda8f7fe700 1 -- 172.21.15.115:0/1707951798 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7c011830 con 0x7fda900c98e0 2024-05-08T21:49:28.744 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.742+0000 7fda8f7fe700 1 -- 172.21.15.115:0/1707951798 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda7c011990 con 0x7fda900c98e0 2024-05-08T21:49:28.744 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.742+0000 7fda8f7fe700 1 -- 172.21.15.115:0/1707951798 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7c011d20 con 0x7fda900c98e0 2024-05-08T21:49:28.747 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.743+0000 7fda97061700 1 -- 172.21.15.115:0/1707951798 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fda900c98e0 msgr2=0x7fda900c6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:28.747 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.743+0000 7fda97061700 1 --2- 172.21.15.115:0/1707951798 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fda900c98e0 0x7fda900c6c10 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fda7c009870 tx=0x7fda7c009b80 comp rx=0 tx=0).stop 2024-05-08T21:49:28.748 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.743+0000 7fda97061700 1 -- 172.21.15.115:0/1707951798 shutdown_connections 2024-05-08T21:49:28.748 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.743+0000 7fda97061700 1 --2- 172.21.15.115:0/1707951798 >> v2:172.21.15.115:3300/0 conn(0x7fda90157c50 0x7fda901580e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:28.748 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.743+0000 7fda97061700 1 --2- 172.21.15.115:0/1707951798 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fda900c98e0 0x7fda900c6c10 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:28.748 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.743+0000 7fda97061700 1 -- 172.21.15.115:0/1707951798 >> 172.21.15.115:0/1707951798 conn(0x7fda900c8d10 msgr2=0x7fda900c9120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:28.748 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.743+0000 7fda97061700 1 -- 172.21.15.115:0/1707951798 shutdown_connections 2024-05-08T21:49:28.748 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.743+0000 7fda97061700 1 -- 172.21.15.115:0/1707951798 wait complete. 2024-05-08T21:49:28.748 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.744+0000 7fda97061700 1 Processor -- start 2024-05-08T21:49:28.748 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.744+0000 7fda97061700 1 -- start start 2024-05-08T21:49:28.748 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.745+0000 7fda97061700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda900c98e0 0x7fda90156570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:28.748 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.745+0000 7fda97061700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda90151e10 0x7fda901edc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:28.748 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.745+0000 7fda97061700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fda90157c50 0x7fda901507c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:28.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.745+0000 7fda97061700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda90144ee0 con 0x7fda900c98e0 2024-05-08T21:49:28.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.745+0000 7fda97061700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda901ed220 con 0x7fda90151e10 2024-05-08T21:49:28.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.745+0000 7fda97061700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda90156ab0 con 0x7fda90157c50 2024-05-08T21:49:28.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.745+0000 7fda955fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fda90157c50 0x7fda901507c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:28.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.745+0000 7fda8ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda90151e10 0x7fda901edc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:28.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.745+0000 7fda8ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda90151e10 0x7fda901edc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54156/0 (socket says 172.21.15.115:54156) 2024-05-08T21:49:28.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.745+0000 7fda955fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fda90157c50 0x7fda901507c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:52476/0 (socket says 172.21.15.115:52476) 2024-05-08T21:49:28.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.745+0000 7fda8ffff700 1 -- 172.21.15.115:0/92130919 learned_addr learned my addr 172.21.15.115:0/92130919 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-08T21:49:28.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.745+0000 7fda94dfd700 1 --2- 172.21.15.115:0/92130919 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda900c98e0 0x7fda90156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:28.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.745+0000 7fda8ffff700 1 -- 172.21.15.115:0/92130919 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fda90157c50 msgr2=0x7fda901507c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:28.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.745+0000 7fda8ffff700 1 --2- 172.21.15.115:0/92130919 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fda90157c50 0x7fda901507c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:28.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.745+0000 7fda8ffff700 1 -- 172.21.15.115:0/92130919 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda900c98e0 msgr2=0x7fda90156570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:28.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.745+0000 7fda8ffff700 1 --2- 172.21.15.115:0/92130919 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda900c98e0 0x7fda90156570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:28.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.745+0000 7fda8ffff700 1 -- 172.21.15.115:0/92130919 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda88009a70 con 0x7fda90151e10 2024-05-08T21:49:28.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.745+0000 7fda955fe700 1 --2- 172.21.15.115:0/92130919 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fda90157c50 0x7fda901507c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:49:28.750 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.745+0000 7fda94dfd700 1 --2- 172.21.15.115:0/92130919 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda900c98e0 0x7fda90156570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:49:28.750 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.745+0000 7fda8ffff700 1 --2- 172.21.15.115:0/92130919 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda90151e10 0x7fda901edc30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fda7c0090b0 tx=0x7fda7c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:28.750 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.746+0000 7fda8d7fa700 1 -- 172.21.15.115:0/92130919 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7c0036a0 con 0x7fda90151e10 2024-05-08T21:49:28.750 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.746+0000 7fda8d7fa700 1 -- 172.21.15.115:0/92130919 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda7c01f070 con 0x7fda90151e10 2024-05-08T21:49:28.750 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.746+0000 7fda97061700 1 -- 172.21.15.115:0/92130919 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda7c0094a0 con 0x7fda90151e10 2024-05-08T21:49:28.750 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.746+0000 7fda8d7fa700 1 -- 172.21.15.115:0/92130919 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7c003a40 con 0x7fda90151e10 2024-05-08T21:49:28.750 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.746+0000 7fda97061700 1 -- 172.21.15.115:0/92130919 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda901ee170 con 0x7fda90151e10 2024-05-08T21:49:28.750 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.746+0000 7fda8d7fa700 1 -- 172.21.15.115:0/92130919 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fda7c026480 con 0x7fda90151e10 2024-05-08T21:49:28.750 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.746+0000 7fda8d7fa700 1 -- 172.21.15.115:0/92130919 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fda7c021070 con 0x7fda90151e10 2024-05-08T21:49:28.750 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.747+0000 7fda97061700 1 -- 172.21.15.115:0/92130919 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda90072020 con 0x7fda90151e10 2024-05-08T21:49:28.751 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.749+0000 7fda8d7fa700 1 -- 172.21.15.115:0/92130919 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7fda7c015020 con 0x7fda90151e10 2024-05-08T21:49:28.761 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-05-08T21:49:28.760+0000 7fabb85d6200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-08T21:49:28.837 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.834+0000 7fda97061700 1 -- 172.21.15.115:0/92130919 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f4187743-f9e6-42e6-aca9-0604a58db1ab", "id": 7} v 0) v1 -- 0x7fda901513a0 con 0x7fda90151e10 2024-05-08T21:49:28.843 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-08T21:49:28.842+0000 7f54f189d200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-08T21:49:28.843 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.842+0000 7fda8d7fa700 1 -- 172.21.15.115:0/92130919 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f4187743-f9e6-42e6-aca9-0604a58db1ab", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fda7c026990 con 0x7fda90151e10 2024-05-08T21:49:28.844 INFO:teuthology.orchestra.run.smithi115.stdout:7 2024-05-08T21:49:28.845 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.843+0000 7fda97061700 1 -- 172.21.15.115:0/92130919 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda90151e10 msgr2=0x7fda901edc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:28.845 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.843+0000 7fda97061700 1 --2- 172.21.15.115:0/92130919 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda90151e10 0x7fda901edc30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fda7c0090b0 tx=0x7fda7c004750 comp rx=0 tx=0).stop 2024-05-08T21:49:28.845 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.843+0000 7fda97061700 1 -- 172.21.15.115:0/92130919 shutdown_connections 2024-05-08T21:49:28.845 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.843+0000 7fda97061700 1 --2- 172.21.15.115:0/92130919 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fda90157c50 0x7fda901507c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:28.845 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.843+0000 7fda97061700 1 --2- 172.21.15.115:0/92130919 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda900c98e0 0x7fda90156570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:28.845 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.843+0000 7fda97061700 1 --2- 172.21.15.115:0/92130919 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda90151e10 0x7fda901edc30 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:28.845 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.843+0000 7fda97061700 1 -- 172.21.15.115:0/92130919 >> 172.21.15.115:0/92130919 conn(0x7fda900c8d10 msgr2=0x7fda90073b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:28.845 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.843+0000 7fda97061700 1 -- 172.21.15.115:0/92130919 shutdown_connections 2024-05-08T21:49:28.845 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T21:49:28.844+0000 7fda97061700 1 -- 172.21.15.115:0/92130919 wait complete. 2024-05-08T21:49:28.856 INFO:tasks.ceph.osd.0:Restarting daemon 2024-05-08T21:49:28.856 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-05-08T21:49:28.858 INFO:tasks.ceph.osd.0:Started 2024-05-08T21:49:28.859 INFO:tasks.ceph.osd.1:Restarting daemon 2024-05-08T21:49:28.859 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-05-08T21:49:28.862 INFO:tasks.ceph.osd.1:Started 2024-05-08T21:49:28.862 INFO:tasks.ceph.osd.2:Restarting daemon 2024-05-08T21:49:28.863 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-05-08T21:49:28.866 INFO:tasks.ceph.osd.2:Started 2024-05-08T21:49:28.866 INFO:tasks.ceph.osd.3:Restarting daemon 2024-05-08T21:49:28.866 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-05-08T21:49:28.868 INFO:tasks.ceph.osd.3:Started 2024-05-08T21:49:28.868 INFO:tasks.ceph.osd.4:Restarting daemon 2024-05-08T21:49:28.868 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-05-08T21:49:28.870 INFO:tasks.ceph.osd.4:Started 2024-05-08T21:49:28.870 INFO:tasks.ceph.osd.5:Restarting daemon 2024-05-08T21:49:28.871 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-05-08T21:49:28.872 INFO:tasks.ceph.osd.5:Started 2024-05-08T21:49:28.872 INFO:tasks.ceph.osd.6:Restarting daemon 2024-05-08T21:49:28.873 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-05-08T21:49:28.874 INFO:tasks.ceph.osd.6:Started 2024-05-08T21:49:28.875 INFO:tasks.ceph.osd.7:Restarting daemon 2024-05-08T21:49:28.875 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-05-08T21:49:28.877 INFO:tasks.ceph.osd.7:Started 2024-05-08T21:49:28.877 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T21:49:28.959 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-08T21:49:28.958+0000 7f54f189d200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-08T21:49:29.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:29.037+0000 7f32c3b6d700 1 Processor -- start 2024-05-08T21:49:29.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:29.037+0000 7f32c3b6d700 1 -- start start 2024-05-08T21:49:29.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:29.038+0000 7f32c3b6d700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f32bc0c4540 0x7f32bc0c8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:29.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:29.038+0000 7f32c3b6d700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32bc0c2570 con 0x7f32bc0b28b0 2024-05-08T21:49:29.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:29.038+0000 7f32c3b6d700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32bc06f4e0 con 0x7f32bc151bd0 2024-05-08T21:49:29.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:29.038+0000 7f32c3b6d700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32bc0c2e80 con 0x7f32bc0c4540 2024-05-08T21:49:29.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:29.038+0000 7f32c1108700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f32bc0c4540 0x7f32bc0c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:29.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:29.038+0000 7f32c1108700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f32bc0c4540 0x7f32bc0c8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38788/0 (socket says 172.21.15.73:38788) 2024-05-08T21:49:29.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:29.038+0000 7f32c210a700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f32bc0b28b0 0x7f32bc162410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49278/0 (socket says 172.21.15.73:49278) 2024-05-08T21:49:29.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:29.038+0000 7f32c1108700 1 -- 172.21.15.73:0/2349530883 learned_addr learned my addr 172.21.15.73:0/2349530883 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:29.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:29.038+0000 7f32c1108700 1 -- 172.21.15.73:0/2349530883 >> v1:172.21.15.115:6789/0 conn(0x7f32bc151bd0 legacy=0x7f32bc0cd4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:29.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:29.038+0000 7f32c1108700 1 -- 172.21.15.73:0/2349530883 >> v1:172.21.15.73:6789/0 conn(0x7f32bc0b28b0 legacy=0x7f32bc162410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:29.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:29.038+0000 7f32c0907700 1 -- 172.21.15.73:0/2349530883 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1131355029 0 0) 0x7f32bc0c2570 con 0x7f32bc0b28b0 2024-05-08T21:49:29.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:29.038+0000 7f32c1108700 1 -- 172.21.15.73:0/2349530883 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32bc06f7c0 con 0x7f32bc0c4540 2024-05-08T21:49:29.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:29.038+0000 7f32c1108700 1 --2- 172.21.15.73:0/2349530883 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f32bc0c4540 0x7f32bc0c8100 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f32ac0098f0 tx=0x7f32ac009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b47d478cc7d69c16 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:29.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:29.038+0000 7f32c0907700 1 -- 172.21.15.73:0/2349530883 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ac00b8a0 con 0x7f32bc0c4540 2024-05-08T21:49:29.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:29.039+0000 7f32c0907700 1 -- 172.21.15.73:0/2349530883 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32ac00ba00 con 0x7f32bc0c4540 2024-05-08T21:49:29.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:29.039+0000 7f32c0907700 1 -- 172.21.15.73:0/2349530883 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ac00bd90 con 0x7f32bc0c4540 2024-05-08T21:49:29.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:29.039+0000 7f32c3b6d700 1 -- 172.21.15.73:0/2349530883 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f32bc0c4540 msgr2=0x7f32bc0c8100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:29.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:29.039+0000 7f32c3b6d700 1 --2- 172.21.15.73:0/2349530883 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f32bc0c4540 0x7f32bc0c8100 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f32ac0098f0 tx=0x7f32ac009c00 comp rx=0 tx=0).stop 2024-05-08T21:49:29.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:29.039+0000 7f32c3b6d700 1 -- 172.21.15.73:0/2349530883 shutdown_connections 2024-05-08T21:49:29.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:29.039+0000 7f32c3b6d700 1 --2- 172.21.15.73:0/2349530883 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f32bc0c4540 0x7f32bc0c8100 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:29.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:29.039+0000 7f32c3b6d700 1 -- 172.21.15.73:0/2349530883 >> 172.21.15.73:0/2349530883 conn(0x7f32bc06ae10 msgr2=0x7f32bc0666c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:29.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:29.039+0000 7f32c3b6d700 1 -- 172.21.15.73:0/2349530883 shutdown_connections 2024-05-08T21:49:29.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:29.039+0000 7f32c3b6d700 1 -- 172.21.15.73:0/2349530883 wait complete. 2024-05-08T21:49:29.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:29.040+0000 7f32c3b6d700 1 Processor -- start 2024-05-08T21:49:29.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:29.040+0000 7f32c3b6d700 1 -- start start 2024-05-08T21:49:29.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:29.041+0000 7f32c3b6d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32bc0b28b0 0x7f32bc0c6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:29.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:29.041+0000 7f32c3b6d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32bc0c4540 0x7f32bc1edf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:29.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:29.041+0000 7f32c3b6d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f32bc151bd0 0x7f32bc14af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:29.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:29.041+0000 7f32c3b6d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32bc14e280 con 0x7f32bc151bd0 2024-05-08T21:49:29.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:29.041+0000 7f32c3b6d700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32bc14e560 con 0x7f32bc0b28b0 2024-05-08T21:49:29.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:29.041+0000 7f32c3b6d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32bc14e840 con 0x7f32bc0c4540 2024-05-08T21:49:29.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:29.041+0000 7f32c210a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f32bc151bd0 0x7f32bc14af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:29.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:29.041+0000 7f32c210a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f32bc151bd0 0x7f32bc14af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38794/0 (socket says 172.21.15.73:38794) 2024-05-08T21:49:29.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:29.041+0000 7f32c210a700 1 -- 172.21.15.73:0/3618402809 learned_addr learned my addr 172.21.15.73:0/3618402809 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:29.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:29.041+0000 7f32c1909700 1 --2- 172.21.15.73:0/3618402809 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32bc0b28b0 0x7f32bc0c6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:29.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:29.041+0000 7f32c1108700 1 --2- 172.21.15.73:0/3618402809 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32bc0c4540 0x7f32bc1edf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:29.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:29.041+0000 7f32c210a700 1 -- 172.21.15.73:0/3618402809 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32bc0c4540 msgr2=0x7f32bc1edf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:29.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:29.041+0000 7f32c210a700 1 --2- 172.21.15.73:0/3618402809 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32bc0c4540 0x7f32bc1edf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:29.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:29.042+0000 7f32c210a700 1 -- 172.21.15.73:0/3618402809 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32bc0b28b0 msgr2=0x7f32bc0c6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:29.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:29.042+0000 7f32c210a700 1 --2- 172.21.15.73:0/3618402809 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32bc0b28b0 0x7f32bc0c6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:29.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:29.042+0000 7f32c210a700 1 -- 172.21.15.73:0/3618402809 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32ac009550 con 0x7f32bc151bd0 2024-05-08T21:49:29.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:29.042+0000 7f32c210a700 1 --2- 172.21.15.73:0/3618402809 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f32bc151bd0 0x7f32bc14af70 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f32b400cc70 tx=0x7f32b400cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:29.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:29.042+0000 7f32b27fc700 1 -- 172.21.15.73:0/3618402809 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b400aaa0 con 0x7f32bc151bd0 2024-05-08T21:49:29.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:29.042+0000 7f32b27fc700 1 -- 172.21.15.73:0/3618402809 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32b400ac20 con 0x7f32bc151bd0 2024-05-08T21:49:29.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:29.042+0000 7f32b27fc700 1 -- 172.21.15.73:0/3618402809 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b40070d0 con 0x7f32bc151bd0 2024-05-08T21:49:29.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:29.042+0000 7f32c3b6d700 1 -- 172.21.15.73:0/3618402809 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32bc14eb20 con 0x7f32bc151bd0 2024-05-08T21:49:29.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:29.042+0000 7f32c3b6d700 1 -- 172.21.15.73:0/3618402809 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32bc154170 con 0x7f32bc151bd0 2024-05-08T21:49:29.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:29.042+0000 7f32b27fc700 1 -- 172.21.15.73:0/3618402809 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f32b4007530 con 0x7f32bc151bd0 2024-05-08T21:49:29.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:29.042+0000 7f32b27fc700 1 -- 172.21.15.73:0/3618402809 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f32b4012400 con 0x7f32bc151bd0 2024-05-08T21:49:29.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:29.043+0000 7f32c3b6d700 1 -- 172.21.15.73:0/3618402809 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32bc1edc20 con 0x7f32bc151bd0 2024-05-08T21:49:29.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:29.045+0000 7f32b27fc700 1 -- 172.21.15.73:0/3618402809 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f32bc1edc20 con 0x7f32bc151bd0 2024-05-08T21:49:29.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:29.114+0000 7f32c3b6d700 1 -- 172.21.15.73:0/3618402809 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f32bc068b80 con 0x7f32bc151bd0 2024-05-08T21:49:29.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:29.114+0000 7f32b27fc700 1 -- 172.21.15.73:0/3618402809 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f32b4018070 con 0x7f32bc151bd0 2024-05-08T21:49:29.115 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:49:29.115 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":10,"fsid":"143164b7-c9c7-4737-a494-7dafa5a3320c","created":"2024-05-08T21:49:26.221909+0000","modified":"2024-05-08T21:49:28.836944+0000","last_up_change":"0.000000","last_in_change":"2024-05-08T21:49:28.836944+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"6b7439c1-daaa-44af-8333-a455f9e9dc67","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"fb67886a-d7f7-45ac-832f-36c871c8a208","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a5cd6e98-6621-473a-bfb8-5c648abbb563","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"36927c20-4241-4f3b-91b5-a6a6f27598e9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"4ebe0a18-8216-4815-878a-39c39a6cd3fc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"957f0ac1-5f26-4f02-8c05-488e6b67ee37","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f5a6768f-ba7f-4f66-b335-0c303b158e3d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"f4187743-f9e6-42e6-aca9-0604a58db1ab","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T21:49:29.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:29.115+0000 7f32c3b6d700 1 -- 172.21.15.73:0/3618402809 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f32bc151bd0 msgr2=0x7f32bc14af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:29.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:29.115+0000 7f32c3b6d700 1 --2- 172.21.15.73:0/3618402809 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f32bc151bd0 0x7f32bc14af70 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f32b400cc70 tx=0x7f32b400cf80 comp rx=0 tx=0).stop 2024-05-08T21:49:29.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:29.115+0000 7f32c3b6d700 1 -- 172.21.15.73:0/3618402809 shutdown_connections 2024-05-08T21:49:29.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:29.115+0000 7f32c3b6d700 1 --2- 172.21.15.73:0/3618402809 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f32bc151bd0 0x7f32bc14af70 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:29.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:29.115+0000 7f32c3b6d700 1 --2- 172.21.15.73:0/3618402809 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32bc0b28b0 0x7f32bc0c6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:29.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:29.115+0000 7f32c3b6d700 1 --2- 172.21.15.73:0/3618402809 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32bc0c4540 0x7f32bc1edf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:29.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:29.115+0000 7f32c3b6d700 1 -- 172.21.15.73:0/3618402809 >> 172.21.15.73:0/3618402809 conn(0x7f32bc06ae10 msgr2=0x7f32bc0cd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:29.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:29.115+0000 7f32c3b6d700 1 -- 172.21.15.73:0/3618402809 shutdown_connections 2024-05-08T21:49:29.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:29.115+0000 7f32c3b6d700 1 -- 172.21.15.73:0/3618402809 wait complete. 2024-05-08T21:49:29.128 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-05-08T21:49:29.128 INFO:tasks.ceph:Waiting for OSDs to come up 2024-05-08T21:49:29.229 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-05-08T21:49:29.228+0000 7f49360ba7c0 -1 Falling back to public interface 2024-05-08T21:49:29.478 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T21:49:29.476+0000 7fa444e857c0 -1 Falling back to public interface 2024-05-08T21:49:29.482 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T21:49:29.481+0000 7fdf54fc87c0 -1 Falling back to public interface 2024-05-08T21:49:29.488 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T21:49:29.487+0000 7f21e0d7b7c0 -1 Falling back to public interface 2024-05-08T21:49:29.491 INFO:tasks.ceph.osd.0.smithi073.stderr:2024-05-08T21:49:29.490+0000 7fd39f5ab7c0 -1 Falling back to public interface 2024-05-08T21:49:29.494 INFO:tasks.ceph.osd.2.smithi073.stderr:2024-05-08T21:49:29.493+0000 7f633e2fa7c0 -1 Falling back to public interface 2024-05-08T21:49:29.497 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T21:49:29.496+0000 7fe4c8c087c0 -1 Falling back to public interface 2024-05-08T21:49:29.501 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-05-08T21:49:29.500+0000 7f0bc65f17c0 -1 Falling back to public interface 2024-05-08T21:49:29.507 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-05-08T21:49:29.506+0000 7fabb85d6200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-08T21:49:29.591 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-05-08T21:49:29.591+0000 7fabb85d6200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-08T21:49:29.675 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-08T21:49:29.674+0000 7f54f189d200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-08T21:49:29.724 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-05-08T21:49:29.723+0000 7fabb85d6200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-08T21:49:29.758 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-08T21:49:29.757+0000 7f54f189d200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-08T21:49:29.892 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-08T21:49:29.891+0000 7f54f189d200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-08T21:49:29.934 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-08T21:49:30.047 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.046+0000 7f6a18860700 1 Processor -- start 2024-05-08T21:49:30.047 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.046+0000 7f6a18860700 1 -- start start 2024-05-08T21:49:30.049 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.047+0000 7f6a18860700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6a141543b0 0x7f6a140bf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:30.050 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.047+0000 7f6a18860700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6a140bfac0 0x7f6a1406ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:30.050 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.047+0000 7f6a18860700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a1406bf60 0x7f6a140c6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:30.050 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.047+0000 7f6a18860700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a1415ae00 con 0x7f6a141543b0 2024-05-08T21:49:30.050 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.047+0000 7f6a18860700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a1415a280 con 0x7f6a140bfac0 2024-05-08T21:49:30.050 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.047+0000 7f6a18860700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1415a560 con 0x7f6a1406bf60 2024-05-08T21:49:30.050 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.047+0000 7f6a1259c700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6a141543b0 0x7f6a140bf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:30.050 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.047+0000 7f6a1259c700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6a141543b0 0x7f6a140bf580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38808/0 (socket says 172.21.15.73:38808) 2024-05-08T21:49:30.050 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.047+0000 7f6a1259c700 1 -- 172.21.15.73:0/1507154555 learned_addr learned my addr 172.21.15.73:0/1507154555 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:30.050 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.047+0000 7f6a12d9d700 1 --2- 172.21.15.73:0/1507154555 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a1406bf60 0x7f6a140c6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:30.050 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.047+0000 7f6a11d9b700 1 --2- 172.21.15.73:0/1507154555 >> v2:172.21.15.115:3300/0 conn(0x7f6a140bfac0 0x7f6a1406ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:30.050 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.047+0000 7f6a1259c700 1 -- 172.21.15.73:0/1507154555 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a1406bf60 msgr2=0x7f6a140c6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:30.050 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.047+0000 7f6a1259c700 1 --2- 172.21.15.73:0/1507154555 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a1406bf60 0x7f6a140c6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:30.050 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.047+0000 7f6a1259c700 1 -- 172.21.15.73:0/1507154555 >> v2:172.21.15.115:3300/0 conn(0x7f6a140bfac0 msgr2=0x7f6a1406ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:30.051 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.047+0000 7f6a1259c700 1 --2- 172.21.15.73:0/1507154555 >> v2:172.21.15.115:3300/0 conn(0x7f6a140bfac0 0x7f6a1406ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:30.051 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.047+0000 7f6a1259c700 1 -- 172.21.15.73:0/1507154555 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a1415a840 con 0x7f6a141543b0 2024-05-08T21:49:30.051 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.047+0000 7f6a1259c700 1 --2- 172.21.15.73:0/1507154555 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a141543b0 0x7f6a140bf580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6a14071200 tx=0x7f6a04009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d46a7aa3e3926e1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:30.051 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.048+0000 7f6a1159a700 1 -- 172.21.15.73:0/1507154555 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a04011830 con 0x7f6a141543b0 2024-05-08T21:49:30.051 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.048+0000 7f6a1159a700 1 -- 172.21.15.73:0/1507154555 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a04011990 con 0x7f6a141543b0 2024-05-08T21:49:30.051 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.048+0000 7f6a1159a700 1 -- 172.21.15.73:0/1507154555 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a04011d20 con 0x7f6a141543b0 2024-05-08T21:49:30.051 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.048+0000 7f6a18860700 1 -- 172.21.15.73:0/1507154555 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a141543b0 msgr2=0x7f6a140bf580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:30.051 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.048+0000 7f6a18860700 1 --2- 172.21.15.73:0/1507154555 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a141543b0 0x7f6a140bf580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6a14071200 tx=0x7f6a04009bd0 comp rx=0 tx=0).stop 2024-05-08T21:49:30.051 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.048+0000 7f6a18860700 1 -- 172.21.15.73:0/1507154555 shutdown_connections 2024-05-08T21:49:30.051 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.048+0000 7f6a18860700 1 --2- 172.21.15.73:0/1507154555 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a1406bf60 0x7f6a140c6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:30.051 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.048+0000 7f6a18860700 1 --2- 172.21.15.73:0/1507154555 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a141543b0 0x7f6a140bf580 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:30.051 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.048+0000 7f6a18860700 1 --2- 172.21.15.73:0/1507154555 >> v2:172.21.15.115:3300/0 conn(0x7f6a140bfac0 0x7f6a1406ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:30.051 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.048+0000 7f6a18860700 1 -- 172.21.15.73:0/1507154555 >> 172.21.15.73:0/1507154555 conn(0x7f6a1406f450 msgr2=0x7f6a1406f830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:30.051 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.048+0000 7f6a18860700 1 -- 172.21.15.73:0/1507154555 shutdown_connections 2024-05-08T21:49:30.052 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.048+0000 7f6a18860700 1 -- 172.21.15.73:0/1507154555 wait complete. 2024-05-08T21:49:30.054 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.050+0000 7f6a18860700 1 Processor -- start 2024-05-08T21:49:30.054 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.050+0000 7f6a18860700 1 -- start start 2024-05-08T21:49:30.054 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.050+0000 7f6a18860700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a1406bf60 0x7f6a14152420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:30.054 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.050+0000 7f6a18860700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a140bfac0 0x7f6a140c9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:30.054 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.050+0000 7f6a18860700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a141543b0 0x7f6a140c96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:30.055 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.050+0000 7f6a18860700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a140c63a0 con 0x7f6a1406bf60 2024-05-08T21:49:30.055 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.050+0000 7f6a18860700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a14157c20 con 0x7f6a141543b0 2024-05-08T21:49:30.055 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.050+0000 7f6a18860700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a14157ee0 con 0x7f6a140bfac0 2024-05-08T21:49:30.055 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.050+0000 7f6a1259c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a1406bf60 0x7f6a14152420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:30.055 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.050+0000 7f6a1259c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a1406bf60 0x7f6a14152420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38824/0 (socket says 172.21.15.73:38824) 2024-05-08T21:49:30.055 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.050+0000 7f6a1259c700 1 -- 172.21.15.73:0/1754125601 learned_addr learned my addr 172.21.15.73:0/1754125601 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:30.055 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.051+0000 7f6a12d9d700 1 --2- 172.21.15.73:0/1754125601 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a141543b0 0x7f6a140c96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:30.055 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.051+0000 7f6a11d9b700 1 --2- 172.21.15.73:0/1754125601 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a140bfac0 0x7f6a140c9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:30.055 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.051+0000 7f6a1259c700 1 -- 172.21.15.73:0/1754125601 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a140bfac0 msgr2=0x7f6a140c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:30.055 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.051+0000 7f6a1259c700 1 --2- 172.21.15.73:0/1754125601 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a140bfac0 0x7f6a140c9170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:30.055 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.051+0000 7f6a1259c700 1 -- 172.21.15.73:0/1754125601 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a141543b0 msgr2=0x7f6a140c96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:30.055 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.051+0000 7f6a1259c700 1 --2- 172.21.15.73:0/1754125601 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a141543b0 0x7f6a140c96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:30.055 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.051+0000 7f6a1259c700 1 -- 172.21.15.73:0/1754125601 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a04009550 con 0x7f6a1406bf60 2024-05-08T21:49:30.055 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.051+0000 7f6a1259c700 1 --2- 172.21.15.73:0/1754125601 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a1406bf60 0x7f6a14152420 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6a04000c00 tx=0x7f6a04004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:30.056 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.051+0000 7f6a02ffd700 1 -- 172.21.15.73:0/1754125601 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a04004240 con 0x7f6a1406bf60 2024-05-08T21:49:30.056 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.051+0000 7f6a02ffd700 1 -- 172.21.15.73:0/1754125601 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a0401f070 con 0x7f6a1406bf60 2024-05-08T21:49:30.056 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.051+0000 7f6a18860700 1 -- 172.21.15.73:0/1754125601 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a141581c0 con 0x7f6a1406bf60 2024-05-08T21:49:30.056 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.051+0000 7f6a02ffd700 1 -- 172.21.15.73:0/1754125601 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a040036a0 con 0x7f6a1406bf60 2024-05-08T21:49:30.056 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.051+0000 7f6a18860700 1 -- 172.21.15.73:0/1754125601 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a140c6030 con 0x7f6a1406bf60 2024-05-08T21:49:30.056 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.051+0000 7f6a02ffd700 1 -- 172.21.15.73:0/1754125601 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f6a04021030 con 0x7f6a1406bf60 2024-05-08T21:49:30.056 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.051+0000 7f6a02ffd700 1 -- 172.21.15.73:0/1754125601 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f6a0401ada0 con 0x7f6a1406bf60 2024-05-08T21:49:30.056 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.052+0000 7f6a18860700 1 -- 172.21.15.73:0/1754125601 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a14067a20 con 0x7f6a1406bf60 2024-05-08T21:49:30.056 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.054+0000 7f6a02ffd700 1 -- 172.21.15.73:0/1754125601 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f6a04015020 con 0x7f6a1406bf60 2024-05-08T21:49:30.126 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.125+0000 7f6a18860700 1 -- 172.21.15.73:0/1754125601 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6a1415c410 con 0x7f6a1406bf60 2024-05-08T21:49:30.126 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.125+0000 7f6a02ffd700 1 -- 172.21.15.73:0/1754125601 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f6a04003c90 con 0x7f6a1406bf60 2024-05-08T21:49:30.127 INFO:teuthology.misc.health.smithi073.stdout: 2024-05-08T21:49:30.127 INFO:teuthology.misc.health.smithi073.stdout:{"epoch":10,"fsid":"143164b7-c9c7-4737-a494-7dafa5a3320c","created":"2024-05-08T21:49:26.221909+0000","modified":"2024-05-08T21:49:28.836944+0000","last_up_change":"0.000000","last_in_change":"2024-05-08T21:49:28.836944+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"6b7439c1-daaa-44af-8333-a455f9e9dc67","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"fb67886a-d7f7-45ac-832f-36c871c8a208","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a5cd6e98-6621-473a-bfb8-5c648abbb563","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"36927c20-4241-4f3b-91b5-a6a6f27598e9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"4ebe0a18-8216-4815-878a-39c39a6cd3fc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"957f0ac1-5f26-4f02-8c05-488e6b67ee37","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f5a6768f-ba7f-4f66-b335-0c303b158e3d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"f4187743-f9e6-42e6-aca9-0604a58db1ab","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T21:49:30.128 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.126+0000 7f6a18860700 1 -- 172.21.15.73:0/1754125601 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a1406bf60 msgr2=0x7f6a14152420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:30.128 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.126+0000 7f6a18860700 1 --2- 172.21.15.73:0/1754125601 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a1406bf60 0x7f6a14152420 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6a04000c00 tx=0x7f6a04004750 comp rx=0 tx=0).stop 2024-05-08T21:49:30.128 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.126+0000 7f6a18860700 1 -- 172.21.15.73:0/1754125601 shutdown_connections 2024-05-08T21:49:30.128 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.126+0000 7f6a18860700 1 --2- 172.21.15.73:0/1754125601 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a141543b0 0x7f6a140c96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:30.128 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.126+0000 7f6a18860700 1 --2- 172.21.15.73:0/1754125601 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a1406bf60 0x7f6a14152420 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:30.128 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.126+0000 7f6a18860700 1 --2- 172.21.15.73:0/1754125601 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a140bfac0 0x7f6a140c9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:30.128 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.126+0000 7f6a18860700 1 -- 172.21.15.73:0/1754125601 >> 172.21.15.73:0/1754125601 conn(0x7f6a1406f450 msgr2=0x7f6a140c6d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:30.128 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.126+0000 7f6a18860700 1 -- 172.21.15.73:0/1754125601 shutdown_connections 2024-05-08T21:49:30.128 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:30.126+0000 7f6a18860700 1 -- 172.21.15.73:0/1754125601 wait complete. 2024-05-08T21:49:30.138 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-08T21:49:30.286 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-05-08T21:49:30.285+0000 7fabb85d6200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-08T21:49:30.446 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-08T21:49:30.445+0000 7f54f189d200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-08T21:49:30.464 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-05-08T21:49:30.464+0000 7fabb85d6200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-08T21:49:30.613 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-08T21:49:30.612+0000 7f54f189d200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-08T21:49:30.632 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-05-08T21:49:30.632+0000 7fabb85d6200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-08T21:49:30.779 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-08T21:49:30.778+0000 7f54f189d200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-08T21:49:31.450 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-05-08T21:49:31.449+0000 7fabb85d6200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-08T21:49:31.602 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-08T21:49:31.601+0000 7f54f189d200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-08T21:49:31.690 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-05-08T21:49:31.689+0000 7fabb85d6200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-08T21:49:31.765 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-05-08T21:49:31.764+0000 7fabb85d6200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-08T21:49:31.840 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-08T21:49:31.839+0000 7f54f189d200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-08T21:49:31.913 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-08T21:49:31.912+0000 7f54f189d200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-08T21:49:31.928 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-05-08T21:49:31.927+0000 7fabb85d6200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-08T21:49:32.095 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-08T21:49:32.094+0000 7f54f189d200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-08T21:49:32.721 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-05-08T21:49:32.720+0000 7f49360ba7c0 -1 osd.1 0 log_to_monitors true 2024-05-08T21:49:32.952 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-05-08T21:49:32.951+0000 7fab73872700 -1 mgr.server handle_report got status from non-daemon mon.c 2024-05-08T21:49:32.952 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-05-08T21:49:32.951+0000 7fab73872700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-05-08T21:49:32.990 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T21:49:32.989+0000 7fdf54fc87c0 -1 osd.5 0 log_to_monitors true 2024-05-08T21:49:33.007 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T21:49:33.006+0000 7f21e0d7b7c0 -1 osd.6 0 log_to_monitors true 2024-05-08T21:49:33.007 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T21:49:33.006+0000 7fa444e857c0 -1 osd.4 0 log_to_monitors true 2024-05-08T21:49:33.009 INFO:tasks.ceph.osd.0.smithi073.stderr:2024-05-08T21:49:33.009+0000 7fd39f5ab7c0 -1 osd.0 0 log_to_monitors true 2024-05-08T21:49:33.023 INFO:tasks.ceph.osd.2.smithi073.stderr:2024-05-08T21:49:33.023+0000 7f633e2fa7c0 -1 osd.2 0 log_to_monitors true 2024-05-08T21:49:33.031 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-05-08T21:49:33.030+0000 7f0bc65f17c0 -1 osd.3 0 log_to_monitors true 2024-05-08T21:49:33.067 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T21:49:33.066+0000 7fe4c8c087c0 -1 osd.7 0 log_to_monitors true 2024-05-08T21:49:34.847 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-05-08T21:49:34.846+0000 7f4929c6f700 -1 osd.1 0 waiting for initial osdmap 2024-05-08T21:49:34.862 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-05-08T21:49:34.858+0000 7f492204a700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T21:49:34.875 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T21:49:34.874+0000 7fdf4a380700 -1 osd.5 0 waiting for initial osdmap 2024-05-08T21:49:34.893 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T21:49:34.892+0000 7fdf40f58700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T21:49:36.627 INFO:tasks.ceph.osd.2.smithi073.stderr:2024-05-08T21:49:36.626+0000 7f6331eaf700 -1 osd.2 0 waiting for initial osdmap 2024-05-08T21:49:36.636 INFO:tasks.ceph.osd.2.smithi073.stderr:2024-05-08T21:49:36.636+0000 7f632a28a700 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T21:49:36.646 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-05-08T21:49:36.646+0000 7f0bba1a6700 -1 osd.3 0 waiting for initial osdmap 2024-05-08T21:49:36.652 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T21:49:36.651+0000 7fe4bc7bd700 -1 osd.7 0 waiting for initial osdmap 2024-05-08T21:49:36.657 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-05-08T21:49:36.657+0000 7f0bb2581700 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T21:49:36.672 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T21:49:36.672+0000 7fe4b4b98700 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T21:49:36.676 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T21:49:36.675+0000 7f21d4930700 -1 osd.6 0 waiting for initial osdmap 2024-05-08T21:49:36.677 INFO:tasks.ceph.osd.0.smithi073.stderr:2024-05-08T21:49:36.677+0000 7fd393160700 -1 osd.0 0 waiting for initial osdmap 2024-05-08T21:49:36.685 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T21:49:36.684+0000 7fa438a3a700 -1 osd.4 0 waiting for initial osdmap 2024-05-08T21:49:36.688 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T21:49:36.688+0000 7f21ccd0b700 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T21:49:36.698 INFO:tasks.ceph.osd.0.smithi073.stderr:2024-05-08T21:49:36.697+0000 7fd38b53b700 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T21:49:36.705 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T21:49:36.705+0000 7fa430e15700 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T21:49:36.945 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-08T21:49:37.058 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.057+0000 7f20af3f5700 1 Processor -- start 2024-05-08T21:49:37.059 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.057+0000 7f20af3f5700 1 -- start start 2024-05-08T21:49:37.062 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.058+0000 7f20af3f5700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f20a80c2540 0x7f20a80c43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:37.062 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.058+0000 7f20af3f5700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f20a80c92b0 0x7f20a80c9720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:37.062 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.058+0000 7f20af3f5700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20a8157fd0 con 0x7f20a80c7f20 2024-05-08T21:49:37.062 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.058+0000 7f20af3f5700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20a8152190 con 0x7f20a80c2540 2024-05-08T21:49:37.062 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.058+0000 7f20af3f5700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20a80c8950 con 0x7f20a80c92b0 2024-05-08T21:49:37.062 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.058+0000 7f20ad191700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f20a80c2540 0x7f20a80c43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:37.062 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.058+0000 7f20ad191700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f20a80c2540 0x7f20a80c43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38926/0 (socket says 172.21.15.73:38926) 2024-05-08T21:49:37.063 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.058+0000 7f20ad191700 1 -- 172.21.15.73:0/1524119080 learned_addr learned my addr 172.21.15.73:0/1524119080 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:37.063 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.058+0000 7f20ac990700 1 --2- 172.21.15.73:0/1524119080 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f20a80c92b0 0x7f20a80c9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:37.063 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.059+0000 7f20ad191700 1 -- 172.21.15.73:0/1524119080 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f20a80c92b0 msgr2=0x7f20a80c9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:37.063 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.059+0000 7f20ad191700 1 --2- 172.21.15.73:0/1524119080 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f20a80c92b0 0x7f20a80c9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:37.063 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.059+0000 7f20ad191700 1 -- 172.21.15.73:0/1524119080 >> v1:172.21.15.115:6789/0 conn(0x7f20a80c7f20 legacy=0x7f20a815af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:37.063 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.059+0000 7f20ad191700 1 -- 172.21.15.73:0/1524119080 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a81579a0 con 0x7f20a80c2540 2024-05-08T21:49:37.063 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.059+0000 7f20ad191700 1 --2- 172.21.15.73:0/1524119080 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20a80c2540 0x7f20a80c43e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f20980098f0 tx=0x7f2098009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35028b78201b725c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:37.063 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.059+0000 7f209ffff700 1 -- 172.21.15.73:0/1524119080 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2098011830 con 0x7f20a80c2540 2024-05-08T21:49:37.063 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.059+0000 7f209ffff700 1 -- 172.21.15.73:0/1524119080 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2098011990 con 0x7f20a80c2540 2024-05-08T21:49:37.063 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.059+0000 7f209ffff700 1 -- 172.21.15.73:0/1524119080 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2098011d20 con 0x7f20a80c2540 2024-05-08T21:49:37.063 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.059+0000 7f20af3f5700 1 -- 172.21.15.73:0/1524119080 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20a80c2540 msgr2=0x7f20a80c43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:37.063 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.059+0000 7f20af3f5700 1 --2- 172.21.15.73:0/1524119080 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20a80c2540 0x7f20a80c43e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f20980098f0 tx=0x7f2098009c00 comp rx=0 tx=0).stop 2024-05-08T21:49:37.063 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.059+0000 7f20af3f5700 1 -- 172.21.15.73:0/1524119080 shutdown_connections 2024-05-08T21:49:37.063 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.059+0000 7f20af3f5700 1 --2- 172.21.15.73:0/1524119080 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20a80c2540 0x7f20a80c43e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:37.064 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.059+0000 7f20af3f5700 1 --2- 172.21.15.73:0/1524119080 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f20a80c92b0 0x7f20a80c9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:37.064 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.059+0000 7f20af3f5700 1 -- 172.21.15.73:0/1524119080 >> 172.21.15.73:0/1524119080 conn(0x7f20a806aff0 msgr2=0x7f20a8073b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:37.064 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.060+0000 7f20af3f5700 1 -- 172.21.15.73:0/1524119080 shutdown_connections 2024-05-08T21:49:37.064 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.060+0000 7f20af3f5700 1 -- 172.21.15.73:0/1524119080 wait complete. 2024-05-08T21:49:37.064 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.061+0000 7f20af3f5700 1 Processor -- start 2024-05-08T21:49:37.064 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.061+0000 7f20af3f5700 1 -- start start 2024-05-08T21:49:37.066 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.061+0000 7f20af3f5700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20a80c2540 0x7f20a8154e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:37.066 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.061+0000 7f20af3f5700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f20a80c7f20 0x7f20a814b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:37.066 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.061+0000 7f20af3f5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20a80c92b0 0x7f20a8142d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:37.066 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.061+0000 7f20af3f5700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a8154100 con 0x7f20a80c92b0 2024-05-08T21:49:37.066 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.061+0000 7f20af3f5700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a80ccb10 con 0x7f20a80c2540 2024-05-08T21:49:37.067 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.061+0000 7f20af3f5700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20a8153bd0 con 0x7f20a80c7f20 2024-05-08T21:49:37.067 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.061+0000 7f20ad992700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20a80c92b0 0x7f20a8142d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:37.067 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.061+0000 7f20ad992700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20a80c92b0 0x7f20a8142d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38934/0 (socket says 172.21.15.73:38934) 2024-05-08T21:49:37.067 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.061+0000 7f20ad191700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20a80c2540 0x7f20a8154e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:37.067 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.062+0000 7f20ad992700 1 -- 172.21.15.73:0/467636829 learned_addr learned my addr 172.21.15.73:0/467636829 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:37.067 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.062+0000 7f20ac990700 1 --2- 172.21.15.73:0/467636829 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f20a80c7f20 0x7f20a814b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:37.067 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.062+0000 7f20ad992700 1 -- 172.21.15.73:0/467636829 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f20a80c7f20 msgr2=0x7f20a814b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:37.067 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.062+0000 7f20ad992700 1 --2- 172.21.15.73:0/467636829 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f20a80c7f20 0x7f20a814b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:37.067 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.062+0000 7f20ad992700 1 -- 172.21.15.73:0/467636829 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20a80c2540 msgr2=0x7f20a8154e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:37.067 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.062+0000 7f20ad992700 1 --2- 172.21.15.73:0/467636829 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20a80c2540 0x7f20a8154e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:37.067 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.062+0000 7f20ad992700 1 -- 172.21.15.73:0/467636829 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2098009550 con 0x7f20a80c92b0 2024-05-08T21:49:37.067 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.062+0000 7f20ad992700 1 --2- 172.21.15.73:0/467636829 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20a80c92b0 0x7f20a8142d40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f20a000cc80 tx=0x7f20a000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:37.067 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.062+0000 7f209dffb700 1 -- 172.21.15.73:0/467636829 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a0003c00 con 0x7f20a80c92b0 2024-05-08T21:49:37.067 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.062+0000 7f209dffb700 1 -- 172.21.15.73:0/467636829 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20a0003d60 con 0x7f20a80c92b0 2024-05-08T21:49:37.067 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.062+0000 7f209dffb700 1 -- 172.21.15.73:0/467636829 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a000aaa0 con 0x7f20a80c92b0 2024-05-08T21:49:37.068 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.062+0000 7f20af3f5700 1 -- 172.21.15.73:0/467636829 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20a81edbf0 con 0x7f20a80c92b0 2024-05-08T21:49:37.068 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.062+0000 7f20af3f5700 1 -- 172.21.15.73:0/467636829 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20a80cdb50 con 0x7f20a80c92b0 2024-05-08T21:49:37.068 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.063+0000 7f20af3f5700 1 -- 172.21.15.73:0/467636829 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20a806eba0 con 0x7f20a80c92b0 2024-05-08T21:49:37.068 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.063+0000 7f209dffb700 1 -- 172.21.15.73:0/467636829 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 4) v1 ==== 89089+0+0 (secure 0 0 0) 0x7f20a000ac00 con 0x7f20a80c92b0 2024-05-08T21:49:37.068 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.064+0000 7f209dffb700 1 --2- 172.21.15.73:0/467636829 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f208c06ac30 0x7f208c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:37.068 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.064+0000 7f209dffb700 1 -- 172.21.15.73:0/467636829 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3166+0+0 (secure 0 0 0) 0x7f20a0088790 con 0x7f20a80c92b0 2024-05-08T21:49:37.068 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.064+0000 7f20ad191700 1 --2- 172.21.15.73:0/467636829 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f208c06ac30 0x7f208c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:37.068 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.064+0000 7f20ad191700 1 --2- 172.21.15.73:0/467636829 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f208c06ac30 0x7f208c06d0f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2098000c00 tx=0x7f2098008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:37.070 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.069+0000 7f209dffb700 1 -- 172.21.15.73:0/467636829 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f20a806eba0 con 0x7f20a80c92b0 2024-05-08T21:49:37.273 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.272+0000 7f20af3f5700 1 -- 172.21.15.73:0/467636829 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f20a8158440 con 0x7f20a80c92b0 2024-05-08T21:49:37.274 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.273+0000 7f209dffb700 1 -- 172.21.15.73:0/467636829 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+12256 (secure 0 0 0) 0x7f20a8158440 con 0x7f20a80c92b0 2024-05-08T21:49:37.274 INFO:teuthology.misc.health.smithi073.stdout: 2024-05-08T21:49:37.274 INFO:teuthology.misc.health.smithi073.stdout:{"epoch":15,"fsid":"143164b7-c9c7-4737-a494-7dafa5a3320c","created":"2024-05-08T21:49:26.221909+0000","modified":"2024-05-08T21:49:37.118386+0000","last_up_change":"2024-05-08T21:49:37.118386+0000","last_in_change":"2024-05-08T21:49:28.836944+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T21:49:35.998578+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6b7439c1-daaa-44af-8333-a455f9e9dc67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":47228},{"type":"v1","addr":"172.21.15.73:6809","nonce":47228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":47228},{"type":"v1","addr":"172.21.15.73:6811","nonce":47228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":47228},{"type":"v1","addr":"172.21.15.73:6815","nonce":47228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":47228},{"type":"v1","addr":"172.21.15.73:6813","nonce":47228}]},"public_addr":"172.21.15.73:6809/47228","cluster_addr":"172.21.15.73:6811/47228","heartbeat_back_addr":"172.21.15.73:6815/47228","heartbeat_front_addr":"172.21.15.73:6813/47228","state":["exists","up"]},{"osd":1,"uuid":"fb67886a-d7f7-45ac-832f-36c871c8a208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":47227},{"type":"v1","addr":"172.21.15.73:6801","nonce":47227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":47227},{"type":"v1","addr":"172.21.15.73:6803","nonce":47227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":47227},{"type":"v1","addr":"172.21.15.73:6807","nonce":47227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":47227},{"type":"v1","addr":"172.21.15.73:6805","nonce":47227}]},"public_addr":"172.21.15.73:6801/47227","cluster_addr":"172.21.15.73:6803/47227","heartbeat_back_addr":"172.21.15.73:6807/47227","heartbeat_front_addr":"172.21.15.73:6805/47227","state":["exists","up"]},{"osd":2,"uuid":"a5cd6e98-6621-473a-bfb8-5c648abbb563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":47229},{"type":"v1","addr":"172.21.15.73:6817","nonce":47229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":47229},{"type":"v1","addr":"172.21.15.73:6819","nonce":47229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":47229},{"type":"v1","addr":"172.21.15.73:6823","nonce":47229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":47229},{"type":"v1","addr":"172.21.15.73:6821","nonce":47229}]},"public_addr":"172.21.15.73:6817/47229","cluster_addr":"172.21.15.73:6819/47229","heartbeat_back_addr":"172.21.15.73:6823/47229","heartbeat_front_addr":"172.21.15.73:6821/47229","state":["exists","up"]},{"osd":3,"uuid":"36927c20-4241-4f3b-91b5-a6a6f27598e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":47232},{"type":"v1","addr":"172.21.15.73:6825","nonce":47232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":47232},{"type":"v1","addr":"172.21.15.73:6827","nonce":47232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":47232},{"type":"v1","addr":"172.21.15.73:6831","nonce":47232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":47232},{"type":"v1","addr":"172.21.15.73:6829","nonce":47232}]},"public_addr":"172.21.15.73:6825/47232","cluster_addr":"172.21.15.73:6827/47232","heartbeat_back_addr":"172.21.15.73:6831/47232","heartbeat_front_addr":"172.21.15.73:6829/47232","state":["exists","up"]},{"osd":4,"uuid":"4ebe0a18-8216-4815-878a-39c39a6cd3fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":47200},{"type":"v1","addr":"172.21.15.115:6801","nonce":47200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":47200},{"type":"v1","addr":"172.21.15.115:6803","nonce":47200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":47200},{"type":"v1","addr":"172.21.15.115:6807","nonce":47200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":47200},{"type":"v1","addr":"172.21.15.115:6805","nonce":47200}]},"public_addr":"172.21.15.115:6801/47200","cluster_addr":"172.21.15.115:6803/47200","heartbeat_back_addr":"172.21.15.115:6807/47200","heartbeat_front_addr":"172.21.15.115:6805/47200","state":["exists","up"]},{"osd":5,"uuid":"957f0ac1-5f26-4f02-8c05-488e6b67ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":47201},{"type":"v1","addr":"172.21.15.115:6809","nonce":47201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":47201},{"type":"v1","addr":"172.21.15.115:6811","nonce":47201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":47201},{"type":"v1","addr":"172.21.15.115:6815","nonce":47201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":47201},{"type":"v1","addr":"172.21.15.115:6813","nonce":47201}]},"public_addr":"172.21.15.115:6809/47201","cluster_addr":"172.21.15.115:6811/47201","heartbeat_back_addr":"172.21.15.115:6815/47201","heartbeat_front_addr":"172.21.15.115:6813/47201","state":["exists","up"]},{"osd":6,"uuid":"f5a6768f-ba7f-4f66-b335-0c303b158e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":47202},{"type":"v1","addr":"172.21.15.115:6817","nonce":47202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":47202},{"type":"v1","addr":"172.21.15.115:6819","nonce":47202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":47202},{"type":"v1","addr":"172.21.15.115:6823","nonce":47202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":47202},{"type":"v1","addr":"172.21.15.115:6821","nonce":47202}]},"public_addr":"172.21.15.115:6817/47202","cluster_addr":"172.21.15.115:6819/47202","heartbeat_back_addr":"172.21.15.115:6823/47202","heartbeat_front_addr":"172.21.15.115:6821/47202","state":["exists","up"]},{"osd":7,"uuid":"f4187743-f9e6-42e6-aca9-0604a58db1ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":47211},{"type":"v1","addr":"172.21.15.115:6825","nonce":47211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":47211},{"type":"v1","addr":"172.21.15.115:6827","nonce":47211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":47211},{"type":"v1","addr":"172.21.15.115:6831","nonce":47211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":47211},{"type":"v1","addr":"172.21.15.115:6829","nonce":47211}]},"public_addr":"172.21.15.115:6825/47211","cluster_addr":"172.21.15.115:6827/47211","heartbeat_back_addr":"172.21.15.115:6831/47211","heartbeat_front_addr":"172.21.15.115:6829/47211","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:33.687451+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:34.876272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T21:49:37.277 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.275+0000 7f20af3f5700 1 -- 172.21.15.73:0/467636829 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f208c06ac30 msgr2=0x7f208c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:37.277 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.275+0000 7f20af3f5700 1 --2- 172.21.15.73:0/467636829 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f208c06ac30 0x7f208c06d0f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2098000c00 tx=0x7f2098008030 comp rx=0 tx=0).stop 2024-05-08T21:49:37.277 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.275+0000 7f20af3f5700 1 -- 172.21.15.73:0/467636829 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20a80c92b0 msgr2=0x7f20a8142d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:37.277 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.275+0000 7f20af3f5700 1 --2- 172.21.15.73:0/467636829 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20a80c92b0 0x7f20a8142d40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f20a000cc80 tx=0x7f20a000cf90 comp rx=0 tx=0).stop 2024-05-08T21:49:37.277 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.276+0000 7f20af3f5700 1 -- 172.21.15.73:0/467636829 shutdown_connections 2024-05-08T21:49:37.277 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.276+0000 7f20af3f5700 1 --2- 172.21.15.73:0/467636829 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f208c06ac30 0x7f208c06d0f0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:37.277 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.276+0000 7f20af3f5700 1 --2- 172.21.15.73:0/467636829 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20a80c92b0 0x7f20a8142d40 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:37.277 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.276+0000 7f20af3f5700 1 --2- 172.21.15.73:0/467636829 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20a80c2540 0x7f20a8154e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:37.277 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.276+0000 7f20af3f5700 1 --2- 172.21.15.73:0/467636829 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f20a80c7f20 0x7f20a814b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:37.277 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.276+0000 7f20af3f5700 1 -- 172.21.15.73:0/467636829 >> 172.21.15.73:0/467636829 conn(0x7f20a806aff0 msgr2=0x7f20a81567c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:37.277 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.276+0000 7f20af3f5700 1 -- 172.21.15.73:0/467636829 shutdown_connections 2024-05-08T21:49:37.277 INFO:teuthology.misc.health.smithi073.stderr:2024-05-08T21:49:37.276+0000 7f20af3f5700 1 -- 172.21.15.73:0/467636829 wait complete. 2024-05-08T21:49:37.288 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-05-08T21:49:37.288 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-05-08T21:49:37.288 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-08T21:49:37.288 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-08T21:49:37.290 INFO:tasks.ceph.mds.a:Started 2024-05-08T21:49:37.291 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-08T21:49:37.291 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-08T21:49:37.292 INFO:tasks.ceph.mds.c:Started 2024-05-08T21:49:37.293 INFO:tasks.ceph.mds.e:Restarting daemon 2024-05-08T21:49:37.293 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2024-05-08T21:49:37.295 INFO:tasks.ceph.mds.e:Started 2024-05-08T21:49:37.295 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-08T21:49:37.295 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-08T21:49:37.298 INFO:tasks.ceph.mds.b:Started 2024-05-08T21:49:37.298 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-08T21:49:37.298 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-08T21:49:37.300 INFO:tasks.ceph.mds.d:Started 2024-05-08T21:49:37.301 INFO:tasks.ceph.mds.f:Restarting daemon 2024-05-08T21:49:37.301 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i f 2024-05-08T21:49:37.303 INFO:tasks.ceph.mds.f:Started 2024-05-08T21:49:37.303 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-05-08T21:49:37.303 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T21:49:37.374 INFO:tasks.ceph.mds.a.smithi073.stdout:starting mds.a at 2024-05-08T21:49:37.375 INFO:tasks.ceph.mds.c.smithi073.stdout:starting mds.c at 2024-05-08T21:49:37.376 INFO:tasks.ceph.mds.e.smithi073.stdout:starting mds.e at 2024-05-08T21:49:37.379 INFO:tasks.ceph.mds.b.smithi115.stdout:starting mds.b at 2024-05-08T21:49:37.379 INFO:tasks.ceph.mds.d.smithi115.stdout:starting mds.d at 2024-05-08T21:49:37.384 INFO:tasks.ceph.mds.f.smithi115.stdout:starting mds.f at 2024-05-08T21:49:37.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.437+0000 7f9bf0196700 1 Processor -- start 2024-05-08T21:49:37.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.437+0000 7f9bf0196700 1 -- start start 2024-05-08T21:49:37.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.438+0000 7f9bf0196700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9be815a7b0 0x7f9be80ca2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:37.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.438+0000 7f9bf0196700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9be815d190 con 0x7f9be8153db0 2024-05-08T21:49:37.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.438+0000 7f9bf0196700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9be815d430 con 0x7f9be80c9ea0 2024-05-08T21:49:37.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.438+0000 7f9bf0196700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9be80ca820 con 0x7f9be815a7b0 2024-05-08T21:49:37.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.438+0000 7f9bedf32700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f9be8153db0 0x7f9be80720f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49312/0 (socket says 172.21.15.73:49312) 2024-05-08T21:49:37.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.438+0000 7f9bedf32700 1 -- 172.21.15.73:0/277059934 learned_addr learned my addr 172.21.15.73:0/277059934 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:49:37.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.438+0000 7f9bee733700 1 --2- 172.21.15.73:0/277059934 >> v2:172.21.15.115:3300/0 conn(0x7f9be815a7b0 0x7f9be80ca2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:37.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.438+0000 7f9becf30700 1 -- 172.21.15.73:0/277059934 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3279784835 0 0) 0x7f9be815d190 con 0x7f9be8153db0 2024-05-08T21:49:37.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.438+0000 7f9becf30700 1 -- 172.21.15.73:0/277059934 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9bd40035b0 con 0x7f9be8153db0 2024-05-08T21:49:37.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.438+0000 7f9becf30700 1 -- 172.21.15.73:0/277059934 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2542593249 0 0) 0x7f9bd40035b0 con 0x7f9be8153db0 2024-05-08T21:49:37.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.438+0000 7f9becf30700 1 -- 172.21.15.73:0/277059934 >> v2:172.21.15.115:3300/0 conn(0x7f9be815a7b0 msgr2=0x7f9be80ca2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:37.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.438+0000 7f9becf30700 1 --2- 172.21.15.73:0/277059934 >> v2:172.21.15.115:3300/0 conn(0x7f9be815a7b0 0x7f9be80ca2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:37.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.438+0000 7f9becf30700 1 -- 172.21.15.73:0/277059934 >> v1:172.21.15.115:6789/0 conn(0x7f9be80c9ea0 legacy=0x7f9be815a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:37.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.438+0000 7f9becf30700 1 -- 172.21.15.73:0/277059934 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9be8159ba0 con 0x7f9be8153db0 2024-05-08T21:49:37.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.438+0000 7f9becf30700 1 -- 172.21.15.73:0/277059934 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 953298616 0 0) 0x7f9bd8001670 con 0x7f9be8153db0 2024-05-08T21:49:37.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.438+0000 7f9becf30700 1 -- 172.21.15.73:0/277059934 >> v1:172.21.15.73:6789/0 conn(0x7f9be8153db0 legacy=0x7f9be80720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:37.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.438+0000 7f9becf30700 1 --2- 172.21.15.73:0/277059934 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9bd4003a00 0x7f9bd4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:37.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.438+0000 7f9becf30700 1 --2- 172.21.15.73:0/277059934 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9bd4004400 0x7f9bd40048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:37.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.438+0000 7f9becf30700 1 --2- 172.21.15.73:0/277059934 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bd40050d0 0x7f9bd400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:37.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.438+0000 7f9becf30700 1 -- 172.21.15.73:0/277059934 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd400bf50 con 0x7f9bd40050d0 2024-05-08T21:49:37.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.438+0000 7f9becf30700 1 -- 172.21.15.73:0/277059934 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd400c0c0 con 0x7f9bd4003a00 2024-05-08T21:49:37.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.438+0000 7f9becf30700 1 -- 172.21.15.73:0/277059934 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd400c280 con 0x7f9bd4004400 2024-05-08T21:49:37.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.438+0000 7f9bee733700 1 --2- 172.21.15.73:0/277059934 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bd40050d0 0x7f9bd400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:37.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.438+0000 7f9bedf32700 1 --2- 172.21.15.73:0/277059934 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9bd4003a00 0x7f9bd4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:37.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.438+0000 7f9bed731700 1 --2- 172.21.15.73:0/277059934 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9bd4004400 0x7f9bd40048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:37.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.439+0000 7f9bee733700 1 -- 172.21.15.73:0/277059934 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9bd4004400 msgr2=0x7f9bd40048d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:37.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.439+0000 7f9bee733700 1 --2- 172.21.15.73:0/277059934 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9bd4004400 0x7f9bd40048d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:37.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.439+0000 7f9bee733700 1 -- 172.21.15.73:0/277059934 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9bd4003a00 msgr2=0x7f9bd4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:37.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.439+0000 7f9bee733700 1 --2- 172.21.15.73:0/277059934 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9bd4003a00 0x7f9bd4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:37.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.439+0000 7f9bee733700 1 -- 172.21.15.73:0/277059934 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bd40035b0 con 0x7f9bd40050d0 2024-05-08T21:49:37.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.439+0000 7f9bee733700 1 -- 172.21.15.73:0/277059934 reap_dead start 2024-05-08T21:49:37.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.439+0000 7f9bee733700 1 --2- 172.21.15.73:0/277059934 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bd40050d0 0x7f9bd400ba10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9be0009fc0 tx=0x7f9bd4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9766ccbf5eb4685 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:37.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.439+0000 7f9becf30700 1 -- 172.21.15.73:0/277059934 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be0003a20 con 0x7f9bd40050d0 2024-05-08T21:49:37.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.439+0000 7f9becf30700 1 -- 172.21.15.73:0/277059934 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9be000f040 con 0x7f9bd40050d0 2024-05-08T21:49:37.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.439+0000 7f9becf30700 1 -- 172.21.15.73:0/277059934 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be0003da0 con 0x7f9bd40050d0 2024-05-08T21:49:37.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.439+0000 7f9bf0196700 1 -- 172.21.15.73:0/277059934 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bd40050d0 msgr2=0x7f9bd400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:37.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.439+0000 7f9bf0196700 1 --2- 172.21.15.73:0/277059934 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bd40050d0 0x7f9bd400ba10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9be0009fc0 tx=0x7f9bd4005880 comp rx=0 tx=0).stop 2024-05-08T21:49:37.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.439+0000 7f9bf0196700 1 -- 172.21.15.73:0/277059934 shutdown_connections 2024-05-08T21:49:37.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.439+0000 7f9bf0196700 1 --2- 172.21.15.73:0/277059934 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bd40050d0 0x7f9bd400ba10 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:37.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.439+0000 7f9bf0196700 1 -- 172.21.15.73:0/277059934 >> 172.21.15.73:0/277059934 conn(0x7f9be806be70 msgr2=0x7f9be806c380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:37.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.439+0000 7f9bf0196700 1 -- 172.21.15.73:0/277059934 shutdown_connections 2024-05-08T21:49:37.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.439+0000 7f9bf0196700 1 -- 172.21.15.73:0/277059934 wait complete. 2024-05-08T21:49:37.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.441+0000 7f9bf0196700 1 Processor -- start 2024-05-08T21:49:37.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.441+0000 7f9bf0196700 1 -- start start 2024-05-08T21:49:37.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.441+0000 7f9bf0196700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bd40050d0 0x7f9be81f2d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:37.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.441+0000 7f9bf0196700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9be815bac0 0x7f9be8144d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:37.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.441+0000 7f9bf0196700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9be81f3280 0x7f9be81452c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:37.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.441+0000 7f9bf0196700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9be815c5e0 con 0x7f9bd40050d0 2024-05-08T21:49:37.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.441+0000 7f9bf0196700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9be815adf0 con 0x7f9be815bac0 2024-05-08T21:49:37.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.441+0000 7f9bf0196700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9be815b410 con 0x7f9be81f3280 2024-05-08T21:49:37.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.441+0000 7f9bedf32700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bd40050d0 0x7f9be81f2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:37.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.441+0000 7f9bedf32700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bd40050d0 0x7f9be81f2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39010/0 (socket says 172.21.15.73:39010) 2024-05-08T21:49:37.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.441+0000 7f9bedf32700 1 -- 172.21.15.73:0/1878050592 learned_addr learned my addr 172.21.15.73:0/1878050592 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:37.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.441+0000 7f9bed731700 1 --2- 172.21.15.73:0/1878050592 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9be815bac0 0x7f9be8144d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:37.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.442+0000 7f9bee733700 1 --2- 172.21.15.73:0/1878050592 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9be81f3280 0x7f9be81452c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:37.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.442+0000 7f9bedf32700 1 -- 172.21.15.73:0/1878050592 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9be81f3280 msgr2=0x7f9be81452c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:37.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.442+0000 7f9bedf32700 1 --2- 172.21.15.73:0/1878050592 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9be81f3280 0x7f9be81452c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:37.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.442+0000 7f9bedf32700 1 -- 172.21.15.73:0/1878050592 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9be815bac0 msgr2=0x7f9be8144d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:37.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.442+0000 7f9bedf32700 1 --2- 172.21.15.73:0/1878050592 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9be815bac0 0x7f9be8144d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:37.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.442+0000 7f9bedf32700 1 -- 172.21.15.73:0/1878050592 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9be81f3800 con 0x7f9bd40050d0 2024-05-08T21:49:37.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.442+0000 7f9bedf32700 1 --2- 172.21.15.73:0/1878050592 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bd40050d0 0x7f9be81f2d40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9bd8007290 tx=0x7f9bd80075a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:37.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.442+0000 7f9bde7fc700 1 -- 172.21.15.73:0/1878050592 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd8011580 con 0x7f9bd40050d0 2024-05-08T21:49:37.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.442+0000 7f9bde7fc700 1 -- 172.21.15.73:0/1878050592 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bd80116e0 con 0x7f9bd40050d0 2024-05-08T21:49:37.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.442+0000 7f9bf0196700 1 -- 172.21.15.73:0/1878050592 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9be815bf90 con 0x7f9bd40050d0 2024-05-08T21:49:37.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.442+0000 7f9bde7fc700 1 -- 172.21.15.73:0/1878050592 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd8011a90 con 0x7f9bd40050d0 2024-05-08T21:49:37.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.442+0000 7f9bf0196700 1 -- 172.21.15.73:0/1878050592 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9be81534f0 con 0x7f9bd40050d0 2024-05-08T21:49:37.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.443+0000 7f9bf0196700 1 -- 172.21.15.73:0/1878050592 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9be8067a20 con 0x7f9bd40050d0 2024-05-08T21:49:37.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.443+0000 7f9bde7fc700 1 -- 172.21.15.73:0/1878050592 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 4) v1 ==== 89089+0+0 (secure 0 0 0) 0x7f9bd8011bf0 con 0x7f9bd40050d0 2024-05-08T21:49:37.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.444+0000 7f9bde7fc700 1 --2- 172.21.15.73:0/1878050592 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f9bcc06ac30 0x7f9bcc06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:37.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.444+0000 7f9bde7fc700 1 -- 172.21.15.73:0/1878050592 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9bd8088f10 con 0x7f9bd40050d0 2024-05-08T21:49:37.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.444+0000 7f9bed731700 1 --2- 172.21.15.73:0/1878050592 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f9bcc06ac30 0x7f9bcc06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:37.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.444+0000 7f9bed731700 1 --2- 172.21.15.73:0/1878050592 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f9bcc06ac30 0x7f9bcc06d0f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9be815bea0 tx=0x7f9be4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:37.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.448+0000 7f9bde7fc700 1 -- 172.21.15.73:0/1878050592 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f9bd8054490 con 0x7f9bd40050d0 2024-05-08T21:49:37.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.642+0000 7f9bf0196700 1 -- 172.21.15.73:0/1878050592 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9be8158390 con 0x7f9bd40050d0 2024-05-08T21:49:37.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.643+0000 7f9bde7fc700 1 -- 172.21.15.73:0/1878050592 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+12256 (secure 0 0 0) 0x7f9bd8057ab0 con 0x7f9bd40050d0 2024-05-08T21:49:37.644 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:49:37.644 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":15,"fsid":"143164b7-c9c7-4737-a494-7dafa5a3320c","created":"2024-05-08T21:49:26.221909+0000","modified":"2024-05-08T21:49:37.118386+0000","last_up_change":"2024-05-08T21:49:37.118386+0000","last_in_change":"2024-05-08T21:49:28.836944+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T21:49:35.998578+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6b7439c1-daaa-44af-8333-a455f9e9dc67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":47228},{"type":"v1","addr":"172.21.15.73:6809","nonce":47228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":47228},{"type":"v1","addr":"172.21.15.73:6811","nonce":47228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":47228},{"type":"v1","addr":"172.21.15.73:6815","nonce":47228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":47228},{"type":"v1","addr":"172.21.15.73:6813","nonce":47228}]},"public_addr":"172.21.15.73:6809/47228","cluster_addr":"172.21.15.73:6811/47228","heartbeat_back_addr":"172.21.15.73:6815/47228","heartbeat_front_addr":"172.21.15.73:6813/47228","state":["exists","up"]},{"osd":1,"uuid":"fb67886a-d7f7-45ac-832f-36c871c8a208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":47227},{"type":"v1","addr":"172.21.15.73:6801","nonce":47227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":47227},{"type":"v1","addr":"172.21.15.73:6803","nonce":47227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":47227},{"type":"v1","addr":"172.21.15.73:6807","nonce":47227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":47227},{"type":"v1","addr":"172.21.15.73:6805","nonce":47227}]},"public_addr":"172.21.15.73:6801/47227","cluster_addr":"172.21.15.73:6803/47227","heartbeat_back_addr":"172.21.15.73:6807/47227","heartbeat_front_addr":"172.21.15.73:6805/47227","state":["exists","up"]},{"osd":2,"uuid":"a5cd6e98-6621-473a-bfb8-5c648abbb563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":47229},{"type":"v1","addr":"172.21.15.73:6817","nonce":47229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":47229},{"type":"v1","addr":"172.21.15.73:6819","nonce":47229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":47229},{"type":"v1","addr":"172.21.15.73:6823","nonce":47229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":47229},{"type":"v1","addr":"172.21.15.73:6821","nonce":47229}]},"public_addr":"172.21.15.73:6817/47229","cluster_addr":"172.21.15.73:6819/47229","heartbeat_back_addr":"172.21.15.73:6823/47229","heartbeat_front_addr":"172.21.15.73:6821/47229","state":["exists","up"]},{"osd":3,"uuid":"36927c20-4241-4f3b-91b5-a6a6f27598e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":47232},{"type":"v1","addr":"172.21.15.73:6825","nonce":47232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":47232},{"type":"v1","addr":"172.21.15.73:6827","nonce":47232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":47232},{"type":"v1","addr":"172.21.15.73:6831","nonce":47232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":47232},{"type":"v1","addr":"172.21.15.73:6829","nonce":47232}]},"public_addr":"172.21.15.73:6825/47232","cluster_addr":"172.21.15.73:6827/47232","heartbeat_back_addr":"172.21.15.73:6831/47232","heartbeat_front_addr":"172.21.15.73:6829/47232","state":["exists","up"]},{"osd":4,"uuid":"4ebe0a18-8216-4815-878a-39c39a6cd3fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":47200},{"type":"v1","addr":"172.21.15.115:6801","nonce":47200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":47200},{"type":"v1","addr":"172.21.15.115:6803","nonce":47200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":47200},{"type":"v1","addr":"172.21.15.115:6807","nonce":47200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":47200},{"type":"v1","addr":"172.21.15.115:6805","nonce":47200}]},"public_addr":"172.21.15.115:6801/47200","cluster_addr":"172.21.15.115:6803/47200","heartbeat_back_addr":"172.21.15.115:6807/47200","heartbeat_front_addr":"172.21.15.115:6805/47200","state":["exists","up"]},{"osd":5,"uuid":"957f0ac1-5f26-4f02-8c05-488e6b67ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":47201},{"type":"v1","addr":"172.21.15.115:6809","nonce":47201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":47201},{"type":"v1","addr":"172.21.15.115:6811","nonce":47201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":47201},{"type":"v1","addr":"172.21.15.115:6815","nonce":47201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":47201},{"type":"v1","addr":"172.21.15.115:6813","nonce":47201}]},"public_addr":"172.21.15.115:6809/47201","cluster_addr":"172.21.15.115:6811/47201","heartbeat_back_addr":"172.21.15.115:6815/47201","heartbeat_front_addr":"172.21.15.115:6813/47201","state":["exists","up"]},{"osd":6,"uuid":"f5a6768f-ba7f-4f66-b335-0c303b158e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":47202},{"type":"v1","addr":"172.21.15.115:6817","nonce":47202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":47202},{"type":"v1","addr":"172.21.15.115:6819","nonce":47202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":47202},{"type":"v1","addr":"172.21.15.115:6823","nonce":47202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":47202},{"type":"v1","addr":"172.21.15.115:6821","nonce":47202}]},"public_addr":"172.21.15.115:6817/47202","cluster_addr":"172.21.15.115:6819/47202","heartbeat_back_addr":"172.21.15.115:6823/47202","heartbeat_front_addr":"172.21.15.115:6821/47202","state":["exists","up"]},{"osd":7,"uuid":"f4187743-f9e6-42e6-aca9-0604a58db1ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":47211},{"type":"v1","addr":"172.21.15.115:6825","nonce":47211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":47211},{"type":"v1","addr":"172.21.15.115:6827","nonce":47211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":47211},{"type":"v1","addr":"172.21.15.115:6831","nonce":47211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":47211},{"type":"v1","addr":"172.21.15.115:6829","nonce":47211}]},"public_addr":"172.21.15.115:6825/47211","cluster_addr":"172.21.15.115:6827/47211","heartbeat_back_addr":"172.21.15.115:6831/47211","heartbeat_front_addr":"172.21.15.115:6829/47211","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:33.687451+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:34.876272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T21:49:37.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.645+0000 7f9bf0196700 1 -- 172.21.15.73:0/1878050592 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f9bcc06ac30 msgr2=0x7f9bcc06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:37.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.645+0000 7f9bf0196700 1 --2- 172.21.15.73:0/1878050592 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f9bcc06ac30 0x7f9bcc06d0f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9be815bea0 tx=0x7f9be4009040 comp rx=0 tx=0).stop 2024-05-08T21:49:37.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.645+0000 7f9bf0196700 1 -- 172.21.15.73:0/1878050592 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bd40050d0 msgr2=0x7f9be81f2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:37.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.645+0000 7f9bf0196700 1 --2- 172.21.15.73:0/1878050592 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bd40050d0 0x7f9be81f2d40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9bd8007290 tx=0x7f9bd80075a0 comp rx=0 tx=0).stop 2024-05-08T21:49:37.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.645+0000 7f9bf0196700 1 -- 172.21.15.73:0/1878050592 shutdown_connections 2024-05-08T21:49:37.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.645+0000 7f9bf0196700 1 --2- 172.21.15.73:0/1878050592 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f9bcc06ac30 0x7f9bcc06d0f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:37.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.645+0000 7f9bf0196700 1 --2- 172.21.15.73:0/1878050592 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9be81f3280 0x7f9be81452c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:37.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.645+0000 7f9bf0196700 1 --2- 172.21.15.73:0/1878050592 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bd40050d0 0x7f9be81f2d40 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:37.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.645+0000 7f9bf0196700 1 --2- 172.21.15.73:0/1878050592 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9be815bac0 0x7f9be8144d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:37.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.645+0000 7f9bf0196700 1 -- 172.21.15.73:0/1878050592 >> 172.21.15.73:0/1878050592 conn(0x7f9be806be70 msgr2=0x7f9be80c5500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:37.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.645+0000 7f9bf0196700 1 -- 172.21.15.73:0/1878050592 shutdown_connections 2024-05-08T21:49:37.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.645+0000 7f9bf0196700 1 -- 172.21.15.73:0/1878050592 wait complete. 2024-05-08T21:49:37.658 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T21:49:35.998578+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T21:49:37.658 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T21:49:37.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.785+0000 7fea04089700 1 Processor -- start 2024-05-08T21:49:37.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.785+0000 7fea04089700 1 -- start start 2024-05-08T21:49:37.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.786+0000 7fea04089700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe9fc0725a0 0x7fe9fc06adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:37.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.786+0000 7fea04089700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe9fc06b300 0x7fe9fc0c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:37.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.786+0000 7fea04089700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9fc06b710 con 0x7fe9fc153eb0 2024-05-08T21:49:37.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.786+0000 7fea04089700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9fc0c3ca0 con 0x7fe9fc0725a0 2024-05-08T21:49:37.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.786+0000 7fea04089700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9fc159c10 con 0x7fe9fc06b300 2024-05-08T21:49:37.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.786+0000 7fea01624700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe9fc0725a0 0x7fe9fc06adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:37.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.786+0000 7fea01e25700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fe9fc153eb0 0x7fe9fc071a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49322/0 (socket says 172.21.15.73:49322) 2024-05-08T21:49:37.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.786+0000 7fea01e25700 1 -- 172.21.15.73:0/3768783394 learned_addr learned my addr 172.21.15.73:0/3768783394 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:49:37.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.786+0000 7fea02626700 1 --2- 172.21.15.73:0/3768783394 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe9fc06b300 0x7fe9fc0c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:37.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.786+0000 7fea00e23700 1 -- 172.21.15.73:0/3768783394 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 397798524 0 0) 0x7fe9f8001110 con 0x7fe9fc153eb0 2024-05-08T21:49:37.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.786+0000 7fea00e23700 1 -- 172.21.15.73:0/3768783394 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9e80035b0 con 0x7fe9fc153eb0 2024-05-08T21:49:37.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.786+0000 7fea01624700 1 -- 172.21.15.73:0/3768783394 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe9fc06b300 msgr2=0x7fe9fc0c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:37.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.786+0000 7fea01624700 1 --2- 172.21.15.73:0/3768783394 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe9fc06b300 0x7fe9fc0c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:37.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.786+0000 7fea01624700 1 -- 172.21.15.73:0/3768783394 >> v1:172.21.15.73:6789/0 conn(0x7fe9fc153eb0 legacy=0x7fe9fc071a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:37.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.786+0000 7fea01624700 1 -- 172.21.15.73:0/3768783394 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9fc159e20 con 0x7fe9fc0725a0 2024-05-08T21:49:37.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.786+0000 7fea01624700 1 --2- 172.21.15.73:0/3768783394 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe9fc0725a0 0x7fe9fc06adc0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec009840 tx=0x7fe9ec009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8ebb383d101df27 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:37.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.786+0000 7fea00e23700 1 -- 172.21.15.73:0/3768783394 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec011830 con 0x7fe9fc0725a0 2024-05-08T21:49:37.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.787+0000 7fea00e23700 1 -- 172.21.15.73:0/3768783394 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9ec011990 con 0x7fe9fc0725a0 2024-05-08T21:49:37.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.787+0000 7fea00e23700 1 -- 172.21.15.73:0/3768783394 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec011d20 con 0x7fe9fc0725a0 2024-05-08T21:49:37.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.787+0000 7fea04089700 1 -- 172.21.15.73:0/3768783394 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe9fc0725a0 msgr2=0x7fe9fc06adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:37.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.787+0000 7fea04089700 1 --2- 172.21.15.73:0/3768783394 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe9fc0725a0 0x7fe9fc06adc0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec009840 tx=0x7fe9ec009b50 comp rx=0 tx=0).stop 2024-05-08T21:49:37.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.787+0000 7fea04089700 1 -- 172.21.15.73:0/3768783394 shutdown_connections 2024-05-08T21:49:37.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.787+0000 7fea04089700 1 --2- 172.21.15.73:0/3768783394 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe9fc06b300 0x7fe9fc0c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:37.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.787+0000 7fea04089700 1 --2- 172.21.15.73:0/3768783394 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe9fc0725a0 0x7fe9fc06adc0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:37.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.787+0000 7fea04089700 1 -- 172.21.15.73:0/3768783394 >> 172.21.15.73:0/3768783394 conn(0x7fe9fc066ab0 msgr2=0x7fe9fc06f550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:37.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.787+0000 7fea04089700 1 -- 172.21.15.73:0/3768783394 shutdown_connections 2024-05-08T21:49:37.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.787+0000 7fea04089700 1 -- 172.21.15.73:0/3768783394 wait complete. 2024-05-08T21:49:37.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.788+0000 7fea04089700 1 Processor -- start 2024-05-08T21:49:37.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.788+0000 7fea04089700 1 -- start start 2024-05-08T21:49:37.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.789+0000 7fea04089700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe9fc06b300 0x7fe9fc150740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:37.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.789+0000 7fea04089700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe9fc0725a0 0x7fe9fc150c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:37.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.789+0000 7fea04089700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9fc153eb0 0x7fe9fc1efc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:37.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.789+0000 7fea04089700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9fc1ef770 con 0x7fe9fc06b300 2024-05-08T21:49:37.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.789+0000 7fea04089700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9fc14e1b0 con 0x7fe9fc153eb0 2024-05-08T21:49:37.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.789+0000 7fea04089700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9fc14e490 con 0x7fe9fc0725a0 2024-05-08T21:49:37.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.789+0000 7fea01e25700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe9fc06b300 0x7fe9fc150740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:37.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.789+0000 7fea01e25700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe9fc06b300 0x7fe9fc150740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39024/0 (socket says 172.21.15.73:39024) 2024-05-08T21:49:37.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.789+0000 7fea01e25700 1 -- 172.21.15.73:0/2070391119 learned_addr learned my addr 172.21.15.73:0/2070391119 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:37.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.789+0000 7fea01624700 1 --2- 172.21.15.73:0/2070391119 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe9fc0725a0 0x7fe9fc150c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:37.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.789+0000 7fea01e25700 1 -- 172.21.15.73:0/2070391119 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe9fc0725a0 msgr2=0x7fe9fc150c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:37.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.789+0000 7fea02626700 1 --2- 172.21.15.73:0/2070391119 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9fc153eb0 0x7fe9fc1efc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:37.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.789+0000 7fea01e25700 1 --2- 172.21.15.73:0/2070391119 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe9fc0725a0 0x7fe9fc150c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:37.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.789+0000 7fea01e25700 1 -- 172.21.15.73:0/2070391119 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9fc153eb0 msgr2=0x7fe9fc1efc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:37.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.789+0000 7fea01e25700 1 --2- 172.21.15.73:0/2070391119 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9fc153eb0 0x7fe9fc1efc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:37.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.789+0000 7fea01e25700 1 -- 172.21.15.73:0/2070391119 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9ec0094a0 con 0x7fe9fc06b300 2024-05-08T21:49:37.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.789+0000 7fea01624700 1 --2- 172.21.15.73:0/2070391119 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe9fc0725a0 0x7fe9fc150c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:49:37.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.789+0000 7fea02626700 1 --2- 172.21.15.73:0/2070391119 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9fc153eb0 0x7fe9fc1efc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:49:37.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.789+0000 7fea01e25700 1 --2- 172.21.15.73:0/2070391119 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe9fc06b300 0x7fe9fc150740 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe9f8007fd0 tx=0x7fe9f800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:37.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.790+0000 7fe9f27fc700 1 -- 172.21.15.73:0/2070391119 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f8005d70 con 0x7fe9fc06b300 2024-05-08T21:49:37.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.790+0000 7fe9f27fc700 1 -- 172.21.15.73:0/2070391119 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9f80070d0 con 0x7fe9fc06b300 2024-05-08T21:49:37.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.790+0000 7fea04089700 1 -- 172.21.15.73:0/2070391119 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9fc14e770 con 0x7fe9fc06b300 2024-05-08T21:49:37.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.790+0000 7fe9f27fc700 1 -- 172.21.15.73:0/2070391119 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f8007460 con 0x7fe9fc06b300 2024-05-08T21:49:37.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.790+0000 7fea04089700 1 -- 172.21.15.73:0/2070391119 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9fc14aff0 con 0x7fe9fc06b300 2024-05-08T21:49:37.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.790+0000 7fea04089700 1 -- 172.21.15.73:0/2070391119 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9fc158330 con 0x7fe9fc06b300 2024-05-08T21:49:37.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.791+0000 7fe9f27fc700 1 -- 172.21.15.73:0/2070391119 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 4) v1 ==== 89089+0+0 (secure 0 0 0) 0x7fe9f80075c0 con 0x7fe9fc06b300 2024-05-08T21:49:37.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.791+0000 7fe9f27fc700 1 --2- 172.21.15.73:0/2070391119 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fe9e006ac00 0x7fe9e006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:37.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.791+0000 7fe9f27fc700 1 -- 172.21.15.73:0/2070391119 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe9f80882a0 con 0x7fe9fc06b300 2024-05-08T21:49:37.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.791+0000 7fea01624700 1 --2- 172.21.15.73:0/2070391119 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fe9e006ac00 0x7fe9e006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:37.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.792+0000 7fea01624700 1 --2- 172.21.15.73:0/2070391119 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fe9e006ac00 0x7fe9e006d0c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc06fb60 tx=0x7fe9ec008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:37.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.796+0000 7fe9f27fc700 1 -- 172.21.15.73:0/2070391119 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fe9f80538b0 con 0x7fe9fc06b300 2024-05-08T21:49:37.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.991+0000 7fea04089700 1 -- 172.21.15.73:0/2070391119 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe9fc14b180 con 0x7fe9fc06b300 2024-05-08T21:49:37.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.991+0000 7fe9f27fc700 1 -- 172.21.15.73:0/2070391119 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v15) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe9fc14b180 con 0x7fe9fc06b300 2024-05-08T21:49:37.992 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-05-08T21:49:37.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.993+0000 7fea04089700 1 -- 172.21.15.73:0/2070391119 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fe9e006ac00 msgr2=0x7fe9e006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:37.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.993+0000 7fea04089700 1 --2- 172.21.15.73:0/2070391119 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fe9e006ac00 0x7fe9e006d0c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc06fb60 tx=0x7fe9ec008030 comp rx=0 tx=0).stop 2024-05-08T21:49:37.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.993+0000 7fea04089700 1 -- 172.21.15.73:0/2070391119 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe9fc06b300 msgr2=0x7fe9fc150740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:37.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.993+0000 7fea04089700 1 --2- 172.21.15.73:0/2070391119 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe9fc06b300 0x7fe9fc150740 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe9f8007fd0 tx=0x7fe9f800c860 comp rx=0 tx=0).stop 2024-05-08T21:49:37.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.993+0000 7fea04089700 1 -- 172.21.15.73:0/2070391119 shutdown_connections 2024-05-08T21:49:37.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.993+0000 7fea04089700 1 --2- 172.21.15.73:0/2070391119 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fe9e006ac00 0x7fe9e006d0c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:37.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.993+0000 7fea04089700 1 --2- 172.21.15.73:0/2070391119 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9fc153eb0 0x7fe9fc1efc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:37.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.993+0000 7fea04089700 1 --2- 172.21.15.73:0/2070391119 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe9fc06b300 0x7fe9fc150740 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:37.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.993+0000 7fea04089700 1 --2- 172.21.15.73:0/2070391119 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe9fc0725a0 0x7fe9fc150c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:37.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.993+0000 7fea04089700 1 -- 172.21.15.73:0/2070391119 >> 172.21.15.73:0/2070391119 conn(0x7fe9fc066ab0 msgr2=0x7fe9fc0719b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:37.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.993+0000 7fea04089700 1 -- 172.21.15.73:0/2070391119 shutdown_connections 2024-05-08T21:49:37.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:37.993+0000 7fea04089700 1 -- 172.21.15.73:0/2070391119 wait complete. 2024-05-08T21:49:38.007 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:49:38.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.128+0000 7f95b517e700 1 Processor -- start 2024-05-08T21:49:38.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.129+0000 7f95b517e700 1 -- start start 2024-05-08T21:49:38.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.130+0000 7f95b517e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95b00c7f50 0x7f95b015a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:38.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.130+0000 7f95b517e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f95b00c8ec0 0x7f95b015a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:38.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.130+0000 7f95b517e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95b00b03b0 con 0x7f95b00affd0 2024-05-08T21:49:38.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.130+0000 7f95b517e700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95b006fcf0 con 0x7f95b00c8ec0 2024-05-08T21:49:38.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.130+0000 7f95b517e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95b0159ed0 con 0x7f95b00c7f50 2024-05-08T21:49:38.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.130+0000 7f95aed9d700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f95b00affd0 0x7f95b00cd4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49324/0 (socket says 172.21.15.73:49324) 2024-05-08T21:49:38.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.130+0000 7f95aed9d700 1 -- 172.21.15.73:0/485033272 learned_addr learned my addr 172.21.15.73:0/485033272 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:49:38.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.130+0000 7f95ae59c700 1 --2- 172.21.15.73:0/485033272 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95b00c7f50 0x7f95b015a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:38.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.130+0000 7f95af59e700 1 --2- 172.21.15.73:0/485033272 >> v2:172.21.15.115:3300/0 conn(0x7f95b00c8ec0 0x7f95b015a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:38.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.130+0000 7f95ae59c700 1 -- 172.21.15.73:0/485033272 >> v2:172.21.15.115:3300/0 conn(0x7f95b00c8ec0 msgr2=0x7f95b015a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:38.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.130+0000 7f95ae59c700 1 --2- 172.21.15.73:0/485033272 >> v2:172.21.15.115:3300/0 conn(0x7f95b00c8ec0 0x7f95b015a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:38.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.130+0000 7f95ae59c700 1 -- 172.21.15.73:0/485033272 >> v1:172.21.15.73:6789/0 conn(0x7f95b00affd0 legacy=0x7f95b00cd4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:38.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.130+0000 7f95ae59c700 1 -- 172.21.15.73:0/485033272 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b00c8a60 con 0x7f95b00c7f50 2024-05-08T21:49:38.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.130+0000 7f95ae59c700 1 --2- 172.21.15.73:0/485033272 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95b00c7f50 0x7f95b015a320 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f95a4009840 tx=0x7f95a4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1da33e0519ed1e25 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:38.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.131+0000 7f95add9b700 1 -- 172.21.15.73:0/485033272 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a4011830 con 0x7f95b00c7f50 2024-05-08T21:49:38.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.131+0000 7f95add9b700 1 -- 172.21.15.73:0/485033272 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95a4011990 con 0x7f95b00c7f50 2024-05-08T21:49:38.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.131+0000 7f95add9b700 1 -- 172.21.15.73:0/485033272 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a4011d20 con 0x7f95b00c7f50 2024-05-08T21:49:38.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.131+0000 7f95b517e700 1 -- 172.21.15.73:0/485033272 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95b00c7f50 msgr2=0x7f95b015a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:38.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.131+0000 7f95b517e700 1 --2- 172.21.15.73:0/485033272 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95b00c7f50 0x7f95b015a320 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f95a4009840 tx=0x7f95a4009b50 comp rx=0 tx=0).stop 2024-05-08T21:49:38.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.131+0000 7f95b517e700 1 -- 172.21.15.73:0/485033272 shutdown_connections 2024-05-08T21:49:38.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.131+0000 7f95b517e700 1 --2- 172.21.15.73:0/485033272 >> v2:172.21.15.115:3300/0 conn(0x7f95b00c8ec0 0x7f95b015a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:38.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.131+0000 7f95b517e700 1 --2- 172.21.15.73:0/485033272 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95b00c7f50 0x7f95b015a320 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:38.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.131+0000 7f95b517e700 1 -- 172.21.15.73:0/485033272 >> 172.21.15.73:0/485033272 conn(0x7f95b006ae10 msgr2=0x7f95b00666c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:38.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.131+0000 7f95b517e700 1 -- 172.21.15.73:0/485033272 shutdown_connections 2024-05-08T21:49:38.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.131+0000 7f95b517e700 1 -- 172.21.15.73:0/485033272 wait complete. 2024-05-08T21:49:38.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.133+0000 7f95b517e700 1 Processor -- start 2024-05-08T21:49:38.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.133+0000 7f95b517e700 1 -- start start 2024-05-08T21:49:38.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.133+0000 7f95b517e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95b00affd0 0x7f95b01f2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:38.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.133+0000 7f95b517e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95b00c7f50 0x7f95b00b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:38.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.133+0000 7f95b517e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f95b00c8ec0 0x7f95b00b2540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:38.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.133+0000 7f95b517e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b00c4950 con 0x7f95b00c7f50 2024-05-08T21:49:38.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.133+0000 7f95b517e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b01f34d0 con 0x7f95b00c8ec0 2024-05-08T21:49:38.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.133+0000 7f95b517e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95b00c4ba0 con 0x7f95b00affd0 2024-05-08T21:49:38.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.134+0000 7f95ae59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95b00c7f50 0x7f95b00b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:38.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.134+0000 7f95ae59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95b00c7f50 0x7f95b00b2000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39036/0 (socket says 172.21.15.73:39036) 2024-05-08T21:49:38.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.134+0000 7f95aed9d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95b00affd0 0x7f95b01f2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:38.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.134+0000 7f95ae59c700 1 -- 172.21.15.73:0/4266716250 learned_addr learned my addr 172.21.15.73:0/4266716250 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:38.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.134+0000 7f95af59e700 1 --2- 172.21.15.73:0/4266716250 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f95b00c8ec0 0x7f95b00b2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:38.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.134+0000 7f95ae59c700 1 -- 172.21.15.73:0/4266716250 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95b00affd0 msgr2=0x7f95b01f2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:38.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.134+0000 7f95ae59c700 1 --2- 172.21.15.73:0/4266716250 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95b00affd0 0x7f95b01f2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:38.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.134+0000 7f95ae59c700 1 -- 172.21.15.73:0/4266716250 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f95b00c8ec0 msgr2=0x7f95b00b2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:38.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.134+0000 7f95ae59c700 1 --2- 172.21.15.73:0/4266716250 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f95b00c8ec0 0x7f95b00b2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:38.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.134+0000 7f95ae59c700 1 -- 172.21.15.73:0/4266716250 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a40094a0 con 0x7f95b00c7f50 2024-05-08T21:49:38.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.134+0000 7f95ae59c700 1 --2- 172.21.15.73:0/4266716250 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95b00c7f50 0x7f95b00b2000 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f95a40090b0 tx=0x7f95a4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:38.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.134+0000 7f95977fe700 1 -- 172.21.15.73:0/4266716250 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a40036a0 con 0x7f95b00c7f50 2024-05-08T21:49:38.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.134+0000 7f95977fe700 1 -- 172.21.15.73:0/4266716250 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95a401f070 con 0x7f95b00c7f50 2024-05-08T21:49:38.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.134+0000 7f95b517e700 1 -- 172.21.15.73:0/4266716250 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95b00b1800 con 0x7f95b00c7f50 2024-05-08T21:49:38.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.134+0000 7f95977fe700 1 -- 172.21.15.73:0/4266716250 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a4003a60 con 0x7f95b00c7f50 2024-05-08T21:49:38.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.134+0000 7f95b517e700 1 -- 172.21.15.73:0/4266716250 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95b015af30 con 0x7f95b00c7f50 2024-05-08T21:49:38.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.135+0000 7f95b517e700 1 -- 172.21.15.73:0/4266716250 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95b00b1d20 con 0x7f95b00c7f50 2024-05-08T21:49:38.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.136+0000 7f95977fe700 1 -- 172.21.15.73:0/4266716250 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 4) v1 ==== 89089+0+0 (secure 0 0 0) 0x7f95a4003bc0 con 0x7f95b00c7f50 2024-05-08T21:49:38.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.136+0000 7f95977fe700 1 --2- 172.21.15.73:0/4266716250 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f959c06ac00 0x7f959c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:38.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.136+0000 7f95aed9d700 1 --2- 172.21.15.73:0/4266716250 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f959c06ac00 0x7f959c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:38.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.136+0000 7f95977fe700 1 -- 172.21.15.73:0/4266716250 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f95a4021070 con 0x7f95b00c7f50 2024-05-08T21:49:38.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.137+0000 7f95aed9d700 1 --2- 172.21.15.73:0/4266716250 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f959c06ac00 0x7f959c06d0c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f95a0005910 tx=0x7f95a0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:38.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.141+0000 7f95977fe700 1 -- 172.21.15.73:0/4266716250 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f95b00b1d20 con 0x7f95b00c7f50 2024-05-08T21:49:38.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.379+0000 7f95b517e700 1 -- 172.21.15.73:0/4266716250 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f95b00b1d20 con 0x7f95b00c7f50 2024-05-08T21:49:38.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.379+0000 7f95977fe700 1 -- 172.21.15.73:0/4266716250 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1256 (secure 0 0 0) 0x7f95a402b500 con 0x7f95b00c7f50 2024-05-08T21:49:38.380 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:49:38.381 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/1772457954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":1772457954},{"type":"v1","addr":"172.21.15.73:6837","nonce":1772457954}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-05-08T21:49:38.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.381+0000 7f95b517e700 1 -- 172.21.15.73:0/4266716250 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f959c06ac00 msgr2=0x7f959c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:38.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.381+0000 7f95b517e700 1 --2- 172.21.15.73:0/4266716250 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f959c06ac00 0x7f959c06d0c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f95a0005910 tx=0x7f95a0009040 comp rx=0 tx=0).stop 2024-05-08T21:49:38.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.381+0000 7f95b517e700 1 -- 172.21.15.73:0/4266716250 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95b00c7f50 msgr2=0x7f95b00b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:38.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.381+0000 7f95b517e700 1 --2- 172.21.15.73:0/4266716250 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95b00c7f50 0x7f95b00b2000 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f95a40090b0 tx=0x7f95a4004750 comp rx=0 tx=0).stop 2024-05-08T21:49:38.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.381+0000 7f95b517e700 1 -- 172.21.15.73:0/4266716250 shutdown_connections 2024-05-08T21:49:38.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.381+0000 7f95b517e700 1 --2- 172.21.15.73:0/4266716250 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f959c06ac00 0x7f959c06d0c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:38.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.381+0000 7f95b517e700 1 --2- 172.21.15.73:0/4266716250 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f95b00c8ec0 0x7f95b00b2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:38.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.381+0000 7f95b517e700 1 --2- 172.21.15.73:0/4266716250 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95b00affd0 0x7f95b01f2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:38.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.381+0000 7f95b517e700 1 --2- 172.21.15.73:0/4266716250 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95b00c7f50 0x7f95b00b2000 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:38.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.381+0000 7f95b517e700 1 -- 172.21.15.73:0/4266716250 >> 172.21.15.73:0/4266716250 conn(0x7f95b006ae10 msgr2=0x7f95b00c2570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:38.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.381+0000 7f95b517e700 1 -- 172.21.15.73:0/4266716250 shutdown_connections 2024-05-08T21:49:38.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:38.381+0000 7f95b517e700 1 -- 172.21.15.73:0/4266716250 wait complete. 2024-05-08T21:49:38.383 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 2 2024-05-08T21:49:40.397 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:49:40.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.521+0000 7f25b2f29700 1 Processor -- start 2024-05-08T21:49:40.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.521+0000 7f25b2f29700 1 -- start start 2024-05-08T21:49:40.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.522+0000 7f25b2f29700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25ac153b60 0x7f25ac0c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:40.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.522+0000 7f25b2f29700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f25ac15d1b0 0x7f25ac06f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:40.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.522+0000 7f25b2f29700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f25ac06ff20 0x7f25ac072710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:40.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.522+0000 7f25b2f29700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25ac0c95b0 con 0x7f25ac15d1b0 2024-05-08T21:49:40.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.522+0000 7f25b2f29700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25ac0c9850 con 0x7f25ac06ff20 2024-05-08T21:49:40.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.522+0000 7f25b2f29700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25ac0c9310 con 0x7f25ac153b60 2024-05-08T21:49:40.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.522+0000 7f25abfff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f25ac15d1b0 0x7f25ac06f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:40.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.522+0000 7f25abfff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f25ac15d1b0 0x7f25ac06f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43582/0 (socket says 172.21.15.73:43582) 2024-05-08T21:49:40.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.522+0000 7f25abfff700 1 -- 172.21.15.73:0/1101162871 learned_addr learned my addr 172.21.15.73:0/1101162871 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:40.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.522+0000 7f25b0cc5700 1 --2- 172.21.15.73:0/1101162871 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25ac153b60 0x7f25ac0c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:40.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.522+0000 7f25b14c6700 1 --2- 172.21.15.73:0/1101162871 >> v2:172.21.15.115:3300/0 conn(0x7f25ac06ff20 0x7f25ac072710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:40.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.523+0000 7f25abfff700 1 -- 172.21.15.73:0/1101162871 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25ac153b60 msgr2=0x7f25ac0c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:40.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.523+0000 7f25abfff700 1 --2- 172.21.15.73:0/1101162871 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25ac153b60 0x7f25ac0c8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:40.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.523+0000 7f25abfff700 1 -- 172.21.15.73:0/1101162871 >> v2:172.21.15.115:3300/0 conn(0x7f25ac06ff20 msgr2=0x7f25ac072710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:40.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.523+0000 7f25abfff700 1 --2- 172.21.15.73:0/1101162871 >> v2:172.21.15.115:3300/0 conn(0x7f25ac06ff20 0x7f25ac072710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:40.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.523+0000 7f25abfff700 1 -- 172.21.15.73:0/1101162871 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25ac159bc0 con 0x7f25ac15d1b0 2024-05-08T21:49:40.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.523+0000 7f25abfff700 1 --2- 172.21.15.73:0/1101162871 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25ac15d1b0 0x7f25ac06f9e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f25ac071960 tx=0x7f2598009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2c475d7551a6d6b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:40.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.523+0000 7f25ab7fe700 1 -- 172.21.15.73:0/1101162871 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2598011830 con 0x7f25ac15d1b0 2024-05-08T21:49:40.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.523+0000 7f25ab7fe700 1 -- 172.21.15.73:0/1101162871 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2598011990 con 0x7f25ac15d1b0 2024-05-08T21:49:40.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.523+0000 7f25ab7fe700 1 -- 172.21.15.73:0/1101162871 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2598011d20 con 0x7f25ac15d1b0 2024-05-08T21:49:40.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.523+0000 7f25b2f29700 1 -- 172.21.15.73:0/1101162871 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25ac15d1b0 msgr2=0x7f25ac06f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:40.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.523+0000 7f25b2f29700 1 --2- 172.21.15.73:0/1101162871 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25ac15d1b0 0x7f25ac06f9e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f25ac071960 tx=0x7f2598009bd0 comp rx=0 tx=0).stop 2024-05-08T21:49:40.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.523+0000 7f25b2f29700 1 -- 172.21.15.73:0/1101162871 shutdown_connections 2024-05-08T21:49:40.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.523+0000 7f25b2f29700 1 --2- 172.21.15.73:0/1101162871 >> v2:172.21.15.115:3300/0 conn(0x7f25ac06ff20 0x7f25ac072710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:40.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.523+0000 7f25b2f29700 1 --2- 172.21.15.73:0/1101162871 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25ac153b60 0x7f25ac0c8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:40.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.523+0000 7f25b2f29700 1 --2- 172.21.15.73:0/1101162871 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25ac15d1b0 0x7f25ac06f9e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:40.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.523+0000 7f25b2f29700 1 -- 172.21.15.73:0/1101162871 >> 172.21.15.73:0/1101162871 conn(0x7f25ac066cf0 msgr2=0x7f25ac06bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:40.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.524+0000 7f25b2f29700 1 -- 172.21.15.73:0/1101162871 shutdown_connections 2024-05-08T21:49:40.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.524+0000 7f25b2f29700 1 -- 172.21.15.73:0/1101162871 wait complete. 2024-05-08T21:49:40.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.525+0000 7f25b2f29700 1 Processor -- start 2024-05-08T21:49:40.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.525+0000 7f25b2f29700 1 -- start start 2024-05-08T21:49:40.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.525+0000 7f25b2f29700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25ac153b60 0x7f25ac0ca390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:40.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.525+0000 7f25b2f29700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25ac15d1b0 0x7f25ac158bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:40.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.525+0000 7f25b2f29700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25ac0ccf50 0x7f25ac154d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:40.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.525+0000 7f25b2f29700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25ac157440 con 0x7f25ac15d1b0 2024-05-08T21:49:40.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.525+0000 7f25b2f29700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25ac0ca9b0 con 0x7f25ac0ccf50 2024-05-08T21:49:40.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.525+0000 7f25b2f29700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25ac0cac70 con 0x7f25ac153b60 2024-05-08T21:49:40.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.526+0000 7f25abfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25ac15d1b0 0x7f25ac158bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:40.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.526+0000 7f25abfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25ac15d1b0 0x7f25ac158bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43590/0 (socket says 172.21.15.73:43590) 2024-05-08T21:49:40.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.526+0000 7f25abfff700 1 -- 172.21.15.73:0/3049324066 learned_addr learned my addr 172.21.15.73:0/3049324066 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:40.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.526+0000 7f25b0cc5700 1 --2- 172.21.15.73:0/3049324066 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25ac153b60 0x7f25ac0ca390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:40.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.526+0000 7f25b14c6700 1 --2- 172.21.15.73:0/3049324066 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25ac0ccf50 0x7f25ac154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:40.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.526+0000 7f25abfff700 1 -- 172.21.15.73:0/3049324066 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25ac153b60 msgr2=0x7f25ac0ca390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:40.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.526+0000 7f25abfff700 1 --2- 172.21.15.73:0/3049324066 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25ac153b60 0x7f25ac0ca390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:40.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.526+0000 7f25abfff700 1 -- 172.21.15.73:0/3049324066 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25ac0ccf50 msgr2=0x7f25ac154d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:40.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.526+0000 7f25abfff700 1 --2- 172.21.15.73:0/3049324066 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25ac0ccf50 0x7f25ac154d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:40.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.526+0000 7f25abfff700 1 -- 172.21.15.73:0/3049324066 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2598009550 con 0x7f25ac15d1b0 2024-05-08T21:49:40.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.526+0000 7f25abfff700 1 --2- 172.21.15.73:0/3049324066 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25ac15d1b0 0x7f25ac158bd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2598009c10 tx=0x7f2598004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:40.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.526+0000 7f25a97fa700 1 -- 172.21.15.73:0/3049324066 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2598004450 con 0x7f25ac15d1b0 2024-05-08T21:49:40.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.526+0000 7f25a97fa700 1 -- 172.21.15.73:0/3049324066 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f259801e070 con 0x7f25ac15d1b0 2024-05-08T21:49:40.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.526+0000 7f25a97fa700 1 -- 172.21.15.73:0/3049324066 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25980038e0 con 0x7f25ac15d1b0 2024-05-08T21:49:40.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.526+0000 7f25b2f29700 1 -- 172.21.15.73:0/3049324066 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25ac0caf50 con 0x7f25ac15d1b0 2024-05-08T21:49:40.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.526+0000 7f25b2f29700 1 -- 172.21.15.73:0/3049324066 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25ac154550 con 0x7f25ac15d1b0 2024-05-08T21:49:40.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.527+0000 7f25b2f29700 1 -- 172.21.15.73:0/3049324066 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25ac067c30 con 0x7f25ac15d1b0 2024-05-08T21:49:40.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.528+0000 7f25a97fa700 1 -- 172.21.15.73:0/3049324066 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2598003a40 con 0x7f25ac15d1b0 2024-05-08T21:49:40.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.528+0000 7f25a97fa700 1 --2- 172.21.15.73:0/3049324066 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f259006acc0 0x7f259006d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:40.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.528+0000 7f25a97fa700 1 -- 172.21.15.73:0/3049324066 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2598089c00 con 0x7f25ac15d1b0 2024-05-08T21:49:40.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.528+0000 7f25b0cc5700 1 --2- 172.21.15.73:0/3049324066 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f259006acc0 0x7f259006d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:40.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.528+0000 7f25b0cc5700 1 --2- 172.21.15.73:0/3049324066 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f259006acc0 0x7f259006d180 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f25a0009be0 tx=0x7f25a0009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:40.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.533+0000 7f25a97fa700 1 -- 172.21.15.73:0/3049324066 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f2598090080 con 0x7f25ac15d1b0 2024-05-08T21:49:40.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.772+0000 7f25b2f29700 1 -- 172.21.15.73:0/3049324066 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f25ac068b80 con 0x7f25ac15d1b0 2024-05-08T21:49:40.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.772+0000 7f25a97fa700 1 -- 172.21.15.73:0/3049324066 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+5045 (secure 0 0 0) 0x7f25980551c0 con 0x7f25ac15d1b0 2024-05-08T21:49:40.773 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:49:40.773 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3242319177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6833","nonce":3242319177},{"type":"v1","addr":"172.21.15.115:6835","nonce":3242319177}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6834/2136341349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2136341349},{"type":"v1","addr":"172.21.15.115:6834","nonce":2136341349}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4249,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1439647913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1439647913},{"type":"v1","addr":"172.21.15.115:6837","nonce":1439647913}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/2386382396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2386382396},{"type":"v1","addr":"172.21.15.73:6836","nonce":2386382396}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/1772457954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":1772457954},{"type":"v1","addr":"172.21.15.73:6837","nonce":1772457954}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6839/1477468490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1477468490},{"type":"v1","addr":"172.21.15.73:6839","nonce":1477468490}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-05-08T21:49:40.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.774+0000 7f25b2f29700 1 -- 172.21.15.73:0/3049324066 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f259006acc0 msgr2=0x7f259006d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:40.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.774+0000 7f25b2f29700 1 --2- 172.21.15.73:0/3049324066 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f259006acc0 0x7f259006d180 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f25a0009be0 tx=0x7f25a0009210 comp rx=0 tx=0).stop 2024-05-08T21:49:40.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.774+0000 7f25b2f29700 1 -- 172.21.15.73:0/3049324066 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25ac15d1b0 msgr2=0x7f25ac158bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:40.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.774+0000 7f25b2f29700 1 --2- 172.21.15.73:0/3049324066 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25ac15d1b0 0x7f25ac158bd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2598009c10 tx=0x7f2598004750 comp rx=0 tx=0).stop 2024-05-08T21:49:40.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.774+0000 7f25b2f29700 1 -- 172.21.15.73:0/3049324066 shutdown_connections 2024-05-08T21:49:40.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.774+0000 7f25b2f29700 1 --2- 172.21.15.73:0/3049324066 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f259006acc0 0x7f259006d180 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:40.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.774+0000 7f25b2f29700 1 --2- 172.21.15.73:0/3049324066 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25ac0ccf50 0x7f25ac154d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:40.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.774+0000 7f25b2f29700 1 --2- 172.21.15.73:0/3049324066 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25ac153b60 0x7f25ac0ca390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:40.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.774+0000 7f25b2f29700 1 --2- 172.21.15.73:0/3049324066 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25ac15d1b0 0x7f25ac158bd0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:40.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.774+0000 7f25b2f29700 1 -- 172.21.15.73:0/3049324066 >> 172.21.15.73:0/3049324066 conn(0x7f25ac066cf0 msgr2=0x7f25ac073b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:40.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.774+0000 7f25b2f29700 1 -- 172.21.15.73:0/3049324066 shutdown_connections 2024-05-08T21:49:40.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.774+0000 7f25b2f29700 1 -- 172.21.15.73:0/3049324066 wait complete. 2024-05-08T21:49:40.777 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 3 2024-05-08T21:49:40.787 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T21:49:40.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.907+0000 7f7e6f9b3700 1 Processor -- start 2024-05-08T21:49:40.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.907+0000 7f7e6f9b3700 1 -- start start 2024-05-08T21:49:40.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.908+0000 7f7e6f9b3700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7e680c4540 0x7f7e680c8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:40.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.908+0000 7f7e6f9b3700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7e680b28b0 0x7f7e680c8640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:40.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.908+0000 7f7e6f9b3700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e680c2570 con 0x7f7e68151bd0 2024-05-08T21:49:40.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.908+0000 7f7e6f9b3700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e680c2e80 con 0x7f7e680c4540 2024-05-08T21:49:40.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.908+0000 7f7e6f9b3700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6806f4e0 con 0x7f7e680b28b0 2024-05-08T21:49:40.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.908+0000 7f7e6cf4e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7e680c4540 0x7f7e680c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:40.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.908+0000 7f7e6cf4e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7e680c4540 0x7f7e680c8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43596/0 (socket says 172.21.15.73:43596) 2024-05-08T21:49:40.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.908+0000 7f7e6cf4e700 1 -- 172.21.15.73:0/865630349 learned_addr learned my addr 172.21.15.73:0/865630349 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:40.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.908+0000 7f7e6df50700 1 --2- 172.21.15.73:0/865630349 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7e680b28b0 0x7f7e680c8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:40.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.909+0000 7f7e6cf4e700 1 -- 172.21.15.73:0/865630349 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7e680b28b0 msgr2=0x7f7e680c8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:40.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.909+0000 7f7e6cf4e700 1 --2- 172.21.15.73:0/865630349 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7e680b28b0 0x7f7e680c8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:40.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.909+0000 7f7e6cf4e700 1 -- 172.21.15.73:0/865630349 >> v1:172.21.15.115:6789/0 conn(0x7f7e68151bd0 legacy=0x7f7e680cd4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:40.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.909+0000 7f7e6cf4e700 1 -- 172.21.15.73:0/865630349 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e6806f7c0 con 0x7f7e680c4540 2024-05-08T21:49:40.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.909+0000 7f7e6cf4e700 1 --2- 172.21.15.73:0/865630349 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e680c4540 0x7f7e680c8100 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7e640098f0 tx=0x7f7e64009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff417a574a8bfbc2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:40.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.909+0000 7f7e5ffff700 1 -- 172.21.15.73:0/865630349 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e64011830 con 0x7f7e680c4540 2024-05-08T21:49:40.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.909+0000 7f7e5ffff700 1 -- 172.21.15.73:0/865630349 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e64011990 con 0x7f7e680c4540 2024-05-08T21:49:40.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.909+0000 7f7e5ffff700 1 -- 172.21.15.73:0/865630349 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e64011d20 con 0x7f7e680c4540 2024-05-08T21:49:40.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.909+0000 7f7e6f9b3700 1 -- 172.21.15.73:0/865630349 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e680c4540 msgr2=0x7f7e680c8100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:40.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.909+0000 7f7e6f9b3700 1 --2- 172.21.15.73:0/865630349 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e680c4540 0x7f7e680c8100 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7e640098f0 tx=0x7f7e64009c00 comp rx=0 tx=0).stop 2024-05-08T21:49:40.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.909+0000 7f7e6f9b3700 1 -- 172.21.15.73:0/865630349 shutdown_connections 2024-05-08T21:49:40.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.909+0000 7f7e6f9b3700 1 --2- 172.21.15.73:0/865630349 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7e680b28b0 0x7f7e680c8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:40.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.909+0000 7f7e6f9b3700 1 --2- 172.21.15.73:0/865630349 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e680c4540 0x7f7e680c8100 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:40.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.909+0000 7f7e6f9b3700 1 -- 172.21.15.73:0/865630349 >> 172.21.15.73:0/865630349 conn(0x7f7e6806ae10 msgr2=0x7f7e680666c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:40.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.910+0000 7f7e6f9b3700 1 -- 172.21.15.73:0/865630349 shutdown_connections 2024-05-08T21:49:40.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.910+0000 7f7e6f9b3700 1 -- 172.21.15.73:0/865630349 wait complete. 2024-05-08T21:49:40.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.911+0000 7f7e6f9b3700 1 Processor -- start 2024-05-08T21:49:40.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.911+0000 7f7e6f9b3700 1 -- start start 2024-05-08T21:49:40.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.911+0000 7f7e6f9b3700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e680b28b0 0x7f7e6814ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:40.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.911+0000 7f7e6f9b3700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7e680c4540 0x7f7e6814cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:40.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.911+0000 7f7e6f9b3700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e68151bd0 0x7f7e6814e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:40.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.911+0000 7f7e6f9b3700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6814d330 con 0x7f7e68151bd0 2024-05-08T21:49:40.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.911+0000 7f7e6f9b3700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e681e3b10 con 0x7f7e680b28b0 2024-05-08T21:49:40.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.911+0000 7f7e6f9b3700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6814da80 con 0x7f7e680c4540 2024-05-08T21:49:40.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.911+0000 7f7e6df50700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e68151bd0 0x7f7e6814e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:40.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.911+0000 7f7e6cf4e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7e680c4540 0x7f7e6814cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:40.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.911+0000 7f7e6df50700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e68151bd0 0x7f7e6814e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43608/0 (socket says 172.21.15.73:43608) 2024-05-08T21:49:40.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.912+0000 7f7e6df50700 1 -- 172.21.15.73:0/2629190274 learned_addr learned my addr 172.21.15.73:0/2629190274 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:40.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.912+0000 7f7e6d74f700 1 --2- 172.21.15.73:0/2629190274 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e680b28b0 0x7f7e6814ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:40.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.912+0000 7f7e6df50700 1 -- 172.21.15.73:0/2629190274 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7e680c4540 msgr2=0x7f7e6814cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:40.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.912+0000 7f7e6df50700 1 --2- 172.21.15.73:0/2629190274 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7e680c4540 0x7f7e6814cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:40.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.912+0000 7f7e6df50700 1 -- 172.21.15.73:0/2629190274 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e680b28b0 msgr2=0x7f7e6814ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:40.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.912+0000 7f7e6df50700 1 --2- 172.21.15.73:0/2629190274 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e680b28b0 0x7f7e6814ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:40.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.912+0000 7f7e6df50700 1 -- 172.21.15.73:0/2629190274 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e64009550 con 0x7f7e68151bd0 2024-05-08T21:49:40.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.912+0000 7f7e6df50700 1 --2- 172.21.15.73:0/2629190274 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e68151bd0 0x7f7e6814e240 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7e6000efc0 tx=0x7f7e60009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:40.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.912+0000 7f7e5dffb700 1 -- 172.21.15.73:0/2629190274 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e60009b20 con 0x7f7e68151bd0 2024-05-08T21:49:40.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.912+0000 7f7e5dffb700 1 -- 172.21.15.73:0/2629190274 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e6000f040 con 0x7f7e68151bd0 2024-05-08T21:49:40.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.912+0000 7f7e6f9b3700 1 -- 172.21.15.73:0/2629190274 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e6814bd80 con 0x7f7e68151bd0 2024-05-08T21:49:40.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.912+0000 7f7e5dffb700 1 -- 172.21.15.73:0/2629190274 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6000cc90 con 0x7f7e68151bd0 2024-05-08T21:49:40.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.912+0000 7f7e6f9b3700 1 -- 172.21.15.73:0/2629190274 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e6814dd20 con 0x7f7e68151bd0 2024-05-08T21:49:40.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.913+0000 7f7e6f9b3700 1 -- 172.21.15.73:0/2629190274 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e6814df10 con 0x7f7e68151bd0 2024-05-08T21:49:40.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.914+0000 7f7e5dffb700 1 -- 172.21.15.73:0/2629190274 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7e60014480 con 0x7f7e68151bd0 2024-05-08T21:49:40.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.914+0000 7f7e5dffb700 1 --2- 172.21.15.73:0/2629190274 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f7e4c06ac90 0x7f7e4c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:40.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.914+0000 7f7e5dffb700 1 -- 172.21.15.73:0/2629190274 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7e600899a0 con 0x7f7e68151bd0 2024-05-08T21:49:40.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.914+0000 7f7e6d74f700 1 --2- 172.21.15.73:0/2629190274 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f7e4c06ac90 0x7f7e4c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:40.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.915+0000 7f7e6d74f700 1 --2- 172.21.15.73:0/2629190274 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f7e4c06ac90 0x7f7e4c06d150 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7e58007fd0 tx=0x7f7e58009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:40.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:40.919+0000 7f7e5dffb700 1 -- 172.21.15.73:0/2629190274 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f7e60054f60 con 0x7f7e68151bd0 2024-05-08T21:49:41.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.119+0000 7f7e6f9b3700 1 -- 172.21.15.73:0/2629190274 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e68068b80 con 0x7f7e68151bd0 2024-05-08T21:49:41.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.119+0000 7f7e5dffb700 1 -- 172.21.15.73:0/2629190274 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12382 (secure 0 0 0) 0x7f7e60018020 con 0x7f7e68151bd0 2024-05-08T21:49:41.120 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:49:41.121 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":17,"fsid":"143164b7-c9c7-4737-a494-7dafa5a3320c","created":"2024-05-08T21:49:26.221909+0000","modified":"2024-05-08T21:49:39.127230+0000","last_up_change":"2024-05-08T21:49:37.118386+0000","last_in_change":"2024-05-08T21:49:28.836944+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T21:49:35.998578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6b7439c1-daaa-44af-8333-a455f9e9dc67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":47228},{"type":"v1","addr":"172.21.15.73:6809","nonce":47228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":47228},{"type":"v1","addr":"172.21.15.73:6811","nonce":47228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":47228},{"type":"v1","addr":"172.21.15.73:6815","nonce":47228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":47228},{"type":"v1","addr":"172.21.15.73:6813","nonce":47228}]},"public_addr":"172.21.15.73:6809/47228","cluster_addr":"172.21.15.73:6811/47228","heartbeat_back_addr":"172.21.15.73:6815/47228","heartbeat_front_addr":"172.21.15.73:6813/47228","state":["exists","up"]},{"osd":1,"uuid":"fb67886a-d7f7-45ac-832f-36c871c8a208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":47227},{"type":"v1","addr":"172.21.15.73:6801","nonce":47227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":47227},{"type":"v1","addr":"172.21.15.73:6803","nonce":47227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":47227},{"type":"v1","addr":"172.21.15.73:6807","nonce":47227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":47227},{"type":"v1","addr":"172.21.15.73:6805","nonce":47227}]},"public_addr":"172.21.15.73:6801/47227","cluster_addr":"172.21.15.73:6803/47227","heartbeat_back_addr":"172.21.15.73:6807/47227","heartbeat_front_addr":"172.21.15.73:6805/47227","state":["exists","up"]},{"osd":2,"uuid":"a5cd6e98-6621-473a-bfb8-5c648abbb563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":47229},{"type":"v1","addr":"172.21.15.73:6817","nonce":47229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":47229},{"type":"v1","addr":"172.21.15.73:6819","nonce":47229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":47229},{"type":"v1","addr":"172.21.15.73:6823","nonce":47229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":47229},{"type":"v1","addr":"172.21.15.73:6821","nonce":47229}]},"public_addr":"172.21.15.73:6817/47229","cluster_addr":"172.21.15.73:6819/47229","heartbeat_back_addr":"172.21.15.73:6823/47229","heartbeat_front_addr":"172.21.15.73:6821/47229","state":["exists","up"]},{"osd":3,"uuid":"36927c20-4241-4f3b-91b5-a6a6f27598e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":47232},{"type":"v1","addr":"172.21.15.73:6825","nonce":47232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":47232},{"type":"v1","addr":"172.21.15.73:6827","nonce":47232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":47232},{"type":"v1","addr":"172.21.15.73:6831","nonce":47232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":47232},{"type":"v1","addr":"172.21.15.73:6829","nonce":47232}]},"public_addr":"172.21.15.73:6825/47232","cluster_addr":"172.21.15.73:6827/47232","heartbeat_back_addr":"172.21.15.73:6831/47232","heartbeat_front_addr":"172.21.15.73:6829/47232","state":["exists","up"]},{"osd":4,"uuid":"4ebe0a18-8216-4815-878a-39c39a6cd3fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":47200},{"type":"v1","addr":"172.21.15.115:6801","nonce":47200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":47200},{"type":"v1","addr":"172.21.15.115:6803","nonce":47200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":47200},{"type":"v1","addr":"172.21.15.115:6807","nonce":47200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":47200},{"type":"v1","addr":"172.21.15.115:6805","nonce":47200}]},"public_addr":"172.21.15.115:6801/47200","cluster_addr":"172.21.15.115:6803/47200","heartbeat_back_addr":"172.21.15.115:6807/47200","heartbeat_front_addr":"172.21.15.115:6805/47200","state":["exists","up"]},{"osd":5,"uuid":"957f0ac1-5f26-4f02-8c05-488e6b67ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":47201},{"type":"v1","addr":"172.21.15.115:6809","nonce":47201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":47201},{"type":"v1","addr":"172.21.15.115:6811","nonce":47201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":47201},{"type":"v1","addr":"172.21.15.115:6815","nonce":47201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":47201},{"type":"v1","addr":"172.21.15.115:6813","nonce":47201}]},"public_addr":"172.21.15.115:6809/47201","cluster_addr":"172.21.15.115:6811/47201","heartbeat_back_addr":"172.21.15.115:6815/47201","heartbeat_front_addr":"172.21.15.115:6813/47201","state":["exists","up"]},{"osd":6,"uuid":"f5a6768f-ba7f-4f66-b335-0c303b158e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":47202},{"type":"v1","addr":"172.21.15.115:6817","nonce":47202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":47202},{"type":"v1","addr":"172.21.15.115:6819","nonce":47202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":47202},{"type":"v1","addr":"172.21.15.115:6823","nonce":47202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":47202},{"type":"v1","addr":"172.21.15.115:6821","nonce":47202}]},"public_addr":"172.21.15.115:6817/47202","cluster_addr":"172.21.15.115:6819/47202","heartbeat_back_addr":"172.21.15.115:6823/47202","heartbeat_front_addr":"172.21.15.115:6821/47202","state":["exists","up"]},{"osd":7,"uuid":"f4187743-f9e6-42e6-aca9-0604a58db1ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":47211},{"type":"v1","addr":"172.21.15.115:6825","nonce":47211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":47211},{"type":"v1","addr":"172.21.15.115:6827","nonce":47211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":47211},{"type":"v1","addr":"172.21.15.115:6831","nonce":47211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":47211},{"type":"v1","addr":"172.21.15.115:6829","nonce":47211}]},"public_addr":"172.21.15.115:6825/47211","cluster_addr":"172.21.15.115:6827/47211","heartbeat_back_addr":"172.21.15.115:6831/47211","heartbeat_front_addr":"172.21.15.115:6829/47211","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:33.996335+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:33.687451+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:34.072549+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:33.997588+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:34.047260+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:34.876272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:33.965472+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:34.038637+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T21:49:41.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.121+0000 7f7e6f9b3700 1 -- 172.21.15.73:0/2629190274 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f7e4c06ac90 msgr2=0x7f7e4c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:41.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.121+0000 7f7e6f9b3700 1 --2- 172.21.15.73:0/2629190274 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f7e4c06ac90 0x7f7e4c06d150 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7e58007fd0 tx=0x7f7e58009040 comp rx=0 tx=0).stop 2024-05-08T21:49:41.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.121+0000 7f7e6f9b3700 1 -- 172.21.15.73:0/2629190274 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e68151bd0 msgr2=0x7f7e6814e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:41.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.121+0000 7f7e6f9b3700 1 --2- 172.21.15.73:0/2629190274 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e68151bd0 0x7f7e6814e240 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7e6000efc0 tx=0x7f7e60009f60 comp rx=0 tx=0).stop 2024-05-08T21:49:41.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.122+0000 7f7e6f9b3700 1 -- 172.21.15.73:0/2629190274 shutdown_connections 2024-05-08T21:49:41.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.122+0000 7f7e6f9b3700 1 --2- 172.21.15.73:0/2629190274 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f7e4c06ac90 0x7f7e4c06d150 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:41.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.122+0000 7f7e6f9b3700 1 --2- 172.21.15.73:0/2629190274 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e68151bd0 0x7f7e6814e240 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:41.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.122+0000 7f7e6f9b3700 1 --2- 172.21.15.73:0/2629190274 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e680b28b0 0x7f7e6814ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:41.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.122+0000 7f7e6f9b3700 1 --2- 172.21.15.73:0/2629190274 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7e680c4540 0x7f7e6814cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:41.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.122+0000 7f7e6f9b3700 1 -- 172.21.15.73:0/2629190274 >> 172.21.15.73:0/2629190274 conn(0x7f7e6806ae10 msgr2=0x7f7e680666c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:41.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.122+0000 7f7e6f9b3700 1 -- 172.21.15.73:0/2629190274 shutdown_connections 2024-05-08T21:49:41.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.122+0000 7f7e6f9b3700 1 -- 172.21.15.73:0/2629190274 wait complete. 2024-05-08T21:49:41.135 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T21:49:35.998578+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T21:49:41.135 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T21:49:41.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.258+0000 7f6c5e1eb700 1 Processor -- start 2024-05-08T21:49:41.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.258+0000 7f6c5e1eb700 1 -- start start 2024-05-08T21:49:41.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.259+0000 7f6c5e1eb700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6c58150b40 0x7f6c581571f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:41.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.259+0000 7f6c5e1eb700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6c58071db0 0x7f6c58161260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:41.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.259+0000 7f6c5e1eb700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c58156d60 con 0x7f6c580c65d0 2024-05-08T21:49:41.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.259+0000 7f6c5e1eb700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c580722f0 con 0x7f6c58150b40 2024-05-08T21:49:41.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.259+0000 7f6c5e1eb700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c580c39c0 con 0x7f6c58071db0 2024-05-08T21:49:41.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.259+0000 7f6c57fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6c58071db0 0x7f6c58161260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:41.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.259+0000 7f6c577fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6c58150b40 0x7f6c581571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:41.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.260+0000 7f6c57fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6c58071db0 0x7f6c58161260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.73:44330/0 (socket says 172.21.15.73:44330) 2024-05-08T21:49:41.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.260+0000 7f6c56ffd700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f6c580c65d0 0x7f6c580cc390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.73:40822/0 (socket says 172.21.15.73:40822) 2024-05-08T21:49:41.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.260+0000 7f6c57fff700 1 -- 172.21.15.73:0/56487740 learned_addr learned my addr 172.21.15.73:0/56487740 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:41.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.260+0000 7f6c57fff700 1 -- 172.21.15.73:0/56487740 >> v2:172.21.15.115:3300/0 conn(0x7f6c58150b40 msgr2=0x7f6c581571f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:41.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.260+0000 7f6c57fff700 1 --2- 172.21.15.73:0/56487740 >> v2:172.21.15.115:3300/0 conn(0x7f6c58150b40 0x7f6c581571f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:41.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.260+0000 7f6c57fff700 1 -- 172.21.15.73:0/56487740 >> v1:172.21.15.115:6789/0 conn(0x7f6c580c65d0 legacy=0x7f6c580cc390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:41.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.260+0000 7f6c57fff700 1 -- 172.21.15.73:0/56487740 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c580c3ca0 con 0x7f6c58071db0 2024-05-08T21:49:41.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.260+0000 7f6c567fc700 1 -- 172.21.15.73:0/56487740 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 77590633 0 0) 0x7f6c58156d60 con 0x7f6c580c65d0 2024-05-08T21:49:41.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.260+0000 7f6c577fe700 1 --2- 172.21.15.73:0/56487740 >> v2:172.21.15.115:3300/0 conn(0x7f6c58150b40 0x7f6c581571f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:49:41.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.260+0000 7f6c57fff700 1 --2- 172.21.15.73:0/56487740 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6c58071db0 0x7f6c58161260 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6c50009e50 tx=0x7f6c5000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c533176c25cd1d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:41.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.260+0000 7f6c567fc700 1 -- 172.21.15.73:0/56487740 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5000e070 con 0x7f6c58071db0 2024-05-08T21:49:41.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.260+0000 7f6c567fc700 1 -- 172.21.15.73:0/56487740 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c5000b910 con 0x7f6c58071db0 2024-05-08T21:49:41.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.260+0000 7f6c567fc700 1 -- 172.21.15.73:0/56487740 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5000bcc0 con 0x7f6c58071db0 2024-05-08T21:49:41.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.261+0000 7f6c5e1eb700 1 -- 172.21.15.73:0/56487740 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6c58071db0 msgr2=0x7f6c58161260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:41.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.261+0000 7f6c5e1eb700 1 --2- 172.21.15.73:0/56487740 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6c58071db0 0x7f6c58161260 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6c50009e50 tx=0x7f6c5000b330 comp rx=0 tx=0).stop 2024-05-08T21:49:41.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.261+0000 7f6c5e1eb700 1 -- 172.21.15.73:0/56487740 shutdown_connections 2024-05-08T21:49:41.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.261+0000 7f6c5e1eb700 1 --2- 172.21.15.73:0/56487740 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6c58071db0 0x7f6c58161260 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:41.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.261+0000 7f6c5e1eb700 1 --2- 172.21.15.73:0/56487740 >> v2:172.21.15.115:3300/0 conn(0x7f6c58150b40 0x7f6c581571f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:41.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.261+0000 7f6c5e1eb700 1 -- 172.21.15.73:0/56487740 >> 172.21.15.73:0/56487740 conn(0x7f6c58066ab0 msgr2=0x7f6c5806f550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:41.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.261+0000 7f6c5e1eb700 1 -- 172.21.15.73:0/56487740 shutdown_connections 2024-05-08T21:49:41.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.261+0000 7f6c5e1eb700 1 -- 172.21.15.73:0/56487740 wait complete. 2024-05-08T21:49:41.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.262+0000 7f6c5e1eb700 1 Processor -- start 2024-05-08T21:49:41.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.262+0000 7f6c5e1eb700 1 -- start start 2024-05-08T21:49:41.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.263+0000 7f6c5e1eb700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6c58071db0 0x7f6c58145180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:41.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.263+0000 7f6c5e1eb700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c580c65d0 0x7f6c581e09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:41.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.263+0000 7f6c5e1eb700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6c58150b40 0x7f6c581e1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:41.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.263+0000 7f6c5e1eb700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c581456c0 con 0x7f6c580c65d0 2024-05-08T21:49:41.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.263+0000 7f6c5e1eb700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c581ebb70 con 0x7f6c58071db0 2024-05-08T21:49:41.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.263+0000 7f6c5e1eb700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c580c7290 con 0x7f6c58150b40 2024-05-08T21:49:41.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.263+0000 7f6c56ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c580c65d0 0x7f6c581e09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:41.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.263+0000 7f6c56ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c580c65d0 0x7f6c581e09f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43618/0 (socket says 172.21.15.73:43618) 2024-05-08T21:49:41.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.263+0000 7f6c56ffd700 1 -- 172.21.15.73:0/2539015802 learned_addr learned my addr 172.21.15.73:0/2539015802 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:41.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.263+0000 7f6c577fe700 1 --2- 172.21.15.73:0/2539015802 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6c58071db0 0x7f6c58145180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:41.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.263+0000 7f6c57fff700 1 --2- 172.21.15.73:0/2539015802 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6c58150b40 0x7f6c581e1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:41.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.263+0000 7f6c56ffd700 1 -- 172.21.15.73:0/2539015802 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6c58150b40 msgr2=0x7f6c581e1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:41.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.263+0000 7f6c56ffd700 1 --2- 172.21.15.73:0/2539015802 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6c58150b40 0x7f6c581e1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:41.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.263+0000 7f6c56ffd700 1 -- 172.21.15.73:0/2539015802 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6c58071db0 msgr2=0x7f6c58145180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:41.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.263+0000 7f6c56ffd700 1 --2- 172.21.15.73:0/2539015802 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6c58071db0 0x7f6c58145180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:41.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.263+0000 7f6c56ffd700 1 -- 172.21.15.73:0/2539015802 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c4000b740 con 0x7f6c580c65d0 2024-05-08T21:49:41.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.263+0000 7f6c56ffd700 1 --2- 172.21.15.73:0/2539015802 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c580c65d0 0x7f6c581e09f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6c480011e0 tx=0x7f6c4800ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:41.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.263+0000 7f6c4ffff700 1 -- 172.21.15.73:0/2539015802 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c48004c80 con 0x7f6c580c65d0 2024-05-08T21:49:41.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.264+0000 7f6c4ffff700 1 -- 172.21.15.73:0/2539015802 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c48004e00 con 0x7f6c580c65d0 2024-05-08T21:49:41.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.264+0000 7f6c5e1eb700 1 -- 172.21.15.73:0/2539015802 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c50009b30 con 0x7f6c580c65d0 2024-05-08T21:49:41.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.264+0000 7f6c4ffff700 1 -- 172.21.15.73:0/2539015802 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c48007310 con 0x7f6c580c65d0 2024-05-08T21:49:41.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.264+0000 7f6c5e1eb700 1 -- 172.21.15.73:0/2539015802 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c581eb520 con 0x7f6c580c65d0 2024-05-08T21:49:41.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.264+0000 7f6c5e1eb700 1 -- 172.21.15.73:0/2539015802 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c58068b80 con 0x7f6c580c65d0 2024-05-08T21:49:41.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.265+0000 7f6c4ffff700 1 -- 172.21.15.73:0/2539015802 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6c48007470 con 0x7f6c580c65d0 2024-05-08T21:49:41.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.265+0000 7f6c4ffff700 1 --2- 172.21.15.73:0/2539015802 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f6c3806acc0 0x7f6c3806d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:41.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.265+0000 7f6c4ffff700 1 -- 172.21.15.73:0/2539015802 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6c48088bd0 con 0x7f6c580c65d0 2024-05-08T21:49:41.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.265+0000 7f6c577fe700 1 --2- 172.21.15.73:0/2539015802 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f6c3806acc0 0x7f6c3806d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:41.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.266+0000 7f6c577fe700 1 --2- 172.21.15.73:0/2539015802 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f6c3806acc0 0x7f6c3806d180 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6c4000bf70 tx=0x7f6c4000b420 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:41.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.270+0000 7f6c4ffff700 1 -- 172.21.15.73:0/2539015802 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f6c48054070 con 0x7f6c580c65d0 2024-05-08T21:49:41.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.464+0000 7f6c5e1eb700 1 -- 172.21.15.73:0/2539015802 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6c580c6fd0 con 0x7f6c580c65d0 2024-05-08T21:49:41.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.464+0000 7f6c4ffff700 1 -- 172.21.15.73:0/2539015802 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6c48057690 con 0x7f6c580c65d0 2024-05-08T21:49:41.466 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-05-08T21:49:41.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.466+0000 7f6c5e1eb700 1 -- 172.21.15.73:0/2539015802 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f6c3806acc0 msgr2=0x7f6c3806d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:41.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.466+0000 7f6c5e1eb700 1 --2- 172.21.15.73:0/2539015802 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f6c3806acc0 0x7f6c3806d180 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6c4000bf70 tx=0x7f6c4000b420 comp rx=0 tx=0).stop 2024-05-08T21:49:41.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.466+0000 7f6c5e1eb700 1 -- 172.21.15.73:0/2539015802 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c580c65d0 msgr2=0x7f6c581e09f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:41.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.466+0000 7f6c5e1eb700 1 --2- 172.21.15.73:0/2539015802 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c580c65d0 0x7f6c581e09f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6c480011e0 tx=0x7f6c4800ca30 comp rx=0 tx=0).stop 2024-05-08T21:49:41.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.466+0000 7f6c5e1eb700 1 -- 172.21.15.73:0/2539015802 shutdown_connections 2024-05-08T21:49:41.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.466+0000 7f6c5e1eb700 1 --2- 172.21.15.73:0/2539015802 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f6c3806acc0 0x7f6c3806d180 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:41.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.466+0000 7f6c5e1eb700 1 --2- 172.21.15.73:0/2539015802 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6c58150b40 0x7f6c581e1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:41.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.466+0000 7f6c5e1eb700 1 --2- 172.21.15.73:0/2539015802 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6c58071db0 0x7f6c58145180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:41.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.466+0000 7f6c5e1eb700 1 --2- 172.21.15.73:0/2539015802 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c580c65d0 0x7f6c581e09f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:41.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.466+0000 7f6c5e1eb700 1 -- 172.21.15.73:0/2539015802 >> 172.21.15.73:0/2539015802 conn(0x7f6c58066ab0 msgr2=0x7f6c58147d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:41.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.467+0000 7f6c5e1eb700 1 -- 172.21.15.73:0/2539015802 shutdown_connections 2024-05-08T21:49:41.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.467+0000 7f6c5e1eb700 1 -- 172.21.15.73:0/2539015802 wait complete. 2024-05-08T21:49:41.480 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-08T21:49:41.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.600+0000 7fcd66f8b700 1 Processor -- start 2024-05-08T21:49:41.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.600+0000 7fcd66f8b700 1 -- start start 2024-05-08T21:49:41.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.600+0000 7fcd66f8b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcd6006b5a0 0x7fcd60072960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:41.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.600+0000 7fcd66f8b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcd60153960 0x7fcd60153df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:41.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.600+0000 7fcd66f8b700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd600c6580 con 0x7fcd6006b1c0 2024-05-08T21:49:41.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.600+0000 7fcd66f8b700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd60154330 con 0x7fcd60153960 2024-05-08T21:49:41.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.600+0000 7fcd66f8b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd60072580 con 0x7fcd6006b5a0 2024-05-08T21:49:41.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.601+0000 7fcd65528700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcd60153960 0x7fcd60153df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:41.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.601+0000 7fcd5ffff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcd6006b5a0 0x7fcd60072960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:41.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.601+0000 7fcd64d27700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fcd6006b1c0 0x7fcd60071af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.73:40826/0 (socket says 172.21.15.73:40826) 2024-05-08T21:49:41.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.601+0000 7fcd64d27700 1 -- 172.21.15.73:0/3383836473 learned_addr learned my addr 172.21.15.73:0/3383836473 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:49:41.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.601+0000 7fcd5f7fe700 1 -- 172.21.15.73:0/3383836473 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2000594605 0 0) 0x7fcd600c6580 con 0x7fcd6006b1c0 2024-05-08T21:49:41.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.601+0000 7fcd5ffff700 1 -- 172.21.15.73:0/3383836473 >> v2:172.21.15.115:3300/0 conn(0x7fcd60153960 msgr2=0x7fcd60153df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:41.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.601+0000 7fcd5ffff700 1 --2- 172.21.15.73:0/3383836473 >> v2:172.21.15.115:3300/0 conn(0x7fcd60153960 0x7fcd60153df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:41.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.601+0000 7fcd5ffff700 1 -- 172.21.15.73:0/3383836473 >> v1:172.21.15.115:6789/0 conn(0x7fcd6006b1c0 legacy=0x7fcd60071af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:41.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.601+0000 7fcd5ffff700 1 -- 172.21.15.73:0/3383836473 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd60159f70 con 0x7fcd6006b5a0 2024-05-08T21:49:41.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.601+0000 7fcd5ffff700 1 --2- 172.21.15.73:0/3383836473 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcd6006b5a0 0x7fcd60072960 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c009840 tx=0x7fcd4c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4fdbaf3080519ac server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:41.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.601+0000 7fcd5f7fe700 1 -- 172.21.15.73:0/3383836473 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c011830 con 0x7fcd6006b5a0 2024-05-08T21:49:41.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.602+0000 7fcd5f7fe700 1 -- 172.21.15.73:0/3383836473 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd4c011990 con 0x7fcd6006b5a0 2024-05-08T21:49:41.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.602+0000 7fcd5f7fe700 1 -- 172.21.15.73:0/3383836473 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c011d20 con 0x7fcd6006b5a0 2024-05-08T21:49:41.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.602+0000 7fcd66f8b700 1 -- 172.21.15.73:0/3383836473 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcd6006b5a0 msgr2=0x7fcd60072960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:41.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.602+0000 7fcd66f8b700 1 --2- 172.21.15.73:0/3383836473 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcd6006b5a0 0x7fcd60072960 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c009840 tx=0x7fcd4c009b50 comp rx=0 tx=0).stop 2024-05-08T21:49:41.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.602+0000 7fcd66f8b700 1 -- 172.21.15.73:0/3383836473 shutdown_connections 2024-05-08T21:49:41.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.602+0000 7fcd66f8b700 1 --2- 172.21.15.73:0/3383836473 >> v2:172.21.15.115:3300/0 conn(0x7fcd60153960 0x7fcd60153df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:41.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.602+0000 7fcd66f8b700 1 --2- 172.21.15.73:0/3383836473 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcd6006b5a0 0x7fcd60072960 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:41.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.602+0000 7fcd66f8b700 1 -- 172.21.15.73:0/3383836473 >> 172.21.15.73:0/3383836473 conn(0x7fcd60066d70 msgr2=0x7fcd600cc500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:41.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.602+0000 7fcd66f8b700 1 -- 172.21.15.73:0/3383836473 shutdown_connections 2024-05-08T21:49:41.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.602+0000 7fcd66f8b700 1 -- 172.21.15.73:0/3383836473 wait complete. 2024-05-08T21:49:41.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.603+0000 7fcd66f8b700 1 Processor -- start 2024-05-08T21:49:41.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.603+0000 7fcd66f8b700 1 -- start start 2024-05-08T21:49:41.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.604+0000 7fcd66f8b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd6006b1c0 0x7fcd6015af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:41.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.604+0000 7fcd66f8b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcd60153960 0x7fcd6014e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:41.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.604+0000 7fcd66f8b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd60157e20 0x7fcd6014ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:41.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.604+0000 7fcd66f8b700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd6014e360 con 0x7fcd60157e20 2024-05-08T21:49:41.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.604+0000 7fcd66f8b700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd6014d390 con 0x7fcd6006b1c0 2024-05-08T21:49:41.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.604+0000 7fcd66f8b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd60154b40 con 0x7fcd60153960 2024-05-08T21:49:41.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.604+0000 7fcd65528700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd60157e20 0x7fcd6014ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:41.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.604+0000 7fcd65528700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd60157e20 0x7fcd6014ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43634/0 (socket says 172.21.15.73:43634) 2024-05-08T21:49:41.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.604+0000 7fcd65528700 1 -- 172.21.15.73:0/316179606 learned_addr learned my addr 172.21.15.73:0/316179606 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:41.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.604+0000 7fcd64d27700 1 --2- 172.21.15.73:0/316179606 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd6006b1c0 0x7fcd6015af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:41.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.604+0000 7fcd5ffff700 1 --2- 172.21.15.73:0/316179606 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcd60153960 0x7fcd6014e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:41.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.604+0000 7fcd65528700 1 -- 172.21.15.73:0/316179606 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcd60153960 msgr2=0x7fcd6014e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:41.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.604+0000 7fcd65528700 1 --2- 172.21.15.73:0/316179606 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcd60153960 0x7fcd6014e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:41.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.604+0000 7fcd65528700 1 -- 172.21.15.73:0/316179606 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd6006b1c0 msgr2=0x7fcd6015af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:41.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.604+0000 7fcd65528700 1 --2- 172.21.15.73:0/316179606 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd6006b1c0 0x7fcd6015af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:41.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.604+0000 7fcd65528700 1 -- 172.21.15.73:0/316179606 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd4c0094a0 con 0x7fcd60157e20 2024-05-08T21:49:41.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.604+0000 7fcd5ffff700 1 --2- 172.21.15.73:0/316179606 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcd60153960 0x7fcd6014e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:49:41.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.605+0000 7fcd65528700 1 --2- 172.21.15.73:0/316179606 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd60157e20 0x7fcd6014ec80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcd5800efc0 tx=0x7fcd5800c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:41.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.605+0000 7fcd5d7fa700 1 -- 172.21.15.73:0/316179606 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5800cb80 con 0x7fcd60157e20 2024-05-08T21:49:41.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.605+0000 7fcd5d7fa700 1 -- 172.21.15.73:0/316179606 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd5800f040 con 0x7fcd60157e20 2024-05-08T21:49:41.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.605+0000 7fcd66f8b700 1 -- 172.21.15.73:0/316179606 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd601585f0 con 0x7fcd60157e20 2024-05-08T21:49:41.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.605+0000 7fcd5d7fa700 1 -- 172.21.15.73:0/316179606 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd58014480 con 0x7fcd60157e20 2024-05-08T21:49:41.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.605+0000 7fcd66f8b700 1 -- 172.21.15.73:0/316179606 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd6014d880 con 0x7fcd60157e20 2024-05-08T21:49:41.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.606+0000 7fcd66f8b700 1 -- 172.21.15.73:0/316179606 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd60068b80 con 0x7fcd60157e20 2024-05-08T21:49:41.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.606+0000 7fcd5d7fa700 1 -- 172.21.15.73:0/316179606 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fcd580145e0 con 0x7fcd60157e20 2024-05-08T21:49:41.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.606+0000 7fcd5d7fa700 1 --2- 172.21.15.73:0/316179606 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fcd4406acc0 0x7fcd4406d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:41.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.607+0000 7fcd5d7fa700 1 -- 172.21.15.73:0/316179606 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fcd580898b0 con 0x7fcd60157e20 2024-05-08T21:49:41.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.607+0000 7fcd64d27700 1 --2- 172.21.15.73:0/316179606 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fcd4406acc0 0x7fcd4406d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:41.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.607+0000 7fcd64d27700 1 --2- 172.21.15.73:0/316179606 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fcd4406acc0 0x7fcd4406d180 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcd54007fd0 tx=0x7fcd54007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:41.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.611+0000 7fcd5d7fa700 1 -- 172.21.15.73:0/316179606 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fcd58054d50 con 0x7fcd60157e20 2024-05-08T21:49:41.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.805+0000 7fcd66f8b700 1 -- 172.21.15.73:0/316179606 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fcd60068130 con 0x7fcd60157e20 2024-05-08T21:49:41.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.806+0000 7fcd5d7fa700 1 -- 172.21.15.73:0/316179606 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7fcd58018020 con 0x7fcd60157e20 2024-05-08T21:49:41.807 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:49:41.807 INFO:teuthology.orchestra.run.smithi073.stdout:[ 2024-05-08T21:49:41.807 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-05-08T21:49:41.807 INFO:teuthology.orchestra.run.smithi073.stdout: "poolnum": 1, 2024-05-08T21:49:41.807 INFO:teuthology.orchestra.run.smithi073.stdout: "poolname": ".mgr" 2024-05-08T21:49:41.808 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-05-08T21:49:41.808 INFO:teuthology.orchestra.run.smithi073.stdout:] 2024-05-08T21:49:41.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.808+0000 7fcd66f8b700 1 -- 172.21.15.73:0/316179606 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fcd4406acc0 msgr2=0x7fcd4406d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:41.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.808+0000 7fcd66f8b700 1 --2- 172.21.15.73:0/316179606 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fcd4406acc0 0x7fcd4406d180 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcd54007fd0 tx=0x7fcd54007de0 comp rx=0 tx=0).stop 2024-05-08T21:49:41.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.808+0000 7fcd66f8b700 1 -- 172.21.15.73:0/316179606 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd60157e20 msgr2=0x7fcd6014ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:41.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.808+0000 7fcd66f8b700 1 --2- 172.21.15.73:0/316179606 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd60157e20 0x7fcd6014ec80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcd5800efc0 tx=0x7fcd5800c0c0 comp rx=0 tx=0).stop 2024-05-08T21:49:41.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.808+0000 7fcd66f8b700 1 -- 172.21.15.73:0/316179606 shutdown_connections 2024-05-08T21:49:41.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.808+0000 7fcd66f8b700 1 --2- 172.21.15.73:0/316179606 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fcd4406acc0 0x7fcd4406d180 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:41.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.808+0000 7fcd66f8b700 1 --2- 172.21.15.73:0/316179606 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd60157e20 0x7fcd6014ec80 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:41.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.808+0000 7fcd66f8b700 1 --2- 172.21.15.73:0/316179606 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd6006b1c0 0x7fcd6015af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:41.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.808+0000 7fcd66f8b700 1 --2- 172.21.15.73:0/316179606 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcd60153960 0x7fcd6014e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:41.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.808+0000 7fcd66f8b700 1 -- 172.21.15.73:0/316179606 >> 172.21.15.73:0/316179606 conn(0x7fcd60066d70 msgr2=0x7fcd600c7210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:41.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.808+0000 7fcd66f8b700 1 -- 172.21.15.73:0/316179606 shutdown_connections 2024-05-08T21:49:41.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.808+0000 7fcd66f8b700 1 -- 172.21.15.73:0/316179606 wait complete. 2024-05-08T21:49:41.821 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-08T21:49:41.821 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-08T21:49:41.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.944+0000 7f5feb5df700 1 Processor -- start 2024-05-08T21:49:41.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.944+0000 7f5feb5df700 1 -- start start 2024-05-08T21:49:41.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.945+0000 7f5feb5df700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5fe4153e50 0x7f5fe406fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:41.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.945+0000 7f5feb5df700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5fe40c9040 0x7f5fe40c9440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:41.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.945+0000 7f5feb5df700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fe415ac50 con 0x7f5fe4154230 2024-05-08T21:49:41.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.945+0000 7f5feb5df700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fe40c9980 con 0x7f5fe4153e50 2024-05-08T21:49:41.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.945+0000 7f5feb5df700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe415a040 con 0x7f5fe40c9040 2024-05-08T21:49:41.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.945+0000 7f5fe8b7a700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f5fe4154230 0x7f5fe4072820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:60304/0 (socket says 172.21.15.73:60304) 2024-05-08T21:49:41.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.945+0000 7f5fe8b7a700 1 -- 172.21.15.73:0/4010239624 learned_addr learned my addr 172.21.15.73:0/4010239624 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:49:41.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.945+0000 7f5fe937b700 1 --2- 172.21.15.73:0/4010239624 >> v2:172.21.15.115:3300/0 conn(0x7f5fe4153e50 0x7f5fe406fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:41.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.945+0000 7f5fe9b7c700 1 --2- 172.21.15.73:0/4010239624 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5fe40c9040 0x7f5fe40c9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:41.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.945+0000 7f5fdbfff700 1 -- 172.21.15.73:0/4010239624 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3049569219 0 0) 0x7f5fe415ac50 con 0x7f5fe4154230 2024-05-08T21:49:41.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.945+0000 7f5fdbfff700 1 -- 172.21.15.73:0/4010239624 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fd00035b0 con 0x7f5fe4154230 2024-05-08T21:49:41.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.946+0000 7f5fdbfff700 1 -- 172.21.15.73:0/4010239624 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 192519336 0 0) 0x7f5fd00035b0 con 0x7f5fe4154230 2024-05-08T21:49:41.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.946+0000 7f5fdbfff700 1 -- 172.21.15.73:0/4010239624 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5fe40c9040 msgr2=0x7f5fe40c9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:41.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.946+0000 7f5fdbfff700 1 --2- 172.21.15.73:0/4010239624 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5fe40c9040 0x7f5fe40c9440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:41.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.946+0000 7f5fdbfff700 1 -- 172.21.15.73:0/4010239624 >> v2:172.21.15.115:3300/0 conn(0x7f5fe4153e50 msgr2=0x7f5fe406fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:41.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.946+0000 7f5fdbfff700 1 --2- 172.21.15.73:0/4010239624 >> v2:172.21.15.115:3300/0 conn(0x7f5fe4153e50 0x7f5fe406fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:41.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.946+0000 7f5fdbfff700 1 -- 172.21.15.73:0/4010239624 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe415a320 con 0x7f5fe4154230 2024-05-08T21:49:41.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.946+0000 7f5fdbfff700 1 -- 172.21.15.73:0/4010239624 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 953298616 0 0) 0x7f5fe0001670 con 0x7f5fe4154230 2024-05-08T21:49:41.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.946+0000 7f5fe9b7c700 1 --2- 172.21.15.73:0/4010239624 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5fe40c9040 0x7f5fe40c9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:49:41.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.946+0000 7f5fdbfff700 1 -- 172.21.15.73:0/4010239624 >> v1:172.21.15.73:6789/0 conn(0x7f5fe4154230 legacy=0x7f5fe4072820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:41.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.946+0000 7f5fdbfff700 1 --2- 172.21.15.73:0/4010239624 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5fe40c9040 0x7f5fd0003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:41.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.946+0000 7f5fdbfff700 1 --2- 172.21.15.73:0/4010239624 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fd0003f40 0x7f5fd0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:41.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.946+0000 7f5fdbfff700 1 --2- 172.21.15.73:0/4010239624 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5fd0004d90 0x7f5fd0005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:41.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.946+0000 7f5fdbfff700 1 -- 172.21.15.73:0/4010239624 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe40c9980 con 0x7f5fd0004d90 2024-05-08T21:49:41.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.946+0000 7f5fdbfff700 1 -- 172.21.15.73:0/4010239624 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe415a040 con 0x7f5fd0003f40 2024-05-08T21:49:41.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.946+0000 7f5fdbfff700 1 -- 172.21.15.73:0/4010239624 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd000ba10 con 0x7f5fe40c9040 2024-05-08T21:49:41.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.946+0000 7f5fe9b7c700 1 --2- 172.21.15.73:0/4010239624 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5fd0004d90 0x7f5fd0005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:41.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.946+0000 7f5fe937b700 1 --2- 172.21.15.73:0/4010239624 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5fe40c9040 0x7f5fd0003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:41.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.946+0000 7f5fe8b7a700 1 --2- 172.21.15.73:0/4010239624 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fd0003f40 0x7f5fd0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:41.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.946+0000 7f5fe9b7c700 1 -- 172.21.15.73:0/4010239624 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5fe40c9040 msgr2=0x7f5fd0003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:41.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.946+0000 7f5fe9b7c700 1 --2- 172.21.15.73:0/4010239624 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5fe40c9040 0x7f5fd0003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:41.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.946+0000 7f5fe9b7c700 1 -- 172.21.15.73:0/4010239624 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fd0003f40 msgr2=0x7f5fd0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:41.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.946+0000 7f5fe9b7c700 1 --2- 172.21.15.73:0/4010239624 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fd0003f40 0x7f5fd0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:41.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.946+0000 7f5fe9b7c700 1 -- 172.21.15.73:0/4010239624 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fdc009a70 con 0x7f5fd0004d90 2024-05-08T21:49:41.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.946+0000 7f5fe9b7c700 1 --2- 172.21.15.73:0/4010239624 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5fd0004d90 0x7f5fd0005210 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc00e380 tx=0x7f5fd0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dd2c799fb11e0c2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:41.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.946+0000 7f5fdbfff700 1 -- 172.21.15.73:0/4010239624 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fdc00ee20 con 0x7f5fd0004d90 2024-05-08T21:49:41.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.946+0000 7f5fdbfff700 1 -- 172.21.15.73:0/4010239624 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fdc00f040 con 0x7f5fd0004d90 2024-05-08T21:49:41.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.946+0000 7f5fdbfff700 1 -- 172.21.15.73:0/4010239624 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fdc0146a0 con 0x7f5fd0004d90 2024-05-08T21:49:41.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.947+0000 7f5feb5df700 1 -- 172.21.15.73:0/4010239624 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5fd0004d90 msgr2=0x7f5fd0005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:41.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.947+0000 7f5feb5df700 1 --2- 172.21.15.73:0/4010239624 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5fd0004d90 0x7f5fd0005210 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc00e380 tx=0x7f5fd0005880 comp rx=0 tx=0).stop 2024-05-08T21:49:41.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.947+0000 7f5fe9b7c700 1 -- 172.21.15.73:0/4010239624 reap_dead start 2024-05-08T21:49:41.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.947+0000 7f5feb5df700 1 -- 172.21.15.73:0/4010239624 shutdown_connections 2024-05-08T21:49:41.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.947+0000 7f5feb5df700 1 -- 172.21.15.73:0/4010239624 >> 172.21.15.73:0/4010239624 conn(0x7f5fe406bad0 msgr2=0x7f5fe406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:41.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.947+0000 7f5feb5df700 1 -- 172.21.15.73:0/4010239624 shutdown_connections 2024-05-08T21:49:41.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.947+0000 7f5feb5df700 1 -- 172.21.15.73:0/4010239624 wait complete. 2024-05-08T21:49:41.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.948+0000 7f5feb5df700 1 Processor -- start 2024-05-08T21:49:41.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.948+0000 7f5feb5df700 1 -- start start 2024-05-08T21:49:41.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.949+0000 7f5feb5df700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5fd0004d90 0x7f5fe40cb880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:41.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.949+0000 7f5feb5df700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fe4157200 0x7f5fe41ef140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:41.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.949+0000 7f5feb5df700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5fe41ef680 0x7f5fe4151a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:41.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.949+0000 7f5feb5df700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe41efae0 con 0x7f5fd0004d90 2024-05-08T21:49:41.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.949+0000 7f5feb5df700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe41f2730 con 0x7f5fe4157200 2024-05-08T21:49:41.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.949+0000 7f5feb5df700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe4154a10 con 0x7f5fe41ef680 2024-05-08T21:49:41.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.949+0000 7f5fe937b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5fd0004d90 0x7f5fe40cb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:41.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.949+0000 7f5fe937b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5fd0004d90 0x7f5fe40cb880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43656/0 (socket says 172.21.15.73:43656) 2024-05-08T21:49:41.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.949+0000 7f5fe937b700 1 -- 172.21.15.73:0/1322325268 learned_addr learned my addr 172.21.15.73:0/1322325268 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:41.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.949+0000 7f5fe9b7c700 1 --2- 172.21.15.73:0/1322325268 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5fe41ef680 0x7f5fe4151a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:41.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.949+0000 7f5fe8b7a700 1 --2- 172.21.15.73:0/1322325268 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fe4157200 0x7f5fe41ef140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:41.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.949+0000 7f5fe937b700 1 -- 172.21.15.73:0/1322325268 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5fe41ef680 msgr2=0x7f5fe4151a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:41.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.949+0000 7f5fe937b700 1 --2- 172.21.15.73:0/1322325268 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5fe41ef680 0x7f5fe4151a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:41.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.949+0000 7f5fe937b700 1 -- 172.21.15.73:0/1322325268 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fe4157200 msgr2=0x7f5fe41ef140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:41.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.949+0000 7f5fe937b700 1 --2- 172.21.15.73:0/1322325268 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fe4157200 0x7f5fe41ef140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:41.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.949+0000 7f5fe937b700 1 -- 172.21.15.73:0/1322325268 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe41f29f0 con 0x7f5fd0004d90 2024-05-08T21:49:41.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.949+0000 7f5fe9b7c700 1 --2- 172.21.15.73:0/1322325268 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5fe41ef680 0x7f5fe4151a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:49:41.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.949+0000 7f5fe937b700 1 --2- 172.21.15.73:0/1322325268 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5fd0004d90 0x7f5fe40cb880 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5fd4011aa0 tx=0x7f5fd4011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:41.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.949+0000 7f5fd9ffb700 1 -- 172.21.15.73:0/1322325268 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd400f9e0 con 0x7f5fd0004d90 2024-05-08T21:49:41.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.950+0000 7f5fd9ffb700 1 -- 172.21.15.73:0/1322325268 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd400fb40 con 0x7f5fd0004d90 2024-05-08T21:49:41.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.950+0000 7f5feb5df700 1 -- 172.21.15.73:0/1322325268 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fe41f2cd0 con 0x7f5fd0004d90 2024-05-08T21:49:41.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.950+0000 7f5fd9ffb700 1 -- 172.21.15.73:0/1322325268 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd4014440 con 0x7f5fd0004d90 2024-05-08T21:49:41.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.950+0000 7f5feb5df700 1 -- 172.21.15.73:0/1322325268 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fe41f3290 con 0x7f5fd0004d90 2024-05-08T21:49:41.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.951+0000 7f5feb5df700 1 -- 172.21.15.73:0/1322325268 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fe41f34b0 con 0x7f5fd0004d90 2024-05-08T21:49:41.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.951+0000 7f5fd9ffb700 1 -- 172.21.15.73:0/1322325268 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5fd40145a0 con 0x7f5fd0004d90 2024-05-08T21:49:41.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.951+0000 7f5fd9ffb700 1 --2- 172.21.15.73:0/1322325268 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f5fc806ac90 0x7f5fc806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:41.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.951+0000 7f5fd9ffb700 1 -- 172.21.15.73:0/1322325268 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5fd4089970 con 0x7f5fd0004d90 2024-05-08T21:49:41.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.951+0000 7f5fe8b7a700 1 --2- 172.21.15.73:0/1322325268 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f5fc806ac90 0x7f5fc806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:41.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.952+0000 7f5fe8b7a700 1 --2- 172.21.15.73:0/1322325268 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f5fc806ac90 0x7f5fc806d150 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5fe414fcd0 tx=0x7f5fe0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:41.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:41.957+0000 7f5fd9ffb700 1 -- 172.21.15.73:0/1322325268 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f5fd4054d70 con 0x7f5fd0004d90 2024-05-08T21:49:42.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.153+0000 7f5feb5df700 1 -- 172.21.15.73:0/1322325268 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f5fe4068b80 con 0x7f5fd0004d90 2024-05-08T21:49:42.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.206+0000 7f5fd9ffb700 1 -- 172.21.15.73:0/1322325268 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7f5fd4058390 con 0x7f5fd0004d90 2024-05-08T21:49:42.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.209+0000 7f5feb5df700 1 -- 172.21.15.73:0/1322325268 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f5fc806ac90 msgr2=0x7f5fc806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:42.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.209+0000 7f5feb5df700 1 --2- 172.21.15.73:0/1322325268 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f5fc806ac90 0x7f5fc806d150 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5fe414fcd0 tx=0x7f5fe0009040 comp rx=0 tx=0).stop 2024-05-08T21:49:42.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.209+0000 7f5feb5df700 1 -- 172.21.15.73:0/1322325268 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5fd0004d90 msgr2=0x7f5fe40cb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:42.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.209+0000 7f5feb5df700 1 --2- 172.21.15.73:0/1322325268 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5fd0004d90 0x7f5fe40cb880 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5fd4011aa0 tx=0x7f5fd4011e60 comp rx=0 tx=0).stop 2024-05-08T21:49:42.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.209+0000 7f5feb5df700 1 -- 172.21.15.73:0/1322325268 shutdown_connections 2024-05-08T21:49:42.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.209+0000 7f5feb5df700 1 --2- 172.21.15.73:0/1322325268 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f5fc806ac90 0x7f5fc806d150 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:42.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.209+0000 7f5feb5df700 1 --2- 172.21.15.73:0/1322325268 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5fe41ef680 0x7f5fe4151a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:42.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.209+0000 7f5feb5df700 1 --2- 172.21.15.73:0/1322325268 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5fd0004d90 0x7f5fe40cb880 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:42.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.209+0000 7f5feb5df700 1 --2- 172.21.15.73:0/1322325268 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fe4157200 0x7f5fe41ef140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:42.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.209+0000 7f5feb5df700 1 -- 172.21.15.73:0/1322325268 >> 172.21.15.73:0/1322325268 conn(0x7f5fe406bad0 msgr2=0x7f5fe40718f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:42.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.209+0000 7f5feb5df700 1 -- 172.21.15.73:0/1322325268 shutdown_connections 2024-05-08T21:49:42.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.209+0000 7f5feb5df700 1 -- 172.21.15.73:0/1322325268 wait complete. 2024-05-08T21:49:42.211 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_metadata' created 2024-05-08T21:49:42.223 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-08T21:49:42.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.351+0000 7f1e4a255700 1 Processor -- start 2024-05-08T21:49:42.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.351+0000 7f1e4a255700 1 -- start start 2024-05-08T21:49:42.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.351+0000 7f1e4a255700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1e440c7770 0x7f1e440c7000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:42.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.351+0000 7f1e4a255700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e440c6b70 con 0x7f1e441502f0 2024-05-08T21:49:42.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.351+0000 7f1e4a255700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e440c7d20 con 0x7f1e440c3df0 2024-05-08T21:49:42.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.351+0000 7f1e4a255700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e440c5f60 con 0x7f1e440c7770 2024-05-08T21:49:42.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.351+0000 7f1e437fe700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f1e441502f0 0x7f1e4406ebf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:60316/0 (socket says 172.21.15.73:60316) 2024-05-08T21:49:42.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.351+0000 7f1e437fe700 1 -- 172.21.15.73:0/3657241802 learned_addr learned my addr 172.21.15.73:0/3657241802 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:49:42.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.351+0000 7f1e42ffd700 1 --2- 172.21.15.73:0/3657241802 >> v2:172.21.15.115:3300/0 conn(0x7f1e440c7770 0x7f1e440c7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:42.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.351+0000 7f1e427fc700 1 -- 172.21.15.73:0/3657241802 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1888219572 0 0) 0x7f1e440c6b70 con 0x7f1e441502f0 2024-05-08T21:49:42.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.351+0000 7f1e427fc700 1 -- 172.21.15.73:0/3657241802 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e300035b0 con 0x7f1e441502f0 2024-05-08T21:49:42.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.351+0000 7f1e427fc700 1 -- 172.21.15.73:0/3657241802 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1443537392 0 0) 0x7f1e300035b0 con 0x7f1e441502f0 2024-05-08T21:49:42.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.351+0000 7f1e427fc700 1 -- 172.21.15.73:0/3657241802 >> v2:172.21.15.115:3300/0 conn(0x7f1e440c7770 msgr2=0x7f1e440c7000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:42.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.351+0000 7f1e427fc700 1 --2- 172.21.15.73:0/3657241802 >> v2:172.21.15.115:3300/0 conn(0x7f1e440c7770 0x7f1e440c7000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:42.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.351+0000 7f1e427fc700 1 -- 172.21.15.73:0/3657241802 >> v1:172.21.15.115:6789/0 conn(0x7f1e440c3df0 legacy=0x7f1e44160970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:42.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.351+0000 7f1e427fc700 1 -- 172.21.15.73:0/3657241802 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e440c6240 con 0x7f1e441502f0 2024-05-08T21:49:42.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.351+0000 7f1e427fc700 1 -- 172.21.15.73:0/3657241802 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 953298616 0 0) 0x7f1e2c001670 con 0x7f1e441502f0 2024-05-08T21:49:42.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.351+0000 7f1e427fc700 1 -- 172.21.15.73:0/3657241802 >> v1:172.21.15.73:6789/0 conn(0x7f1e441502f0 legacy=0x7f1e4406ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:42.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.351+0000 7f1e427fc700 1 --2- 172.21.15.73:0/3657241802 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e30003a00 0x7f1e30003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:42.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.351+0000 7f1e427fc700 1 --2- 172.21.15.73:0/3657241802 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e30004850 0x7f1e30004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:42.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.351+0000 7f1e427fc700 1 --2- 172.21.15.73:0/3657241802 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e30005210 0x7f1e3000cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:42.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.351+0000 7f1e427fc700 1 -- 172.21.15.73:0/3657241802 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e440c5f60 con 0x7f1e30004850 2024-05-08T21:49:42.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.351+0000 7f1e427fc700 1 -- 172.21.15.73:0/3657241802 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3000d1c0 con 0x7f1e30003a00 2024-05-08T21:49:42.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.351+0000 7f1e427fc700 1 -- 172.21.15.73:0/3657241802 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3000d380 con 0x7f1e30005210 2024-05-08T21:49:42.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.352+0000 7f1e42ffd700 1 --2- 172.21.15.73:0/3657241802 >> v2:172.21.15.115:3300/0 conn(0x7f1e440c7770 0x7f1e440c7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:49:42.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.352+0000 7f1e437fe700 1 --2- 172.21.15.73:0/3657241802 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e30003a00 0x7f1e30003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:42.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.352+0000 7f1e42ffd700 1 --2- 172.21.15.73:0/3657241802 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e30004850 0x7f1e30004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:42.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.352+0000 7f1e43fff700 1 --2- 172.21.15.73:0/3657241802 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e30005210 0x7f1e3000cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:42.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.352+0000 7f1e42ffd700 1 -- 172.21.15.73:0/3657241802 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e30005210 msgr2=0x7f1e3000cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:42.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.352+0000 7f1e42ffd700 1 --2- 172.21.15.73:0/3657241802 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e30005210 0x7f1e3000cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:42.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.352+0000 7f1e42ffd700 1 -- 172.21.15.73:0/3657241802 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e30003a00 msgr2=0x7f1e30003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:42.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.352+0000 7f1e42ffd700 1 --2- 172.21.15.73:0/3657241802 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e30003a00 0x7f1e30003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:42.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.352+0000 7f1e43fff700 1 -- 172.21.15.73:0/3657241802 reap_dead start 2024-05-08T21:49:42.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.352+0000 7f1e42ffd700 1 -- 172.21.15.73:0/3657241802 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e300035b0 con 0x7f1e30004850 2024-05-08T21:49:42.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.352+0000 7f1e437fe700 1 --2- 172.21.15.73:0/3657241802 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e30003a00 0x7f1e30003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:49:42.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.352+0000 7f1e42ffd700 1 --2- 172.21.15.73:0/3657241802 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e30004850 0x7f1e30004cd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1e34009d10 tx=0x7f1e30005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86f3a71330ef5a76 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:42.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.352+0000 7f1e427fc700 1 -- 172.21.15.73:0/3657241802 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e34009e60 con 0x7f1e30004850 2024-05-08T21:49:42.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.352+0000 7f1e427fc700 1 -- 172.21.15.73:0/3657241802 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e3400e9a0 con 0x7f1e30004850 2024-05-08T21:49:42.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.352+0000 7f1e427fc700 1 -- 172.21.15.73:0/3657241802 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3400ed30 con 0x7f1e30004850 2024-05-08T21:49:42.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.353+0000 7f1e4a255700 1 -- 172.21.15.73:0/3657241802 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e30004850 msgr2=0x7f1e30004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:42.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.353+0000 7f1e4a255700 1 --2- 172.21.15.73:0/3657241802 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e30004850 0x7f1e30004cd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1e34009d10 tx=0x7f1e30005880 comp rx=0 tx=0).stop 2024-05-08T21:49:42.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.353+0000 7f1e4a255700 1 -- 172.21.15.73:0/3657241802 shutdown_connections 2024-05-08T21:49:42.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.353+0000 7f1e4a255700 1 --2- 172.21.15.73:0/3657241802 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e30004850 0x7f1e30004cd0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:42.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.353+0000 7f1e4a255700 1 -- 172.21.15.73:0/3657241802 >> 172.21.15.73:0/3657241802 conn(0x7f1e440cb560 msgr2=0x7f1e440cb970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:42.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.353+0000 7f1e4a255700 1 -- 172.21.15.73:0/3657241802 shutdown_connections 2024-05-08T21:49:42.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.353+0000 7f1e4a255700 1 -- 172.21.15.73:0/3657241802 wait complete. 2024-05-08T21:49:42.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.354+0000 7f1e4a255700 1 Processor -- start 2024-05-08T21:49:42.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.355+0000 7f1e4a255700 1 -- start start 2024-05-08T21:49:42.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.355+0000 7f1e4a255700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e30004850 0x7f1e440c4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:42.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.355+0000 7f1e4a255700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e4414bff0 0x7f1e441de300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:42.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.355+0000 7f1e4a255700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e441de840 0x7f1e44142ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:42.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.355+0000 7f1e4a255700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e44149e50 con 0x7f1e441de840 2024-05-08T21:49:42.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.355+0000 7f1e4a255700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e441decd0 con 0x7f1e30004850 2024-05-08T21:49:42.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.355+0000 7f1e4a255700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e44149240 con 0x7f1e4414bff0 2024-05-08T21:49:42.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.356+0000 7f1e43fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e441de840 0x7f1e44142ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:42.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.356+0000 7f1e43fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e441de840 0x7f1e44142ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43666/0 (socket says 172.21.15.73:43666) 2024-05-08T21:49:42.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.356+0000 7f1e43fff700 1 -- 172.21.15.73:0/1217364257 learned_addr learned my addr 172.21.15.73:0/1217364257 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:42.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.356+0000 7f1e437fe700 1 --2- 172.21.15.73:0/1217364257 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e30004850 0x7f1e440c4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:42.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.356+0000 7f1e42ffd700 1 --2- 172.21.15.73:0/1217364257 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e4414bff0 0x7f1e441de300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:42.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.356+0000 7f1e43fff700 1 -- 172.21.15.73:0/1217364257 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e4414bff0 msgr2=0x7f1e441de300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:42.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.356+0000 7f1e43fff700 1 --2- 172.21.15.73:0/1217364257 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e4414bff0 0x7f1e441de300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:42.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.356+0000 7f1e43fff700 1 -- 172.21.15.73:0/1217364257 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e30004850 msgr2=0x7f1e440c4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:42.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.356+0000 7f1e43fff700 1 --2- 172.21.15.73:0/1217364257 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e30004850 0x7f1e440c4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:42.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.356+0000 7f1e43fff700 1 -- 172.21.15.73:0/1217364257 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e44149520 con 0x7f1e441de840 2024-05-08T21:49:42.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.356+0000 7f1e437fe700 1 --2- 172.21.15.73:0/1217364257 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e30004850 0x7f1e440c4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:49:42.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.356+0000 7f1e43fff700 1 --2- 172.21.15.73:0/1217364257 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e441de840 0x7f1e44142ed0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1e440c5c20 tx=0x7f1e3c00f640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:42.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.356+0000 7f1e3bfff700 1 -- 172.21.15.73:0/1217364257 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c003c00 con 0x7f1e441de840 2024-05-08T21:49:42.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.356+0000 7f1e3bfff700 1 -- 172.21.15.73:0/1217364257 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e3c003d80 con 0x7f1e441de840 2024-05-08T21:49:42.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.356+0000 7f1e3bfff700 1 -- 172.21.15.73:0/1217364257 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c005310 con 0x7f1e441de840 2024-05-08T21:49:42.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.356+0000 7f1e4a255700 1 -- 172.21.15.73:0/1217364257 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e44149800 con 0x7f1e441de840 2024-05-08T21:49:42.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.356+0000 7f1e4a255700 1 -- 172.21.15.73:0/1217364257 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e44157080 con 0x7f1e441de840 2024-05-08T21:49:42.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.357+0000 7f1e4a255700 1 -- 172.21.15.73:0/1217364257 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e440674f0 con 0x7f1e441de840 2024-05-08T21:49:42.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.358+0000 7f1e3bfff700 1 -- 172.21.15.73:0/1217364257 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1e3c018020 con 0x7f1e441de840 2024-05-08T21:49:42.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.358+0000 7f1e3bfff700 1 --2- 172.21.15.73:0/1217364257 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f1e2406ac90 0x7f1e2406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:42.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.358+0000 7f1e3bfff700 1 -- 172.21.15.73:0/1217364257 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f1e3c08b320 con 0x7f1e441de840 2024-05-08T21:49:42.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.358+0000 7f1e437fe700 1 --2- 172.21.15.73:0/1217364257 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f1e2406ac90 0x7f1e2406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:42.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.358+0000 7f1e437fe700 1 --2- 172.21.15.73:0/1217364257 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f1e2406ac90 0x7f1e2406d150 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c007d40 tx=0x7f1e2c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:42.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.363+0000 7f1e3bfff700 1 -- 172.21.15.73:0/1217364257 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f1e3c056650 con 0x7f1e441de840 2024-05-08T21:49:42.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:42.558+0000 7f1e4a255700 1 -- 172.21.15.73:0/1217364257 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f1e4414a000 con 0x7f1e441de840 2024-05-08T21:49:43.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.205+0000 7f1e3bfff700 1 -- 172.21.15.73:0/1217364257 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) v1 ==== 170+0+0 (secure 0 0 0) 0x7f1e4414a000 con 0x7f1e441de840 2024-05-08T21:49:43.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.209+0000 7f1e4a255700 1 -- 172.21.15.73:0/1217364257 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f1e2406ac90 msgr2=0x7f1e2406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:43.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.209+0000 7f1e4a255700 1 --2- 172.21.15.73:0/1217364257 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f1e2406ac90 0x7f1e2406d150 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c007d40 tx=0x7f1e2c009040 comp rx=0 tx=0).stop 2024-05-08T21:49:43.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.209+0000 7f1e4a255700 1 -- 172.21.15.73:0/1217364257 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e441de840 msgr2=0x7f1e44142ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:43.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.209+0000 7f1e4a255700 1 --2- 172.21.15.73:0/1217364257 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e441de840 0x7f1e44142ed0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1e440c5c20 tx=0x7f1e3c00f640 comp rx=0 tx=0).stop 2024-05-08T21:49:43.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.209+0000 7f1e4a255700 1 -- 172.21.15.73:0/1217364257 shutdown_connections 2024-05-08T21:49:43.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.209+0000 7f1e4a255700 1 --2- 172.21.15.73:0/1217364257 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f1e2406ac90 0x7f1e2406d150 secure :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c007d40 tx=0x7f1e2c009040 comp rx=0 tx=0).stop 2024-05-08T21:49:43.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.209+0000 7f1e4a255700 1 --2- 172.21.15.73:0/1217364257 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e441de840 0x7f1e44142ed0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:43.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.209+0000 7f1e4a255700 1 --2- 172.21.15.73:0/1217364257 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e30004850 0x7f1e440c4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:43.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.209+0000 7f1e4a255700 1 --2- 172.21.15.73:0/1217364257 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e4414bff0 0x7f1e441de300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:43.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.209+0000 7f1e4a255700 1 -- 172.21.15.73:0/1217364257 >> 172.21.15.73:0/1217364257 conn(0x7f1e440cb560 msgr2=0x7f1e44145160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:43.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.211+0000 7f1e4a255700 1 -- 172.21.15.73:0/1217364257 shutdown_connections 2024-05-08T21:49:43.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.211+0000 7f1e4a255700 1 -- 172.21.15.73:0/1217364257 wait complete. 2024-05-08T21:49:43.364 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_data' created 2024-05-08T21:49:43.364 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-08T21:49:43.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.490+0000 7f25be60c700 1 Processor -- start 2024-05-08T21:49:43.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.490+0000 7f25be60c700 1 -- start start 2024-05-08T21:49:43.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.491+0000 7f25be60c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f25b8150b40 0x7f25b81571f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:43.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.491+0000 7f25be60c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25b8071db0 0x7f25b8161260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:43.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.491+0000 7f25be60c700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25b8156d60 con 0x7f25b80c65d0 2024-05-08T21:49:43.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.491+0000 7f25be60c700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25b80722f0 con 0x7f25b8150b40 2024-05-08T21:49:43.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.491+0000 7f25be60c700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25b80c39c0 con 0x7f25b8071db0 2024-05-08T21:49:43.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.491+0000 7f25b77fe700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f25b80c65d0 0x7f25b80cc390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:60330/0 (socket says 172.21.15.73:60330) 2024-05-08T21:49:43.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.491+0000 7f25b77fe700 1 -- 172.21.15.73:0/2527460730 learned_addr learned my addr 172.21.15.73:0/2527460730 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:49:43.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.491+0000 7f25b7fff700 1 --2- 172.21.15.73:0/2527460730 >> v2:172.21.15.115:3300/0 conn(0x7f25b8150b40 0x7f25b81571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:43.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.491+0000 7f25bcba9700 1 --2- 172.21.15.73:0/2527460730 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25b8071db0 0x7f25b8161260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:43.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.491+0000 7f25b6ffd700 1 -- 172.21.15.73:0/2527460730 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1138249228 0 0) 0x7f25b8156d60 con 0x7f25b80c65d0 2024-05-08T21:49:43.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.491+0000 7f25b6ffd700 1 -- 172.21.15.73:0/2527460730 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25a00035b0 con 0x7f25b80c65d0 2024-05-08T21:49:43.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.491+0000 7f25b6ffd700 1 -- 172.21.15.73:0/2527460730 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 166746225 0 0) 0x7f25a00035b0 con 0x7f25b80c65d0 2024-05-08T21:49:43.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.491+0000 7f25b7fff700 1 -- 172.21.15.73:0/2527460730 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25b8071db0 msgr2=0x7f25b8161260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:43.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.491+0000 7f25b7fff700 1 --2- 172.21.15.73:0/2527460730 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25b8071db0 0x7f25b8161260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:43.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.491+0000 7f25b7fff700 1 -- 172.21.15.73:0/2527460730 >> v1:172.21.15.73:6789/0 conn(0x7f25b80c65d0 legacy=0x7f25b80cc390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:43.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.491+0000 7f25b7fff700 1 -- 172.21.15.73:0/2527460730 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b80c3ca0 con 0x7f25b8150b40 2024-05-08T21:49:43.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.492+0000 7f25b7fff700 1 --2- 172.21.15.73:0/2527460730 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25b8150b40 0x7f25b81571f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f25ac009840 tx=0x7f25ac009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae6b926777060885 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:43.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.492+0000 7f25b6ffd700 1 -- 172.21.15.73:0/2527460730 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a8001670 con 0x7f25b8150b40 2024-05-08T21:49:43.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.492+0000 7f25b6ffd700 1 -- 172.21.15.73:0/2527460730 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25ac004030 con 0x7f25b8150b40 2024-05-08T21:49:43.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.492+0000 7f25b6ffd700 1 -- 172.21.15.73:0/2527460730 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ac0043a0 con 0x7f25b8150b40 2024-05-08T21:49:43.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.492+0000 7f25be60c700 1 -- 172.21.15.73:0/2527460730 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25b8150b40 msgr2=0x7f25b81571f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:43.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.492+0000 7f25be60c700 1 --2- 172.21.15.73:0/2527460730 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25b8150b40 0x7f25b81571f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f25ac009840 tx=0x7f25ac009b50 comp rx=0 tx=0).stop 2024-05-08T21:49:43.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.492+0000 7f25be60c700 1 -- 172.21.15.73:0/2527460730 shutdown_connections 2024-05-08T21:49:43.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.492+0000 7f25be60c700 1 --2- 172.21.15.73:0/2527460730 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25b8071db0 0x7f25b8161260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:43.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.492+0000 7f25be60c700 1 --2- 172.21.15.73:0/2527460730 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25b8150b40 0x7f25b81571f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:43.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.492+0000 7f25be60c700 1 -- 172.21.15.73:0/2527460730 >> 172.21.15.73:0/2527460730 conn(0x7f25b8066ab0 msgr2=0x7f25b806f550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:43.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.492+0000 7f25be60c700 1 -- 172.21.15.73:0/2527460730 shutdown_connections 2024-05-08T21:49:43.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.492+0000 7f25be60c700 1 -- 172.21.15.73:0/2527460730 wait complete. 2024-05-08T21:49:43.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.493+0000 7f25be60c700 1 Processor -- start 2024-05-08T21:49:43.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.494+0000 7f25be60c700 1 -- start start 2024-05-08T21:49:43.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.494+0000 7f25be60c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25b8071db0 0x7f25b814e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:43.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.494+0000 7f25be60c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25b80c65d0 0x7f25b8147390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:43.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.494+0000 7f25be60c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25b8150b40 0x7f25b81414b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:43.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.494+0000 7f25be60c700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b8144ec0 con 0x7f25b8071db0 2024-05-08T21:49:43.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.494+0000 7f25be60c700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b81466a0 con 0x7f25b80c65d0 2024-05-08T21:49:43.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.494+0000 7f25be60c700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25b81ecf00 con 0x7f25b8150b40 2024-05-08T21:49:43.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.494+0000 7f25b7fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25b8071db0 0x7f25b814e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:43.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.494+0000 7f25b7fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25b8071db0 0x7f25b814e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43678/0 (socket says 172.21.15.73:43678) 2024-05-08T21:49:43.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.494+0000 7f25b7fff700 1 -- 172.21.15.73:0/2442244522 learned_addr learned my addr 172.21.15.73:0/2442244522 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:43.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.495+0000 7f25b77fe700 1 --2- 172.21.15.73:0/2442244522 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25b80c65d0 0x7f25b8147390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:43.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.495+0000 7f25bcba9700 1 --2- 172.21.15.73:0/2442244522 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25b8150b40 0x7f25b81414b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:43.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.495+0000 7f25b7fff700 1 -- 172.21.15.73:0/2442244522 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25b8150b40 msgr2=0x7f25b81414b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:43.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.495+0000 7f25b7fff700 1 --2- 172.21.15.73:0/2442244522 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25b8150b40 0x7f25b81414b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:43.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.495+0000 7f25b7fff700 1 -- 172.21.15.73:0/2442244522 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25b80c65d0 msgr2=0x7f25b8147390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:43.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.495+0000 7f25b7fff700 1 --2- 172.21.15.73:0/2442244522 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25b80c65d0 0x7f25b8147390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:43.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.495+0000 7f25b7fff700 1 -- 172.21.15.73:0/2442244522 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25ac0094a0 con 0x7f25b8071db0 2024-05-08T21:49:43.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.495+0000 7f25bcba9700 1 --2- 172.21.15.73:0/2442244522 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25b8150b40 0x7f25b81414b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:49:43.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.495+0000 7f25b7fff700 1 --2- 172.21.15.73:0/2442244522 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25b8071db0 0x7f25b814e5c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f25ac0090b0 tx=0x7f25ac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:43.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.495+0000 7f25b4ff9700 1 -- 172.21.15.73:0/2442244522 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ac003d00 con 0x7f25b8071db0 2024-05-08T21:49:43.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.495+0000 7f25b4ff9700 1 -- 172.21.15.73:0/2442244522 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25ac01f070 con 0x7f25b8071db0 2024-05-08T21:49:43.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.495+0000 7f25b4ff9700 1 -- 172.21.15.73:0/2442244522 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ac011870 con 0x7f25b8071db0 2024-05-08T21:49:43.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.495+0000 7f25be60c700 1 -- 172.21.15.73:0/2442244522 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25b81460e0 con 0x7f25b8071db0 2024-05-08T21:49:43.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.495+0000 7f25be60c700 1 -- 172.21.15.73:0/2442244522 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25b8146b90 con 0x7f25b8071db0 2024-05-08T21:49:43.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.496+0000 7f25be60c700 1 -- 172.21.15.73:0/2442244522 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25b80c4e70 con 0x7f25b8071db0 2024-05-08T21:49:43.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.497+0000 7f25b4ff9700 1 -- 172.21.15.73:0/2442244522 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f25ac021030 con 0x7f25b8071db0 2024-05-08T21:49:43.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.497+0000 7f25b4ff9700 1 --2- 172.21.15.73:0/2442244522 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f25a406ac90 0x7f25a406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:43.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.497+0000 7f25b4ff9700 1 -- 172.21.15.73:0/2442244522 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f25ac08a640 con 0x7f25b8071db0 2024-05-08T21:49:43.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.497+0000 7f25b77fe700 1 --2- 172.21.15.73:0/2442244522 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f25a406ac90 0x7f25a406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:43.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.497+0000 7f25b77fe700 1 --2- 172.21.15.73:0/2442244522 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f25a406ac90 0x7f25a406d150 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f25b81496b0 tx=0x7f25a8001e40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:43.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.502+0000 7f25b4ff9700 1 -- 172.21.15.73:0/2442244522 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f25ac055880 con 0x7f25b8071db0 2024-05-08T21:49:43.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.746+0000 7f25be60c700 1 -- 172.21.15.73:0/2442244522 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f25b8067c30 con 0x7f25b8071db0 2024-05-08T21:49:43.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.754+0000 7f25b4ff9700 1 -- 172.21.15.73:0/2442244522 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f25ac058ea0 con 0x7f25b8071db0 2024-05-08T21:49:43.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.760+0000 7f25be60c700 1 -- 172.21.15.73:0/2442244522 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f25a406ac90 msgr2=0x7f25a406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:43.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.760+0000 7f25be60c700 1 --2- 172.21.15.73:0/2442244522 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f25a406ac90 0x7f25a406d150 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f25b81496b0 tx=0x7f25a8001e40 comp rx=0 tx=0).stop 2024-05-08T21:49:43.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.760+0000 7f25be60c700 1 -- 172.21.15.73:0/2442244522 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25b8071db0 msgr2=0x7f25b814e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:43.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.760+0000 7f25be60c700 1 --2- 172.21.15.73:0/2442244522 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25b8071db0 0x7f25b814e5c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f25ac0090b0 tx=0x7f25ac004750 comp rx=0 tx=0).stop 2024-05-08T21:49:43.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.760+0000 7f25be60c700 1 -- 172.21.15.73:0/2442244522 shutdown_connections 2024-05-08T21:49:43.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.760+0000 7f25be60c700 1 --2- 172.21.15.73:0/2442244522 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f25a406ac90 0x7f25a406d150 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:43.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.760+0000 7f25be60c700 1 --2- 172.21.15.73:0/2442244522 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25b8150b40 0x7f25b81414b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:43.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.760+0000 7f25be60c700 1 --2- 172.21.15.73:0/2442244522 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25b8071db0 0x7f25b814e5c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:43.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.760+0000 7f25be60c700 1 --2- 172.21.15.73:0/2442244522 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25b80c65d0 0x7f25b8147390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:43.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.760+0000 7f25be60c700 1 -- 172.21.15.73:0/2442244522 >> 172.21.15.73:0/2442244522 conn(0x7f25b8066ab0 msgr2=0x7f25b814f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:43.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.760+0000 7f25be60c700 1 -- 172.21.15.73:0/2442244522 shutdown_connections 2024-05-08T21:49:43.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.760+0000 7f25be60c700 1 -- 172.21.15.73:0/2442244522 wait complete. 2024-05-08T21:49:43.767 INFO:teuthology.orchestra.run.smithi073.stderr:new fs with metadata pool 2 and data pool 3 2024-05-08T21:49:43.778 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T21:49:43.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.899+0000 7feaa9f92700 1 Processor -- start 2024-05-08T21:49:43.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.899+0000 7feaa9f92700 1 -- start start 2024-05-08T21:49:43.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.899+0000 7feaa9f92700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7feaa4072980 0x7feaa406f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:43.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.899+0000 7feaa9f92700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaa415dfc0 con 0x7feaa4072d60 2024-05-08T21:49:43.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.899+0000 7feaa9f92700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaa406feb0 con 0x7feaa4072260 2024-05-08T21:49:43.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.899+0000 7feaa9f92700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaa4070120 con 0x7feaa4072980 2024-05-08T21:49:43.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.900+0000 7feaa3fff700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7feaa4072d60 0x7feaa4153860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:60336/0 (socket says 172.21.15.73:60336) 2024-05-08T21:49:43.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.900+0000 7feaa3fff700 1 -- 172.21.15.73:0/3639268191 learned_addr learned my addr 172.21.15.73:0/3639268191 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:49:43.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.900+0000 7feaa37fe700 1 --2- 172.21.15.73:0/3639268191 >> v2:172.21.15.115:3300/0 conn(0x7feaa4072980 0x7feaa406f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:43.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.900+0000 7feaa27fc700 1 -- 172.21.15.73:0/3639268191 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 576639424 0 0) 0x7feaa415dfc0 con 0x7feaa4072d60 2024-05-08T21:49:43.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.900+0000 7feaa27fc700 1 -- 172.21.15.73:0/3639268191 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea900035b0 con 0x7feaa4072d60 2024-05-08T21:49:43.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.900+0000 7feaa27fc700 1 -- 172.21.15.73:0/3639268191 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1474085801 0 0) 0x7fea900035b0 con 0x7feaa4072d60 2024-05-08T21:49:43.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.900+0000 7feaa27fc700 1 -- 172.21.15.73:0/3639268191 >> v2:172.21.15.115:3300/0 conn(0x7feaa4072980 msgr2=0x7feaa406f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:43.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.900+0000 7feaa27fc700 1 --2- 172.21.15.73:0/3639268191 >> v2:172.21.15.115:3300/0 conn(0x7feaa4072980 0x7feaa406f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:43.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.900+0000 7feaa27fc700 1 -- 172.21.15.73:0/3639268191 >> v1:172.21.15.115:6789/0 conn(0x7feaa4072260 legacy=0x7feaa4159d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:43.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.900+0000 7feaa27fc700 1 -- 172.21.15.73:0/3639268191 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa415d3b0 con 0x7feaa4072d60 2024-05-08T21:49:43.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.900+0000 7feaa27fc700 1 -- 172.21.15.73:0/3639268191 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 953298616 0 0) 0x7fea9c0019f0 con 0x7feaa4072d60 2024-05-08T21:49:43.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.900+0000 7feaa37fe700 1 --2- 172.21.15.73:0/3639268191 >> v2:172.21.15.115:3300/0 conn(0x7feaa4072980 0x7feaa406f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:49:43.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.900+0000 7feaa27fc700 1 -- 172.21.15.73:0/3639268191 >> v1:172.21.15.73:6789/0 conn(0x7feaa4072d60 legacy=0x7feaa4153860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:43.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.900+0000 7feaa27fc700 1 --2- 172.21.15.73:0/3639268191 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fea90003a00 0x7fea90003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:43.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.900+0000 7feaa27fc700 1 --2- 172.21.15.73:0/3639268191 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea90004850 0x7fea90004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:43.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.900+0000 7feaa27fc700 1 --2- 172.21.15.73:0/3639268191 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fea90005210 0x7fea9000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:43.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.900+0000 7feaa27fc700 1 -- 172.21.15.73:0/3639268191 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa4070120 con 0x7fea90004850 2024-05-08T21:49:43.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.900+0000 7feaa27fc700 1 -- 172.21.15.73:0/3639268191 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea9000c0c0 con 0x7fea90005210 2024-05-08T21:49:43.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.900+0000 7feaa27fc700 1 -- 172.21.15.73:0/3639268191 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea9000c280 con 0x7fea90003a00 2024-05-08T21:49:43.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.900+0000 7feaa2ffd700 1 --2- 172.21.15.73:0/3639268191 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea90004850 0x7fea90004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:43.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.900+0000 7feaa37fe700 1 --2- 172.21.15.73:0/3639268191 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fea90003a00 0x7fea90003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:43.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.900+0000 7feaa3fff700 1 --2- 172.21.15.73:0/3639268191 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fea90005210 0x7fea9000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:43.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.900+0000 7feaa2ffd700 1 -- 172.21.15.73:0/3639268191 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fea90003a00 msgr2=0x7fea90003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:43.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.900+0000 7feaa2ffd700 1 --2- 172.21.15.73:0/3639268191 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fea90003a00 0x7fea90003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:43.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.900+0000 7feaa2ffd700 1 -- 172.21.15.73:0/3639268191 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fea90005210 msgr2=0x7fea9000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:43.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.900+0000 7feaa2ffd700 1 --2- 172.21.15.73:0/3639268191 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fea90005210 0x7fea9000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:43.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.900+0000 7feaa2ffd700 1 -- 172.21.15.73:0/3639268191 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea900035b0 con 0x7fea90004850 2024-05-08T21:49:43.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.900+0000 7feaa3fff700 1 -- 172.21.15.73:0/3639268191 reap_dead start 2024-05-08T21:49:43.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.901+0000 7feaa2ffd700 1 --2- 172.21.15.73:0/3639268191 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea90004850 0x7fea90004cd0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fea8c0017c0 tx=0x7fea90005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e5787522f8dcd21 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:43.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.901+0000 7feaa27fc700 1 -- 172.21.15.73:0/3639268191 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea8c0052d0 con 0x7fea90004850 2024-05-08T21:49:43.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.901+0000 7feaa27fc700 1 -- 172.21.15.73:0/3639268191 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea8c005450 con 0x7fea90004850 2024-05-08T21:49:43.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.901+0000 7feaa27fc700 1 -- 172.21.15.73:0/3639268191 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea8c0038c0 con 0x7fea90004850 2024-05-08T21:49:43.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.901+0000 7feaa9f92700 1 -- 172.21.15.73:0/3639268191 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea90004850 msgr2=0x7fea90004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:43.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.901+0000 7feaa9f92700 1 --2- 172.21.15.73:0/3639268191 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea90004850 0x7fea90004cd0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fea8c0017c0 tx=0x7fea90005880 comp rx=0 tx=0).stop 2024-05-08T21:49:43.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.901+0000 7feaa9f92700 1 -- 172.21.15.73:0/3639268191 shutdown_connections 2024-05-08T21:49:43.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.901+0000 7feaa9f92700 1 --2- 172.21.15.73:0/3639268191 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea90004850 0x7fea90004cd0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:43.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.901+0000 7feaa9f92700 1 -- 172.21.15.73:0/3639268191 >> 172.21.15.73:0/3639268191 conn(0x7feaa4066cf0 msgr2=0x7feaa406bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:43.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.901+0000 7feaa9f92700 1 -- 172.21.15.73:0/3639268191 shutdown_connections 2024-05-08T21:49:43.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.901+0000 7feaa9f92700 1 -- 172.21.15.73:0/3639268191 wait complete. 2024-05-08T21:49:43.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.902+0000 7feaa9f92700 1 Processor -- start 2024-05-08T21:49:43.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.903+0000 7feaa9f92700 1 -- start start 2024-05-08T21:49:43.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.903+0000 7feaa9f92700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fea90004850 0x7feaa41ef280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:43.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.903+0000 7feaa9f92700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feaa4158c80 0x7feaa41f3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:43.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.903+0000 7feaa9f92700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feaa41591d0 0x7feaa415c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:43.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.903+0000 7feaa9f92700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa41f2ec0 con 0x7feaa41591d0 2024-05-08T21:49:43.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.903+0000 7feaa9f92700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa4159650 con 0x7fea90004850 2024-05-08T21:49:43.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.903+0000 7feaa9f92700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaa4150a40 con 0x7feaa4158c80 2024-05-08T21:49:43.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.904+0000 7feaa3fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feaa41591d0 0x7feaa415c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:43.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.904+0000 7feaa37fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fea90004850 0x7feaa41ef280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:43.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.904+0000 7feaa37fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fea90004850 0x7feaa41ef280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.73:58250/0 (socket says 172.21.15.73:58250) 2024-05-08T21:49:43.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.904+0000 7feaa37fe700 1 -- 172.21.15.73:0/1557899466 learned_addr learned my addr 172.21.15.73:0/1557899466 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:43.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.904+0000 7feaa3fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feaa41591d0 0x7feaa415c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43704/0 (socket says 172.21.15.73:43704) 2024-05-08T21:49:43.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.904+0000 7feaa2ffd700 1 --2- 172.21.15.73:0/1557899466 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feaa4158c80 0x7feaa41f3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:43.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.904+0000 7feaa3fff700 1 -- 172.21.15.73:0/1557899466 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feaa4158c80 msgr2=0x7feaa41f3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:43.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.904+0000 7feaa3fff700 1 --2- 172.21.15.73:0/1557899466 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feaa4158c80 0x7feaa41f3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:43.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.904+0000 7feaa3fff700 1 -- 172.21.15.73:0/1557899466 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fea90004850 msgr2=0x7feaa41ef280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:43.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.904+0000 7feaa3fff700 1 --2- 172.21.15.73:0/1557899466 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fea90004850 0x7feaa41ef280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:43.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.904+0000 7feaa3fff700 1 -- 172.21.15.73:0/1557899466 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa4150d20 con 0x7feaa41591d0 2024-05-08T21:49:43.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.904+0000 7feaa3fff700 1 --2- 172.21.15.73:0/1557899466 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feaa41591d0 0x7feaa415c2b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7feaa40c4580 tx=0x7fea9c00a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:43.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.904+0000 7fea9bfff700 1 -- 172.21.15.73:0/1557899466 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9c00ad10 con 0x7feaa41591d0 2024-05-08T21:49:43.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.904+0000 7fea9bfff700 1 -- 172.21.15.73:0/1557899466 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea9c00ae90 con 0x7feaa41591d0 2024-05-08T21:49:43.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.904+0000 7feaa9f92700 1 -- 172.21.15.73:0/1557899466 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaa41f2870 con 0x7feaa41591d0 2024-05-08T21:49:43.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.904+0000 7fea9bfff700 1 -- 172.21.15.73:0/1557899466 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9c013630 con 0x7feaa41591d0 2024-05-08T21:49:43.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.904+0000 7feaa9f92700 1 -- 172.21.15.73:0/1557899466 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaa4152e80 con 0x7feaa41591d0 2024-05-08T21:49:43.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.905+0000 7feaa9f92700 1 -- 172.21.15.73:0/1557899466 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaa415d1f0 con 0x7feaa41591d0 2024-05-08T21:49:43.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.906+0000 7fea9bfff700 1 -- 172.21.15.73:0/1557899466 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fea9c013790 con 0x7feaa41591d0 2024-05-08T21:49:43.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.906+0000 7fea9bfff700 1 --2- 172.21.15.73:0/1557899466 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fea8406acc0 0x7fea8406d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:43.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.906+0000 7feaa37fe700 1 --2- 172.21.15.73:0/1557899466 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fea8406acc0 0x7fea8406d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:43.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.906+0000 7fea9bfff700 1 -- 172.21.15.73:0/1557899466 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fea9c089ae0 con 0x7feaa41591d0 2024-05-08T21:49:43.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.907+0000 7feaa37fe700 1 --2- 172.21.15.73:0/1557899466 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fea8406acc0 0x7fea8406d180 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fea94009470 tx=0x7fea94009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:43.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:43.911+0000 7fea9bfff700 1 -- 172.21.15.73:0/1557899466 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fea9c054c30 con 0x7feaa41591d0 2024-05-08T21:49:44.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.108+0000 7feaa9f92700 1 -- 172.21.15.73:0/1557899466 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feaa4068b80 con 0x7feaa41591d0 2024-05-08T21:49:44.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.110+0000 7fea9bfff700 1 -- 172.21.15.73:0/1557899466 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16050 (secure 0 0 0) 0x7fea9c058250 con 0x7feaa41591d0 2024-05-08T21:49:44.110 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:49:44.110 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":20,"fsid":"143164b7-c9c7-4737-a494-7dafa5a3320c","created":"2024-05-08T21:49:26.221909+0000","modified":"2024-05-08T21:49:43.746853+0000","last_up_change":"2024-05-08T21:49:37.118386+0000","last_in_change":"2024-05-08T21:49:28.836944+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T21:49:35.998578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T21:49:42.171760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T21:49:42.576293+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6b7439c1-daaa-44af-8333-a455f9e9dc67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":47228},{"type":"v1","addr":"172.21.15.73:6809","nonce":47228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":47228},{"type":"v1","addr":"172.21.15.73:6811","nonce":47228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":47228},{"type":"v1","addr":"172.21.15.73:6815","nonce":47228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":47228},{"type":"v1","addr":"172.21.15.73:6813","nonce":47228}]},"public_addr":"172.21.15.73:6809/47228","cluster_addr":"172.21.15.73:6811/47228","heartbeat_back_addr":"172.21.15.73:6815/47228","heartbeat_front_addr":"172.21.15.73:6813/47228","state":["exists","up"]},{"osd":1,"uuid":"fb67886a-d7f7-45ac-832f-36c871c8a208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":47227},{"type":"v1","addr":"172.21.15.73:6801","nonce":47227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":47227},{"type":"v1","addr":"172.21.15.73:6803","nonce":47227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":47227},{"type":"v1","addr":"172.21.15.73:6807","nonce":47227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":47227},{"type":"v1","addr":"172.21.15.73:6805","nonce":47227}]},"public_addr":"172.21.15.73:6801/47227","cluster_addr":"172.21.15.73:6803/47227","heartbeat_back_addr":"172.21.15.73:6807/47227","heartbeat_front_addr":"172.21.15.73:6805/47227","state":["exists","up"]},{"osd":2,"uuid":"a5cd6e98-6621-473a-bfb8-5c648abbb563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":47229},{"type":"v1","addr":"172.21.15.73:6817","nonce":47229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":47229},{"type":"v1","addr":"172.21.15.73:6819","nonce":47229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":47229},{"type":"v1","addr":"172.21.15.73:6823","nonce":47229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":47229},{"type":"v1","addr":"172.21.15.73:6821","nonce":47229}]},"public_addr":"172.21.15.73:6817/47229","cluster_addr":"172.21.15.73:6819/47229","heartbeat_back_addr":"172.21.15.73:6823/47229","heartbeat_front_addr":"172.21.15.73:6821/47229","state":["exists","up"]},{"osd":3,"uuid":"36927c20-4241-4f3b-91b5-a6a6f27598e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":47232},{"type":"v1","addr":"172.21.15.73:6825","nonce":47232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":47232},{"type":"v1","addr":"172.21.15.73:6827","nonce":47232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":47232},{"type":"v1","addr":"172.21.15.73:6831","nonce":47232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":47232},{"type":"v1","addr":"172.21.15.73:6829","nonce":47232}]},"public_addr":"172.21.15.73:6825/47232","cluster_addr":"172.21.15.73:6827/47232","heartbeat_back_addr":"172.21.15.73:6831/47232","heartbeat_front_addr":"172.21.15.73:6829/47232","state":["exists","up"]},{"osd":4,"uuid":"4ebe0a18-8216-4815-878a-39c39a6cd3fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":47200},{"type":"v1","addr":"172.21.15.115:6801","nonce":47200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":47200},{"type":"v1","addr":"172.21.15.115:6803","nonce":47200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":47200},{"type":"v1","addr":"172.21.15.115:6807","nonce":47200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":47200},{"type":"v1","addr":"172.21.15.115:6805","nonce":47200}]},"public_addr":"172.21.15.115:6801/47200","cluster_addr":"172.21.15.115:6803/47200","heartbeat_back_addr":"172.21.15.115:6807/47200","heartbeat_front_addr":"172.21.15.115:6805/47200","state":["exists","up"]},{"osd":5,"uuid":"957f0ac1-5f26-4f02-8c05-488e6b67ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":47201},{"type":"v1","addr":"172.21.15.115:6809","nonce":47201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":47201},{"type":"v1","addr":"172.21.15.115:6811","nonce":47201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":47201},{"type":"v1","addr":"172.21.15.115:6815","nonce":47201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":47201},{"type":"v1","addr":"172.21.15.115:6813","nonce":47201}]},"public_addr":"172.21.15.115:6809/47201","cluster_addr":"172.21.15.115:6811/47201","heartbeat_back_addr":"172.21.15.115:6815/47201","heartbeat_front_addr":"172.21.15.115:6813/47201","state":["exists","up"]},{"osd":6,"uuid":"f5a6768f-ba7f-4f66-b335-0c303b158e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":47202},{"type":"v1","addr":"172.21.15.115:6817","nonce":47202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":47202},{"type":"v1","addr":"172.21.15.115:6819","nonce":47202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":47202},{"type":"v1","addr":"172.21.15.115:6823","nonce":47202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":47202},{"type":"v1","addr":"172.21.15.115:6821","nonce":47202}]},"public_addr":"172.21.15.115:6817/47202","cluster_addr":"172.21.15.115:6819/47202","heartbeat_back_addr":"172.21.15.115:6823/47202","heartbeat_front_addr":"172.21.15.115:6821/47202","state":["exists","up"]},{"osd":7,"uuid":"f4187743-f9e6-42e6-aca9-0604a58db1ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":47211},{"type":"v1","addr":"172.21.15.115:6825","nonce":47211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":47211},{"type":"v1","addr":"172.21.15.115:6827","nonce":47211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":47211},{"type":"v1","addr":"172.21.15.115:6831","nonce":47211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":47211},{"type":"v1","addr":"172.21.15.115:6829","nonce":47211}]},"public_addr":"172.21.15.115:6825/47211","cluster_addr":"172.21.15.115:6827/47211","heartbeat_back_addr":"172.21.15.115:6831/47211","heartbeat_front_addr":"172.21.15.115:6829/47211","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:33.996335+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:33.687451+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:34.072549+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:33.997588+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:34.047260+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:34.876272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:33.965472+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:34.038637+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T21:49:44.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.112+0000 7feaa9f92700 1 -- 172.21.15.73:0/1557899466 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fea8406acc0 msgr2=0x7fea8406d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:44.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.112+0000 7feaa9f92700 1 --2- 172.21.15.73:0/1557899466 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fea8406acc0 0x7fea8406d180 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fea94009470 tx=0x7fea94009210 comp rx=0 tx=0).stop 2024-05-08T21:49:44.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.112+0000 7feaa9f92700 1 -- 172.21.15.73:0/1557899466 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feaa41591d0 msgr2=0x7feaa415c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:44.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.112+0000 7feaa9f92700 1 --2- 172.21.15.73:0/1557899466 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feaa41591d0 0x7feaa415c2b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7feaa40c4580 tx=0x7fea9c00a5f0 comp rx=0 tx=0).stop 2024-05-08T21:49:44.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.112+0000 7feaa9f92700 1 -- 172.21.15.73:0/1557899466 shutdown_connections 2024-05-08T21:49:44.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.112+0000 7feaa9f92700 1 --2- 172.21.15.73:0/1557899466 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fea8406acc0 0x7fea8406d180 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:44.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.112+0000 7feaa9f92700 1 --2- 172.21.15.73:0/1557899466 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feaa41591d0 0x7feaa415c2b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:44.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.112+0000 7feaa9f92700 1 --2- 172.21.15.73:0/1557899466 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fea90004850 0x7feaa41ef280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:44.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.112+0000 7feaa9f92700 1 --2- 172.21.15.73:0/1557899466 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feaa4158c80 0x7feaa41f3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:44.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.112+0000 7feaa9f92700 1 -- 172.21.15.73:0/1557899466 >> 172.21.15.73:0/1557899466 conn(0x7feaa4066cf0 msgr2=0x7feaa41491e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:44.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.112+0000 7feaa9f92700 1 -- 172.21.15.73:0/1557899466 shutdown_connections 2024-05-08T21:49:44.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.112+0000 7feaa9f92700 1 -- 172.21.15.73:0/1557899466 wait complete. 2024-05-08T21:49:44.124 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T21:49:44.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.247+0000 7fad90622700 1 Processor -- start 2024-05-08T21:49:44.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.247+0000 7fad90622700 1 -- start start 2024-05-08T21:49:44.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.248+0000 7fad90622700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fad88072080 0x7fad88072460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:44.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.248+0000 7fad90622700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fad880c3a00 0x7fad88161350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:44.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.248+0000 7fad90622700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad880c3f10 con 0x7fad880c3490 2024-05-08T21:49:44.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.248+0000 7fad90622700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad880729a0 con 0x7fad88072080 2024-05-08T21:49:44.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.248+0000 7fad90622700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad880c41b0 con 0x7fad880c3a00 2024-05-08T21:49:44.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.248+0000 7fad8e3be700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fad88072080 0x7fad88072460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:44.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.248+0000 7fad8e3be700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fad88072080 0x7fad88072460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43716/0 (socket says 172.21.15.73:43716) 2024-05-08T21:49:44.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.248+0000 7fad8e3be700 1 -- 172.21.15.73:0/2804709972 learned_addr learned my addr 172.21.15.73:0/2804709972 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:44.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.248+0000 7fad8ebbf700 1 --2- 172.21.15.73:0/2804709972 >> v2:172.21.15.115:3300/0 conn(0x7fad880c3a00 0x7fad88161350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:44.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.248+0000 7fad8e3be700 1 -- 172.21.15.73:0/2804709972 >> v2:172.21.15.115:3300/0 conn(0x7fad880c3a00 msgr2=0x7fad88161350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:44.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.248+0000 7fad8e3be700 1 --2- 172.21.15.73:0/2804709972 >> v2:172.21.15.115:3300/0 conn(0x7fad880c3a00 0x7fad88161350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:44.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.248+0000 7fad8e3be700 1 -- 172.21.15.73:0/2804709972 >> v1:172.21.15.115:6789/0 conn(0x7fad880c3490 legacy=0x7fad88156dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:44.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.248+0000 7fad8e3be700 1 -- 172.21.15.73:0/2804709972 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad880c7820 con 0x7fad88072080 2024-05-08T21:49:44.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.248+0000 7fad8e3be700 1 --2- 172.21.15.73:0/2804709972 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad88072080 0x7fad88072460 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fad880702d0 tx=0x7fad78009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3541594d559732d4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:44.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.248+0000 7fad8d3bc700 1 -- 172.21.15.73:0/2804709972 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad78004230 con 0x7fad88072080 2024-05-08T21:49:44.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.248+0000 7fad8d3bc700 1 -- 172.21.15.73:0/2804709972 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad78004390 con 0x7fad88072080 2024-05-08T21:49:44.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.248+0000 7fad8d3bc700 1 -- 172.21.15.73:0/2804709972 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad780036a0 con 0x7fad88072080 2024-05-08T21:49:44.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.249+0000 7fad90622700 1 -- 172.21.15.73:0/2804709972 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad88072080 msgr2=0x7fad88072460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:44.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.249+0000 7fad90622700 1 --2- 172.21.15.73:0/2804709972 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad88072080 0x7fad88072460 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fad880702d0 tx=0x7fad78009bd0 comp rx=0 tx=0).stop 2024-05-08T21:49:44.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.249+0000 7fad90622700 1 -- 172.21.15.73:0/2804709972 shutdown_connections 2024-05-08T21:49:44.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.249+0000 7fad90622700 1 --2- 172.21.15.73:0/2804709972 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad88072080 0x7fad88072460 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:44.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.249+0000 7fad90622700 1 --2- 172.21.15.73:0/2804709972 >> v2:172.21.15.115:3300/0 conn(0x7fad880c3a00 0x7fad88161350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:44.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.249+0000 7fad90622700 1 -- 172.21.15.73:0/2804709972 >> 172.21.15.73:0/2804709972 conn(0x7fad88066d70 msgr2=0x7fad880cc500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:44.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.249+0000 7fad90622700 1 -- 172.21.15.73:0/2804709972 shutdown_connections 2024-05-08T21:49:44.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.249+0000 7fad90622700 1 -- 172.21.15.73:0/2804709972 wait complete. 2024-05-08T21:49:44.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.250+0000 7fad90622700 1 Processor -- start 2024-05-08T21:49:44.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.250+0000 7fad90622700 1 -- start start 2024-05-08T21:49:44.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.251+0000 7fad90622700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad88072080 0x7fad881546d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:44.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.251+0000 7fad90622700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad880c3490 0x7fad881ee010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:44.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.251+0000 7fad90622700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad880c3a00 0x7fad88159e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:44.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.251+0000 7fad90622700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad88155c00 con 0x7fad880c3490 2024-05-08T21:49:44.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.251+0000 7fad90622700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad881598c0 con 0x7fad880c3a00 2024-05-08T21:49:44.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.251+0000 7fad90622700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad88154d10 con 0x7fad88072080 2024-05-08T21:49:44.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.251+0000 7fad8dbbd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad880c3490 0x7fad881ee010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:44.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.251+0000 7fad8dbbd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad880c3490 0x7fad881ee010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43732/0 (socket says 172.21.15.73:43732) 2024-05-08T21:49:44.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.251+0000 7fad8dbbd700 1 -- 172.21.15.73:0/3971395638 learned_addr learned my addr 172.21.15.73:0/3971395638 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:44.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.251+0000 7fad8e3be700 1 --2- 172.21.15.73:0/3971395638 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad88072080 0x7fad881546d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:44.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.251+0000 7fad8ebbf700 1 --2- 172.21.15.73:0/3971395638 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad880c3a00 0x7fad88159e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:44.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.251+0000 7fad8dbbd700 1 -- 172.21.15.73:0/3971395638 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad88072080 msgr2=0x7fad881546d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:44.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.251+0000 7fad8dbbd700 1 --2- 172.21.15.73:0/3971395638 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad88072080 0x7fad881546d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:44.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.251+0000 7fad8dbbd700 1 -- 172.21.15.73:0/3971395638 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad880c3a00 msgr2=0x7fad88159e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:44.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.251+0000 7fad8dbbd700 1 --2- 172.21.15.73:0/3971395638 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad880c3a00 0x7fad88159e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:44.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.251+0000 7fad8dbbd700 1 -- 172.21.15.73:0/3971395638 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad78009550 con 0x7fad880c3490 2024-05-08T21:49:44.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.251+0000 7fad8dbbd700 1 --2- 172.21.15.73:0/3971395638 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad880c3490 0x7fad881ee010 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fad8400c4a0 tx=0x7fad8400c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:44.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.251+0000 7fad7effd700 1 -- 172.21.15.73:0/3971395638 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad840054e0 con 0x7fad880c3490 2024-05-08T21:49:44.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.251+0000 7fad7effd700 1 -- 172.21.15.73:0/3971395638 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad84003680 con 0x7fad880c3490 2024-05-08T21:49:44.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.251+0000 7fad90622700 1 -- 172.21.15.73:0/3971395638 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad88154ff0 con 0x7fad880c3490 2024-05-08T21:49:44.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.251+0000 7fad7effd700 1 -- 172.21.15.73:0/3971395638 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad84003a10 con 0x7fad880c3490 2024-05-08T21:49:44.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.251+0000 7fad90622700 1 -- 172.21.15.73:0/3971395638 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad881555b0 con 0x7fad880c3490 2024-05-08T21:49:44.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.252+0000 7fad90622700 1 -- 172.21.15.73:0/3971395638 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad88068b80 con 0x7fad880c3490 2024-05-08T21:49:44.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.253+0000 7fad7effd700 1 -- 172.21.15.73:0/3971395638 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fad84003b70 con 0x7fad880c3490 2024-05-08T21:49:44.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.253+0000 7fad7effd700 1 --2- 172.21.15.73:0/3971395638 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fad6c06ac90 0x7fad6c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:44.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.253+0000 7fad7effd700 1 -- 172.21.15.73:0/3971395638 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fad840885d0 con 0x7fad880c3490 2024-05-08T21:49:44.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.253+0000 7fad8e3be700 1 --2- 172.21.15.73:0/3971395638 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fad6c06ac90 0x7fad6c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:44.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.254+0000 7fad8e3be700 1 --2- 172.21.15.73:0/3971395638 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fad6c06ac90 0x7fad6c06d150 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fad78009130 tx=0x7fad78008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:44.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.258+0000 7fad7effd700 1 -- 172.21.15.73:0/3971395638 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fad84053860 con 0x7fad880c3490 2024-05-08T21:49:44.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.454+0000 7fad90622700 1 -- 172.21.15.73:0/3971395638 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fad88155d40 con 0x7fad880c3490 2024-05-08T21:49:44.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.455+0000 7fad7effd700 1 -- 172.21.15.73:0/3971395638 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16050 (secure 0 0 0) 0x7fad84017090 con 0x7fad880c3490 2024-05-08T21:49:44.455 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:49:44.456 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":20,"fsid":"143164b7-c9c7-4737-a494-7dafa5a3320c","created":"2024-05-08T21:49:26.221909+0000","modified":"2024-05-08T21:49:43.746853+0000","last_up_change":"2024-05-08T21:49:37.118386+0000","last_in_change":"2024-05-08T21:49:28.836944+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T21:49:35.998578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T21:49:42.171760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T21:49:42.576293+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6b7439c1-daaa-44af-8333-a455f9e9dc67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":47228},{"type":"v1","addr":"172.21.15.73:6809","nonce":47228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":47228},{"type":"v1","addr":"172.21.15.73:6811","nonce":47228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":47228},{"type":"v1","addr":"172.21.15.73:6815","nonce":47228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":47228},{"type":"v1","addr":"172.21.15.73:6813","nonce":47228}]},"public_addr":"172.21.15.73:6809/47228","cluster_addr":"172.21.15.73:6811/47228","heartbeat_back_addr":"172.21.15.73:6815/47228","heartbeat_front_addr":"172.21.15.73:6813/47228","state":["exists","up"]},{"osd":1,"uuid":"fb67886a-d7f7-45ac-832f-36c871c8a208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":47227},{"type":"v1","addr":"172.21.15.73:6801","nonce":47227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":47227},{"type":"v1","addr":"172.21.15.73:6803","nonce":47227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":47227},{"type":"v1","addr":"172.21.15.73:6807","nonce":47227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":47227},{"type":"v1","addr":"172.21.15.73:6805","nonce":47227}]},"public_addr":"172.21.15.73:6801/47227","cluster_addr":"172.21.15.73:6803/47227","heartbeat_back_addr":"172.21.15.73:6807/47227","heartbeat_front_addr":"172.21.15.73:6805/47227","state":["exists","up"]},{"osd":2,"uuid":"a5cd6e98-6621-473a-bfb8-5c648abbb563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":47229},{"type":"v1","addr":"172.21.15.73:6817","nonce":47229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":47229},{"type":"v1","addr":"172.21.15.73:6819","nonce":47229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":47229},{"type":"v1","addr":"172.21.15.73:6823","nonce":47229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":47229},{"type":"v1","addr":"172.21.15.73:6821","nonce":47229}]},"public_addr":"172.21.15.73:6817/47229","cluster_addr":"172.21.15.73:6819/47229","heartbeat_back_addr":"172.21.15.73:6823/47229","heartbeat_front_addr":"172.21.15.73:6821/47229","state":["exists","up"]},{"osd":3,"uuid":"36927c20-4241-4f3b-91b5-a6a6f27598e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":47232},{"type":"v1","addr":"172.21.15.73:6825","nonce":47232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":47232},{"type":"v1","addr":"172.21.15.73:6827","nonce":47232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":47232},{"type":"v1","addr":"172.21.15.73:6831","nonce":47232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":47232},{"type":"v1","addr":"172.21.15.73:6829","nonce":47232}]},"public_addr":"172.21.15.73:6825/47232","cluster_addr":"172.21.15.73:6827/47232","heartbeat_back_addr":"172.21.15.73:6831/47232","heartbeat_front_addr":"172.21.15.73:6829/47232","state":["exists","up"]},{"osd":4,"uuid":"4ebe0a18-8216-4815-878a-39c39a6cd3fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":47200},{"type":"v1","addr":"172.21.15.115:6801","nonce":47200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":47200},{"type":"v1","addr":"172.21.15.115:6803","nonce":47200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":47200},{"type":"v1","addr":"172.21.15.115:6807","nonce":47200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":47200},{"type":"v1","addr":"172.21.15.115:6805","nonce":47200}]},"public_addr":"172.21.15.115:6801/47200","cluster_addr":"172.21.15.115:6803/47200","heartbeat_back_addr":"172.21.15.115:6807/47200","heartbeat_front_addr":"172.21.15.115:6805/47200","state":["exists","up"]},{"osd":5,"uuid":"957f0ac1-5f26-4f02-8c05-488e6b67ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":47201},{"type":"v1","addr":"172.21.15.115:6809","nonce":47201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":47201},{"type":"v1","addr":"172.21.15.115:6811","nonce":47201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":47201},{"type":"v1","addr":"172.21.15.115:6815","nonce":47201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":47201},{"type":"v1","addr":"172.21.15.115:6813","nonce":47201}]},"public_addr":"172.21.15.115:6809/47201","cluster_addr":"172.21.15.115:6811/47201","heartbeat_back_addr":"172.21.15.115:6815/47201","heartbeat_front_addr":"172.21.15.115:6813/47201","state":["exists","up"]},{"osd":6,"uuid":"f5a6768f-ba7f-4f66-b335-0c303b158e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":47202},{"type":"v1","addr":"172.21.15.115:6817","nonce":47202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":47202},{"type":"v1","addr":"172.21.15.115:6819","nonce":47202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":47202},{"type":"v1","addr":"172.21.15.115:6823","nonce":47202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":47202},{"type":"v1","addr":"172.21.15.115:6821","nonce":47202}]},"public_addr":"172.21.15.115:6817/47202","cluster_addr":"172.21.15.115:6819/47202","heartbeat_back_addr":"172.21.15.115:6823/47202","heartbeat_front_addr":"172.21.15.115:6821/47202","state":["exists","up"]},{"osd":7,"uuid":"f4187743-f9e6-42e6-aca9-0604a58db1ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":47211},{"type":"v1","addr":"172.21.15.115:6825","nonce":47211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":47211},{"type":"v1","addr":"172.21.15.115:6827","nonce":47211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":47211},{"type":"v1","addr":"172.21.15.115:6831","nonce":47211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":47211},{"type":"v1","addr":"172.21.15.115:6829","nonce":47211}]},"public_addr":"172.21.15.115:6825/47211","cluster_addr":"172.21.15.115:6827/47211","heartbeat_back_addr":"172.21.15.115:6831/47211","heartbeat_front_addr":"172.21.15.115:6829/47211","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:33.996335+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:33.687451+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:34.072549+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:33.997588+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:34.047260+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:34.876272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:33.965472+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:34.038637+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T21:49:44.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.458+0000 7fad90622700 1 -- 172.21.15.73:0/3971395638 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fad6c06ac90 msgr2=0x7fad6c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:44.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.458+0000 7fad90622700 1 --2- 172.21.15.73:0/3971395638 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fad6c06ac90 0x7fad6c06d150 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fad78009130 tx=0x7fad78008030 comp rx=0 tx=0).stop 2024-05-08T21:49:44.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.458+0000 7fad90622700 1 -- 172.21.15.73:0/3971395638 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad880c3490 msgr2=0x7fad881ee010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:44.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.458+0000 7fad90622700 1 --2- 172.21.15.73:0/3971395638 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad880c3490 0x7fad881ee010 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fad8400c4a0 tx=0x7fad8400c7b0 comp rx=0 tx=0).stop 2024-05-08T21:49:44.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.458+0000 7fad90622700 1 -- 172.21.15.73:0/3971395638 shutdown_connections 2024-05-08T21:49:44.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.458+0000 7fad90622700 1 --2- 172.21.15.73:0/3971395638 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fad6c06ac90 0x7fad6c06d150 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:44.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.458+0000 7fad90622700 1 --2- 172.21.15.73:0/3971395638 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad880c3a00 0x7fad88159e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:44.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.458+0000 7fad90622700 1 --2- 172.21.15.73:0/3971395638 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad88072080 0x7fad881546d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:44.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.458+0000 7fad90622700 1 --2- 172.21.15.73:0/3971395638 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad880c3490 0x7fad881ee010 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:44.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.458+0000 7fad90622700 1 -- 172.21.15.73:0/3971395638 >> 172.21.15.73:0/3971395638 conn(0x7fad88066d70 msgr2=0x7fad88073bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:44.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.458+0000 7fad90622700 1 -- 172.21.15.73:0/3971395638 shutdown_connections 2024-05-08T21:49:44.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.458+0000 7fad90622700 1 -- 172.21.15.73:0/3971395638 wait complete. 2024-05-08T21:49:44.470 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-08T21:49:44.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.594+0000 7f975eb45700 1 Processor -- start 2024-05-08T21:49:44.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.594+0000 7f975eb45700 1 -- start start 2024-05-08T21:49:44.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.595+0000 7f975eb45700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9758153eb0 0x7f9758071a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:44.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.595+0000 7f975eb45700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f975806b4d0 0x7f9758071fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:44.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.595+0000 7f975eb45700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9758159e20 con 0x7f97580725a0 2024-05-08T21:49:44.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.595+0000 7f975eb45700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97580c3ca0 con 0x7f975806b4d0 2024-05-08T21:49:44.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.595+0000 7f975eb45700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9758159c10 con 0x7f9758153eb0 2024-05-08T21:49:44.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.595+0000 7f975d0e2700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f975806b4d0 0x7f9758071fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:44.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.595+0000 7f975d0e2700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f975806b4d0 0x7f9758071fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43742/0 (socket says 172.21.15.73:43742) 2024-05-08T21:49:44.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.595+0000 7f9757fff700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f97580725a0 0x7f975806adc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:60346/0 (socket says 172.21.15.73:60346) 2024-05-08T21:49:44.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.595+0000 7f975d0e2700 1 -- 172.21.15.73:0/2915270814 learned_addr learned my addr 172.21.15.73:0/2915270814 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:44.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.595+0000 7f975c8e1700 1 --2- 172.21.15.73:0/2915270814 >> v2:172.21.15.115:3300/0 conn(0x7f9758153eb0 0x7f9758071a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:44.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.595+0000 7f975d0e2700 1 -- 172.21.15.73:0/2915270814 >> v2:172.21.15.115:3300/0 conn(0x7f9758153eb0 msgr2=0x7f9758071a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:44.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.595+0000 7f975d0e2700 1 --2- 172.21.15.73:0/2915270814 >> v2:172.21.15.115:3300/0 conn(0x7f9758153eb0 0x7f9758071a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:44.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.595+0000 7f975d0e2700 1 -- 172.21.15.73:0/2915270814 >> v1:172.21.15.73:6789/0 conn(0x7f97580725a0 legacy=0x7f975806adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:44.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.595+0000 7f975d0e2700 1 -- 172.21.15.73:0/2915270814 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f975815a0c0 con 0x7f975806b4d0 2024-05-08T21:49:44.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.595+0000 7f975c8e1700 1 --2- 172.21.15.73:0/2915270814 >> v2:172.21.15.115:3300/0 conn(0x7f9758153eb0 0x7f9758071a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:49:44.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.595+0000 7f975d0e2700 1 --2- 172.21.15.73:0/2915270814 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f975806b4d0 0x7f9758071fa0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f975806ffb0 tx=0x7f975000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f5865976b8b9ec0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:44.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.595+0000 7f97577fe700 1 -- 172.21.15.73:0/2915270814 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975000e070 con 0x7f975806b4d0 2024-05-08T21:49:44.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.595+0000 7f97577fe700 1 -- 172.21.15.73:0/2915270814 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f975000b9c0 con 0x7f975806b4d0 2024-05-08T21:49:44.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.595+0000 7f97577fe700 1 -- 172.21.15.73:0/2915270814 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975000bd70 con 0x7f975806b4d0 2024-05-08T21:49:44.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.596+0000 7f975eb45700 1 -- 172.21.15.73:0/2915270814 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f975806b4d0 msgr2=0x7f9758071fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:44.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.596+0000 7f975eb45700 1 --2- 172.21.15.73:0/2915270814 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f975806b4d0 0x7f9758071fa0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f975806ffb0 tx=0x7f975000b330 comp rx=0 tx=0).stop 2024-05-08T21:49:44.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.596+0000 7f975eb45700 1 -- 172.21.15.73:0/2915270814 shutdown_connections 2024-05-08T21:49:44.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.596+0000 7f975eb45700 1 --2- 172.21.15.73:0/2915270814 >> v2:172.21.15.115:3300/0 conn(0x7f9758153eb0 0x7f9758071a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:44.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.596+0000 7f975eb45700 1 --2- 172.21.15.73:0/2915270814 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f975806b4d0 0x7f9758071fa0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:44.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.596+0000 7f975eb45700 1 -- 172.21.15.73:0/2915270814 >> 172.21.15.73:0/2915270814 conn(0x7f9758066ab0 msgr2=0x7f975806f550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:44.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.596+0000 7f975eb45700 1 -- 172.21.15.73:0/2915270814 shutdown_connections 2024-05-08T21:49:44.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.596+0000 7f975eb45700 1 -- 172.21.15.73:0/2915270814 wait complete. 2024-05-08T21:49:44.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.597+0000 7f975eb45700 1 Processor -- start 2024-05-08T21:49:44.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.597+0000 7f975eb45700 1 -- start start 2024-05-08T21:49:44.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.598+0000 7f975eb45700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f975806b4d0 0x7f975814abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:44.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.598+0000 7f975eb45700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f97580725a0 0x7f97581509d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:44.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.598+0000 7f975eb45700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9758153eb0 0x7f97581f2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:44.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.598+0000 7f975eb45700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f975814b0f0 con 0x7f9758153eb0 2024-05-08T21:49:44.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.598+0000 7f975eb45700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f975814dac0 con 0x7f975806b4d0 2024-05-08T21:49:44.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.598+0000 7f975eb45700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f975814e130 con 0x7f97580725a0 2024-05-08T21:49:44.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.598+0000 7f975d0e2700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9758153eb0 0x7f97581f2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:44.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.598+0000 7f975d0e2700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9758153eb0 0x7f97581f2d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43756/0 (socket says 172.21.15.73:43756) 2024-05-08T21:49:44.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.598+0000 7f975d0e2700 1 -- 172.21.15.73:0/3025824933 learned_addr learned my addr 172.21.15.73:0/3025824933 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:44.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.598+0000 7f975c8e1700 1 --2- 172.21.15.73:0/3025824933 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f975806b4d0 0x7f975814abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:44.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.598+0000 7f9757fff700 1 --2- 172.21.15.73:0/3025824933 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f97580725a0 0x7f97581509d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:44.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.598+0000 7f975d0e2700 1 -- 172.21.15.73:0/3025824933 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f97580725a0 msgr2=0x7f97581509d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:44.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.598+0000 7f975d0e2700 1 --2- 172.21.15.73:0/3025824933 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f97580725a0 0x7f97581509d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:44.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.598+0000 7f975d0e2700 1 -- 172.21.15.73:0/3025824933 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f975806b4d0 msgr2=0x7f975814abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:44.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.598+0000 7f975d0e2700 1 --2- 172.21.15.73:0/3025824933 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f975806b4d0 0x7f975814abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:44.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.598+0000 7f975d0e2700 1 -- 172.21.15.73:0/3025824933 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9750009b30 con 0x7f9758153eb0 2024-05-08T21:49:44.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.598+0000 7f975d0e2700 1 --2- 172.21.15.73:0/3025824933 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9758153eb0 0x7f97581f2d90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f975000b730 tx=0x7f9750004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:44.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.599+0000 7f97557fa700 1 -- 172.21.15.73:0/3025824933 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97500099b0 con 0x7f9758153eb0 2024-05-08T21:49:44.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.599+0000 7f97557fa700 1 -- 172.21.15.73:0/3025824933 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97500092e0 con 0x7f9758153eb0 2024-05-08T21:49:44.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.599+0000 7f975eb45700 1 -- 172.21.15.73:0/3025824933 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f975814e410 con 0x7f9758153eb0 2024-05-08T21:49:44.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.599+0000 7f97557fa700 1 -- 172.21.15.73:0/3025824933 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975001c660 con 0x7f9758153eb0 2024-05-08T21:49:44.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.599+0000 7f975eb45700 1 -- 172.21.15.73:0/3025824933 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f975814e9d0 con 0x7f9758153eb0 2024-05-08T21:49:44.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.599+0000 7f975eb45700 1 -- 172.21.15.73:0/3025824933 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97581f2be0 con 0x7f9758153eb0 2024-05-08T21:49:44.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.600+0000 7f97557fa700 1 -- 172.21.15.73:0/3025824933 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f975001c7c0 con 0x7f9758153eb0 2024-05-08T21:49:44.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.600+0000 7f97557fa700 1 --2- 172.21.15.73:0/3025824933 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f973c06ac90 0x7f973c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:44.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.600+0000 7f97557fa700 1 -- 172.21.15.73:0/3025824933 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f975008aa80 con 0x7f9758153eb0 2024-05-08T21:49:44.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.600+0000 7f975c8e1700 1 --2- 172.21.15.73:0/3025824933 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f973c06ac90 0x7f973c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:44.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.601+0000 7f975c8e1700 1 --2- 172.21.15.73:0/3025824933 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f973c06ac90 0x7f973c06d150 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f974c006fd0 tx=0x7f974c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:44.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.605+0000 7f97557fa700 1 -- 172.21.15.73:0/3025824933 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f9750055c60 con 0x7f9758153eb0 2024-05-08T21:49:44.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:44.847+0000 7f975eb45700 1 -- 172.21.15.73:0/3025824933 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f9758068b80 con 0x7f9758153eb0 2024-05-08T21:49:45.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.756+0000 7f97557fa700 1 -- 172.21.15.73:0/3025824933 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) v1 ==== 118+0+0 (secure 0 0 0) 0x7f9750059280 con 0x7f9758153eb0 2024-05-08T21:49:45.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.758+0000 7f975eb45700 1 -- 172.21.15.73:0/3025824933 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f973c06ac90 msgr2=0x7f973c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:45.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.758+0000 7f975eb45700 1 --2- 172.21.15.73:0/3025824933 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f973c06ac90 0x7f973c06d150 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f974c006fd0 tx=0x7f974c008040 comp rx=0 tx=0).stop 2024-05-08T21:49:45.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.758+0000 7f975eb45700 1 -- 172.21.15.73:0/3025824933 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9758153eb0 msgr2=0x7f97581f2d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:45.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.758+0000 7f975eb45700 1 --2- 172.21.15.73:0/3025824933 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9758153eb0 0x7f97581f2d90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f975000b730 tx=0x7f9750004ad0 comp rx=0 tx=0).stop 2024-05-08T21:49:45.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.758+0000 7f975eb45700 1 -- 172.21.15.73:0/3025824933 shutdown_connections 2024-05-08T21:49:45.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.759+0000 7f975eb45700 1 --2- 172.21.15.73:0/3025824933 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f973c06ac90 0x7f973c06d150 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:45.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.759+0000 7f975eb45700 1 --2- 172.21.15.73:0/3025824933 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9758153eb0 0x7f97581f2d90 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:45.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.759+0000 7f975eb45700 1 --2- 172.21.15.73:0/3025824933 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f975806b4d0 0x7f975814abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:45.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.759+0000 7f975eb45700 1 --2- 172.21.15.73:0/3025824933 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f97580725a0 0x7f97581509d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:45.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.759+0000 7f975eb45700 1 -- 172.21.15.73:0/3025824933 >> 172.21.15.73:0/3025824933 conn(0x7f9758066ab0 msgr2=0x7f97580c6f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:45.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.759+0000 7f975eb45700 1 -- 172.21.15.73:0/3025824933 shutdown_connections 2024-05-08T21:49:45.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.759+0000 7f975eb45700 1 -- 172.21.15.73:0/3025824933 wait complete. 2024-05-08T21:49:45.774 DEBUG:tasks.cephfs.filesystem:fs_config: {'session_timeout': 300} 2024-05-08T21:49:45.774 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-08T21:49:45.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.903+0000 7f4b53cf1700 1 Processor -- start 2024-05-08T21:49:45.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.903+0000 7f4b53cf1700 1 -- start start 2024-05-08T21:49:45.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.904+0000 7f4b53cf1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4b4c153d20 0x7f4b4c0c8020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:45.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.904+0000 7f4b53cf1700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4b4c0c64f0 0x7f4b4c159b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:45.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.904+0000 7f4b53cf1700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b4c06b1f0 con 0x7f4b4c06ad80 2024-05-08T21:49:45.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.904+0000 7f4b53cf1700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b4c072670 con 0x7f4b4c0c64f0 2024-05-08T21:49:45.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.904+0000 7f4b53cf1700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c072910 con 0x7f4b4c153d20 2024-05-08T21:49:45.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.904+0000 7f4b5128c700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4b4c0c64f0 0x7f4b4c159b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:45.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.904+0000 7f4b5128c700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4b4c0c64f0 0x7f4b4c159b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43764/0 (socket says 172.21.15.73:43764) 2024-05-08T21:49:45.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.904+0000 7f4b5128c700 1 -- 172.21.15.73:0/1251099523 learned_addr learned my addr 172.21.15.73:0/1251099523 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:45.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.905+0000 7f4b51a8d700 1 --2- 172.21.15.73:0/1251099523 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4b4c153d20 0x7f4b4c0c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:45.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.905+0000 7f4b5128c700 1 -- 172.21.15.73:0/1251099523 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4b4c153d20 msgr2=0x7f4b4c0c8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:45.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.905+0000 7f4b5128c700 1 --2- 172.21.15.73:0/1251099523 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4b4c153d20 0x7f4b4c0c8020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:45.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.905+0000 7f4b5128c700 1 -- 172.21.15.73:0/1251099523 >> v1:172.21.15.115:6789/0 conn(0x7f4b4c06ad80 legacy=0x7f4b4c0719b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:45.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.905+0000 7f4b5128c700 1 -- 172.21.15.73:0/1251099523 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b4c0c7820 con 0x7f4b4c0c64f0 2024-05-08T21:49:45.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.905+0000 7f4b5128c700 1 --2- 172.21.15.73:0/1251099523 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b4c0c64f0 0x7f4b4c159b70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4b480098f0 tx=0x7f4b48009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1121bd7937b958b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:45.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.905+0000 7f4b50a8b700 1 -- 172.21.15.73:0/1251099523 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b48004230 con 0x7f4b4c0c64f0 2024-05-08T21:49:45.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.905+0000 7f4b50a8b700 1 -- 172.21.15.73:0/1251099523 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b48004390 con 0x7f4b4c0c64f0 2024-05-08T21:49:45.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.905+0000 7f4b50a8b700 1 -- 172.21.15.73:0/1251099523 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b480036a0 con 0x7f4b4c0c64f0 2024-05-08T21:49:45.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.905+0000 7f4b53cf1700 1 -- 172.21.15.73:0/1251099523 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b4c0c64f0 msgr2=0x7f4b4c159b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:45.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.905+0000 7f4b53cf1700 1 --2- 172.21.15.73:0/1251099523 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b4c0c64f0 0x7f4b4c159b70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4b480098f0 tx=0x7f4b48009c00 comp rx=0 tx=0).stop 2024-05-08T21:49:45.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.906+0000 7f4b53cf1700 1 -- 172.21.15.73:0/1251099523 shutdown_connections 2024-05-08T21:49:45.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.906+0000 7f4b53cf1700 1 --2- 172.21.15.73:0/1251099523 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4b4c153d20 0x7f4b4c0c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:45.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.906+0000 7f4b53cf1700 1 --2- 172.21.15.73:0/1251099523 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b4c0c64f0 0x7f4b4c159b70 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:45.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.906+0000 7f4b53cf1700 1 -- 172.21.15.73:0/1251099523 >> 172.21.15.73:0/1251099523 conn(0x7f4b4c066ab0 msgr2=0x7f4b4c06f550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:45.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.906+0000 7f4b53cf1700 1 -- 172.21.15.73:0/1251099523 shutdown_connections 2024-05-08T21:49:45.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.906+0000 7f4b53cf1700 1 -- 172.21.15.73:0/1251099523 wait complete. 2024-05-08T21:49:45.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.907+0000 7f4b53cf1700 1 Processor -- start 2024-05-08T21:49:45.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.907+0000 7f4b53cf1700 1 -- start start 2024-05-08T21:49:45.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.907+0000 7f4b53cf1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4b4c06ad80 0x7f4b4c14c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:45.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.907+0000 7f4b53cf1700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b4c0c64f0 0x7f4b4c15d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:45.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.907+0000 7f4b53cf1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b4c153d20 0x7f4b4c14a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:45.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.907+0000 7f4b53cf1700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c14c640 con 0x7f4b4c153d20 2024-05-08T21:49:45.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.907+0000 7f4b53cf1700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c0cc390 con 0x7f4b4c0c64f0 2024-05-08T21:49:45.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.907+0000 7f4b53cf1700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c1ef400 con 0x7f4b4c06ad80 2024-05-08T21:49:45.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.908+0000 7f4b5228e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b4c153d20 0x7f4b4c14a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:45.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.908+0000 7f4b5228e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b4c153d20 0x7f4b4c14a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43772/0 (socket says 172.21.15.73:43772) 2024-05-08T21:49:45.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.908+0000 7f4b5228e700 1 -- 172.21.15.73:0/1424333012 learned_addr learned my addr 172.21.15.73:0/1424333012 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:45.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.908+0000 7f4b51a8d700 1 --2- 172.21.15.73:0/1424333012 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4b4c06ad80 0x7f4b4c14c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:45.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.908+0000 7f4b5128c700 1 --2- 172.21.15.73:0/1424333012 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b4c0c64f0 0x7f4b4c15d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:45.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.908+0000 7f4b5228e700 1 -- 172.21.15.73:0/1424333012 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4b4c06ad80 msgr2=0x7f4b4c14c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:45.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.908+0000 7f4b5228e700 1 --2- 172.21.15.73:0/1424333012 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4b4c06ad80 0x7f4b4c14c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:45.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.908+0000 7f4b5228e700 1 -- 172.21.15.73:0/1424333012 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b4c0c64f0 msgr2=0x7f4b4c15d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:45.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.908+0000 7f4b5228e700 1 --2- 172.21.15.73:0/1424333012 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b4c0c64f0 0x7f4b4c15d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:45.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.908+0000 7f4b5228e700 1 -- 172.21.15.73:0/1424333012 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b48009550 con 0x7f4b4c153d20 2024-05-08T21:49:45.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.908+0000 7f4b5228e700 1 --2- 172.21.15.73:0/1424333012 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b4c153d20 0x7f4b4c14a510 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4b4400c7a0 tx=0x7f4b4400cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:45.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.908+0000 7f4b427fc700 1 -- 172.21.15.73:0/1424333012 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b44003e10 con 0x7f4b4c153d20 2024-05-08T21:49:45.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.908+0000 7f4b427fc700 1 -- 172.21.15.73:0/1424333012 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b44005070 con 0x7f4b4c153d20 2024-05-08T21:49:45.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.908+0000 7f4b53cf1700 1 -- 172.21.15.73:0/1424333012 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b4c1ef6e0 con 0x7f4b4c153d20 2024-05-08T21:49:45.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.908+0000 7f4b427fc700 1 -- 172.21.15.73:0/1424333012 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b44005420 con 0x7f4b4c153d20 2024-05-08T21:49:45.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.908+0000 7f4b53cf1700 1 -- 172.21.15.73:0/1424333012 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b4c1efca0 con 0x7f4b4c153d20 2024-05-08T21:49:45.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.909+0000 7f4b53cf1700 1 -- 172.21.15.73:0/1424333012 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b4c1efe90 con 0x7f4b4c153d20 2024-05-08T21:49:45.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.909+0000 7f4b427fc700 1 -- 172.21.15.73:0/1424333012 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4b44005580 con 0x7f4b4c153d20 2024-05-08T21:49:45.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.910+0000 7f4b427fc700 1 --2- 172.21.15.73:0/1424333012 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f4b3006ac90 0x7f4b3006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:45.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.910+0000 7f4b427fc700 1 -- 172.21.15.73:0/1424333012 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4b44088a30 con 0x7f4b4c153d20 2024-05-08T21:49:45.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.910+0000 7f4b51a8d700 1 --2- 172.21.15.73:0/1424333012 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f4b3006ac90 0x7f4b3006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:45.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.910+0000 7f4b51a8d700 1 --2- 172.21.15.73:0/1424333012 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f4b3006ac90 0x7f4b3006d150 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c00a950 tx=0x7f4b3c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:45.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:45.914+0000 7f4b427fc700 1 -- 172.21.15.73:0/1424333012 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f4b44053c10 con 0x7f4b4c153d20 2024-05-08T21:49:46.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.157+0000 7f4b53cf1700 1 -- 172.21.15.73:0/1424333012 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f4b4c068b80 con 0x7f4b4c153d20 2024-05-08T21:49:46.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.759+0000 7f4b427fc700 1 -- 172.21.15.73:0/1424333012 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4b44017070 con 0x7f4b4c153d20 2024-05-08T21:49:46.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.762+0000 7f4b53cf1700 1 -- 172.21.15.73:0/1424333012 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f4b3006ac90 msgr2=0x7f4b3006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:46.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.762+0000 7f4b53cf1700 1 --2- 172.21.15.73:0/1424333012 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f4b3006ac90 0x7f4b3006d150 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c00a950 tx=0x7f4b3c008040 comp rx=0 tx=0).stop 2024-05-08T21:49:46.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.762+0000 7f4b53cf1700 1 -- 172.21.15.73:0/1424333012 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b4c153d20 msgr2=0x7f4b4c14a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:46.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.762+0000 7f4b53cf1700 1 --2- 172.21.15.73:0/1424333012 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b4c153d20 0x7f4b4c14a510 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4b4400c7a0 tx=0x7f4b4400cb60 comp rx=0 tx=0).stop 2024-05-08T21:49:46.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.762+0000 7f4b53cf1700 1 -- 172.21.15.73:0/1424333012 shutdown_connections 2024-05-08T21:49:46.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.762+0000 7f4b53cf1700 1 --2- 172.21.15.73:0/1424333012 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f4b3006ac90 0x7f4b3006d150 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:46.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.762+0000 7f4b53cf1700 1 --2- 172.21.15.73:0/1424333012 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b4c153d20 0x7f4b4c14a510 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:46.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.762+0000 7f4b53cf1700 1 --2- 172.21.15.73:0/1424333012 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4b4c06ad80 0x7f4b4c14c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:46.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.762+0000 7f4b53cf1700 1 --2- 172.21.15.73:0/1424333012 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b4c0c64f0 0x7f4b4c15d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:46.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.762+0000 7f4b53cf1700 1 -- 172.21.15.73:0/1424333012 >> 172.21.15.73:0/1424333012 conn(0x7f4b4c066ab0 msgr2=0x7f4b4c0719b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:46.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.762+0000 7f4b53cf1700 1 -- 172.21.15.73:0/1424333012 shutdown_connections 2024-05-08T21:49:46.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.762+0000 7f4b53cf1700 1 -- 172.21.15.73:0/1424333012 wait complete. 2024-05-08T21:49:46.776 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-05-08T21:49:46.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.902+0000 7ffa439d9700 1 Processor -- start 2024-05-08T21:49:46.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.903+0000 7ffa439d9700 1 -- start start 2024-05-08T21:49:46.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.903+0000 7ffa439d9700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffa3c14e630 0x7ffa3c157a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:46.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.903+0000 7ffa439d9700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ffa3c06ff30 0x7ffa3c0c9340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:46.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.903+0000 7ffa439d9700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa3c14ea10 con 0x7ffa3c0c4330 2024-05-08T21:49:46.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.903+0000 7ffa439d9700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa3c06f790 con 0x7ffa3c06ff30 2024-05-08T21:49:46.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.903+0000 7ffa439d9700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3c0c2710 con 0x7ffa3c14e630 2024-05-08T21:49:46.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.903+0000 7ffa40f74700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ffa3c06ff30 0x7ffa3c0c9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:46.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.903+0000 7ffa41f76700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7ffa3c0c4330 0x7ffa3c0ca050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:60354/0 (socket says 172.21.15.73:60354) 2024-05-08T21:49:46.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.903+0000 7ffa41f76700 1 -- 172.21.15.73:0/663660161 learned_addr learned my addr 172.21.15.73:0/663660161 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:49:46.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.904+0000 7ffa40f74700 1 -- 172.21.15.73:0/663660161 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffa3c14e630 msgr2=0x7ffa3c157a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:46.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.904+0000 7ffa40f74700 1 --2- 172.21.15.73:0/663660161 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffa3c14e630 0x7ffa3c157a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:46.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.904+0000 7ffa40f74700 1 -- 172.21.15.73:0/663660161 >> v1:172.21.15.73:6789/0 conn(0x7ffa3c0c4330 legacy=0x7ffa3c0ca050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:46.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.904+0000 7ffa33fff700 1 -- 172.21.15.73:0/663660161 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2282553634 0 0) 0x7ffa3c14ea10 con 0x7ffa3c0c4330 2024-05-08T21:49:46.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.904+0000 7ffa40f74700 1 -- 172.21.15.73:0/663660161 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa3c0c80f0 con 0x7ffa3c06ff30 2024-05-08T21:49:46.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.904+0000 7ffa40f74700 1 --2- 172.21.15.73:0/663660161 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa3c06ff30 0x7ffa3c0c9340 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ffa38009840 tx=0x7ffa38009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=935b8ed0f28e9e1c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:46.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.904+0000 7ffa33fff700 1 -- 172.21.15.73:0/663660161 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa38011830 con 0x7ffa3c06ff30 2024-05-08T21:49:46.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.904+0000 7ffa33fff700 1 -- 172.21.15.73:0/663660161 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa38011990 con 0x7ffa3c06ff30 2024-05-08T21:49:46.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.904+0000 7ffa33fff700 1 -- 172.21.15.73:0/663660161 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa38011d20 con 0x7ffa3c06ff30 2024-05-08T21:49:46.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.905+0000 7ffa439d9700 1 -- 172.21.15.73:0/663660161 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa3c06ff30 msgr2=0x7ffa3c0c9340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:46.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.905+0000 7ffa439d9700 1 --2- 172.21.15.73:0/663660161 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa3c06ff30 0x7ffa3c0c9340 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ffa38009840 tx=0x7ffa38009b50 comp rx=0 tx=0).stop 2024-05-08T21:49:46.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.905+0000 7ffa439d9700 1 -- 172.21.15.73:0/663660161 shutdown_connections 2024-05-08T21:49:46.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.905+0000 7ffa439d9700 1 --2- 172.21.15.73:0/663660161 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffa3c14e630 0x7ffa3c157a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:46.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.905+0000 7ffa439d9700 1 --2- 172.21.15.73:0/663660161 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa3c06ff30 0x7ffa3c0c9340 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:46.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.905+0000 7ffa439d9700 1 -- 172.21.15.73:0/663660161 >> 172.21.15.73:0/663660161 conn(0x7ffa3c06aff0 msgr2=0x7ffa3c0666c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:46.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.905+0000 7ffa439d9700 1 -- 172.21.15.73:0/663660161 shutdown_connections 2024-05-08T21:49:46.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.905+0000 7ffa439d9700 1 -- 172.21.15.73:0/663660161 wait complete. 2024-05-08T21:49:46.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.906+0000 7ffa439d9700 1 Processor -- start 2024-05-08T21:49:46.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.906+0000 7ffa439d9700 1 -- start start 2024-05-08T21:49:46.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.907+0000 7ffa439d9700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffa3c06ff30 0x7ffa3c144910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:46.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.907+0000 7ffa439d9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa3c0c4330 0x7ffa3c144e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:46.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.907+0000 7ffa439d9700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa3c14e630 0x7ffa3c1430b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:46.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.907+0000 7ffa439d9700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3c1ee3b0 con 0x7ffa3c0c4330 2024-05-08T21:49:46.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.907+0000 7ffa439d9700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3c144480 con 0x7ffa3c14e630 2024-05-08T21:49:46.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.907+0000 7ffa439d9700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3c1ede10 con 0x7ffa3c06ff30 2024-05-08T21:49:46.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.907+0000 7ffa40f74700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa3c0c4330 0x7ffa3c144e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:46.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.907+0000 7ffa40f74700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa3c0c4330 0x7ffa3c144e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43784/0 (socket says 172.21.15.73:43784) 2024-05-08T21:49:46.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.907+0000 7ffa40f74700 1 -- 172.21.15.73:0/529957506 learned_addr learned my addr 172.21.15.73:0/529957506 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:46.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.907+0000 7ffa41775700 1 --2- 172.21.15.73:0/529957506 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffa3c06ff30 0x7ffa3c144910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:46.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.907+0000 7ffa41f76700 1 --2- 172.21.15.73:0/529957506 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa3c14e630 0x7ffa3c1430b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:46.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.907+0000 7ffa40f74700 1 -- 172.21.15.73:0/529957506 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffa3c06ff30 msgr2=0x7ffa3c144910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:46.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.907+0000 7ffa40f74700 1 --2- 172.21.15.73:0/529957506 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffa3c06ff30 0x7ffa3c144910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:46.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.907+0000 7ffa40f74700 1 -- 172.21.15.73:0/529957506 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa3c14e630 msgr2=0x7ffa3c1430b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:46.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.907+0000 7ffa40f74700 1 --2- 172.21.15.73:0/529957506 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa3c14e630 0x7ffa3c1430b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:46.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.907+0000 7ffa40f74700 1 -- 172.21.15.73:0/529957506 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa380094a0 con 0x7ffa3c0c4330 2024-05-08T21:49:46.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.907+0000 7ffa40f74700 1 --2- 172.21.15.73:0/529957506 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa3c0c4330 0x7ffa3c144e50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ffa380090b0 tx=0x7ffa38004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:46.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.907+0000 7ffa31ffb700 1 -- 172.21.15.73:0/529957506 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa380045f0 con 0x7ffa3c0c4330 2024-05-08T21:49:46.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.907+0000 7ffa31ffb700 1 -- 172.21.15.73:0/529957506 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa3801f070 con 0x7ffa3c0c4330 2024-05-08T21:49:46.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.907+0000 7ffa439d9700 1 -- 172.21.15.73:0/529957506 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa3c1ee0d0 con 0x7ffa3c0c4330 2024-05-08T21:49:46.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.907+0000 7ffa31ffb700 1 -- 172.21.15.73:0/529957506 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa38003b00 con 0x7ffa3c0c4330 2024-05-08T21:49:46.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.908+0000 7ffa439d9700 1 -- 172.21.15.73:0/529957506 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa3c15bde0 con 0x7ffa3c0c4330 2024-05-08T21:49:46.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.908+0000 7ffa439d9700 1 -- 172.21.15.73:0/529957506 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa3c15b960 con 0x7ffa3c0c4330 2024-05-08T21:49:46.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.909+0000 7ffa31ffb700 1 -- 172.21.15.73:0/529957506 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ffa38003c60 con 0x7ffa3c0c4330 2024-05-08T21:49:46.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.909+0000 7ffa31ffb700 1 --2- 172.21.15.73:0/529957506 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7ffa2006acc0 0x7ffa2006d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:46.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.909+0000 7ffa41775700 1 --2- 172.21.15.73:0/529957506 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7ffa2006acc0 0x7ffa2006d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:46.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.909+0000 7ffa31ffb700 1 -- 172.21.15.73:0/529957506 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffa38021070 con 0x7ffa3c0c4330 2024-05-08T21:49:46.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.910+0000 7ffa41775700 1 --2- 172.21.15.73:0/529957506 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7ffa2006acc0 0x7ffa2006d180 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c006fd0 tx=0x7ffa2c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:46.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:46.914+0000 7ffa31ffb700 1 -- 172.21.15.73:0/529957506 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7ffa3c15b960 con 0x7ffa3c0c4330 2024-05-08T21:49:47.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.158+0000 7ffa439d9700 1 -- 172.21.15.73:0/529957506 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7ffa3c15b960 con 0x7ffa3c0c4330 2024-05-08T21:49:47.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.761+0000 7ffa31ffb700 1 -- 172.21.15.73:0/529957506 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v7) v1 ==== 115+0+0 (secure 0 0 0) 0x7ffa3c15b960 con 0x7ffa3c0c4330 2024-05-08T21:49:47.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.764+0000 7ffa439d9700 1 -- 172.21.15.73:0/529957506 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7ffa2006acc0 msgr2=0x7ffa2006d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:47.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.764+0000 7ffa439d9700 1 --2- 172.21.15.73:0/529957506 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7ffa2006acc0 0x7ffa2006d180 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c006fd0 tx=0x7ffa2c008040 comp rx=0 tx=0).stop 2024-05-08T21:49:47.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.764+0000 7ffa439d9700 1 -- 172.21.15.73:0/529957506 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa3c0c4330 msgr2=0x7ffa3c144e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:47.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.764+0000 7ffa439d9700 1 --2- 172.21.15.73:0/529957506 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa3c0c4330 0x7ffa3c144e50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ffa380090b0 tx=0x7ffa38004750 comp rx=0 tx=0).stop 2024-05-08T21:49:47.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.764+0000 7ffa439d9700 1 -- 172.21.15.73:0/529957506 shutdown_connections 2024-05-08T21:49:47.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.764+0000 7ffa439d9700 1 --2- 172.21.15.73:0/529957506 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7ffa2006acc0 0x7ffa2006d180 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:47.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.764+0000 7ffa439d9700 1 --2- 172.21.15.73:0/529957506 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa3c14e630 0x7ffa3c1430b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:47.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.764+0000 7ffa439d9700 1 --2- 172.21.15.73:0/529957506 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffa3c06ff30 0x7ffa3c144910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:47.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.764+0000 7ffa439d9700 1 --2- 172.21.15.73:0/529957506 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa3c0c4330 0x7ffa3c144e50 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:47.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.764+0000 7ffa439d9700 1 -- 172.21.15.73:0/529957506 >> 172.21.15.73:0/529957506 conn(0x7ffa3c06aff0 msgr2=0x7ffa3c0666c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:47.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.764+0000 7ffa439d9700 1 -- 172.21.15.73:0/529957506 shutdown_connections 2024-05-08T21:49:47.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.764+0000 7ffa439d9700 1 -- 172.21.15.73:0/529957506 wait complete. 2024-05-08T21:49:47.780 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-08T21:49:47.780 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:49:47.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.906+0000 7fcfa969b700 1 Processor -- start 2024-05-08T21:49:47.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.906+0000 7fcfa969b700 1 -- start start 2024-05-08T21:49:47.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.907+0000 7fcfa969b700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcfa4072080 0x7fcfa4072460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:47.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.907+0000 7fcfa969b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcfa40c3490 0x7fcfa4156dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:47.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.907+0000 7fcfa969b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcfa40c3a00 0x7fcfa4157300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:47.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.907+0000 7fcfa969b700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfa40729a0 con 0x7fcfa4072080 2024-05-08T21:49:47.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.907+0000 7fcfa969b700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfa40c3f10 con 0x7fcfa40c3a00 2024-05-08T21:49:47.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.907+0000 7fcfa969b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa40c41b0 con 0x7fcfa40c3490 2024-05-08T21:49:47.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.907+0000 7fcfa2ffd700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcfa4072080 0x7fcfa4072460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:47.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.907+0000 7fcfa2ffd700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcfa4072080 0x7fcfa4072460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43794/0 (socket says 172.21.15.73:43794) 2024-05-08T21:49:47.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.907+0000 7fcfa2ffd700 1 -- 172.21.15.73:0/3678391689 learned_addr learned my addr 172.21.15.73:0/3678391689 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:47.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.908+0000 7fcfa37fe700 1 --2- 172.21.15.73:0/3678391689 >> v2:172.21.15.115:3300/0 conn(0x7fcfa40c3a00 0x7fcfa4157300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:47.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.908+0000 7fcfa27fc700 1 --2- 172.21.15.73:0/3678391689 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcfa40c3490 0x7fcfa4156dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:47.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.908+0000 7fcfa2ffd700 1 -- 172.21.15.73:0/3678391689 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcfa40c3490 msgr2=0x7fcfa4156dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:47.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.908+0000 7fcfa2ffd700 1 --2- 172.21.15.73:0/3678391689 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcfa40c3490 0x7fcfa4156dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:47.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.908+0000 7fcfa2ffd700 1 -- 172.21.15.73:0/3678391689 >> v2:172.21.15.115:3300/0 conn(0x7fcfa40c3a00 msgr2=0x7fcfa4157300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:47.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.908+0000 7fcfa2ffd700 1 --2- 172.21.15.73:0/3678391689 >> v2:172.21.15.115:3300/0 conn(0x7fcfa40c3a00 0x7fcfa4157300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:47.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.908+0000 7fcfa2ffd700 1 -- 172.21.15.73:0/3678391689 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa40c7820 con 0x7fcfa4072080 2024-05-08T21:49:47.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.908+0000 7fcfa2ffd700 1 --2- 172.21.15.73:0/3678391689 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfa4072080 0x7fcfa4072460 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4157b80 tx=0x7fcf98009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36730aec9bd8e903 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:47.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.908+0000 7fcfa1ffb700 1 -- 172.21.15.73:0/3678391689 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9800b870 con 0x7fcfa4072080 2024-05-08T21:49:47.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.908+0000 7fcfa1ffb700 1 -- 172.21.15.73:0/3678391689 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf9800b9d0 con 0x7fcfa4072080 2024-05-08T21:49:47.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.908+0000 7fcfa1ffb700 1 -- 172.21.15.73:0/3678391689 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9800bd60 con 0x7fcfa4072080 2024-05-08T21:49:47.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.908+0000 7fcfa969b700 1 -- 172.21.15.73:0/3678391689 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfa4072080 msgr2=0x7fcfa4072460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:47.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.908+0000 7fcfa969b700 1 --2- 172.21.15.73:0/3678391689 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfa4072080 0x7fcfa4072460 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4157b80 tx=0x7fcf98009bd0 comp rx=0 tx=0).stop 2024-05-08T21:49:47.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.909+0000 7fcfa969b700 1 -- 172.21.15.73:0/3678391689 shutdown_connections 2024-05-08T21:49:47.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.909+0000 7fcfa969b700 1 --2- 172.21.15.73:0/3678391689 >> v2:172.21.15.115:3300/0 conn(0x7fcfa40c3a00 0x7fcfa4157300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:47.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.909+0000 7fcfa969b700 1 --2- 172.21.15.73:0/3678391689 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfa4072080 0x7fcfa4072460 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:47.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.909+0000 7fcfa969b700 1 --2- 172.21.15.73:0/3678391689 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcfa40c3490 0x7fcfa4156dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:47.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.909+0000 7fcfa969b700 1 -- 172.21.15.73:0/3678391689 >> 172.21.15.73:0/3678391689 conn(0x7fcfa4066d70 msgr2=0x7fcfa40cc500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:47.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.909+0000 7fcfa969b700 1 -- 172.21.15.73:0/3678391689 shutdown_connections 2024-05-08T21:49:47.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.909+0000 7fcfa969b700 1 -- 172.21.15.73:0/3678391689 wait complete. 2024-05-08T21:49:47.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.910+0000 7fcfa969b700 1 Processor -- start 2024-05-08T21:49:47.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.910+0000 7fcfa969b700 1 -- start start 2024-05-08T21:49:47.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.910+0000 7fcfa969b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfa4072080 0x7fcfa414b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:47.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.911+0000 7fcfa969b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcfa40c3490 0x7fcfa41ed410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:47.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.911+0000 7fcfa969b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcfa40c3a00 0x7fcfa41ed950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:47.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.911+0000 7fcfa969b700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa4153fc0 con 0x7fcfa4072080 2024-05-08T21:49:47.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.911+0000 7fcfa969b700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa41ecf80 con 0x7fcfa40c3490 2024-05-08T21:49:47.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.911+0000 7fcfa969b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa4152680 con 0x7fcfa40c3a00 2024-05-08T21:49:47.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.911+0000 7fcfa2ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfa4072080 0x7fcfa414b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:47.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.911+0000 7fcfa2ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfa4072080 0x7fcfa414b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43808/0 (socket says 172.21.15.73:43808) 2024-05-08T21:49:47.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.911+0000 7fcfa2ffd700 1 -- 172.21.15.73:0/2275390988 learned_addr learned my addr 172.21.15.73:0/2275390988 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:47.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.911+0000 7fcfa37fe700 1 --2- 172.21.15.73:0/2275390988 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcfa40c3a00 0x7fcfa41ed950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:47.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.911+0000 7fcfa27fc700 1 --2- 172.21.15.73:0/2275390988 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcfa40c3490 0x7fcfa41ed410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:47.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.911+0000 7fcfa2ffd700 1 -- 172.21.15.73:0/2275390988 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcfa40c3a00 msgr2=0x7fcfa41ed950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:47.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.911+0000 7fcfa2ffd700 1 --2- 172.21.15.73:0/2275390988 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcfa40c3a00 0x7fcfa41ed950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:47.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.911+0000 7fcfa2ffd700 1 -- 172.21.15.73:0/2275390988 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcfa40c3490 msgr2=0x7fcfa41ed410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:47.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.911+0000 7fcfa2ffd700 1 --2- 172.21.15.73:0/2275390988 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcfa40c3490 0x7fcfa41ed410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:47.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.911+0000 7fcfa2ffd700 1 -- 172.21.15.73:0/2275390988 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf98009550 con 0x7fcfa4072080 2024-05-08T21:49:47.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.911+0000 7fcfa27fc700 1 --2- 172.21.15.73:0/2275390988 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcfa40c3490 0x7fcfa41ed410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:49:47.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.911+0000 7fcfa37fe700 1 --2- 172.21.15.73:0/2275390988 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcfa40c3a00 0x7fcfa41ed950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:49:47.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.911+0000 7fcfa2ffd700 1 --2- 172.21.15.73:0/2275390988 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfa4072080 0x7fcfa414b570 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcf98009fd0 tx=0x7fcf98004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:47.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.911+0000 7fcf8b7fe700 1 -- 172.21.15.73:0/2275390988 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf98004310 con 0x7fcfa4072080 2024-05-08T21:49:47.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.911+0000 7fcf8b7fe700 1 -- 172.21.15.73:0/2275390988 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf9801f070 con 0x7fcfa4072080 2024-05-08T21:49:47.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.911+0000 7fcfa969b700 1 -- 172.21.15.73:0/2275390988 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfa4152960 con 0x7fcfa4072080 2024-05-08T21:49:47.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.911+0000 7fcf8b7fe700 1 -- 172.21.15.73:0/2275390988 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf980036a0 con 0x7fcfa4072080 2024-05-08T21:49:47.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.911+0000 7fcfa969b700 1 -- 172.21.15.73:0/2275390988 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfa41ecc10 con 0x7fcfa4072080 2024-05-08T21:49:47.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.912+0000 7fcfa969b700 1 -- 172.21.15.73:0/2275390988 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfa4068b80 con 0x7fcfa4072080 2024-05-08T21:49:47.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.913+0000 7fcf8b7fe700 1 -- 172.21.15.73:0/2275390988 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fcf98021030 con 0x7fcfa4072080 2024-05-08T21:49:47.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.913+0000 7fcf8b7fe700 1 --2- 172.21.15.73:0/2275390988 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fcf9006ac90 0x7fcf9006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:47.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.913+0000 7fcf8b7fe700 1 -- 172.21.15.73:0/2275390988 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcf9808a840 con 0x7fcfa4072080 2024-05-08T21:49:47.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.913+0000 7fcfa27fc700 1 --2- 172.21.15.73:0/2275390988 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fcf9006ac90 0x7fcf9006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:47.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.913+0000 7fcfa27fc700 1 --2- 172.21.15.73:0/2275390988 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fcf9006ac90 0x7fcf9006d150 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcfa40c9f90 tx=0x7fcf94008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:47.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:47.917+0000 7fcf8b7fe700 1 -- 172.21.15.73:0/2275390988 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fcf98055b40 con 0x7fcfa4072080 2024-05-08T21:49:48.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.159+0000 7fcfa969b700 1 -- 172.21.15.73:0/2275390988 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcfa40c5040 con 0x7fcfa4072080 2024-05-08T21:49:48.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.160+0000 7fcf8b7fe700 1 -- 172.21.15.73:0/2275390988 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+6252 (secure 0 0 0) 0x7fcf98015090 con 0x7fcfa4072080 2024-05-08T21:49:48.160 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:49:48.160 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3242319177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6833","nonce":3242319177},{"type":"v1","addr":"172.21.15.115:6835","nonce":3242319177}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6834/2136341349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2136341349},{"type":"v1","addr":"172.21.15.115:6834","nonce":2136341349}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4249,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1439647913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1439647913},{"type":"v1","addr":"172.21.15.115:6837","nonce":1439647913}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/2386382396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2386382396},{"type":"v1","addr":"172.21.15.73:6836","nonce":2386382396}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/1772457954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":1772457954},{"type":"v1","addr":"172.21.15.73:6837","nonce":1772457954}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:49:43.747162+0000","modified":"2024-05-08T21:49:47.758016+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"e","rank":0,"incarnation":4,"state":"up:creating","state_seq":1,"addr":"172.21.15.73:6839/1477468490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1477468490},{"type":"v1","addr":"172.21.15.73:6839","nonce":1477468490}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:49:48.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.162+0000 7fcfa969b700 1 -- 172.21.15.73:0/2275390988 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fcf9006ac90 msgr2=0x7fcf9006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:48.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.162+0000 7fcfa969b700 1 --2- 172.21.15.73:0/2275390988 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fcf9006ac90 0x7fcf9006d150 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcfa40c9f90 tx=0x7fcf94008040 comp rx=0 tx=0).stop 2024-05-08T21:49:48.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.162+0000 7fcfa969b700 1 -- 172.21.15.73:0/2275390988 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfa4072080 msgr2=0x7fcfa414b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:48.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.162+0000 7fcfa969b700 1 --2- 172.21.15.73:0/2275390988 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfa4072080 0x7fcfa414b570 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcf98009fd0 tx=0x7fcf98004750 comp rx=0 tx=0).stop 2024-05-08T21:49:48.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.162+0000 7fcfa969b700 1 -- 172.21.15.73:0/2275390988 shutdown_connections 2024-05-08T21:49:48.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.162+0000 7fcfa969b700 1 --2- 172.21.15.73:0/2275390988 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fcf9006ac90 0x7fcf9006d150 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:48.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.162+0000 7fcfa969b700 1 --2- 172.21.15.73:0/2275390988 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcfa40c3a00 0x7fcfa41ed950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:48.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.162+0000 7fcfa969b700 1 --2- 172.21.15.73:0/2275390988 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfa4072080 0x7fcfa414b570 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:48.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.162+0000 7fcfa969b700 1 --2- 172.21.15.73:0/2275390988 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcfa40c3490 0x7fcfa41ed410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:48.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.162+0000 7fcfa969b700 1 -- 172.21.15.73:0/2275390988 >> 172.21.15.73:0/2275390988 conn(0x7fcfa4066d70 msgr2=0x7fcfa414e450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:48.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.162+0000 7fcfa969b700 1 -- 172.21.15.73:0/2275390988 shutdown_connections 2024-05-08T21:49:48.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.162+0000 7fcfa969b700 1 -- 172.21.15.73:0/2275390988 wait complete. 2024-05-08T21:49:48.167 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 7 2024-05-08T21:49:48.175 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T21:49:48.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.296+0000 7fbe63e98700 1 Processor -- start 2024-05-08T21:49:48.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.297+0000 7fbe63e98700 1 -- start start 2024-05-08T21:49:48.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.297+0000 7fbe63e98700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fbe5c0c2760 0x7fbe5c0cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:48.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.297+0000 7fbe63e98700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe5c0c91e0 con 0x7fbe5c152010 2024-05-08T21:49:48.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.297+0000 7fbe63e98700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe5c157ba0 con 0x7fbe5c0ce290 2024-05-08T21:49:48.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.297+0000 7fbe63e98700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe5c0c99f0 con 0x7fbe5c0c2760 2024-05-08T21:49:48.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.298+0000 7fbe61c34700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fbe5c152010 0x7fbe5c0c8140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:51720/0 (socket says 172.21.15.73:51720) 2024-05-08T21:49:48.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.298+0000 7fbe61c34700 1 -- 172.21.15.73:0/4215192170 learned_addr learned my addr 172.21.15.73:0/4215192170 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:49:48.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.298+0000 7fbe61433700 1 --2- 172.21.15.73:0/4215192170 >> v2:172.21.15.115:3300/0 conn(0x7fbe5c0c2760 0x7fbe5c0cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:48.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.298+0000 7fbe60c32700 1 -- 172.21.15.73:0/4215192170 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2422068556 0 0) 0x7fbe5c0c91e0 con 0x7fbe5c152010 2024-05-08T21:49:48.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.298+0000 7fbe60c32700 1 -- 172.21.15.73:0/4215192170 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe480035b0 con 0x7fbe5c152010 2024-05-08T21:49:48.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.298+0000 7fbe60c32700 1 -- 172.21.15.73:0/4215192170 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1487072190 0 0) 0x7fbe480035b0 con 0x7fbe5c152010 2024-05-08T21:49:48.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.298+0000 7fbe61433700 1 -- 172.21.15.73:0/4215192170 >> v1:172.21.15.115:6789/0 conn(0x7fbe5c0ce290 legacy=0x7fbe5c070ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:48.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.298+0000 7fbe61433700 1 -- 172.21.15.73:0/4215192170 >> v1:172.21.15.73:6789/0 conn(0x7fbe5c152010 legacy=0x7fbe5c0c8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:48.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.298+0000 7fbe61433700 1 -- 172.21.15.73:0/4215192170 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe5c0c9bb0 con 0x7fbe5c0c2760 2024-05-08T21:49:48.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.298+0000 7fbe61433700 1 --2- 172.21.15.73:0/4215192170 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe5c0c2760 0x7fbe5c0cdd50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbe58009840 tx=0x7fbe58009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=782db829a2767da9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:48.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.298+0000 7fbe60c32700 1 -- 172.21.15.73:0/4215192170 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4c001670 con 0x7fbe5c0c2760 2024-05-08T21:49:48.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.298+0000 7fbe60c32700 1 -- 172.21.15.73:0/4215192170 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe58004030 con 0x7fbe5c0c2760 2024-05-08T21:49:48.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.298+0000 7fbe60c32700 1 -- 172.21.15.73:0/4215192170 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe580043a0 con 0x7fbe5c0c2760 2024-05-08T21:49:48.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.299+0000 7fbe63e98700 1 -- 172.21.15.73:0/4215192170 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe5c0c2760 msgr2=0x7fbe5c0cdd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:48.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.299+0000 7fbe63e98700 1 --2- 172.21.15.73:0/4215192170 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe5c0c2760 0x7fbe5c0cdd50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbe58009840 tx=0x7fbe58009b50 comp rx=0 tx=0).stop 2024-05-08T21:49:48.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.299+0000 7fbe63e98700 1 -- 172.21.15.73:0/4215192170 shutdown_connections 2024-05-08T21:49:48.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.299+0000 7fbe63e98700 1 --2- 172.21.15.73:0/4215192170 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe5c0c2760 0x7fbe5c0cdd50 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:48.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.299+0000 7fbe63e98700 1 -- 172.21.15.73:0/4215192170 >> 172.21.15.73:0/4215192170 conn(0x7fbe5c06ea20 msgr2=0x7fbe5c06ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:48.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.299+0000 7fbe63e98700 1 -- 172.21.15.73:0/4215192170 shutdown_connections 2024-05-08T21:49:48.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.299+0000 7fbe63e98700 1 -- 172.21.15.73:0/4215192170 wait complete. 2024-05-08T21:49:48.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.300+0000 7fbe63e98700 1 Processor -- start 2024-05-08T21:49:48.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.300+0000 7fbe63e98700 1 -- start start 2024-05-08T21:49:48.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.301+0000 7fbe63e98700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe5c0c2760 0x7fbe5c155280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:48.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.301+0000 7fbe63e98700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe5c0ce290 0x7fbe5c0c6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:48.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.301+0000 7fbe63e98700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe5c152010 0x7fbe5c14fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:48.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.301+0000 7fbe63e98700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5c1557c0 con 0x7fbe5c152010 2024-05-08T21:49:48.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.301+0000 7fbe63e98700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5c1ee320 con 0x7fbe5c0ce290 2024-05-08T21:49:48.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.301+0000 7fbe63e98700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5c14ec80 con 0x7fbe5c0c2760 2024-05-08T21:49:48.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.301+0000 7fbe62435700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe5c152010 0x7fbe5c14fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:48.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.301+0000 7fbe62435700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe5c152010 0x7fbe5c14fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38706/0 (socket says 172.21.15.73:38706) 2024-05-08T21:49:48.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.301+0000 7fbe62435700 1 -- 172.21.15.73:0/1416410225 learned_addr learned my addr 172.21.15.73:0/1416410225 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:48.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.301+0000 7fbe61433700 1 --2- 172.21.15.73:0/1416410225 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe5c0ce290 0x7fbe5c0c6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:48.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.301+0000 7fbe61c34700 1 --2- 172.21.15.73:0/1416410225 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe5c0c2760 0x7fbe5c155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:48.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.301+0000 7fbe62435700 1 -- 172.21.15.73:0/1416410225 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe5c0c2760 msgr2=0x7fbe5c155280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:48.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.301+0000 7fbe62435700 1 --2- 172.21.15.73:0/1416410225 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe5c0c2760 0x7fbe5c155280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:48.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.301+0000 7fbe62435700 1 -- 172.21.15.73:0/1416410225 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe5c0ce290 msgr2=0x7fbe5c0c6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:48.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.301+0000 7fbe62435700 1 --2- 172.21.15.73:0/1416410225 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe5c0ce290 0x7fbe5c0c6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:48.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.301+0000 7fbe62435700 1 -- 172.21.15.73:0/1416410225 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe580094a0 con 0x7fbe5c152010 2024-05-08T21:49:48.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.301+0000 7fbe61433700 1 --2- 172.21.15.73:0/1416410225 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe5c0ce290 0x7fbe5c0c6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:49:48.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.301+0000 7fbe61c34700 1 --2- 172.21.15.73:0/1416410225 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe5c0c2760 0x7fbe5c155280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:49:48.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.301+0000 7fbe62435700 1 --2- 172.21.15.73:0/1416410225 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe5c152010 0x7fbe5c14fc90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbe5400ccb0 tx=0x7fbe5400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:48.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.302+0000 7fbe527fc700 1 -- 172.21.15.73:0/1416410225 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe5400ad00 con 0x7fbe5c152010 2024-05-08T21:49:48.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.302+0000 7fbe527fc700 1 -- 172.21.15.73:0/1416410225 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe5400ae60 con 0x7fbe5c152010 2024-05-08T21:49:48.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.302+0000 7fbe527fc700 1 -- 172.21.15.73:0/1416410225 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe54003c40 con 0x7fbe5c152010 2024-05-08T21:49:48.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.302+0000 7fbe63e98700 1 -- 172.21.15.73:0/1416410225 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe5c14f800 con 0x7fbe5c152010 2024-05-08T21:49:48.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.302+0000 7fbe63e98700 1 -- 172.21.15.73:0/1416410225 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe5c155fe0 con 0x7fbe5c152010 2024-05-08T21:49:48.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.303+0000 7fbe63e98700 1 -- 172.21.15.73:0/1416410225 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe5c068b80 con 0x7fbe5c152010 2024-05-08T21:49:48.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.303+0000 7fbe527fc700 1 -- 172.21.15.73:0/1416410225 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbe540050d0 con 0x7fbe5c152010 2024-05-08T21:49:48.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.303+0000 7fbe527fc700 1 --2- 172.21.15.73:0/1416410225 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fbe4006ac90 0x7fbe4006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:48.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.303+0000 7fbe527fc700 1 -- 172.21.15.73:0/1416410225 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbe540893c0 con 0x7fbe5c152010 2024-05-08T21:49:48.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.304+0000 7fbe61c34700 1 --2- 172.21.15.73:0/1416410225 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fbe4006ac90 0x7fbe4006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:48.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.304+0000 7fbe61c34700 1 --2- 172.21.15.73:0/1416410225 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fbe4006ac90 0x7fbe4006d150 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c0b3630 tx=0x7fbe4c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:48.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.308+0000 7fbe527fc700 1 -- 172.21.15.73:0/1416410225 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fbe54054630 con 0x7fbe5c152010 2024-05-08T21:49:48.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.504+0000 7fbe63e98700 1 -- 172.21.15.73:0/1416410225 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbe5c0cd800 con 0x7fbe5c152010 2024-05-08T21:49:48.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.506+0000 7fbe527fc700 1 -- 172.21.15.73:0/1416410225 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16037 (secure 0 0 0) 0x7fbe54057c50 con 0x7fbe5c152010 2024-05-08T21:49:48.506 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:49:48.506 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":21,"fsid":"143164b7-c9c7-4737-a494-7dafa5a3320c","created":"2024-05-08T21:49:26.221909+0000","modified":"2024-05-08T21:49:44.748794+0000","last_up_change":"2024-05-08T21:49:37.118386+0000","last_in_change":"2024-05-08T21:49:28.836944+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T21:49:35.998578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T21:49:42.171760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T21:49:42.576293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6b7439c1-daaa-44af-8333-a455f9e9dc67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":47228},{"type":"v1","addr":"172.21.15.73:6809","nonce":47228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":47228},{"type":"v1","addr":"172.21.15.73:6811","nonce":47228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":47228},{"type":"v1","addr":"172.21.15.73:6815","nonce":47228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":47228},{"type":"v1","addr":"172.21.15.73:6813","nonce":47228}]},"public_addr":"172.21.15.73:6809/47228","cluster_addr":"172.21.15.73:6811/47228","heartbeat_back_addr":"172.21.15.73:6815/47228","heartbeat_front_addr":"172.21.15.73:6813/47228","state":["exists","up"]},{"osd":1,"uuid":"fb67886a-d7f7-45ac-832f-36c871c8a208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":47227},{"type":"v1","addr":"172.21.15.73:6801","nonce":47227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":47227},{"type":"v1","addr":"172.21.15.73:6803","nonce":47227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":47227},{"type":"v1","addr":"172.21.15.73:6807","nonce":47227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":47227},{"type":"v1","addr":"172.21.15.73:6805","nonce":47227}]},"public_addr":"172.21.15.73:6801/47227","cluster_addr":"172.21.15.73:6803/47227","heartbeat_back_addr":"172.21.15.73:6807/47227","heartbeat_front_addr":"172.21.15.73:6805/47227","state":["exists","up"]},{"osd":2,"uuid":"a5cd6e98-6621-473a-bfb8-5c648abbb563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":47229},{"type":"v1","addr":"172.21.15.73:6817","nonce":47229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":47229},{"type":"v1","addr":"172.21.15.73:6819","nonce":47229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":47229},{"type":"v1","addr":"172.21.15.73:6823","nonce":47229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":47229},{"type":"v1","addr":"172.21.15.73:6821","nonce":47229}]},"public_addr":"172.21.15.73:6817/47229","cluster_addr":"172.21.15.73:6819/47229","heartbeat_back_addr":"172.21.15.73:6823/47229","heartbeat_front_addr":"172.21.15.73:6821/47229","state":["exists","up"]},{"osd":3,"uuid":"36927c20-4241-4f3b-91b5-a6a6f27598e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":47232},{"type":"v1","addr":"172.21.15.73:6825","nonce":47232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":47232},{"type":"v1","addr":"172.21.15.73:6827","nonce":47232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":47232},{"type":"v1","addr":"172.21.15.73:6831","nonce":47232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":47232},{"type":"v1","addr":"172.21.15.73:6829","nonce":47232}]},"public_addr":"172.21.15.73:6825/47232","cluster_addr":"172.21.15.73:6827/47232","heartbeat_back_addr":"172.21.15.73:6831/47232","heartbeat_front_addr":"172.21.15.73:6829/47232","state":["exists","up"]},{"osd":4,"uuid":"4ebe0a18-8216-4815-878a-39c39a6cd3fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":47200},{"type":"v1","addr":"172.21.15.115:6801","nonce":47200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":47200},{"type":"v1","addr":"172.21.15.115:6803","nonce":47200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":47200},{"type":"v1","addr":"172.21.15.115:6807","nonce":47200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":47200},{"type":"v1","addr":"172.21.15.115:6805","nonce":47200}]},"public_addr":"172.21.15.115:6801/47200","cluster_addr":"172.21.15.115:6803/47200","heartbeat_back_addr":"172.21.15.115:6807/47200","heartbeat_front_addr":"172.21.15.115:6805/47200","state":["exists","up"]},{"osd":5,"uuid":"957f0ac1-5f26-4f02-8c05-488e6b67ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":47201},{"type":"v1","addr":"172.21.15.115:6809","nonce":47201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":47201},{"type":"v1","addr":"172.21.15.115:6811","nonce":47201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":47201},{"type":"v1","addr":"172.21.15.115:6815","nonce":47201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":47201},{"type":"v1","addr":"172.21.15.115:6813","nonce":47201}]},"public_addr":"172.21.15.115:6809/47201","cluster_addr":"172.21.15.115:6811/47201","heartbeat_back_addr":"172.21.15.115:6815/47201","heartbeat_front_addr":"172.21.15.115:6813/47201","state":["exists","up"]},{"osd":6,"uuid":"f5a6768f-ba7f-4f66-b335-0c303b158e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":47202},{"type":"v1","addr":"172.21.15.115:6817","nonce":47202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":47202},{"type":"v1","addr":"172.21.15.115:6819","nonce":47202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":47202},{"type":"v1","addr":"172.21.15.115:6823","nonce":47202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":47202},{"type":"v1","addr":"172.21.15.115:6821","nonce":47202}]},"public_addr":"172.21.15.115:6817/47202","cluster_addr":"172.21.15.115:6819/47202","heartbeat_back_addr":"172.21.15.115:6823/47202","heartbeat_front_addr":"172.21.15.115:6821/47202","state":["exists","up"]},{"osd":7,"uuid":"f4187743-f9e6-42e6-aca9-0604a58db1ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":47211},{"type":"v1","addr":"172.21.15.115:6825","nonce":47211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":47211},{"type":"v1","addr":"172.21.15.115:6827","nonce":47211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":47211},{"type":"v1","addr":"172.21.15.115:6831","nonce":47211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":47211},{"type":"v1","addr":"172.21.15.115:6829","nonce":47211}]},"public_addr":"172.21.15.115:6825/47211","cluster_addr":"172.21.15.115:6827/47211","heartbeat_back_addr":"172.21.15.115:6831/47211","heartbeat_front_addr":"172.21.15.115:6829/47211","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:33.996335+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:33.687451+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:34.072549+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:33.997588+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:34.047260+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:34.876272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:33.965472+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:34.038637+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T21:49:48.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.508+0000 7fbe63e98700 1 -- 172.21.15.73:0/1416410225 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fbe4006ac90 msgr2=0x7fbe4006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:48.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.508+0000 7fbe63e98700 1 --2- 172.21.15.73:0/1416410225 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fbe4006ac90 0x7fbe4006d150 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c0b3630 tx=0x7fbe4c009040 comp rx=0 tx=0).stop 2024-05-08T21:49:48.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.508+0000 7fbe63e98700 1 -- 172.21.15.73:0/1416410225 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe5c152010 msgr2=0x7fbe5c14fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:48.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.508+0000 7fbe63e98700 1 --2- 172.21.15.73:0/1416410225 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe5c152010 0x7fbe5c14fc90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbe5400ccb0 tx=0x7fbe5400a340 comp rx=0 tx=0).stop 2024-05-08T21:49:48.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.508+0000 7fbe63e98700 1 -- 172.21.15.73:0/1416410225 shutdown_connections 2024-05-08T21:49:48.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.508+0000 7fbe63e98700 1 --2- 172.21.15.73:0/1416410225 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fbe4006ac90 0x7fbe4006d150 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:48.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.508+0000 7fbe63e98700 1 --2- 172.21.15.73:0/1416410225 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe5c152010 0x7fbe5c14fc90 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:48.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.508+0000 7fbe63e98700 1 --2- 172.21.15.73:0/1416410225 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe5c0c2760 0x7fbe5c155280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:48.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.508+0000 7fbe63e98700 1 --2- 172.21.15.73:0/1416410225 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe5c0ce290 0x7fbe5c0c6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:48.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.508+0000 7fbe63e98700 1 -- 172.21.15.73:0/1416410225 >> 172.21.15.73:0/1416410225 conn(0x7fbe5c06ea20 msgr2=0x7fbe5c06ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:48.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.508+0000 7fbe63e98700 1 -- 172.21.15.73:0/1416410225 shutdown_connections 2024-05-08T21:49:48.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.508+0000 7fbe63e98700 1 -- 172.21.15.73:0/1416410225 wait complete. 2024-05-08T21:49:48.520 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-05-08T21:49:48.521 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T21:49:48.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.643+0000 7f545600f700 1 Processor -- start 2024-05-08T21:49:48.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.643+0000 7f545600f700 1 -- start start 2024-05-08T21:49:48.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.644+0000 7f545600f700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f54501540b0 0x7f545006afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:48.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.644+0000 7f545600f700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5450154490 con 0x7f545015d530 2024-05-08T21:49:48.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.644+0000 7f545600f700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54500c79b0 con 0x7f5450071d70 2024-05-08T21:49:48.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.644+0000 7f545600f700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54500c7c90 con 0x7f54501540b0 2024-05-08T21:49:48.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.644+0000 7f544f7fe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f54501540b0 0x7f545006afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:48.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.644+0000 7f544ffff700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f545015d530 0x7f545015d9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:51722/0 (socket says 172.21.15.73:51722) 2024-05-08T21:49:48.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.644+0000 7f544ffff700 1 -- 172.21.15.73:0/2237878057 learned_addr learned my addr 172.21.15.73:0/2237878057 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:49:48.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.644+0000 7f544f7fe700 1 -- 172.21.15.73:0/2237878057 >> v1:172.21.15.115:6789/0 conn(0x7f5450071d70 legacy=0x7f54500724e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:48.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.644+0000 7f544f7fe700 1 -- 172.21.15.73:0/2237878057 >> v1:172.21.15.73:6789/0 conn(0x7f545015d530 legacy=0x7f545015d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:48.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.644+0000 7f544f7fe700 1 -- 172.21.15.73:0/2237878057 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54500c7f70 con 0x7f54501540b0 2024-05-08T21:49:48.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.644+0000 7f544f7fe700 1 --2- 172.21.15.73:0/2237878057 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54501540b0 0x7f545006afc0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5440009840 tx=0x7f5440009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83234ac2777775c8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:48.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.644+0000 7f544e7fc700 1 -- 172.21.15.73:0/2237878057 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5440004230 con 0x7f54501540b0 2024-05-08T21:49:48.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.644+0000 7f544e7fc700 1 -- 172.21.15.73:0/2237878057 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5440004390 con 0x7f54501540b0 2024-05-08T21:49:48.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.644+0000 7f544e7fc700 1 -- 172.21.15.73:0/2237878057 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54400036a0 con 0x7f54501540b0 2024-05-08T21:49:48.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.645+0000 7f545600f700 1 -- 172.21.15.73:0/2237878057 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54501540b0 msgr2=0x7f545006afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:48.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.645+0000 7f545600f700 1 --2- 172.21.15.73:0/2237878057 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54501540b0 0x7f545006afc0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5440009840 tx=0x7f5440009b50 comp rx=0 tx=0).stop 2024-05-08T21:49:48.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.645+0000 7f545600f700 1 -- 172.21.15.73:0/2237878057 shutdown_connections 2024-05-08T21:49:48.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.645+0000 7f545600f700 1 --2- 172.21.15.73:0/2237878057 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54501540b0 0x7f545006afc0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:48.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.645+0000 7f545600f700 1 -- 172.21.15.73:0/2237878057 >> 172.21.15.73:0/2237878057 conn(0x7f5450066d70 msgr2=0x7f54500cc500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:48.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.645+0000 7f545600f700 1 -- 172.21.15.73:0/2237878057 shutdown_connections 2024-05-08T21:49:48.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.645+0000 7f545600f700 1 -- 172.21.15.73:0/2237878057 wait complete. 2024-05-08T21:49:48.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.646+0000 7f545600f700 1 Processor -- start 2024-05-08T21:49:48.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.646+0000 7f545600f700 1 -- start start 2024-05-08T21:49:48.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.647+0000 7f545600f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5450071d70 0x7f54501f05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:48.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.647+0000 7f545600f700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54501540b0 0x7f5450156cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:48.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.647+0000 7f545600f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f545015d530 0x7f5450148ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:48.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.647+0000 7f545600f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f545015c7d0 con 0x7f5450071d70 2024-05-08T21:49:48.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.647+0000 7f545600f700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54501f0130 con 0x7f54501540b0 2024-05-08T21:49:48.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.647+0000 7f545600f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54501efe00 con 0x7f545015d530 2024-05-08T21:49:48.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.647+0000 7f544f7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5450071d70 0x7f54501f05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:48.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.647+0000 7f544f7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5450071d70 0x7f54501f05c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38722/0 (socket says 172.21.15.73:38722) 2024-05-08T21:49:48.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.647+0000 7f544f7fe700 1 -- 172.21.15.73:0/2106727406 learned_addr learned my addr 172.21.15.73:0/2106727406 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:48.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.647+0000 7f544effd700 1 --2- 172.21.15.73:0/2106727406 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54501540b0 0x7f5450156cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:48.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.647+0000 7f544ffff700 1 --2- 172.21.15.73:0/2106727406 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f545015d530 0x7f5450148ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:48.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.647+0000 7f544f7fe700 1 -- 172.21.15.73:0/2106727406 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f545015d530 msgr2=0x7f5450148ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:48.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.647+0000 7f544f7fe700 1 --2- 172.21.15.73:0/2106727406 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f545015d530 0x7f5450148ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:48.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.647+0000 7f544f7fe700 1 -- 172.21.15.73:0/2106727406 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54501540b0 msgr2=0x7f5450156cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:48.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.647+0000 7f544f7fe700 1 --2- 172.21.15.73:0/2106727406 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54501540b0 0x7f5450156cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:48.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.647+0000 7f544f7fe700 1 -- 172.21.15.73:0/2106727406 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54400094a0 con 0x7f5450071d70 2024-05-08T21:49:48.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.647+0000 7f544ffff700 1 --2- 172.21.15.73:0/2106727406 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f545015d530 0x7f5450148ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:49:48.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.647+0000 7f544f7fe700 1 --2- 172.21.15.73:0/2106727406 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5450071d70 0x7f54501f05c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5440009b90 tx=0x7f5440004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:48.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.647+0000 7f5437fff700 1 -- 172.21.15.73:0/2106727406 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5440011630 con 0x7f5450071d70 2024-05-08T21:49:48.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.647+0000 7f5437fff700 1 -- 172.21.15.73:0/2106727406 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f544001e070 con 0x7f5450071d70 2024-05-08T21:49:48.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.647+0000 7f545600f700 1 -- 172.21.15.73:0/2106727406 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54501551c0 con 0x7f5450071d70 2024-05-08T21:49:48.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.648+0000 7f5437fff700 1 -- 172.21.15.73:0/2106727406 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54400119f0 con 0x7f5450071d70 2024-05-08T21:49:48.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.648+0000 7f545600f700 1 -- 172.21.15.73:0/2106727406 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f545015bd20 con 0x7f5450071d70 2024-05-08T21:49:48.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.648+0000 7f545600f700 1 -- 172.21.15.73:0/2106727406 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5450068b80 con 0x7f5450071d70 2024-05-08T21:49:48.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.649+0000 7f5437fff700 1 -- 172.21.15.73:0/2106727406 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5440011b50 con 0x7f5450071d70 2024-05-08T21:49:48.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.649+0000 7f5437fff700 1 --2- 172.21.15.73:0/2106727406 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f543c06acc0 0x7f543c06d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:48.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.649+0000 7f544effd700 1 --2- 172.21.15.73:0/2106727406 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f543c06acc0 0x7f543c06d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:48.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.650+0000 7f5437fff700 1 -- 172.21.15.73:0/2106727406 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f544008a6c0 con 0x7f5450071d70 2024-05-08T21:49:48.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.650+0000 7f544effd700 1 --2- 172.21.15.73:0/2106727406 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f543c06acc0 0x7f543c06d180 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f545015b830 tx=0x7f5444008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:48.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.654+0000 7f5437fff700 1 -- 172.21.15.73:0/2106727406 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f5440055930 con 0x7f5450071d70 2024-05-08T21:49:48.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.853+0000 7f545600f700 1 -- 172.21.15.73:0/2106727406 --> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f54500c8530 con 0x7f543c06acc0 2024-05-08T21:49:48.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.860+0000 7f5437fff700 1 -- 172.21.15.73:0/2106727406 <== mgr.4104 v2:172.21.15.73:6832/46949 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+256954 (secure 0 0 0) 0x7f5444009510 con 0x7f543c06acc0 2024-05-08T21:49:48.862 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:49:48.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.863+0000 7f545600f700 1 -- 172.21.15.73:0/2106727406 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f543c06acc0 msgr2=0x7f543c06d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:48.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.863+0000 7f545600f700 1 --2- 172.21.15.73:0/2106727406 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f543c06acc0 0x7f543c06d180 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f545015b830 tx=0x7f5444008040 comp rx=0 tx=0).stop 2024-05-08T21:49:48.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.863+0000 7f545600f700 1 -- 172.21.15.73:0/2106727406 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5450071d70 msgr2=0x7f54501f05c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:48.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.863+0000 7f545600f700 1 --2- 172.21.15.73:0/2106727406 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5450071d70 0x7f54501f05c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5440009b90 tx=0x7f5440004750 comp rx=0 tx=0).stop 2024-05-08T21:49:48.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.863+0000 7f545600f700 1 -- 172.21.15.73:0/2106727406 shutdown_connections 2024-05-08T21:49:48.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.863+0000 7f545600f700 1 --2- 172.21.15.73:0/2106727406 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f543c06acc0 0x7f543c06d180 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:48.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.863+0000 7f545600f700 1 --2- 172.21.15.73:0/2106727406 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f545015d530 0x7f5450148ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:48.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.863+0000 7f545600f700 1 --2- 172.21.15.73:0/2106727406 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5450071d70 0x7f54501f05c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:48.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.863+0000 7f545600f700 1 --2- 172.21.15.73:0/2106727406 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54501540b0 0x7f5450156cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:48.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.863+0000 7f545600f700 1 -- 172.21.15.73:0/2106727406 >> 172.21.15.73:0/2106727406 conn(0x7f5450066d70 msgr2=0x7f5450153320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:48.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.863+0000 7f545600f700 1 -- 172.21.15.73:0/2106727406 shutdown_connections 2024-05-08T21:49:48.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:48.863+0000 7f545600f700 1 -- 172.21.15.73:0/2106727406 wait complete. 2024-05-08T21:49:48.867 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-05-08T21:49:48.875 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-05-08T21:49:47.950948+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":102,"acting":102,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":21,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219440,"kb_used_data":2528,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755280,"statfs":{"total":773094113280,"available":772869406720,"internally_reserved":0,"allocated":2588672,"data_stored":1626080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.748514"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755108+0000","last_change":"2024-05-08T21:49:43.766984+0000","last_active":"2024-05-08T21:49:44.755108+0000","last_peered":"2024-05-08T21:49:44.755108+0000","last_clean":"2024-05-08T21:49:44.755108+0000","last_became_active":"2024-05-08T21:49:43.765995+0000","last_became_peered":"2024-05-08T21:49:43.765995+0000","last_unstale":"2024-05-08T21:49:44.755108+0000","last_undegraded":"2024-05-08T21:49:44.755108+0000","last_fullsized":"2024-05-08T21:49:44.755108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:21:41.238890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757017+0000","last_change":"2024-05-08T21:49:43.766355+0000","last_active":"2024-05-08T21:49:44.757017+0000","last_peered":"2024-05-08T21:49:44.757017+0000","last_clean":"2024-05-08T21:49:44.757017+0000","last_became_active":"2024-05-08T21:49:43.765507+0000","last_became_peered":"2024-05-08T21:49:43.765507+0000","last_unstale":"2024-05-08T21:49:44.757017+0000","last_undegraded":"2024-05-08T21:49:44.757017+0000","last_fullsized":"2024-05-08T21:49:44.757017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:09:09.676078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756907+0000","last_change":"2024-05-08T21:49:43.771390+0000","last_active":"2024-05-08T21:49:44.756907+0000","last_peered":"2024-05-08T21:49:44.756907+0000","last_clean":"2024-05-08T21:49:44.756907+0000","last_became_active":"2024-05-08T21:49:43.770893+0000","last_became_peered":"2024-05-08T21:49:43.770893+0000","last_unstale":"2024-05-08T21:49:44.756907+0000","last_undegraded":"2024-05-08T21:49:44.756907+0000","last_fullsized":"2024-05-08T21:49:44.756907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:28.979468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.754916+0000","last_change":"2024-05-08T21:49:43.765080+0000","last_active":"2024-05-08T21:49:44.754916+0000","last_peered":"2024-05-08T21:49:44.754916+0000","last_clean":"2024-05-08T21:49:44.754916+0000","last_became_active":"2024-05-08T21:49:43.764810+0000","last_became_peered":"2024-05-08T21:49:43.764810+0000","last_unstale":"2024-05-08T21:49:44.754916+0000","last_undegraded":"2024-05-08T21:49:44.754916+0000","last_fullsized":"2024-05-08T21:49:44.754916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:24:11.223913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756634+0000","last_change":"2024-05-08T21:49:43.766717+0000","last_active":"2024-05-08T21:49:44.756634+0000","last_peered":"2024-05-08T21:49:44.756634+0000","last_clean":"2024-05-08T21:49:44.756634+0000","last_became_active":"2024-05-08T21:49:43.766427+0000","last_became_peered":"2024-05-08T21:49:43.766427+0000","last_unstale":"2024-05-08T21:49:44.756634+0000","last_undegraded":"2024-05-08T21:49:44.756634+0000","last_fullsized":"2024-05-08T21:49:44.756634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:49:22.833820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757256+0000","last_change":"2024-05-08T21:49:43.776929+0000","last_active":"2024-05-08T21:49:44.757256+0000","last_peered":"2024-05-08T21:49:44.757256+0000","last_clean":"2024-05-08T21:49:44.757256+0000","last_became_active":"2024-05-08T21:49:43.776509+0000","last_became_peered":"2024-05-08T21:49:43.776509+0000","last_unstale":"2024-05-08T21:49:44.757256+0000","last_undegraded":"2024-05-08T21:49:44.757256+0000","last_fullsized":"2024-05-08T21:49:44.757256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:26.199459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T21:49:42.206879+0000","last_change":"2024-05-08T21:49:42.206879+0000","last_active":"2024-05-08T21:49:42.193474+0000","last_peered":"2024-05-08T21:49:42.193474+0000","last_clean":"2024-05-08T21:49:42.193474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:42.206879+0000","last_undegraded":"2024-05-08T21:49:42.206879+0000","last_fullsized":"2024-05-08T21:49:42.206879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:02:45.778415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T21:49:42.203256+0000","last_change":"2024-05-08T21:49:42.203256+0000","last_active":"2024-05-08T21:49:42.193474+0000","last_peered":"2024-05-08T21:49:42.193474+0000","last_clean":"2024-05-08T21:49:42.193474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:42.203256+0000","last_undegraded":"2024-05-08T21:49:42.203256+0000","last_fullsized":"2024-05-08T21:49:42.203256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:17.379362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T21:49:42.207304+0000","last_change":"2024-05-08T21:49:42.207304+0000","last_active":"2024-05-08T21:49:42.193474+0000","last_peered":"2024-05-08T21:49:42.193474+0000","last_clean":"2024-05-08T21:49:42.193474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:42.207304+0000","last_undegraded":"2024-05-08T21:49:42.207304+0000","last_fullsized":"2024-05-08T21:49:42.207304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:01.844011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756849+0000","last_change":"2024-05-08T21:49:43.766694+0000","last_active":"2024-05-08T21:49:44.756849+0000","last_peered":"2024-05-08T21:49:44.756849+0000","last_clean":"2024-05-08T21:49:44.756849+0000","last_became_active":"2024-05-08T21:49:43.766079+0000","last_became_peered":"2024-05-08T21:49:43.766079+0000","last_unstale":"2024-05-08T21:49:44.756849+0000","last_undegraded":"2024-05-08T21:49:44.756849+0000","last_fullsized":"2024-05-08T21:49:44.756849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:01:16.682080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T21:49:42.206963+0000","last_change":"2024-05-08T21:49:42.206963+0000","last_active":"2024-05-08T21:49:42.193474+0000","last_peered":"2024-05-08T21:49:42.193474+0000","last_clean":"2024-05-08T21:49:42.193474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:42.206963+0000","last_undegraded":"2024-05-08T21:49:42.206963+0000","last_fullsized":"2024-05-08T21:49:42.206963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:33:12.827218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757018+0000","last_change":"2024-05-08T21:49:43.771097+0000","last_active":"2024-05-08T21:49:44.757018+0000","last_peered":"2024-05-08T21:49:44.757018+0000","last_clean":"2024-05-08T21:49:44.757018+0000","last_became_active":"2024-05-08T21:49:43.770727+0000","last_became_peered":"2024-05-08T21:49:43.770727+0000","last_unstale":"2024-05-08T21:49:44.757018+0000","last_undegraded":"2024-05-08T21:49:44.757018+0000","last_fullsized":"2024-05-08T21:49:44.757018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:24:02.741766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T21:49:42.203244+0000","last_change":"2024-05-08T21:49:42.203244+0000","last_active":"2024-05-08T21:49:42.193474+0000","last_peered":"2024-05-08T21:49:42.193474+0000","last_clean":"2024-05-08T21:49:42.193474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:42.203244+0000","last_undegraded":"2024-05-08T21:49:42.203244+0000","last_fullsized":"2024-05-08T21:49:42.203244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:33:28.074468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T21:49:42.203787+0000","last_change":"2024-05-08T21:49:42.203787+0000","last_active":"2024-05-08T21:49:42.193474+0000","last_peered":"2024-05-08T21:49:42.193474+0000","last_clean":"2024-05-08T21:49:42.193474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:42.203787+0000","last_undegraded":"2024-05-08T21:49:42.203787+0000","last_fullsized":"2024-05-08T21:49:42.203787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:10.497167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T21:49:42.203257+0000","last_change":"2024-05-08T21:49:42.203257+0000","last_active":"2024-05-08T21:49:42.193474+0000","last_peered":"2024-05-08T21:49:42.193474+0000","last_clean":"2024-05-08T21:49:42.193474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:42.203257+0000","last_undegraded":"2024-05-08T21:49:42.203257+0000","last_fullsized":"2024-05-08T21:49:42.203257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:20:34.123736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756625+0000","last_change":"2024-05-08T21:49:43.225299+0000","last_active":"2024-05-08T21:49:44.756625+0000","last_peered":"2024-05-08T21:49:44.756625+0000","last_clean":"2024-05-08T21:49:44.756625+0000","last_became_active":"2024-05-08T21:49:43.225057+0000","last_became_peered":"2024-05-08T21:49:43.225057+0000","last_unstale":"2024-05-08T21:49:44.756625+0000","last_undegraded":"2024-05-08T21:49:44.756625+0000","last_fullsized":"2024-05-08T21:49:44.756625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:38:43.069159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755021+0000","last_change":"2024-05-08T21:49:43.757361+0000","last_active":"2024-05-08T21:49:44.755021+0000","last_peered":"2024-05-08T21:49:44.755021+0000","last_clean":"2024-05-08T21:49:44.755021+0000","last_became_active":"2024-05-08T21:49:43.757092+0000","last_became_peered":"2024-05-08T21:49:43.757092+0000","last_unstale":"2024-05-08T21:49:44.755021+0000","last_undegraded":"2024-05-08T21:49:44.755021+0000","last_fullsized":"2024-05-08T21:49:44.755021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:24:02.741766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T21:49:42.204534+0000","last_change":"2024-05-08T21:49:42.204534+0000","last_active":"2024-05-08T21:49:42.193474+0000","last_peered":"2024-05-08T21:49:42.193474+0000","last_clean":"2024-05-08T21:49:42.193474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:42.204534+0000","last_undegraded":"2024-05-08T21:49:42.204534+0000","last_fullsized":"2024-05-08T21:49:42.204534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:18:58.164159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757172+0000","last_change":"2024-05-08T21:49:43.773243+0000","last_active":"2024-05-08T21:49:44.757172+0000","last_peered":"2024-05-08T21:49:44.757172+0000","last_clean":"2024-05-08T21:49:44.757172+0000","last_became_active":"2024-05-08T21:49:43.772944+0000","last_became_peered":"2024-05-08T21:49:43.772944+0000","last_unstale":"2024-05-08T21:49:44.757172+0000","last_undegraded":"2024-05-08T21:49:44.757172+0000","last_fullsized":"2024-05-08T21:49:44.757172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:21:41.238890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757107+0000","last_change":"2024-05-08T21:49:43.224999+0000","last_active":"2024-05-08T21:49:44.757107+0000","last_peered":"2024-05-08T21:49:44.757107+0000","last_clean":"2024-05-08T21:49:44.757107+0000","last_became_active":"2024-05-08T21:49:43.223476+0000","last_became_peered":"2024-05-08T21:49:43.223476+0000","last_unstale":"2024-05-08T21:49:44.757107+0000","last_undegraded":"2024-05-08T21:49:44.757107+0000","last_fullsized":"2024-05-08T21:49:44.757107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:09:12.983430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755246+0000","last_change":"2024-05-08T21:49:43.224378+0000","last_active":"2024-05-08T21:49:44.755246+0000","last_peered":"2024-05-08T21:49:44.755246+0000","last_clean":"2024-05-08T21:49:44.755246+0000","last_became_active":"2024-05-08T21:49:43.224164+0000","last_became_peered":"2024-05-08T21:49:43.224164+0000","last_unstale":"2024-05-08T21:49:44.755246+0000","last_undegraded":"2024-05-08T21:49:44.755246+0000","last_fullsized":"2024-05-08T21:49:44.755246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:06:10.276907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T21:49:42.203786+0000","last_change":"2024-05-08T21:49:42.203786+0000","last_active":"2024-05-08T21:49:42.193474+0000","last_peered":"2024-05-08T21:49:42.193474+0000","last_clean":"2024-05-08T21:49:42.193474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:42.203786+0000","last_undegraded":"2024-05-08T21:49:42.203786+0000","last_fullsized":"2024-05-08T21:49:42.203786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:17.379362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T21:49:42.206849+0000","last_change":"2024-05-08T21:49:42.206849+0000","last_active":"2024-05-08T21:49:42.193474+0000","last_peered":"2024-05-08T21:49:42.193474+0000","last_clean":"2024-05-08T21:49:42.193474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:42.206849+0000","last_undegraded":"2024-05-08T21:49:42.206849+0000","last_fullsized":"2024-05-08T21:49:42.206849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:20:34.123736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757128+0000","last_change":"2024-05-08T21:49:43.227386+0000","last_active":"2024-05-08T21:49:44.757128+0000","last_peered":"2024-05-08T21:49:44.757128+0000","last_clean":"2024-05-08T21:49:44.757128+0000","last_became_active":"2024-05-08T21:49:43.227065+0000","last_became_peered":"2024-05-08T21:49:43.227065+0000","last_unstale":"2024-05-08T21:49:44.757128+0000","last_undegraded":"2024-05-08T21:49:44.757128+0000","last_fullsized":"2024-05-08T21:49:44.757128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:43:48.019170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T21:49:42.204720+0000","last_change":"2024-05-08T21:49:42.204720+0000","last_active":"2024-05-08T21:49:42.193474+0000","last_peered":"2024-05-08T21:49:42.193474+0000","last_clean":"2024-05-08T21:49:42.193474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:42.204720+0000","last_undegraded":"2024-05-08T21:49:42.204720+0000","last_fullsized":"2024-05-08T21:49:42.204720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:52.323917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T21:49:42.217091+0000","last_change":"2024-05-08T21:49:42.217091+0000","last_active":"2024-05-08T21:49:42.193474+0000","last_peered":"2024-05-08T21:49:42.193474+0000","last_clean":"2024-05-08T21:49:42.193474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:42.217091+0000","last_undegraded":"2024-05-08T21:49:42.217091+0000","last_fullsized":"2024-05-08T21:49:42.217091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:10.497167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T21:49:42.209363+0000","last_change":"2024-05-08T21:49:42.209363+0000","last_active":"2024-05-08T21:49:42.193474+0000","last_peered":"2024-05-08T21:49:42.193474+0000","last_clean":"2024-05-08T21:49:42.193474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:42.209363+0000","last_undegraded":"2024-05-08T21:49:42.209363+0000","last_fullsized":"2024-05-08T21:49:42.209363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:41:35.881003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755188+0000","last_change":"2024-05-08T21:49:43.215293+0000","last_active":"2024-05-08T21:49:44.755188+0000","last_peered":"2024-05-08T21:49:44.755188+0000","last_clean":"2024-05-08T21:49:44.755188+0000","last_became_active":"2024-05-08T21:49:43.215048+0000","last_became_peered":"2024-05-08T21:49:43.215048+0000","last_unstale":"2024-05-08T21:49:44.755188+0000","last_undegraded":"2024-05-08T21:49:44.755188+0000","last_fullsized":"2024-05-08T21:49:44.755188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:43:48.019170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757129+0000","last_change":"2024-05-08T21:49:43.770326+0000","last_active":"2024-05-08T21:49:44.757129+0000","last_peered":"2024-05-08T21:49:44.757129+0000","last_clean":"2024-05-08T21:49:44.757129+0000","last_became_active":"2024-05-08T21:49:43.770029+0000","last_became_peered":"2024-05-08T21:49:43.770029+0000","last_unstale":"2024-05-08T21:49:44.757129+0000","last_undegraded":"2024-05-08T21:49:44.757129+0000","last_fullsized":"2024-05-08T21:49:44.757129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:33:33.642847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757017+0000","last_change":"2024-05-08T21:49:43.227710+0000","last_active":"2024-05-08T21:49:44.757017+0000","last_peered":"2024-05-08T21:49:44.757017+0000","last_clean":"2024-05-08T21:49:44.757017+0000","last_became_active":"2024-05-08T21:49:43.227430+0000","last_became_peered":"2024-05-08T21:49:43.227430+0000","last_unstale":"2024-05-08T21:49:44.757017+0000","last_undegraded":"2024-05-08T21:49:44.757017+0000","last_fullsized":"2024-05-08T21:49:44.757017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:05:58.875400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.754953+0000","last_change":"2024-05-08T21:49:43.758618+0000","last_active":"2024-05-08T21:49:44.754953+0000","last_peered":"2024-05-08T21:49:44.754953+0000","last_clean":"2024-05-08T21:49:44.754953+0000","last_became_active":"2024-05-08T21:49:43.758367+0000","last_became_peered":"2024-05-08T21:49:43.758367+0000","last_unstale":"2024-05-08T21:49:44.754953+0000","last_undegraded":"2024-05-08T21:49:44.754953+0000","last_fullsized":"2024-05-08T21:49:44.754953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:30:06.569971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T21:49:42.217162+0000","last_change":"2024-05-08T21:49:42.217162+0000","last_active":"2024-05-08T21:49:42.193474+0000","last_peered":"2024-05-08T21:49:42.193474+0000","last_clean":"2024-05-08T21:49:42.193474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:42.217162+0000","last_undegraded":"2024-05-08T21:49:42.217162+0000","last_fullsized":"2024-05-08T21:49:42.217162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:17.379362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756759+0000","last_change":"2024-05-08T21:49:43.224929+0000","last_active":"2024-05-08T21:49:44.756759+0000","last_peered":"2024-05-08T21:49:44.756759+0000","last_clean":"2024-05-08T21:49:44.756759+0000","last_became_active":"2024-05-08T21:49:43.223469+0000","last_became_peered":"2024-05-08T21:49:43.223469+0000","last_unstale":"2024-05-08T21:49:44.756759+0000","last_undegraded":"2024-05-08T21:49:44.756759+0000","last_fullsized":"2024-05-08T21:49:44.756759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:27.504127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":161,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-08T21:49:39.634710+0000","last_change":"2024-05-08T21:49:38.626519+0000","last_active":"2024-05-08T21:49:39.634710+0000","last_peered":"2024-05-08T21:49:39.634710+0000","last_clean":"2024-05-08T21:49:39.634710+0000","last_became_active":"2024-05-08T21:49:38.626159+0000","last_became_peered":"2024-05-08T21:49:38.626159+0000","last_unstale":"2024-05-08T21:49:39.634710+0000","last_undegraded":"2024-05-08T21:49:39.634710+0000","last_fullsized":"2024-05-08T21:49:39.634710+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:36.031649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:36.031649+0000","last_clean_scrub_stamp":"2024-05-08T21:49:36.031649+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:12:04.846500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T21:49:42.206520+0000","last_change":"2024-05-08T21:49:42.206520+0000","last_active":"2024-05-08T21:49:42.193474+0000","last_peered":"2024-05-08T21:49:42.193474+0000","last_clean":"2024-05-08T21:49:42.193474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:42.206520+0000","last_undegraded":"2024-05-08T21:49:42.206520+0000","last_fullsized":"2024-05-08T21:49:42.206520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:52.323917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T21:49:42.206709+0000","last_change":"2024-05-08T21:49:42.206709+0000","last_active":"2024-05-08T21:49:42.193474+0000","last_peered":"2024-05-08T21:49:42.193474+0000","last_clean":"2024-05-08T21:49:42.193474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:42.206709+0000","last_undegraded":"2024-05-08T21:49:42.206709+0000","last_fullsized":"2024-05-08T21:49:42.206709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:18:58.164159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755021+0000","last_change":"2024-05-08T21:49:43.758424+0000","last_active":"2024-05-08T21:49:44.755021+0000","last_peered":"2024-05-08T21:49:44.755021+0000","last_clean":"2024-05-08T21:49:44.755021+0000","last_became_active":"2024-05-08T21:49:43.758140+0000","last_became_peered":"2024-05-08T21:49:43.758140+0000","last_unstale":"2024-05-08T21:49:44.755021+0000","last_undegraded":"2024-05-08T21:49:44.755021+0000","last_fullsized":"2024-05-08T21:49:44.755021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:10.795540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755053+0000","last_change":"2024-05-08T21:49:43.218241+0000","last_active":"2024-05-08T21:49:44.755053+0000","last_peered":"2024-05-08T21:49:44.755053+0000","last_clean":"2024-05-08T21:49:44.755053+0000","last_became_active":"2024-05-08T21:49:43.217780+0000","last_became_peered":"2024-05-08T21:49:43.217780+0000","last_unstale":"2024-05-08T21:49:44.755053+0000","last_undegraded":"2024-05-08T21:49:44.755053+0000","last_fullsized":"2024-05-08T21:49:44.755053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:27.504127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T21:49:42.203786+0000","last_change":"2024-05-08T21:49:42.203786+0000","last_active":"2024-05-08T21:49:42.193474+0000","last_peered":"2024-05-08T21:49:42.193474+0000","last_clean":"2024-05-08T21:49:42.193474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:42.203786+0000","last_undegraded":"2024-05-08T21:49:42.203786+0000","last_fullsized":"2024-05-08T21:49:42.203786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:33:28.074468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T21:49:42.207910+0000","last_change":"2024-05-08T21:49:42.207910+0000","last_active":"2024-05-08T21:49:42.193474+0000","last_peered":"2024-05-08T21:49:42.193474+0000","last_clean":"2024-05-08T21:49:42.193474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:42.207910+0000","last_undegraded":"2024-05-08T21:49:42.207910+0000","last_fullsized":"2024-05-08T21:49:42.207910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:10.497167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.754925+0000","last_change":"2024-05-08T21:49:43.215361+0000","last_active":"2024-05-08T21:49:44.754925+0000","last_peered":"2024-05-08T21:49:44.754925+0000","last_clean":"2024-05-08T21:49:44.754925+0000","last_became_active":"2024-05-08T21:49:43.215162+0000","last_became_peered":"2024-05-08T21:49:43.215162+0000","last_unstale":"2024-05-08T21:49:44.754925+0000","last_undegraded":"2024-05-08T21:49:44.754925+0000","last_fullsized":"2024-05-08T21:49:44.754925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:05:58.875400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755100+0000","last_change":"2024-05-08T21:49:43.217935+0000","last_active":"2024-05-08T21:49:44.755100+0000","last_peered":"2024-05-08T21:49:44.755100+0000","last_clean":"2024-05-08T21:49:44.755100+0000","last_became_active":"2024-05-08T21:49:43.217595+0000","last_became_peered":"2024-05-08T21:49:43.217595+0000","last_unstale":"2024-05-08T21:49:44.755100+0000","last_undegraded":"2024-05-08T21:49:44.755100+0000","last_fullsized":"2024-05-08T21:49:44.755100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:38:43.069159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T21:49:42.206656+0000","last_change":"2024-05-08T21:49:42.206656+0000","last_active":"2024-05-08T21:49:42.193474+0000","last_peered":"2024-05-08T21:49:42.193474+0000","last_clean":"2024-05-08T21:49:42.193474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:42.206656+0000","last_undegraded":"2024-05-08T21:49:42.206656+0000","last_fullsized":"2024-05-08T21:49:42.206656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:03.961487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T21:49:42.217098+0000","last_change":"2024-05-08T21:49:42.217098+0000","last_active":"2024-05-08T21:49:42.193474+0000","last_peered":"2024-05-08T21:49:42.193474+0000","last_clean":"2024-05-08T21:49:42.193474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:42.217098+0000","last_undegraded":"2024-05-08T21:49:42.217098+0000","last_fullsized":"2024-05-08T21:49:42.217098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:33:28.074468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755187+0000","last_change":"2024-05-08T21:49:43.208581+0000","last_active":"2024-05-08T21:49:44.755187+0000","last_peered":"2024-05-08T21:49:44.755187+0000","last_clean":"2024-05-08T21:49:44.755187+0000","last_became_active":"2024-05-08T21:49:43.208326+0000","last_became_peered":"2024-05-08T21:49:43.208326+0000","last_unstale":"2024-05-08T21:49:44.755187+0000","last_undegraded":"2024-05-08T21:49:44.755187+0000","last_fullsized":"2024-05-08T21:49:44.755187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:13:35.461791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756911+0000","last_change":"2024-05-08T21:49:43.766519+0000","last_active":"2024-05-08T21:49:44.756911+0000","last_peered":"2024-05-08T21:49:44.756911+0000","last_clean":"2024-05-08T21:49:44.756911+0000","last_became_active":"2024-05-08T21:49:43.765789+0000","last_became_peered":"2024-05-08T21:49:43.765789+0000","last_unstale":"2024-05-08T21:49:44.756911+0000","last_undegraded":"2024-05-08T21:49:44.756911+0000","last_fullsized":"2024-05-08T21:49:44.756911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:23.674986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T21:49:42.217041+0000","last_change":"2024-05-08T21:49:42.217041+0000","last_active":"2024-05-08T21:49:42.193474+0000","last_peered":"2024-05-08T21:49:42.193474+0000","last_clean":"2024-05-08T21:49:42.193474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:42.217041+0000","last_undegraded":"2024-05-08T21:49:42.217041+0000","last_fullsized":"2024-05-08T21:49:42.217041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:18:58.164159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757080+0000","last_change":"2024-05-08T21:49:43.768929+0000","last_active":"2024-05-08T21:49:44.757080+0000","last_peered":"2024-05-08T21:49:44.757080+0000","last_clean":"2024-05-08T21:49:44.757080+0000","last_became_active":"2024-05-08T21:49:43.767606+0000","last_became_peered":"2024-05-08T21:49:43.767606+0000","last_unstale":"2024-05-08T21:49:44.757080+0000","last_undegraded":"2024-05-08T21:49:44.757080+0000","last_fullsized":"2024-05-08T21:49:44.757080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:13:06.426154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755114+0000","last_change":"2024-05-08T21:49:43.757318+0000","last_active":"2024-05-08T21:49:44.755114+0000","last_peered":"2024-05-08T21:49:44.755114+0000","last_clean":"2024-05-08T21:49:44.755114+0000","last_became_active":"2024-05-08T21:49:43.757083+0000","last_became_peered":"2024-05-08T21:49:43.757083+0000","last_unstale":"2024-05-08T21:49:44.755114+0000","last_undegraded":"2024-05-08T21:49:44.755114+0000","last_fullsized":"2024-05-08T21:49:44.755114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:47.551474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756761+0000","last_change":"2024-05-08T21:49:43.768942+0000","last_active":"2024-05-08T21:49:44.756761+0000","last_peered":"2024-05-08T21:49:44.756761+0000","last_clean":"2024-05-08T21:49:44.756761+0000","last_became_active":"2024-05-08T21:49:43.768673+0000","last_became_peered":"2024-05-08T21:49:43.768673+0000","last_unstale":"2024-05-08T21:49:44.756761+0000","last_undegraded":"2024-05-08T21:49:44.756761+0000","last_fullsized":"2024-05-08T21:49:44.756761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:15:41.869107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756863+0000","last_change":"2024-05-08T21:49:43.775098+0000","last_active":"2024-05-08T21:49:44.756863+0000","last_peered":"2024-05-08T21:49:44.756863+0000","last_clean":"2024-05-08T21:49:44.756863+0000","last_became_active":"2024-05-08T21:49:43.774808+0000","last_became_peered":"2024-05-08T21:49:43.774808+0000","last_unstale":"2024-05-08T21:49:44.756863+0000","last_undegraded":"2024-05-08T21:49:44.756863+0000","last_fullsized":"2024-05-08T21:49:44.756863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:51:15.152611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":36,"acting":36,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28376,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343464,"statfs":{"total":96636764160,"available":96607707136,"internally_reserved":0,"allocated":753664,"data_stored":638290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]}]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":159744,"data_stored":47922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":73089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":73089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]}]},{"osd":0,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":765952,"data_stored":644107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]}]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":172032,"data_stored":53739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]}]},{"osd":3,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":159744,"data_stored":47922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]}]},{"osd":4,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":159744,"data_stored":47922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T21:49:48.880 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T21:49:49.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.045+0000 7f9bbbbb1700 1 Processor -- start 2024-05-08T21:49:49.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.045+0000 7f9bbbbb1700 1 -- start start 2024-05-08T21:49:49.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.046+0000 7f9bbbbb1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9bb406f700 0x7f9bb40c8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:49.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.046+0000 7f9bbbbb1700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9bb40c6510 0x7f9bb40c93f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:49.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.046+0000 7f9bbbbb1700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bb40c77e0 con 0x7f9bb4153d20 2024-05-08T21:49:49.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.046+0000 7f9bbbbb1700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bb40c7da0 con 0x7f9bb40c6510 2024-05-08T21:49:49.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.046+0000 7f9bbbbb1700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb406fc50 con 0x7f9bb406f700 2024-05-08T21:49:49.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.046+0000 7f9bb994d700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f9bb4153d20 0x7f9bb415d160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:51726/0 (socket says 172.21.15.73:51726) 2024-05-08T21:49:49.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.046+0000 7f9bb994d700 1 -- 172.21.15.73:0/965639016 learned_addr learned my addr 172.21.15.73:0/965639016 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:49:49.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.046+0000 7f9bba14e700 1 --2- 172.21.15.73:0/965639016 >> v2:172.21.15.115:3300/0 conn(0x7f9bb40c6510 0x7f9bb40c93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:49.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.046+0000 7f9bb914c700 1 --2- 172.21.15.73:0/965639016 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9bb406f700 0x7f9bb40c8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:49.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.046+0000 7f9bb894b700 1 -- 172.21.15.73:0/965639016 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2401390574 0 0) 0x7f9bb40c77e0 con 0x7f9bb4153d20 2024-05-08T21:49:49.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.046+0000 7f9bb894b700 1 -- 172.21.15.73:0/965639016 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ba00035b0 con 0x7f9bb4153d20 2024-05-08T21:49:49.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.047+0000 7f9bb894b700 1 -- 172.21.15.73:0/965639016 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2935258345 0 0) 0x7f9ba00035b0 con 0x7f9bb4153d20 2024-05-08T21:49:49.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.047+0000 7f9bb894b700 1 -- 172.21.15.73:0/965639016 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9bb406f700 msgr2=0x7f9bb40c8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:49.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.047+0000 7f9bb894b700 1 --2- 172.21.15.73:0/965639016 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9bb406f700 0x7f9bb40c8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:49.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.047+0000 7f9bb894b700 1 -- 172.21.15.73:0/965639016 >> v2:172.21.15.115:3300/0 conn(0x7f9bb40c6510 msgr2=0x7f9bb40c93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:49.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.047+0000 7f9bb894b700 1 --2- 172.21.15.73:0/965639016 >> v2:172.21.15.115:3300/0 conn(0x7f9bb40c6510 0x7f9bb40c93f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:49.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.047+0000 7f9bb894b700 1 -- 172.21.15.73:0/965639016 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb406ff30 con 0x7f9bb4153d20 2024-05-08T21:49:49.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.047+0000 7f9bb894b700 1 -- 172.21.15.73:0/965639016 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 953298616 0 0) 0x7f9bb0001670 con 0x7f9bb4153d20 2024-05-08T21:49:49.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.047+0000 7f9bb894b700 1 -- 172.21.15.73:0/965639016 >> v1:172.21.15.73:6789/0 conn(0x7f9bb4153d20 legacy=0x7f9bb415d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:49.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.047+0000 7f9bb894b700 1 --2- 172.21.15.73:0/965639016 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ba0003a00 0x7f9ba0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:49.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.047+0000 7f9bb894b700 1 --2- 172.21.15.73:0/965639016 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9bb406f700 0x7f9ba0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:49.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.047+0000 7f9bb894b700 1 --2- 172.21.15.73:0/965639016 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9ba0004d90 0x7f9ba0005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:49.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.047+0000 7f9bb894b700 1 -- 172.21.15.73:0/965639016 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb40c7da0 con 0x7f9ba0003a00 2024-05-08T21:49:49.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.047+0000 7f9bb894b700 1 -- 172.21.15.73:0/965639016 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb406fc50 con 0x7f9ba0004d90 2024-05-08T21:49:49.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.047+0000 7f9bb894b700 1 -- 172.21.15.73:0/965639016 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba000ba40 con 0x7f9bb406f700 2024-05-08T21:49:49.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.047+0000 7f9bb994d700 1 --2- 172.21.15.73:0/965639016 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ba0003a00 0x7f9ba0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:49.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.047+0000 7f9bb914c700 1 --2- 172.21.15.73:0/965639016 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9bb406f700 0x7f9ba0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:49.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.047+0000 7f9bba14e700 1 --2- 172.21.15.73:0/965639016 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9ba0004d90 0x7f9ba0005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:49.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.047+0000 7f9bb994d700 1 -- 172.21.15.73:0/965639016 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9bb406f700 msgr2=0x7f9ba0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:49.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.047+0000 7f9bb994d700 1 --2- 172.21.15.73:0/965639016 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9bb406f700 0x7f9ba0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:49.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.047+0000 7f9bb994d700 1 -- 172.21.15.73:0/965639016 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9ba0004d90 msgr2=0x7f9ba0005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:49.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.047+0000 7f9bb994d700 1 --2- 172.21.15.73:0/965639016 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9ba0004d90 0x7f9ba0005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:49.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.047+0000 7f9bb994d700 1 -- 172.21.15.73:0/965639016 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba00035b0 con 0x7f9ba0003a00 2024-05-08T21:49:49.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.047+0000 7f9bb994d700 1 --2- 172.21.15.73:0/965639016 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ba0003a00 0x7f9ba0003e20 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9bb000c320 tx=0x7f9ba0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca424fb7e5f99325 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:49.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.047+0000 7f9bb894b700 1 -- 172.21.15.73:0/965639016 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb000ce60 con 0x7f9ba0003a00 2024-05-08T21:49:49.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.047+0000 7f9bb894b700 1 -- 172.21.15.73:0/965639016 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb0005960 con 0x7f9ba0003a00 2024-05-08T21:49:49.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.047+0000 7f9bb894b700 1 -- 172.21.15.73:0/965639016 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb0005d10 con 0x7f9ba0003a00 2024-05-08T21:49:49.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.048+0000 7f9bbbbb1700 1 -- 172.21.15.73:0/965639016 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ba0003a00 msgr2=0x7f9ba0003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:49.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.048+0000 7f9bbbbb1700 1 --2- 172.21.15.73:0/965639016 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ba0003a00 0x7f9ba0003e20 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9bb000c320 tx=0x7f9ba0005880 comp rx=0 tx=0).stop 2024-05-08T21:49:49.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.048+0000 7f9bba14e700 1 -- 172.21.15.73:0/965639016 reap_dead start 2024-05-08T21:49:49.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.048+0000 7f9bbbbb1700 1 -- 172.21.15.73:0/965639016 shutdown_connections 2024-05-08T21:49:49.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.048+0000 7f9bbbbb1700 1 -- 172.21.15.73:0/965639016 >> 172.21.15.73:0/965639016 conn(0x7f9bb40cc420 msgr2=0x7f9bb40cc800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:49.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.048+0000 7f9bbbbb1700 1 -- 172.21.15.73:0/965639016 shutdown_connections 2024-05-08T21:49:49.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.048+0000 7f9bbbbb1700 1 -- 172.21.15.73:0/965639016 wait complete. 2024-05-08T21:49:49.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.049+0000 7f9bbbbb1700 1 Processor -- start 2024-05-08T21:49:49.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.049+0000 7f9bbbbb1700 1 -- start start 2024-05-08T21:49:49.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.050+0000 7f9bbbbb1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ba0003a00 0x7f9bb414c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:49.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.050+0000 7f9bbbbb1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9bb415a050 0x7f9bb415a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:49.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.050+0000 7f9bbbbb1700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9bb41ed9c0 0x7f9bb41ede40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:49.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.050+0000 7f9bbbbb1700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb414c630 con 0x7f9ba0003a00 2024-05-08T21:49:49.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.050+0000 7f9bbbbb1700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb41ee380 con 0x7f9bb41ed9c0 2024-05-08T21:49:49.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.050+0000 7f9bbbbb1700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb4158c90 con 0x7f9bb415a050 2024-05-08T21:49:49.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.050+0000 7f9bb994d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ba0003a00 0x7f9bb414c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:49.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.050+0000 7f9bb994d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ba0003a00 0x7f9bb414c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38742/0 (socket says 172.21.15.73:38742) 2024-05-08T21:49:49.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.050+0000 7f9bb994d700 1 -- 172.21.15.73:0/2786497905 learned_addr learned my addr 172.21.15.73:0/2786497905 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:49.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.050+0000 7f9bb914c700 1 --2- 172.21.15.73:0/2786497905 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9bb415a050 0x7f9bb415a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:49.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.050+0000 7f9bba14e700 1 --2- 172.21.15.73:0/2786497905 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9bb41ed9c0 0x7f9bb41ede40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:49.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.050+0000 7f9bb994d700 1 -- 172.21.15.73:0/2786497905 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9bb415a050 msgr2=0x7f9bb415a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:49.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.050+0000 7f9bb994d700 1 --2- 172.21.15.73:0/2786497905 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9bb415a050 0x7f9bb415a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:49.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.050+0000 7f9bb994d700 1 -- 172.21.15.73:0/2786497905 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9bb41ed9c0 msgr2=0x7f9bb41ede40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:49.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.050+0000 7f9bb994d700 1 --2- 172.21.15.73:0/2786497905 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9bb41ed9c0 0x7f9bb41ede40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:49.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.050+0000 7f9bb994d700 1 -- 172.21.15.73:0/2786497905 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb4158f70 con 0x7f9ba0003a00 2024-05-08T21:49:49.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.050+0000 7f9bb994d700 1 --2- 172.21.15.73:0/2786497905 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ba0003a00 0x7f9bb414c0f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9bb000c910 tx=0x7f9bb0001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:49.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.050+0000 7f9baa7fc700 1 -- 172.21.15.73:0/2786497905 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb0001680 con 0x7f9ba0003a00 2024-05-08T21:49:49.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.050+0000 7f9baa7fc700 1 -- 172.21.15.73:0/2786497905 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb0004a80 con 0x7f9ba0003a00 2024-05-08T21:49:49.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.050+0000 7f9bbbbb1700 1 -- 172.21.15.73:0/2786497905 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bb4159250 con 0x7f9ba0003a00 2024-05-08T21:49:49.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.050+0000 7f9baa7fc700 1 -- 172.21.15.73:0/2786497905 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb0004e30 con 0x7f9ba0003a00 2024-05-08T21:49:49.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.051+0000 7f9bbbbb1700 1 -- 172.21.15.73:0/2786497905 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bb4159810 con 0x7f9ba0003a00 2024-05-08T21:49:49.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.051+0000 7f9bbbbb1700 1 -- 172.21.15.73:0/2786497905 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bb41ed810 con 0x7f9ba0003a00 2024-05-08T21:49:49.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.052+0000 7f9baa7fc700 1 -- 172.21.15.73:0/2786497905 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9bb00070d0 con 0x7f9ba0003a00 2024-05-08T21:49:49.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.052+0000 7f9baa7fc700 1 --2- 172.21.15.73:0/2786497905 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f9b9806acc0 0x7f9b9806d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:49.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.052+0000 7f9baa7fc700 1 -- 172.21.15.73:0/2786497905 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9bb008a6c0 con 0x7f9ba0003a00 2024-05-08T21:49:49.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.052+0000 7f9bb914c700 1 --2- 172.21.15.73:0/2786497905 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f9b9806acc0 0x7f9b9806d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:49.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.053+0000 7f9bb914c700 1 --2- 172.21.15.73:0/2786497905 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f9b9806acc0 0x7f9b9806d180 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9bb40c99d0 tx=0x7f9ba4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:49.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.057+0000 7f9baa7fc700 1 -- 172.21.15.73:0/2786497905 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f9bb00559f0 con 0x7f9ba0003a00 2024-05-08T21:49:49.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.249+0000 7f9bbbbb1700 1 -- 172.21.15.73:0/2786497905 --> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9bb414c630 con 0x7f9b9806acc0 2024-05-08T21:49:49.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.255+0000 7f9baa7fc700 1 -- 172.21.15.73:0/2786497905 <== mgr.4104 v2:172.21.15.73:6832/46949 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+256954 (secure 0 0 0) 0x7f9bb414c630 con 0x7f9b9806acc0 2024-05-08T21:49:49.256 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:49:49.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.259+0000 7f9bbbbb1700 1 -- 172.21.15.73:0/2786497905 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f9b9806acc0 msgr2=0x7f9b9806d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:49.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.259+0000 7f9bbbbb1700 1 --2- 172.21.15.73:0/2786497905 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f9b9806acc0 0x7f9b9806d180 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9bb40c99d0 tx=0x7f9ba4008040 comp rx=0 tx=0).stop 2024-05-08T21:49:49.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.259+0000 7f9bbbbb1700 1 -- 172.21.15.73:0/2786497905 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ba0003a00 msgr2=0x7f9bb414c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:49.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.259+0000 7f9bbbbb1700 1 --2- 172.21.15.73:0/2786497905 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ba0003a00 0x7f9bb414c0f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9bb000c910 tx=0x7f9bb0001a00 comp rx=0 tx=0).stop 2024-05-08T21:49:49.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.259+0000 7f9bbbbb1700 1 -- 172.21.15.73:0/2786497905 shutdown_connections 2024-05-08T21:49:49.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.259+0000 7f9bbbbb1700 1 --2- 172.21.15.73:0/2786497905 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f9b9806acc0 0x7f9b9806d180 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:49.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.259+0000 7f9bbbbb1700 1 --2- 172.21.15.73:0/2786497905 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9bb41ed9c0 0x7f9bb41ede40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:49.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.259+0000 7f9bbbbb1700 1 --2- 172.21.15.73:0/2786497905 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ba0003a00 0x7f9bb414c0f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:49.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.259+0000 7f9bbbbb1700 1 --2- 172.21.15.73:0/2786497905 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9bb415a050 0x7f9bb415a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:49.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.259+0000 7f9bbbbb1700 1 -- 172.21.15.73:0/2786497905 >> 172.21.15.73:0/2786497905 conn(0x7f9bb40cc420 msgr2=0x7f9bb40caa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:49.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.259+0000 7f9bbbbb1700 1 -- 172.21.15.73:0/2786497905 shutdown_connections 2024-05-08T21:49:49.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.259+0000 7f9bbbbb1700 1 -- 172.21.15.73:0/2786497905 wait complete. 2024-05-08T21:49:49.264 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-05-08T21:49:49.271 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-05-08T21:49:47.950948+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":102,"acting":102,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":21,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219440,"kb_used_data":2528,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755280,"statfs":{"total":773094113280,"available":772869406720,"internally_reserved":0,"allocated":2588672,"data_stored":1626080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.748514"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755108+0000","last_change":"2024-05-08T21:49:43.766984+0000","last_active":"2024-05-08T21:49:44.755108+0000","last_peered":"2024-05-08T21:49:44.755108+0000","last_clean":"2024-05-08T21:49:44.755108+0000","last_became_active":"2024-05-08T21:49:43.765995+0000","last_became_peered":"2024-05-08T21:49:43.765995+0000","last_unstale":"2024-05-08T21:49:44.755108+0000","last_undegraded":"2024-05-08T21:49:44.755108+0000","last_fullsized":"2024-05-08T21:49:44.755108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:21:41.238890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757017+0000","last_change":"2024-05-08T21:49:43.766355+0000","last_active":"2024-05-08T21:49:44.757017+0000","last_peered":"2024-05-08T21:49:44.757017+0000","last_clean":"2024-05-08T21:49:44.757017+0000","last_became_active":"2024-05-08T21:49:43.765507+0000","last_became_peered":"2024-05-08T21:49:43.765507+0000","last_unstale":"2024-05-08T21:49:44.757017+0000","last_undegraded":"2024-05-08T21:49:44.757017+0000","last_fullsized":"2024-05-08T21:49:44.757017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:09:09.676078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756907+0000","last_change":"2024-05-08T21:49:43.771390+0000","last_active":"2024-05-08T21:49:44.756907+0000","last_peered":"2024-05-08T21:49:44.756907+0000","last_clean":"2024-05-08T21:49:44.756907+0000","last_became_active":"2024-05-08T21:49:43.770893+0000","last_became_peered":"2024-05-08T21:49:43.770893+0000","last_unstale":"2024-05-08T21:49:44.756907+0000","last_undegraded":"2024-05-08T21:49:44.756907+0000","last_fullsized":"2024-05-08T21:49:44.756907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:28.979468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.754916+0000","last_change":"2024-05-08T21:49:43.765080+0000","last_active":"2024-05-08T21:49:44.754916+0000","last_peered":"2024-05-08T21:49:44.754916+0000","last_clean":"2024-05-08T21:49:44.754916+0000","last_became_active":"2024-05-08T21:49:43.764810+0000","last_became_peered":"2024-05-08T21:49:43.764810+0000","last_unstale":"2024-05-08T21:49:44.754916+0000","last_undegraded":"2024-05-08T21:49:44.754916+0000","last_fullsized":"2024-05-08T21:49:44.754916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:24:11.223913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756634+0000","last_change":"2024-05-08T21:49:43.766717+0000","last_active":"2024-05-08T21:49:44.756634+0000","last_peered":"2024-05-08T21:49:44.756634+0000","last_clean":"2024-05-08T21:49:44.756634+0000","last_became_active":"2024-05-08T21:49:43.766427+0000","last_became_peered":"2024-05-08T21:49:43.766427+0000","last_unstale":"2024-05-08T21:49:44.756634+0000","last_undegraded":"2024-05-08T21:49:44.756634+0000","last_fullsized":"2024-05-08T21:49:44.756634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:49:22.833820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757256+0000","last_change":"2024-05-08T21:49:43.776929+0000","last_active":"2024-05-08T21:49:44.757256+0000","last_peered":"2024-05-08T21:49:44.757256+0000","last_clean":"2024-05-08T21:49:44.757256+0000","last_became_active":"2024-05-08T21:49:43.776509+0000","last_became_peered":"2024-05-08T21:49:43.776509+0000","last_unstale":"2024-05-08T21:49:44.757256+0000","last_undegraded":"2024-05-08T21:49:44.757256+0000","last_fullsized":"2024-05-08T21:49:44.757256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:26.199459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T21:49:42.206879+0000","last_change":"2024-05-08T21:49:42.206879+0000","last_active":"2024-05-08T21:49:42.193474+0000","last_peered":"2024-05-08T21:49:42.193474+0000","last_clean":"2024-05-08T21:49:42.193474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:42.206879+0000","last_undegraded":"2024-05-08T21:49:42.206879+0000","last_fullsized":"2024-05-08T21:49:42.206879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:02:45.778415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T21:49:42.203256+0000","last_change":"2024-05-08T21:49:42.203256+0000","last_active":"2024-05-08T21:49:42.193474+0000","last_peered":"2024-05-08T21:49:42.193474+0000","last_clean":"2024-05-08T21:49:42.193474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:42.203256+0000","last_undegraded":"2024-05-08T21:49:42.203256+0000","last_fullsized":"2024-05-08T21:49:42.203256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:17.379362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T21:49:42.207304+0000","last_change":"2024-05-08T21:49:42.207304+0000","last_active":"2024-05-08T21:49:42.193474+0000","last_peered":"2024-05-08T21:49:42.193474+0000","last_clean":"2024-05-08T21:49:42.193474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:42.207304+0000","last_undegraded":"2024-05-08T21:49:42.207304+0000","last_fullsized":"2024-05-08T21:49:42.207304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:01.844011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756849+0000","last_change":"2024-05-08T21:49:43.766694+0000","last_active":"2024-05-08T21:49:44.756849+0000","last_peered":"2024-05-08T21:49:44.756849+0000","last_clean":"2024-05-08T21:49:44.756849+0000","last_became_active":"2024-05-08T21:49:43.766079+0000","last_became_peered":"2024-05-08T21:49:43.766079+0000","last_unstale":"2024-05-08T21:49:44.756849+0000","last_undegraded":"2024-05-08T21:49:44.756849+0000","last_fullsized":"2024-05-08T21:49:44.756849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:01:16.682080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T21:49:42.206963+0000","last_change":"2024-05-08T21:49:42.206963+0000","last_active":"2024-05-08T21:49:42.193474+0000","last_peered":"2024-05-08T21:49:42.193474+0000","last_clean":"2024-05-08T21:49:42.193474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:42.206963+0000","last_undegraded":"2024-05-08T21:49:42.206963+0000","last_fullsized":"2024-05-08T21:49:42.206963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:33:12.827218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757018+0000","last_change":"2024-05-08T21:49:43.771097+0000","last_active":"2024-05-08T21:49:44.757018+0000","last_peered":"2024-05-08T21:49:44.757018+0000","last_clean":"2024-05-08T21:49:44.757018+0000","last_became_active":"2024-05-08T21:49:43.770727+0000","last_became_peered":"2024-05-08T21:49:43.770727+0000","last_unstale":"2024-05-08T21:49:44.757018+0000","last_undegraded":"2024-05-08T21:49:44.757018+0000","last_fullsized":"2024-05-08T21:49:44.757018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:24:02.741766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T21:49:42.203244+0000","last_change":"2024-05-08T21:49:42.203244+0000","last_active":"2024-05-08T21:49:42.193474+0000","last_peered":"2024-05-08T21:49:42.193474+0000","last_clean":"2024-05-08T21:49:42.193474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:42.203244+0000","last_undegraded":"2024-05-08T21:49:42.203244+0000","last_fullsized":"2024-05-08T21:49:42.203244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:33:28.074468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T21:49:42.203787+0000","last_change":"2024-05-08T21:49:42.203787+0000","last_active":"2024-05-08T21:49:42.193474+0000","last_peered":"2024-05-08T21:49:42.193474+0000","last_clean":"2024-05-08T21:49:42.193474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:42.203787+0000","last_undegraded":"2024-05-08T21:49:42.203787+0000","last_fullsized":"2024-05-08T21:49:42.203787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:10.497167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T21:49:42.203257+0000","last_change":"2024-05-08T21:49:42.203257+0000","last_active":"2024-05-08T21:49:42.193474+0000","last_peered":"2024-05-08T21:49:42.193474+0000","last_clean":"2024-05-08T21:49:42.193474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:42.203257+0000","last_undegraded":"2024-05-08T21:49:42.203257+0000","last_fullsized":"2024-05-08T21:49:42.203257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:20:34.123736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756625+0000","last_change":"2024-05-08T21:49:43.225299+0000","last_active":"2024-05-08T21:49:44.756625+0000","last_peered":"2024-05-08T21:49:44.756625+0000","last_clean":"2024-05-08T21:49:44.756625+0000","last_became_active":"2024-05-08T21:49:43.225057+0000","last_became_peered":"2024-05-08T21:49:43.225057+0000","last_unstale":"2024-05-08T21:49:44.756625+0000","last_undegraded":"2024-05-08T21:49:44.756625+0000","last_fullsized":"2024-05-08T21:49:44.756625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:38:43.069159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755021+0000","last_change":"2024-05-08T21:49:43.757361+0000","last_active":"2024-05-08T21:49:44.755021+0000","last_peered":"2024-05-08T21:49:44.755021+0000","last_clean":"2024-05-08T21:49:44.755021+0000","last_became_active":"2024-05-08T21:49:43.757092+0000","last_became_peered":"2024-05-08T21:49:43.757092+0000","last_unstale":"2024-05-08T21:49:44.755021+0000","last_undegraded":"2024-05-08T21:49:44.755021+0000","last_fullsized":"2024-05-08T21:49:44.755021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:24:02.741766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T21:49:42.204534+0000","last_change":"2024-05-08T21:49:42.204534+0000","last_active":"2024-05-08T21:49:42.193474+0000","last_peered":"2024-05-08T21:49:42.193474+0000","last_clean":"2024-05-08T21:49:42.193474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:42.204534+0000","last_undegraded":"2024-05-08T21:49:42.204534+0000","last_fullsized":"2024-05-08T21:49:42.204534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:18:58.164159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757172+0000","last_change":"2024-05-08T21:49:43.773243+0000","last_active":"2024-05-08T21:49:44.757172+0000","last_peered":"2024-05-08T21:49:44.757172+0000","last_clean":"2024-05-08T21:49:44.757172+0000","last_became_active":"2024-05-08T21:49:43.772944+0000","last_became_peered":"2024-05-08T21:49:43.772944+0000","last_unstale":"2024-05-08T21:49:44.757172+0000","last_undegraded":"2024-05-08T21:49:44.757172+0000","last_fullsized":"2024-05-08T21:49:44.757172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:21:41.238890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757107+0000","last_change":"2024-05-08T21:49:43.224999+0000","last_active":"2024-05-08T21:49:44.757107+0000","last_peered":"2024-05-08T21:49:44.757107+0000","last_clean":"2024-05-08T21:49:44.757107+0000","last_became_active":"2024-05-08T21:49:43.223476+0000","last_became_peered":"2024-05-08T21:49:43.223476+0000","last_unstale":"2024-05-08T21:49:44.757107+0000","last_undegraded":"2024-05-08T21:49:44.757107+0000","last_fullsized":"2024-05-08T21:49:44.757107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:09:12.983430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755246+0000","last_change":"2024-05-08T21:49:43.224378+0000","last_active":"2024-05-08T21:49:44.755246+0000","last_peered":"2024-05-08T21:49:44.755246+0000","last_clean":"2024-05-08T21:49:44.755246+0000","last_became_active":"2024-05-08T21:49:43.224164+0000","last_became_peered":"2024-05-08T21:49:43.224164+0000","last_unstale":"2024-05-08T21:49:44.755246+0000","last_undegraded":"2024-05-08T21:49:44.755246+0000","last_fullsized":"2024-05-08T21:49:44.755246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:06:10.276907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T21:49:42.203786+0000","last_change":"2024-05-08T21:49:42.203786+0000","last_active":"2024-05-08T21:49:42.193474+0000","last_peered":"2024-05-08T21:49:42.193474+0000","last_clean":"2024-05-08T21:49:42.193474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:42.203786+0000","last_undegraded":"2024-05-08T21:49:42.203786+0000","last_fullsized":"2024-05-08T21:49:42.203786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:17.379362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T21:49:42.206849+0000","last_change":"2024-05-08T21:49:42.206849+0000","last_active":"2024-05-08T21:49:42.193474+0000","last_peered":"2024-05-08T21:49:42.193474+0000","last_clean":"2024-05-08T21:49:42.193474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:42.206849+0000","last_undegraded":"2024-05-08T21:49:42.206849+0000","last_fullsized":"2024-05-08T21:49:42.206849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:20:34.123736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757128+0000","last_change":"2024-05-08T21:49:43.227386+0000","last_active":"2024-05-08T21:49:44.757128+0000","last_peered":"2024-05-08T21:49:44.757128+0000","last_clean":"2024-05-08T21:49:44.757128+0000","last_became_active":"2024-05-08T21:49:43.227065+0000","last_became_peered":"2024-05-08T21:49:43.227065+0000","last_unstale":"2024-05-08T21:49:44.757128+0000","last_undegraded":"2024-05-08T21:49:44.757128+0000","last_fullsized":"2024-05-08T21:49:44.757128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:43:48.019170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T21:49:42.204720+0000","last_change":"2024-05-08T21:49:42.204720+0000","last_active":"2024-05-08T21:49:42.193474+0000","last_peered":"2024-05-08T21:49:42.193474+0000","last_clean":"2024-05-08T21:49:42.193474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:42.204720+0000","last_undegraded":"2024-05-08T21:49:42.204720+0000","last_fullsized":"2024-05-08T21:49:42.204720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:52.323917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T21:49:42.217091+0000","last_change":"2024-05-08T21:49:42.217091+0000","last_active":"2024-05-08T21:49:42.193474+0000","last_peered":"2024-05-08T21:49:42.193474+0000","last_clean":"2024-05-08T21:49:42.193474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:42.217091+0000","last_undegraded":"2024-05-08T21:49:42.217091+0000","last_fullsized":"2024-05-08T21:49:42.217091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:10.497167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T21:49:42.209363+0000","last_change":"2024-05-08T21:49:42.209363+0000","last_active":"2024-05-08T21:49:42.193474+0000","last_peered":"2024-05-08T21:49:42.193474+0000","last_clean":"2024-05-08T21:49:42.193474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:42.209363+0000","last_undegraded":"2024-05-08T21:49:42.209363+0000","last_fullsized":"2024-05-08T21:49:42.209363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:41:35.881003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755188+0000","last_change":"2024-05-08T21:49:43.215293+0000","last_active":"2024-05-08T21:49:44.755188+0000","last_peered":"2024-05-08T21:49:44.755188+0000","last_clean":"2024-05-08T21:49:44.755188+0000","last_became_active":"2024-05-08T21:49:43.215048+0000","last_became_peered":"2024-05-08T21:49:43.215048+0000","last_unstale":"2024-05-08T21:49:44.755188+0000","last_undegraded":"2024-05-08T21:49:44.755188+0000","last_fullsized":"2024-05-08T21:49:44.755188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:43:48.019170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757129+0000","last_change":"2024-05-08T21:49:43.770326+0000","last_active":"2024-05-08T21:49:44.757129+0000","last_peered":"2024-05-08T21:49:44.757129+0000","last_clean":"2024-05-08T21:49:44.757129+0000","last_became_active":"2024-05-08T21:49:43.770029+0000","last_became_peered":"2024-05-08T21:49:43.770029+0000","last_unstale":"2024-05-08T21:49:44.757129+0000","last_undegraded":"2024-05-08T21:49:44.757129+0000","last_fullsized":"2024-05-08T21:49:44.757129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:33:33.642847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757017+0000","last_change":"2024-05-08T21:49:43.227710+0000","last_active":"2024-05-08T21:49:44.757017+0000","last_peered":"2024-05-08T21:49:44.757017+0000","last_clean":"2024-05-08T21:49:44.757017+0000","last_became_active":"2024-05-08T21:49:43.227430+0000","last_became_peered":"2024-05-08T21:49:43.227430+0000","last_unstale":"2024-05-08T21:49:44.757017+0000","last_undegraded":"2024-05-08T21:49:44.757017+0000","last_fullsized":"2024-05-08T21:49:44.757017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:05:58.875400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.754953+0000","last_change":"2024-05-08T21:49:43.758618+0000","last_active":"2024-05-08T21:49:44.754953+0000","last_peered":"2024-05-08T21:49:44.754953+0000","last_clean":"2024-05-08T21:49:44.754953+0000","last_became_active":"2024-05-08T21:49:43.758367+0000","last_became_peered":"2024-05-08T21:49:43.758367+0000","last_unstale":"2024-05-08T21:49:44.754953+0000","last_undegraded":"2024-05-08T21:49:44.754953+0000","last_fullsized":"2024-05-08T21:49:44.754953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:30:06.569971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T21:49:42.217162+0000","last_change":"2024-05-08T21:49:42.217162+0000","last_active":"2024-05-08T21:49:42.193474+0000","last_peered":"2024-05-08T21:49:42.193474+0000","last_clean":"2024-05-08T21:49:42.193474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:42.217162+0000","last_undegraded":"2024-05-08T21:49:42.217162+0000","last_fullsized":"2024-05-08T21:49:42.217162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:17.379362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756759+0000","last_change":"2024-05-08T21:49:43.224929+0000","last_active":"2024-05-08T21:49:44.756759+0000","last_peered":"2024-05-08T21:49:44.756759+0000","last_clean":"2024-05-08T21:49:44.756759+0000","last_became_active":"2024-05-08T21:49:43.223469+0000","last_became_peered":"2024-05-08T21:49:43.223469+0000","last_unstale":"2024-05-08T21:49:44.756759+0000","last_undegraded":"2024-05-08T21:49:44.756759+0000","last_fullsized":"2024-05-08T21:49:44.756759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:27.504127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":161,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-08T21:49:39.634710+0000","last_change":"2024-05-08T21:49:38.626519+0000","last_active":"2024-05-08T21:49:39.634710+0000","last_peered":"2024-05-08T21:49:39.634710+0000","last_clean":"2024-05-08T21:49:39.634710+0000","last_became_active":"2024-05-08T21:49:38.626159+0000","last_became_peered":"2024-05-08T21:49:38.626159+0000","last_unstale":"2024-05-08T21:49:39.634710+0000","last_undegraded":"2024-05-08T21:49:39.634710+0000","last_fullsized":"2024-05-08T21:49:39.634710+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:36.031649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:36.031649+0000","last_clean_scrub_stamp":"2024-05-08T21:49:36.031649+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:12:04.846500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T21:49:42.206520+0000","last_change":"2024-05-08T21:49:42.206520+0000","last_active":"2024-05-08T21:49:42.193474+0000","last_peered":"2024-05-08T21:49:42.193474+0000","last_clean":"2024-05-08T21:49:42.193474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:42.206520+0000","last_undegraded":"2024-05-08T21:49:42.206520+0000","last_fullsized":"2024-05-08T21:49:42.206520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:52.323917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T21:49:42.206709+0000","last_change":"2024-05-08T21:49:42.206709+0000","last_active":"2024-05-08T21:49:42.193474+0000","last_peered":"2024-05-08T21:49:42.193474+0000","last_clean":"2024-05-08T21:49:42.193474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:42.206709+0000","last_undegraded":"2024-05-08T21:49:42.206709+0000","last_fullsized":"2024-05-08T21:49:42.206709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:18:58.164159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755021+0000","last_change":"2024-05-08T21:49:43.758424+0000","last_active":"2024-05-08T21:49:44.755021+0000","last_peered":"2024-05-08T21:49:44.755021+0000","last_clean":"2024-05-08T21:49:44.755021+0000","last_became_active":"2024-05-08T21:49:43.758140+0000","last_became_peered":"2024-05-08T21:49:43.758140+0000","last_unstale":"2024-05-08T21:49:44.755021+0000","last_undegraded":"2024-05-08T21:49:44.755021+0000","last_fullsized":"2024-05-08T21:49:44.755021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:10.795540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755053+0000","last_change":"2024-05-08T21:49:43.218241+0000","last_active":"2024-05-08T21:49:44.755053+0000","last_peered":"2024-05-08T21:49:44.755053+0000","last_clean":"2024-05-08T21:49:44.755053+0000","last_became_active":"2024-05-08T21:49:43.217780+0000","last_became_peered":"2024-05-08T21:49:43.217780+0000","last_unstale":"2024-05-08T21:49:44.755053+0000","last_undegraded":"2024-05-08T21:49:44.755053+0000","last_fullsized":"2024-05-08T21:49:44.755053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:27.504127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T21:49:42.203786+0000","last_change":"2024-05-08T21:49:42.203786+0000","last_active":"2024-05-08T21:49:42.193474+0000","last_peered":"2024-05-08T21:49:42.193474+0000","last_clean":"2024-05-08T21:49:42.193474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:42.203786+0000","last_undegraded":"2024-05-08T21:49:42.203786+0000","last_fullsized":"2024-05-08T21:49:42.203786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:33:28.074468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T21:49:42.207910+0000","last_change":"2024-05-08T21:49:42.207910+0000","last_active":"2024-05-08T21:49:42.193474+0000","last_peered":"2024-05-08T21:49:42.193474+0000","last_clean":"2024-05-08T21:49:42.193474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:42.207910+0000","last_undegraded":"2024-05-08T21:49:42.207910+0000","last_fullsized":"2024-05-08T21:49:42.207910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:10.497167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.754925+0000","last_change":"2024-05-08T21:49:43.215361+0000","last_active":"2024-05-08T21:49:44.754925+0000","last_peered":"2024-05-08T21:49:44.754925+0000","last_clean":"2024-05-08T21:49:44.754925+0000","last_became_active":"2024-05-08T21:49:43.215162+0000","last_became_peered":"2024-05-08T21:49:43.215162+0000","last_unstale":"2024-05-08T21:49:44.754925+0000","last_undegraded":"2024-05-08T21:49:44.754925+0000","last_fullsized":"2024-05-08T21:49:44.754925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:05:58.875400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755100+0000","last_change":"2024-05-08T21:49:43.217935+0000","last_active":"2024-05-08T21:49:44.755100+0000","last_peered":"2024-05-08T21:49:44.755100+0000","last_clean":"2024-05-08T21:49:44.755100+0000","last_became_active":"2024-05-08T21:49:43.217595+0000","last_became_peered":"2024-05-08T21:49:43.217595+0000","last_unstale":"2024-05-08T21:49:44.755100+0000","last_undegraded":"2024-05-08T21:49:44.755100+0000","last_fullsized":"2024-05-08T21:49:44.755100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:38:43.069159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T21:49:42.206656+0000","last_change":"2024-05-08T21:49:42.206656+0000","last_active":"2024-05-08T21:49:42.193474+0000","last_peered":"2024-05-08T21:49:42.193474+0000","last_clean":"2024-05-08T21:49:42.193474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:42.206656+0000","last_undegraded":"2024-05-08T21:49:42.206656+0000","last_fullsized":"2024-05-08T21:49:42.206656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:03.961487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T21:49:42.217098+0000","last_change":"2024-05-08T21:49:42.217098+0000","last_active":"2024-05-08T21:49:42.193474+0000","last_peered":"2024-05-08T21:49:42.193474+0000","last_clean":"2024-05-08T21:49:42.193474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:42.217098+0000","last_undegraded":"2024-05-08T21:49:42.217098+0000","last_fullsized":"2024-05-08T21:49:42.217098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:33:28.074468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755187+0000","last_change":"2024-05-08T21:49:43.208581+0000","last_active":"2024-05-08T21:49:44.755187+0000","last_peered":"2024-05-08T21:49:44.755187+0000","last_clean":"2024-05-08T21:49:44.755187+0000","last_became_active":"2024-05-08T21:49:43.208326+0000","last_became_peered":"2024-05-08T21:49:43.208326+0000","last_unstale":"2024-05-08T21:49:44.755187+0000","last_undegraded":"2024-05-08T21:49:44.755187+0000","last_fullsized":"2024-05-08T21:49:44.755187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:13:35.461791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756911+0000","last_change":"2024-05-08T21:49:43.766519+0000","last_active":"2024-05-08T21:49:44.756911+0000","last_peered":"2024-05-08T21:49:44.756911+0000","last_clean":"2024-05-08T21:49:44.756911+0000","last_became_active":"2024-05-08T21:49:43.765789+0000","last_became_peered":"2024-05-08T21:49:43.765789+0000","last_unstale":"2024-05-08T21:49:44.756911+0000","last_undegraded":"2024-05-08T21:49:44.756911+0000","last_fullsized":"2024-05-08T21:49:44.756911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:23.674986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T21:49:42.217041+0000","last_change":"2024-05-08T21:49:42.217041+0000","last_active":"2024-05-08T21:49:42.193474+0000","last_peered":"2024-05-08T21:49:42.193474+0000","last_clean":"2024-05-08T21:49:42.193474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:42.217041+0000","last_undegraded":"2024-05-08T21:49:42.217041+0000","last_fullsized":"2024-05-08T21:49:42.217041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:18:58.164159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757080+0000","last_change":"2024-05-08T21:49:43.768929+0000","last_active":"2024-05-08T21:49:44.757080+0000","last_peered":"2024-05-08T21:49:44.757080+0000","last_clean":"2024-05-08T21:49:44.757080+0000","last_became_active":"2024-05-08T21:49:43.767606+0000","last_became_peered":"2024-05-08T21:49:43.767606+0000","last_unstale":"2024-05-08T21:49:44.757080+0000","last_undegraded":"2024-05-08T21:49:44.757080+0000","last_fullsized":"2024-05-08T21:49:44.757080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:13:06.426154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755114+0000","last_change":"2024-05-08T21:49:43.757318+0000","last_active":"2024-05-08T21:49:44.755114+0000","last_peered":"2024-05-08T21:49:44.755114+0000","last_clean":"2024-05-08T21:49:44.755114+0000","last_became_active":"2024-05-08T21:49:43.757083+0000","last_became_peered":"2024-05-08T21:49:43.757083+0000","last_unstale":"2024-05-08T21:49:44.755114+0000","last_undegraded":"2024-05-08T21:49:44.755114+0000","last_fullsized":"2024-05-08T21:49:44.755114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:47.551474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756761+0000","last_change":"2024-05-08T21:49:43.768942+0000","last_active":"2024-05-08T21:49:44.756761+0000","last_peered":"2024-05-08T21:49:44.756761+0000","last_clean":"2024-05-08T21:49:44.756761+0000","last_became_active":"2024-05-08T21:49:43.768673+0000","last_became_peered":"2024-05-08T21:49:43.768673+0000","last_unstale":"2024-05-08T21:49:44.756761+0000","last_undegraded":"2024-05-08T21:49:44.756761+0000","last_fullsized":"2024-05-08T21:49:44.756761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:15:41.869107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756863+0000","last_change":"2024-05-08T21:49:43.775098+0000","last_active":"2024-05-08T21:49:44.756863+0000","last_peered":"2024-05-08T21:49:44.756863+0000","last_clean":"2024-05-08T21:49:44.756863+0000","last_became_active":"2024-05-08T21:49:43.774808+0000","last_became_peered":"2024-05-08T21:49:43.774808+0000","last_unstale":"2024-05-08T21:49:44.756863+0000","last_undegraded":"2024-05-08T21:49:44.756863+0000","last_fullsized":"2024-05-08T21:49:44.756863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:51:15.152611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":36,"acting":36,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28376,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343464,"statfs":{"total":96636764160,"available":96607707136,"internally_reserved":0,"allocated":753664,"data_stored":638290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]}]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":159744,"data_stored":47922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":73089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":73089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]}]},{"osd":0,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":765952,"data_stored":644107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]}]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":172032,"data_stored":53739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]}]},{"osd":3,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":159744,"data_stored":47922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]}]},{"osd":4,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":159744,"data_stored":47922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T21:49:49.274 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T21:49:49.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.433+0000 7f99d290a700 1 Processor -- start 2024-05-08T21:49:49.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.433+0000 7f99d290a700 1 -- start start 2024-05-08T21:49:49.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.434+0000 7f99d290a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f99cc06c860 0x7f99cc0666c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:49.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.434+0000 7f99d290a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f99cc066c00 0x7f99cc06d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:49.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.434+0000 7f99d290a700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99cc15d6f0 con 0x7f99cc06cc40 2024-05-08T21:49:49.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.434+0000 7f99d290a700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99cc15d9d0 con 0x7f99cc066c00 2024-05-08T21:49:49.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.434+0000 7f99d290a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99cc15dcb0 con 0x7f99cc06c860 2024-05-08T21:49:49.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.434+0000 7f99cb7fe700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f99cc06cc40 0x7f99cc0c2700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:51734/0 (socket says 172.21.15.73:51734) 2024-05-08T21:49:49.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.434+0000 7f99cb7fe700 1 -- 172.21.15.73:0/2405388054 learned_addr learned my addr 172.21.15.73:0/2405388054 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:49:49.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.435+0000 7f99caffd700 1 -- 172.21.15.73:0/2405388054 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2259448972 0 0) 0x7f99cc15d6f0 con 0x7f99cc06cc40 2024-05-08T21:49:49.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.435+0000 7f99d0ea7700 1 --2- 172.21.15.73:0/2405388054 >> v2:172.21.15.115:3300/0 conn(0x7f99cc066c00 0x7f99cc06d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:49.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.435+0000 7f99caffd700 1 -- 172.21.15.73:0/2405388054 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99b40035b0 con 0x7f99cc06cc40 2024-05-08T21:49:49.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.435+0000 7f99cbfff700 1 --2- 172.21.15.73:0/2405388054 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f99cc06c860 0x7f99cc0666c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:49.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.435+0000 7f99caffd700 1 -- 172.21.15.73:0/2405388054 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3903752164 0 0) 0x7f99b40035b0 con 0x7f99cc06cc40 2024-05-08T21:49:49.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.435+0000 7f99caffd700 1 -- 172.21.15.73:0/2405388054 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f99cc06c860 msgr2=0x7f99cc0666c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:49.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.435+0000 7f99caffd700 1 --2- 172.21.15.73:0/2405388054 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f99cc06c860 0x7f99cc0666c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:49.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.435+0000 7f99caffd700 1 -- 172.21.15.73:0/2405388054 >> v2:172.21.15.115:3300/0 conn(0x7f99cc066c00 msgr2=0x7f99cc06d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:49.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.435+0000 7f99caffd700 1 --2- 172.21.15.73:0/2405388054 >> v2:172.21.15.115:3300/0 conn(0x7f99cc066c00 0x7f99cc06d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:49.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.435+0000 7f99caffd700 1 -- 172.21.15.73:0/2405388054 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99cc15df90 con 0x7f99cc06cc40 2024-05-08T21:49:49.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.435+0000 7f99caffd700 1 -- 172.21.15.73:0/2405388054 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 953298616 0 0) 0x7f99c0001670 con 0x7f99cc06cc40 2024-05-08T21:49:49.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.435+0000 7f99cbfff700 1 --2- 172.21.15.73:0/2405388054 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f99cc06c860 0x7f99cc0666c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:49:49.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.435+0000 7f99caffd700 1 -- 172.21.15.73:0/2405388054 >> v1:172.21.15.73:6789/0 conn(0x7f99cc06cc40 legacy=0x7f99cc0c2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:49.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.435+0000 7f99caffd700 1 --2- 172.21.15.73:0/2405388054 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99b4003a00 0x7f99b4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:49.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.435+0000 7f99caffd700 1 --2- 172.21.15.73:0/2405388054 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f99cc06c860 0x7f99b4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:49.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.435+0000 7f99caffd700 1 --2- 172.21.15.73:0/2405388054 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f99b4004d90 0x7f99b4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:49.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.435+0000 7f99caffd700 1 -- 172.21.15.73:0/2405388054 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99cc15d9d0 con 0x7f99b4003a00 2024-05-08T21:49:49.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.435+0000 7f99caffd700 1 -- 172.21.15.73:0/2405388054 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99cc15dcb0 con 0x7f99b4004d90 2024-05-08T21:49:49.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.435+0000 7f99caffd700 1 -- 172.21.15.73:0/2405388054 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99b400ba90 con 0x7f99cc06c860 2024-05-08T21:49:49.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.435+0000 7f99cbfff700 1 --2- 172.21.15.73:0/2405388054 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99b4003a00 0x7f99b4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:49.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.435+0000 7f99cb7fe700 1 --2- 172.21.15.73:0/2405388054 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f99cc06c860 0x7f99b4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:49.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.435+0000 7f99d0ea7700 1 --2- 172.21.15.73:0/2405388054 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f99b4004d90 0x7f99b4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:49.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.435+0000 7f99cbfff700 1 -- 172.21.15.73:0/2405388054 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f99cc06c860 msgr2=0x7f99b4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:49.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.435+0000 7f99cbfff700 1 --2- 172.21.15.73:0/2405388054 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f99cc06c860 0x7f99b4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:49.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.435+0000 7f99cbfff700 1 -- 172.21.15.73:0/2405388054 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f99b4004d90 msgr2=0x7f99b4005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:49.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.435+0000 7f99cbfff700 1 --2- 172.21.15.73:0/2405388054 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f99b4004d90 0x7f99b4005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:49.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.435+0000 7f99cbfff700 1 -- 172.21.15.73:0/2405388054 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b40035b0 con 0x7f99b4003a00 2024-05-08T21:49:49.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.435+0000 7f99cb7fe700 1 --2- 172.21.15.73:0/2405388054 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f99cc06c860 0x7f99b4004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:49:49.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.435+0000 7f99cbfff700 1 --2- 172.21.15.73:0/2405388054 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99b4003a00 0x7f99b4003e20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f99bc009950 tx=0x7f99b4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c691b60f764beb27 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:49.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.435+0000 7f99caffd700 1 -- 172.21.15.73:0/2405388054 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99bc00c070 con 0x7f99b4003a00 2024-05-08T21:49:49.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.436+0000 7f99caffd700 1 -- 172.21.15.73:0/2405388054 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99bc013610 con 0x7f99b4003a00 2024-05-08T21:49:49.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.436+0000 7f99caffd700 1 -- 172.21.15.73:0/2405388054 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99bc009560 con 0x7f99b4003a00 2024-05-08T21:49:49.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.436+0000 7f99d290a700 1 -- 172.21.15.73:0/2405388054 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99b4003a00 msgr2=0x7f99b4003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:49.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.436+0000 7f99d290a700 1 --2- 172.21.15.73:0/2405388054 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99b4003a00 0x7f99b4003e20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f99bc009950 tx=0x7f99b4005880 comp rx=0 tx=0).stop 2024-05-08T21:49:49.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.436+0000 7f99d0ea7700 1 -- 172.21.15.73:0/2405388054 reap_dead start 2024-05-08T21:49:49.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.436+0000 7f99d290a700 1 -- 172.21.15.73:0/2405388054 shutdown_connections 2024-05-08T21:49:49.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.436+0000 7f99d290a700 1 -- 172.21.15.73:0/2405388054 >> 172.21.15.73:0/2405388054 conn(0x7f99cc06f9b0 msgr2=0x7f99cc06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:49.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.436+0000 7f99d290a700 1 -- 172.21.15.73:0/2405388054 shutdown_connections 2024-05-08T21:49:49.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.436+0000 7f99d290a700 1 -- 172.21.15.73:0/2405388054 wait complete. 2024-05-08T21:49:49.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.437+0000 7f99d290a700 1 Processor -- start 2024-05-08T21:49:49.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.437+0000 7f99d290a700 1 -- start start 2024-05-08T21:49:49.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.438+0000 7f99d290a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99b4003a00 0x7f99cc14d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:49.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.438+0000 7f99d290a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f99cc071d30 0x7f99cc14c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:49.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.438+0000 7f99d290a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f99cc14c640 0x7f99cc1f0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:49.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.438+0000 7f99d290a700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99cc0c3460 con 0x7f99b4003a00 2024-05-08T21:49:49.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.438+0000 7f99d290a700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99cc14cac0 con 0x7f99cc14c640 2024-05-08T21:49:49.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.438+0000 7f99d290a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99cc0c5080 con 0x7f99cc071d30 2024-05-08T21:49:49.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.438+0000 7f99cbfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99b4003a00 0x7f99cc14d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:49.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.438+0000 7f99cbfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99b4003a00 0x7f99cc14d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38758/0 (socket says 172.21.15.73:38758) 2024-05-08T21:49:49.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.438+0000 7f99cbfff700 1 -- 172.21.15.73:0/2175663037 learned_addr learned my addr 172.21.15.73:0/2175663037 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:49.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.438+0000 7f99cb7fe700 1 --2- 172.21.15.73:0/2175663037 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f99cc071d30 0x7f99cc14c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:49.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.438+0000 7f99d0ea7700 1 --2- 172.21.15.73:0/2175663037 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f99cc14c640 0x7f99cc1f0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:49.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.438+0000 7f99cbfff700 1 -- 172.21.15.73:0/2175663037 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f99cc071d30 msgr2=0x7f99cc14c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:49.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.438+0000 7f99cbfff700 1 --2- 172.21.15.73:0/2175663037 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f99cc071d30 0x7f99cc14c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:49.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.438+0000 7f99cbfff700 1 -- 172.21.15.73:0/2175663037 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f99cc14c640 msgr2=0x7f99cc1f0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:49.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.439+0000 7f99cbfff700 1 --2- 172.21.15.73:0/2175663037 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f99cc14c640 0x7f99cc1f0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:49.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.439+0000 7f99cbfff700 1 -- 172.21.15.73:0/2175663037 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99cc14d910 con 0x7f99b4003a00 2024-05-08T21:49:49.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.439+0000 7f99cb7fe700 1 --2- 172.21.15.73:0/2175663037 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f99cc071d30 0x7f99cc14c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:49:49.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.439+0000 7f99d0ea7700 1 --2- 172.21.15.73:0/2175663037 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f99cc14c640 0x7f99cc1f0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:49:49.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.439+0000 7f99cbfff700 1 --2- 172.21.15.73:0/2175663037 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99b4003a00 0x7f99cc14d3d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f99bc009f40 tx=0x7f99bc0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:49.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.439+0000 7f99c8ff9700 1 -- 172.21.15.73:0/2175663037 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99bc013b90 con 0x7f99b4003a00 2024-05-08T21:49:49.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.439+0000 7f99c8ff9700 1 -- 172.21.15.73:0/2175663037 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99bc013cf0 con 0x7f99b4003a00 2024-05-08T21:49:49.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.439+0000 7f99c8ff9700 1 -- 172.21.15.73:0/2175663037 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99bc0038e0 con 0x7f99b4003a00 2024-05-08T21:49:49.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.439+0000 7f99d290a700 1 -- 172.21.15.73:0/2175663037 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99cc0c5320 con 0x7f99b4003a00 2024-05-08T21:49:49.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.439+0000 7f99d290a700 1 -- 172.21.15.73:0/2175663037 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99cc0c58e0 con 0x7f99b4003a00 2024-05-08T21:49:49.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.440+0000 7f99d290a700 1 -- 172.21.15.73:0/2175663037 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99cc068b80 con 0x7f99b4003a00 2024-05-08T21:49:49.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.440+0000 7f99c8ff9700 1 -- 172.21.15.73:0/2175663037 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f99bc003a40 con 0x7f99b4003a00 2024-05-08T21:49:49.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.440+0000 7f99c8ff9700 1 --2- 172.21.15.73:0/2175663037 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f99b806ac90 0x7f99b806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:49.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.441+0000 7f99c8ff9700 1 -- 172.21.15.73:0/2175663037 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f99bc08a3d0 con 0x7f99b4003a00 2024-05-08T21:49:49.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.441+0000 7f99cb7fe700 1 --2- 172.21.15.73:0/2175663037 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f99b806ac90 0x7f99b806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:49.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.441+0000 7f99cb7fe700 1 --2- 172.21.15.73:0/2175663037 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f99b806ac90 0x7f99b806d150 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f99c0000fb0 tx=0x7f99c0001df0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:49.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.445+0000 7f99c8ff9700 1 -- 172.21.15.73:0/2175663037 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f99bc055640 con 0x7f99b4003a00 2024-05-08T21:49:49.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.638+0000 7f99d290a700 1 -- 172.21.15.73:0/2175663037 --> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f99cc0b1890 con 0x7f99b806ac90 2024-05-08T21:49:49.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.644+0000 7f99c8ff9700 1 -- 172.21.15.73:0/2175663037 <== mgr.4104 v2:172.21.15.73:6832/46949 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+256954 (secure 0 0 0) 0x7f99cc0b1890 con 0x7f99b806ac90 2024-05-08T21:49:49.647 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:49:49.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.647+0000 7f99d290a700 1 -- 172.21.15.73:0/2175663037 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f99b806ac90 msgr2=0x7f99b806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:49.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.647+0000 7f99d290a700 1 --2- 172.21.15.73:0/2175663037 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f99b806ac90 0x7f99b806d150 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f99c0000fb0 tx=0x7f99c0001df0 comp rx=0 tx=0).stop 2024-05-08T21:49:49.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.647+0000 7f99d290a700 1 -- 172.21.15.73:0/2175663037 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99b4003a00 msgr2=0x7f99cc14d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:49.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.647+0000 7f99d290a700 1 --2- 172.21.15.73:0/2175663037 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99b4003a00 0x7f99cc14d3d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f99bc009f40 tx=0x7f99bc0047c0 comp rx=0 tx=0).stop 2024-05-08T21:49:49.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.647+0000 7f99d290a700 1 -- 172.21.15.73:0/2175663037 shutdown_connections 2024-05-08T21:49:49.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.647+0000 7f99d290a700 1 --2- 172.21.15.73:0/2175663037 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f99b806ac90 0x7f99b806d150 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:49.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.647+0000 7f99d290a700 1 --2- 172.21.15.73:0/2175663037 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f99cc14c640 0x7f99cc1f0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:49.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.647+0000 7f99d290a700 1 --2- 172.21.15.73:0/2175663037 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99b4003a00 0x7f99cc14d3d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:49.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.647+0000 7f99d290a700 1 --2- 172.21.15.73:0/2175663037 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f99cc071d30 0x7f99cc14c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:49.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.647+0000 7f99d290a700 1 -- 172.21.15.73:0/2175663037 >> 172.21.15.73:0/2175663037 conn(0x7f99cc06f9b0 msgr2=0x7f99cc06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:49.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.647+0000 7f99d290a700 1 -- 172.21.15.73:0/2175663037 shutdown_connections 2024-05-08T21:49:49.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.647+0000 7f99d290a700 1 -- 172.21.15.73:0/2175663037 wait complete. 2024-05-08T21:49:49.651 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-05-08T21:49:49.659 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-05-08T21:49:47.950948+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":102,"acting":102,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":21,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219440,"kb_used_data":2528,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755280,"statfs":{"total":773094113280,"available":772869406720,"internally_reserved":0,"allocated":2588672,"data_stored":1626080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.748514"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755108+0000","last_change":"2024-05-08T21:49:43.766984+0000","last_active":"2024-05-08T21:49:44.755108+0000","last_peered":"2024-05-08T21:49:44.755108+0000","last_clean":"2024-05-08T21:49:44.755108+0000","last_became_active":"2024-05-08T21:49:43.765995+0000","last_became_peered":"2024-05-08T21:49:43.765995+0000","last_unstale":"2024-05-08T21:49:44.755108+0000","last_undegraded":"2024-05-08T21:49:44.755108+0000","last_fullsized":"2024-05-08T21:49:44.755108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:21:41.238890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757017+0000","last_change":"2024-05-08T21:49:43.766355+0000","last_active":"2024-05-08T21:49:44.757017+0000","last_peered":"2024-05-08T21:49:44.757017+0000","last_clean":"2024-05-08T21:49:44.757017+0000","last_became_active":"2024-05-08T21:49:43.765507+0000","last_became_peered":"2024-05-08T21:49:43.765507+0000","last_unstale":"2024-05-08T21:49:44.757017+0000","last_undegraded":"2024-05-08T21:49:44.757017+0000","last_fullsized":"2024-05-08T21:49:44.757017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:09:09.676078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756907+0000","last_change":"2024-05-08T21:49:43.771390+0000","last_active":"2024-05-08T21:49:44.756907+0000","last_peered":"2024-05-08T21:49:44.756907+0000","last_clean":"2024-05-08T21:49:44.756907+0000","last_became_active":"2024-05-08T21:49:43.770893+0000","last_became_peered":"2024-05-08T21:49:43.770893+0000","last_unstale":"2024-05-08T21:49:44.756907+0000","last_undegraded":"2024-05-08T21:49:44.756907+0000","last_fullsized":"2024-05-08T21:49:44.756907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:28.979468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.754916+0000","last_change":"2024-05-08T21:49:43.765080+0000","last_active":"2024-05-08T21:49:44.754916+0000","last_peered":"2024-05-08T21:49:44.754916+0000","last_clean":"2024-05-08T21:49:44.754916+0000","last_became_active":"2024-05-08T21:49:43.764810+0000","last_became_peered":"2024-05-08T21:49:43.764810+0000","last_unstale":"2024-05-08T21:49:44.754916+0000","last_undegraded":"2024-05-08T21:49:44.754916+0000","last_fullsized":"2024-05-08T21:49:44.754916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:24:11.223913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756634+0000","last_change":"2024-05-08T21:49:43.766717+0000","last_active":"2024-05-08T21:49:44.756634+0000","last_peered":"2024-05-08T21:49:44.756634+0000","last_clean":"2024-05-08T21:49:44.756634+0000","last_became_active":"2024-05-08T21:49:43.766427+0000","last_became_peered":"2024-05-08T21:49:43.766427+0000","last_unstale":"2024-05-08T21:49:44.756634+0000","last_undegraded":"2024-05-08T21:49:44.756634+0000","last_fullsized":"2024-05-08T21:49:44.756634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:49:22.833820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757256+0000","last_change":"2024-05-08T21:49:43.776929+0000","last_active":"2024-05-08T21:49:44.757256+0000","last_peered":"2024-05-08T21:49:44.757256+0000","last_clean":"2024-05-08T21:49:44.757256+0000","last_became_active":"2024-05-08T21:49:43.776509+0000","last_became_peered":"2024-05-08T21:49:43.776509+0000","last_unstale":"2024-05-08T21:49:44.757256+0000","last_undegraded":"2024-05-08T21:49:44.757256+0000","last_fullsized":"2024-05-08T21:49:44.757256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:26.199459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T21:49:42.206879+0000","last_change":"2024-05-08T21:49:42.206879+0000","last_active":"2024-05-08T21:49:42.193474+0000","last_peered":"2024-05-08T21:49:42.193474+0000","last_clean":"2024-05-08T21:49:42.193474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:42.206879+0000","last_undegraded":"2024-05-08T21:49:42.206879+0000","last_fullsized":"2024-05-08T21:49:42.206879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:02:45.778415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T21:49:42.203256+0000","last_change":"2024-05-08T21:49:42.203256+0000","last_active":"2024-05-08T21:49:42.193474+0000","last_peered":"2024-05-08T21:49:42.193474+0000","last_clean":"2024-05-08T21:49:42.193474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:42.203256+0000","last_undegraded":"2024-05-08T21:49:42.203256+0000","last_fullsized":"2024-05-08T21:49:42.203256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:17.379362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T21:49:42.207304+0000","last_change":"2024-05-08T21:49:42.207304+0000","last_active":"2024-05-08T21:49:42.193474+0000","last_peered":"2024-05-08T21:49:42.193474+0000","last_clean":"2024-05-08T21:49:42.193474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:42.207304+0000","last_undegraded":"2024-05-08T21:49:42.207304+0000","last_fullsized":"2024-05-08T21:49:42.207304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:01.844011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756849+0000","last_change":"2024-05-08T21:49:43.766694+0000","last_active":"2024-05-08T21:49:44.756849+0000","last_peered":"2024-05-08T21:49:44.756849+0000","last_clean":"2024-05-08T21:49:44.756849+0000","last_became_active":"2024-05-08T21:49:43.766079+0000","last_became_peered":"2024-05-08T21:49:43.766079+0000","last_unstale":"2024-05-08T21:49:44.756849+0000","last_undegraded":"2024-05-08T21:49:44.756849+0000","last_fullsized":"2024-05-08T21:49:44.756849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:01:16.682080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T21:49:42.206963+0000","last_change":"2024-05-08T21:49:42.206963+0000","last_active":"2024-05-08T21:49:42.193474+0000","last_peered":"2024-05-08T21:49:42.193474+0000","last_clean":"2024-05-08T21:49:42.193474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:42.206963+0000","last_undegraded":"2024-05-08T21:49:42.206963+0000","last_fullsized":"2024-05-08T21:49:42.206963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:33:12.827218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757018+0000","last_change":"2024-05-08T21:49:43.771097+0000","last_active":"2024-05-08T21:49:44.757018+0000","last_peered":"2024-05-08T21:49:44.757018+0000","last_clean":"2024-05-08T21:49:44.757018+0000","last_became_active":"2024-05-08T21:49:43.770727+0000","last_became_peered":"2024-05-08T21:49:43.770727+0000","last_unstale":"2024-05-08T21:49:44.757018+0000","last_undegraded":"2024-05-08T21:49:44.757018+0000","last_fullsized":"2024-05-08T21:49:44.757018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:24:02.741766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T21:49:42.203244+0000","last_change":"2024-05-08T21:49:42.203244+0000","last_active":"2024-05-08T21:49:42.193474+0000","last_peered":"2024-05-08T21:49:42.193474+0000","last_clean":"2024-05-08T21:49:42.193474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:42.203244+0000","last_undegraded":"2024-05-08T21:49:42.203244+0000","last_fullsized":"2024-05-08T21:49:42.203244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:33:28.074468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T21:49:42.203787+0000","last_change":"2024-05-08T21:49:42.203787+0000","last_active":"2024-05-08T21:49:42.193474+0000","last_peered":"2024-05-08T21:49:42.193474+0000","last_clean":"2024-05-08T21:49:42.193474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:42.203787+0000","last_undegraded":"2024-05-08T21:49:42.203787+0000","last_fullsized":"2024-05-08T21:49:42.203787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:10.497167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T21:49:42.203257+0000","last_change":"2024-05-08T21:49:42.203257+0000","last_active":"2024-05-08T21:49:42.193474+0000","last_peered":"2024-05-08T21:49:42.193474+0000","last_clean":"2024-05-08T21:49:42.193474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:42.203257+0000","last_undegraded":"2024-05-08T21:49:42.203257+0000","last_fullsized":"2024-05-08T21:49:42.203257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:20:34.123736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756625+0000","last_change":"2024-05-08T21:49:43.225299+0000","last_active":"2024-05-08T21:49:44.756625+0000","last_peered":"2024-05-08T21:49:44.756625+0000","last_clean":"2024-05-08T21:49:44.756625+0000","last_became_active":"2024-05-08T21:49:43.225057+0000","last_became_peered":"2024-05-08T21:49:43.225057+0000","last_unstale":"2024-05-08T21:49:44.756625+0000","last_undegraded":"2024-05-08T21:49:44.756625+0000","last_fullsized":"2024-05-08T21:49:44.756625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:38:43.069159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755021+0000","last_change":"2024-05-08T21:49:43.757361+0000","last_active":"2024-05-08T21:49:44.755021+0000","last_peered":"2024-05-08T21:49:44.755021+0000","last_clean":"2024-05-08T21:49:44.755021+0000","last_became_active":"2024-05-08T21:49:43.757092+0000","last_became_peered":"2024-05-08T21:49:43.757092+0000","last_unstale":"2024-05-08T21:49:44.755021+0000","last_undegraded":"2024-05-08T21:49:44.755021+0000","last_fullsized":"2024-05-08T21:49:44.755021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:24:02.741766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T21:49:42.204534+0000","last_change":"2024-05-08T21:49:42.204534+0000","last_active":"2024-05-08T21:49:42.193474+0000","last_peered":"2024-05-08T21:49:42.193474+0000","last_clean":"2024-05-08T21:49:42.193474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:42.204534+0000","last_undegraded":"2024-05-08T21:49:42.204534+0000","last_fullsized":"2024-05-08T21:49:42.204534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:18:58.164159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757172+0000","last_change":"2024-05-08T21:49:43.773243+0000","last_active":"2024-05-08T21:49:44.757172+0000","last_peered":"2024-05-08T21:49:44.757172+0000","last_clean":"2024-05-08T21:49:44.757172+0000","last_became_active":"2024-05-08T21:49:43.772944+0000","last_became_peered":"2024-05-08T21:49:43.772944+0000","last_unstale":"2024-05-08T21:49:44.757172+0000","last_undegraded":"2024-05-08T21:49:44.757172+0000","last_fullsized":"2024-05-08T21:49:44.757172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:21:41.238890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757107+0000","last_change":"2024-05-08T21:49:43.224999+0000","last_active":"2024-05-08T21:49:44.757107+0000","last_peered":"2024-05-08T21:49:44.757107+0000","last_clean":"2024-05-08T21:49:44.757107+0000","last_became_active":"2024-05-08T21:49:43.223476+0000","last_became_peered":"2024-05-08T21:49:43.223476+0000","last_unstale":"2024-05-08T21:49:44.757107+0000","last_undegraded":"2024-05-08T21:49:44.757107+0000","last_fullsized":"2024-05-08T21:49:44.757107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:09:12.983430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755246+0000","last_change":"2024-05-08T21:49:43.224378+0000","last_active":"2024-05-08T21:49:44.755246+0000","last_peered":"2024-05-08T21:49:44.755246+0000","last_clean":"2024-05-08T21:49:44.755246+0000","last_became_active":"2024-05-08T21:49:43.224164+0000","last_became_peered":"2024-05-08T21:49:43.224164+0000","last_unstale":"2024-05-08T21:49:44.755246+0000","last_undegraded":"2024-05-08T21:49:44.755246+0000","last_fullsized":"2024-05-08T21:49:44.755246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:06:10.276907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T21:49:42.203786+0000","last_change":"2024-05-08T21:49:42.203786+0000","last_active":"2024-05-08T21:49:42.193474+0000","last_peered":"2024-05-08T21:49:42.193474+0000","last_clean":"2024-05-08T21:49:42.193474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:42.203786+0000","last_undegraded":"2024-05-08T21:49:42.203786+0000","last_fullsized":"2024-05-08T21:49:42.203786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:17.379362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T21:49:42.206849+0000","last_change":"2024-05-08T21:49:42.206849+0000","last_active":"2024-05-08T21:49:42.193474+0000","last_peered":"2024-05-08T21:49:42.193474+0000","last_clean":"2024-05-08T21:49:42.193474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:42.206849+0000","last_undegraded":"2024-05-08T21:49:42.206849+0000","last_fullsized":"2024-05-08T21:49:42.206849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:20:34.123736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757128+0000","last_change":"2024-05-08T21:49:43.227386+0000","last_active":"2024-05-08T21:49:44.757128+0000","last_peered":"2024-05-08T21:49:44.757128+0000","last_clean":"2024-05-08T21:49:44.757128+0000","last_became_active":"2024-05-08T21:49:43.227065+0000","last_became_peered":"2024-05-08T21:49:43.227065+0000","last_unstale":"2024-05-08T21:49:44.757128+0000","last_undegraded":"2024-05-08T21:49:44.757128+0000","last_fullsized":"2024-05-08T21:49:44.757128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:43:48.019170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T21:49:42.204720+0000","last_change":"2024-05-08T21:49:42.204720+0000","last_active":"2024-05-08T21:49:42.193474+0000","last_peered":"2024-05-08T21:49:42.193474+0000","last_clean":"2024-05-08T21:49:42.193474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:42.204720+0000","last_undegraded":"2024-05-08T21:49:42.204720+0000","last_fullsized":"2024-05-08T21:49:42.204720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:52.323917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T21:49:42.217091+0000","last_change":"2024-05-08T21:49:42.217091+0000","last_active":"2024-05-08T21:49:42.193474+0000","last_peered":"2024-05-08T21:49:42.193474+0000","last_clean":"2024-05-08T21:49:42.193474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:42.217091+0000","last_undegraded":"2024-05-08T21:49:42.217091+0000","last_fullsized":"2024-05-08T21:49:42.217091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:10.497167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T21:49:42.209363+0000","last_change":"2024-05-08T21:49:42.209363+0000","last_active":"2024-05-08T21:49:42.193474+0000","last_peered":"2024-05-08T21:49:42.193474+0000","last_clean":"2024-05-08T21:49:42.193474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:42.209363+0000","last_undegraded":"2024-05-08T21:49:42.209363+0000","last_fullsized":"2024-05-08T21:49:42.209363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:41:35.881003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755188+0000","last_change":"2024-05-08T21:49:43.215293+0000","last_active":"2024-05-08T21:49:44.755188+0000","last_peered":"2024-05-08T21:49:44.755188+0000","last_clean":"2024-05-08T21:49:44.755188+0000","last_became_active":"2024-05-08T21:49:43.215048+0000","last_became_peered":"2024-05-08T21:49:43.215048+0000","last_unstale":"2024-05-08T21:49:44.755188+0000","last_undegraded":"2024-05-08T21:49:44.755188+0000","last_fullsized":"2024-05-08T21:49:44.755188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:43:48.019170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757129+0000","last_change":"2024-05-08T21:49:43.770326+0000","last_active":"2024-05-08T21:49:44.757129+0000","last_peered":"2024-05-08T21:49:44.757129+0000","last_clean":"2024-05-08T21:49:44.757129+0000","last_became_active":"2024-05-08T21:49:43.770029+0000","last_became_peered":"2024-05-08T21:49:43.770029+0000","last_unstale":"2024-05-08T21:49:44.757129+0000","last_undegraded":"2024-05-08T21:49:44.757129+0000","last_fullsized":"2024-05-08T21:49:44.757129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:33:33.642847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757017+0000","last_change":"2024-05-08T21:49:43.227710+0000","last_active":"2024-05-08T21:49:44.757017+0000","last_peered":"2024-05-08T21:49:44.757017+0000","last_clean":"2024-05-08T21:49:44.757017+0000","last_became_active":"2024-05-08T21:49:43.227430+0000","last_became_peered":"2024-05-08T21:49:43.227430+0000","last_unstale":"2024-05-08T21:49:44.757017+0000","last_undegraded":"2024-05-08T21:49:44.757017+0000","last_fullsized":"2024-05-08T21:49:44.757017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:05:58.875400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.754953+0000","last_change":"2024-05-08T21:49:43.758618+0000","last_active":"2024-05-08T21:49:44.754953+0000","last_peered":"2024-05-08T21:49:44.754953+0000","last_clean":"2024-05-08T21:49:44.754953+0000","last_became_active":"2024-05-08T21:49:43.758367+0000","last_became_peered":"2024-05-08T21:49:43.758367+0000","last_unstale":"2024-05-08T21:49:44.754953+0000","last_undegraded":"2024-05-08T21:49:44.754953+0000","last_fullsized":"2024-05-08T21:49:44.754953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:30:06.569971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T21:49:42.217162+0000","last_change":"2024-05-08T21:49:42.217162+0000","last_active":"2024-05-08T21:49:42.193474+0000","last_peered":"2024-05-08T21:49:42.193474+0000","last_clean":"2024-05-08T21:49:42.193474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:42.217162+0000","last_undegraded":"2024-05-08T21:49:42.217162+0000","last_fullsized":"2024-05-08T21:49:42.217162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:17.379362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756759+0000","last_change":"2024-05-08T21:49:43.224929+0000","last_active":"2024-05-08T21:49:44.756759+0000","last_peered":"2024-05-08T21:49:44.756759+0000","last_clean":"2024-05-08T21:49:44.756759+0000","last_became_active":"2024-05-08T21:49:43.223469+0000","last_became_peered":"2024-05-08T21:49:43.223469+0000","last_unstale":"2024-05-08T21:49:44.756759+0000","last_undegraded":"2024-05-08T21:49:44.756759+0000","last_fullsized":"2024-05-08T21:49:44.756759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:27.504127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":161,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-08T21:49:39.634710+0000","last_change":"2024-05-08T21:49:38.626519+0000","last_active":"2024-05-08T21:49:39.634710+0000","last_peered":"2024-05-08T21:49:39.634710+0000","last_clean":"2024-05-08T21:49:39.634710+0000","last_became_active":"2024-05-08T21:49:38.626159+0000","last_became_peered":"2024-05-08T21:49:38.626159+0000","last_unstale":"2024-05-08T21:49:39.634710+0000","last_undegraded":"2024-05-08T21:49:39.634710+0000","last_fullsized":"2024-05-08T21:49:39.634710+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:36.031649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:36.031649+0000","last_clean_scrub_stamp":"2024-05-08T21:49:36.031649+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:12:04.846500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T21:49:42.206520+0000","last_change":"2024-05-08T21:49:42.206520+0000","last_active":"2024-05-08T21:49:42.193474+0000","last_peered":"2024-05-08T21:49:42.193474+0000","last_clean":"2024-05-08T21:49:42.193474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:42.206520+0000","last_undegraded":"2024-05-08T21:49:42.206520+0000","last_fullsized":"2024-05-08T21:49:42.206520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:52.323917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T21:49:42.206709+0000","last_change":"2024-05-08T21:49:42.206709+0000","last_active":"2024-05-08T21:49:42.193474+0000","last_peered":"2024-05-08T21:49:42.193474+0000","last_clean":"2024-05-08T21:49:42.193474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:42.206709+0000","last_undegraded":"2024-05-08T21:49:42.206709+0000","last_fullsized":"2024-05-08T21:49:42.206709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:18:58.164159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755021+0000","last_change":"2024-05-08T21:49:43.758424+0000","last_active":"2024-05-08T21:49:44.755021+0000","last_peered":"2024-05-08T21:49:44.755021+0000","last_clean":"2024-05-08T21:49:44.755021+0000","last_became_active":"2024-05-08T21:49:43.758140+0000","last_became_peered":"2024-05-08T21:49:43.758140+0000","last_unstale":"2024-05-08T21:49:44.755021+0000","last_undegraded":"2024-05-08T21:49:44.755021+0000","last_fullsized":"2024-05-08T21:49:44.755021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:10.795540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755053+0000","last_change":"2024-05-08T21:49:43.218241+0000","last_active":"2024-05-08T21:49:44.755053+0000","last_peered":"2024-05-08T21:49:44.755053+0000","last_clean":"2024-05-08T21:49:44.755053+0000","last_became_active":"2024-05-08T21:49:43.217780+0000","last_became_peered":"2024-05-08T21:49:43.217780+0000","last_unstale":"2024-05-08T21:49:44.755053+0000","last_undegraded":"2024-05-08T21:49:44.755053+0000","last_fullsized":"2024-05-08T21:49:44.755053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:27.504127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T21:49:42.203786+0000","last_change":"2024-05-08T21:49:42.203786+0000","last_active":"2024-05-08T21:49:42.193474+0000","last_peered":"2024-05-08T21:49:42.193474+0000","last_clean":"2024-05-08T21:49:42.193474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:42.203786+0000","last_undegraded":"2024-05-08T21:49:42.203786+0000","last_fullsized":"2024-05-08T21:49:42.203786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:33:28.074468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T21:49:42.207910+0000","last_change":"2024-05-08T21:49:42.207910+0000","last_active":"2024-05-08T21:49:42.193474+0000","last_peered":"2024-05-08T21:49:42.193474+0000","last_clean":"2024-05-08T21:49:42.193474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:42.207910+0000","last_undegraded":"2024-05-08T21:49:42.207910+0000","last_fullsized":"2024-05-08T21:49:42.207910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:10.497167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.754925+0000","last_change":"2024-05-08T21:49:43.215361+0000","last_active":"2024-05-08T21:49:44.754925+0000","last_peered":"2024-05-08T21:49:44.754925+0000","last_clean":"2024-05-08T21:49:44.754925+0000","last_became_active":"2024-05-08T21:49:43.215162+0000","last_became_peered":"2024-05-08T21:49:43.215162+0000","last_unstale":"2024-05-08T21:49:44.754925+0000","last_undegraded":"2024-05-08T21:49:44.754925+0000","last_fullsized":"2024-05-08T21:49:44.754925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:05:58.875400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755100+0000","last_change":"2024-05-08T21:49:43.217935+0000","last_active":"2024-05-08T21:49:44.755100+0000","last_peered":"2024-05-08T21:49:44.755100+0000","last_clean":"2024-05-08T21:49:44.755100+0000","last_became_active":"2024-05-08T21:49:43.217595+0000","last_became_peered":"2024-05-08T21:49:43.217595+0000","last_unstale":"2024-05-08T21:49:44.755100+0000","last_undegraded":"2024-05-08T21:49:44.755100+0000","last_fullsized":"2024-05-08T21:49:44.755100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:38:43.069159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T21:49:42.206656+0000","last_change":"2024-05-08T21:49:42.206656+0000","last_active":"2024-05-08T21:49:42.193474+0000","last_peered":"2024-05-08T21:49:42.193474+0000","last_clean":"2024-05-08T21:49:42.193474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:42.206656+0000","last_undegraded":"2024-05-08T21:49:42.206656+0000","last_fullsized":"2024-05-08T21:49:42.206656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:03.961487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T21:49:42.217098+0000","last_change":"2024-05-08T21:49:42.217098+0000","last_active":"2024-05-08T21:49:42.193474+0000","last_peered":"2024-05-08T21:49:42.193474+0000","last_clean":"2024-05-08T21:49:42.193474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:42.217098+0000","last_undegraded":"2024-05-08T21:49:42.217098+0000","last_fullsized":"2024-05-08T21:49:42.217098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:33:28.074468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755187+0000","last_change":"2024-05-08T21:49:43.208581+0000","last_active":"2024-05-08T21:49:44.755187+0000","last_peered":"2024-05-08T21:49:44.755187+0000","last_clean":"2024-05-08T21:49:44.755187+0000","last_became_active":"2024-05-08T21:49:43.208326+0000","last_became_peered":"2024-05-08T21:49:43.208326+0000","last_unstale":"2024-05-08T21:49:44.755187+0000","last_undegraded":"2024-05-08T21:49:44.755187+0000","last_fullsized":"2024-05-08T21:49:44.755187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:13:35.461791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756911+0000","last_change":"2024-05-08T21:49:43.766519+0000","last_active":"2024-05-08T21:49:44.756911+0000","last_peered":"2024-05-08T21:49:44.756911+0000","last_clean":"2024-05-08T21:49:44.756911+0000","last_became_active":"2024-05-08T21:49:43.765789+0000","last_became_peered":"2024-05-08T21:49:43.765789+0000","last_unstale":"2024-05-08T21:49:44.756911+0000","last_undegraded":"2024-05-08T21:49:44.756911+0000","last_fullsized":"2024-05-08T21:49:44.756911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:23.674986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T21:49:42.217041+0000","last_change":"2024-05-08T21:49:42.217041+0000","last_active":"2024-05-08T21:49:42.193474+0000","last_peered":"2024-05-08T21:49:42.193474+0000","last_clean":"2024-05-08T21:49:42.193474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:42.217041+0000","last_undegraded":"2024-05-08T21:49:42.217041+0000","last_fullsized":"2024-05-08T21:49:42.217041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:18:58.164159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757080+0000","last_change":"2024-05-08T21:49:43.768929+0000","last_active":"2024-05-08T21:49:44.757080+0000","last_peered":"2024-05-08T21:49:44.757080+0000","last_clean":"2024-05-08T21:49:44.757080+0000","last_became_active":"2024-05-08T21:49:43.767606+0000","last_became_peered":"2024-05-08T21:49:43.767606+0000","last_unstale":"2024-05-08T21:49:44.757080+0000","last_undegraded":"2024-05-08T21:49:44.757080+0000","last_fullsized":"2024-05-08T21:49:44.757080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:13:06.426154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755114+0000","last_change":"2024-05-08T21:49:43.757318+0000","last_active":"2024-05-08T21:49:44.755114+0000","last_peered":"2024-05-08T21:49:44.755114+0000","last_clean":"2024-05-08T21:49:44.755114+0000","last_became_active":"2024-05-08T21:49:43.757083+0000","last_became_peered":"2024-05-08T21:49:43.757083+0000","last_unstale":"2024-05-08T21:49:44.755114+0000","last_undegraded":"2024-05-08T21:49:44.755114+0000","last_fullsized":"2024-05-08T21:49:44.755114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:47.551474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756761+0000","last_change":"2024-05-08T21:49:43.768942+0000","last_active":"2024-05-08T21:49:44.756761+0000","last_peered":"2024-05-08T21:49:44.756761+0000","last_clean":"2024-05-08T21:49:44.756761+0000","last_became_active":"2024-05-08T21:49:43.768673+0000","last_became_peered":"2024-05-08T21:49:43.768673+0000","last_unstale":"2024-05-08T21:49:44.756761+0000","last_undegraded":"2024-05-08T21:49:44.756761+0000","last_fullsized":"2024-05-08T21:49:44.756761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:15:41.869107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756863+0000","last_change":"2024-05-08T21:49:43.775098+0000","last_active":"2024-05-08T21:49:44.756863+0000","last_peered":"2024-05-08T21:49:44.756863+0000","last_clean":"2024-05-08T21:49:44.756863+0000","last_became_active":"2024-05-08T21:49:43.774808+0000","last_became_peered":"2024-05-08T21:49:43.774808+0000","last_unstale":"2024-05-08T21:49:44.756863+0000","last_undegraded":"2024-05-08T21:49:44.756863+0000","last_fullsized":"2024-05-08T21:49:44.756863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:51:15.152611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T21:49:43.200171+0000","last_change":"2024-05-08T21:49:43.200171+0000","last_active":"2024-05-08T21:49:43.200171+0000","last_peered":"2024-05-08T21:49:43.200171+0000","last_clean":"2024-05-08T21:49:43.200171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T21:49:43.200171+0000","last_undegraded":"2024-05-08T21:49:43.200171+0000","last_fullsized":"2024-05-08T21:49:43.200171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":36,"acting":36,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28376,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343464,"statfs":{"total":96636764160,"available":96607707136,"internally_reserved":0,"allocated":753664,"data_stored":638290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]}]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":159744,"data_stored":47922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":73089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":73089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]}]},{"osd":0,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":765952,"data_stored":644107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]}]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":172032,"data_stored":53739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]}]},{"osd":3,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":159744,"data_stored":47922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]}]},{"osd":4,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":159744,"data_stored":47922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T21:49:49.663 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3f is not active+clean 2024-05-08T21:49:49.663 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T21:49:43.200171+0000', 'last_change': '2024-05-08T21:49:43.200171+0000', 'last_active': '2024-05-08T21:49:43.200171+0000', 'last_peered': '2024-05-08T21:49:43.200171+0000', 'last_clean': '2024-05-08T21:49:43.200171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T21:49:43.200171+0000', 'last_undegraded': '2024-05-08T21:49:43.200171+0000', 'last_fullsized': '2024-05-08T21:49:43.200171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_clean_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T21:49:49.664 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3d is not active+clean 2024-05-08T21:49:49.664 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T21:49:43.200171+0000', 'last_change': '2024-05-08T21:49:43.200171+0000', 'last_active': '2024-05-08T21:49:43.200171+0000', 'last_peered': '2024-05-08T21:49:43.200171+0000', 'last_clean': '2024-05-08T21:49:43.200171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T21:49:43.200171+0000', 'last_undegraded': '2024-05-08T21:49:43.200171+0000', 'last_fullsized': '2024-05-08T21:49:43.200171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_clean_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T21:49:49.664 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3b is not active+clean 2024-05-08T21:49:49.664 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T21:49:43.200171+0000', 'last_change': '2024-05-08T21:49:43.200171+0000', 'last_active': '2024-05-08T21:49:43.200171+0000', 'last_peered': '2024-05-08T21:49:43.200171+0000', 'last_clean': '2024-05-08T21:49:43.200171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T21:49:43.200171+0000', 'last_undegraded': '2024-05-08T21:49:43.200171+0000', 'last_fullsized': '2024-05-08T21:49:43.200171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_clean_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T21:49:49.664 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.39 is not active+clean 2024-05-08T21:49:49.664 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T21:49:43.200171+0000', 'last_change': '2024-05-08T21:49:43.200171+0000', 'last_active': '2024-05-08T21:49:43.200171+0000', 'last_peered': '2024-05-08T21:49:43.200171+0000', 'last_clean': '2024-05-08T21:49:43.200171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T21:49:43.200171+0000', 'last_undegraded': '2024-05-08T21:49:43.200171+0000', 'last_fullsized': '2024-05-08T21:49:43.200171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_clean_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T21:49:49.664 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.38 is not active+clean 2024-05-08T21:49:49.664 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T21:49:43.200171+0000', 'last_change': '2024-05-08T21:49:43.200171+0000', 'last_active': '2024-05-08T21:49:43.200171+0000', 'last_peered': '2024-05-08T21:49:43.200171+0000', 'last_clean': '2024-05-08T21:49:43.200171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T21:49:43.200171+0000', 'last_undegraded': '2024-05-08T21:49:43.200171+0000', 'last_fullsized': '2024-05-08T21:49:43.200171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_clean_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T21:49:49.664 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.37 is not active+clean 2024-05-08T21:49:49.664 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T21:49:43.200171+0000', 'last_change': '2024-05-08T21:49:43.200171+0000', 'last_active': '2024-05-08T21:49:43.200171+0000', 'last_peered': '2024-05-08T21:49:43.200171+0000', 'last_clean': '2024-05-08T21:49:43.200171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T21:49:43.200171+0000', 'last_undegraded': '2024-05-08T21:49:43.200171+0000', 'last_fullsized': '2024-05-08T21:49:43.200171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_clean_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T21:49:49.665 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.36 is not active+clean 2024-05-08T21:49:49.665 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T21:49:43.200171+0000', 'last_change': '2024-05-08T21:49:43.200171+0000', 'last_active': '2024-05-08T21:49:43.200171+0000', 'last_peered': '2024-05-08T21:49:43.200171+0000', 'last_clean': '2024-05-08T21:49:43.200171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T21:49:43.200171+0000', 'last_undegraded': '2024-05-08T21:49:43.200171+0000', 'last_fullsized': '2024-05-08T21:49:43.200171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_clean_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T21:49:49.665 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.35 is not active+clean 2024-05-08T21:49:49.665 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T21:49:43.200171+0000', 'last_change': '2024-05-08T21:49:43.200171+0000', 'last_active': '2024-05-08T21:49:43.200171+0000', 'last_peered': '2024-05-08T21:49:43.200171+0000', 'last_clean': '2024-05-08T21:49:43.200171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T21:49:43.200171+0000', 'last_undegraded': '2024-05-08T21:49:43.200171+0000', 'last_fullsized': '2024-05-08T21:49:43.200171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_clean_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T21:49:49.665 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.34 is not active+clean 2024-05-08T21:49:49.666 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T21:49:43.200171+0000', 'last_change': '2024-05-08T21:49:43.200171+0000', 'last_active': '2024-05-08T21:49:43.200171+0000', 'last_peered': '2024-05-08T21:49:43.200171+0000', 'last_clean': '2024-05-08T21:49:43.200171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T21:49:43.200171+0000', 'last_undegraded': '2024-05-08T21:49:43.200171+0000', 'last_fullsized': '2024-05-08T21:49:43.200171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_clean_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T21:49:49.666 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.33 is not active+clean 2024-05-08T21:49:49.666 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T21:49:43.200171+0000', 'last_change': '2024-05-08T21:49:43.200171+0000', 'last_active': '2024-05-08T21:49:43.200171+0000', 'last_peered': '2024-05-08T21:49:43.200171+0000', 'last_clean': '2024-05-08T21:49:43.200171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T21:49:43.200171+0000', 'last_undegraded': '2024-05-08T21:49:43.200171+0000', 'last_fullsized': '2024-05-08T21:49:43.200171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_clean_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T21:49:49.666 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.32 is not active+clean 2024-05-08T21:49:49.666 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T21:49:43.200171+0000', 'last_change': '2024-05-08T21:49:43.200171+0000', 'last_active': '2024-05-08T21:49:43.200171+0000', 'last_peered': '2024-05-08T21:49:43.200171+0000', 'last_clean': '2024-05-08T21:49:43.200171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T21:49:43.200171+0000', 'last_undegraded': '2024-05-08T21:49:43.200171+0000', 'last_fullsized': '2024-05-08T21:49:43.200171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_clean_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T21:49:49.666 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2e is not active+clean 2024-05-08T21:49:49.666 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T21:49:43.200171+0000', 'last_change': '2024-05-08T21:49:43.200171+0000', 'last_active': '2024-05-08T21:49:43.200171+0000', 'last_peered': '2024-05-08T21:49:43.200171+0000', 'last_clean': '2024-05-08T21:49:43.200171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T21:49:43.200171+0000', 'last_undegraded': '2024-05-08T21:49:43.200171+0000', 'last_fullsized': '2024-05-08T21:49:43.200171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_clean_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T21:49:49.666 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2d is not active+clean 2024-05-08T21:49:49.666 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T21:49:43.200171+0000', 'last_change': '2024-05-08T21:49:43.200171+0000', 'last_active': '2024-05-08T21:49:43.200171+0000', 'last_peered': '2024-05-08T21:49:43.200171+0000', 'last_clean': '2024-05-08T21:49:43.200171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T21:49:43.200171+0000', 'last_undegraded': '2024-05-08T21:49:43.200171+0000', 'last_fullsized': '2024-05-08T21:49:43.200171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_clean_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T21:49:49.666 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1f is not active+clean 2024-05-08T21:49:49.666 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T21:49:42.206879+0000', 'last_change': '2024-05-08T21:49:42.206879+0000', 'last_active': '2024-05-08T21:49:42.193474+0000', 'last_peered': '2024-05-08T21:49:42.193474+0000', 'last_clean': '2024-05-08T21:49:42.193474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T21:49:42.206879+0000', 'last_undegraded': '2024-05-08T21:49:42.206879+0000', 'last_fullsized': '2024-05-08T21:49:42.206879+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T21:49:42.193474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T21:49:42.193474+0000', 'last_clean_scrub_stamp': '2024-05-08T21:49:42.193474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-10T02:02:45.778415+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-08T21:49:49.667 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1e is not active+clean 2024-05-08T21:49:49.667 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T21:49:43.200171+0000', 'last_change': '2024-05-08T21:49:43.200171+0000', 'last_active': '2024-05-08T21:49:43.200171+0000', 'last_peered': '2024-05-08T21:49:43.200171+0000', 'last_clean': '2024-05-08T21:49:43.200171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T21:49:43.200171+0000', 'last_undegraded': '2024-05-08T21:49:43.200171+0000', 'last_fullsized': '2024-05-08T21:49:43.200171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_clean_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T21:49:49.667 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1e is not active+clean 2024-05-08T21:49:49.667 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T21:49:42.203256+0000', 'last_change': '2024-05-08T21:49:42.203256+0000', 'last_active': '2024-05-08T21:49:42.193474+0000', 'last_peered': '2024-05-08T21:49:42.193474+0000', 'last_clean': '2024-05-08T21:49:42.193474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T21:49:42.203256+0000', 'last_undegraded': '2024-05-08T21:49:42.203256+0000', 'last_fullsized': '2024-05-08T21:49:42.203256+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T21:49:42.193474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T21:49:42.193474+0000', 'last_clean_scrub_stamp': '2024-05-08T21:49:42.193474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-10T05:35:17.379362+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-08T21:49:49.667 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1f is not active+clean 2024-05-08T21:49:49.667 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T21:49:43.200171+0000', 'last_change': '2024-05-08T21:49:43.200171+0000', 'last_active': '2024-05-08T21:49:43.200171+0000', 'last_peered': '2024-05-08T21:49:43.200171+0000', 'last_clean': '2024-05-08T21:49:43.200171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T21:49:43.200171+0000', 'last_undegraded': '2024-05-08T21:49:43.200171+0000', 'last_fullsized': '2024-05-08T21:49:43.200171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_clean_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T21:49:49.667 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1d is not active+clean 2024-05-08T21:49:49.667 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T21:49:42.207304+0000', 'last_change': '2024-05-08T21:49:42.207304+0000', 'last_active': '2024-05-08T21:49:42.193474+0000', 'last_peered': '2024-05-08T21:49:42.193474+0000', 'last_clean': '2024-05-08T21:49:42.193474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T21:49:42.207304+0000', 'last_undegraded': '2024-05-08T21:49:42.207304+0000', 'last_fullsized': '2024-05-08T21:49:42.207304+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T21:49:42.193474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T21:49:42.193474+0000', 'last_clean_scrub_stamp': '2024-05-08T21:49:42.193474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-10T02:42:01.844011+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-08T21:49:49.667 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1c is not active+clean 2024-05-08T21:49:49.667 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T21:49:42.206963+0000', 'last_change': '2024-05-08T21:49:42.206963+0000', 'last_active': '2024-05-08T21:49:42.193474+0000', 'last_peered': '2024-05-08T21:49:42.193474+0000', 'last_clean': '2024-05-08T21:49:42.193474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T21:49:42.206963+0000', 'last_undegraded': '2024-05-08T21:49:42.206963+0000', 'last_fullsized': '2024-05-08T21:49:42.206963+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T21:49:42.193474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T21:49:42.193474+0000', 'last_clean_scrub_stamp': '2024-05-08T21:49:42.193474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-10T01:33:12.827218+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-08T21:49:49.667 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1b is not active+clean 2024-05-08T21:49:49.667 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T21:49:42.203244+0000', 'last_change': '2024-05-08T21:49:42.203244+0000', 'last_active': '2024-05-08T21:49:42.193474+0000', 'last_peered': '2024-05-08T21:49:42.193474+0000', 'last_clean': '2024-05-08T21:49:42.193474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T21:49:42.203244+0000', 'last_undegraded': '2024-05-08T21:49:42.203244+0000', 'last_fullsized': '2024-05-08T21:49:42.203244+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T21:49:42.193474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T21:49:42.193474+0000', 'last_clean_scrub_stamp': '2024-05-08T21:49:42.193474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-10T08:33:28.074468+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-08T21:49:49.668 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1a is not active+clean 2024-05-08T21:49:49.668 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T21:49:43.200171+0000', 'last_change': '2024-05-08T21:49:43.200171+0000', 'last_active': '2024-05-08T21:49:43.200171+0000', 'last_peered': '2024-05-08T21:49:43.200171+0000', 'last_clean': '2024-05-08T21:49:43.200171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T21:49:43.200171+0000', 'last_undegraded': '2024-05-08T21:49:43.200171+0000', 'last_fullsized': '2024-05-08T21:49:43.200171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_clean_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T21:49:49.668 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1a is not active+clean 2024-05-08T21:49:49.668 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T21:49:42.203787+0000', 'last_change': '2024-05-08T21:49:42.203787+0000', 'last_active': '2024-05-08T21:49:42.193474+0000', 'last_peered': '2024-05-08T21:49:42.193474+0000', 'last_clean': '2024-05-08T21:49:42.193474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T21:49:42.203787+0000', 'last_undegraded': '2024-05-08T21:49:42.203787+0000', 'last_fullsized': '2024-05-08T21:49:42.203787+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T21:49:42.193474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T21:49:42.193474+0000', 'last_clean_scrub_stamp': '2024-05-08T21:49:42.193474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-09T22:06:10.497167+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-08T21:49:49.668 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1b is not active+clean 2024-05-08T21:49:49.668 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T21:49:43.200171+0000', 'last_change': '2024-05-08T21:49:43.200171+0000', 'last_active': '2024-05-08T21:49:43.200171+0000', 'last_peered': '2024-05-08T21:49:43.200171+0000', 'last_clean': '2024-05-08T21:49:43.200171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T21:49:43.200171+0000', 'last_undegraded': '2024-05-08T21:49:43.200171+0000', 'last_fullsized': '2024-05-08T21:49:43.200171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_clean_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T21:49:49.668 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.19 is not active+clean 2024-05-08T21:49:49.668 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T21:49:42.203257+0000', 'last_change': '2024-05-08T21:49:42.203257+0000', 'last_active': '2024-05-08T21:49:42.193474+0000', 'last_peered': '2024-05-08T21:49:42.193474+0000', 'last_clean': '2024-05-08T21:49:42.193474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T21:49:42.203257+0000', 'last_undegraded': '2024-05-08T21:49:42.203257+0000', 'last_fullsized': '2024-05-08T21:49:42.203257+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T21:49:42.193474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T21:49:42.193474+0000', 'last_clean_scrub_stamp': '2024-05-08T21:49:42.193474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-10T09:20:34.123736+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-08T21:49:49.668 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.18 is not active+clean 2024-05-08T21:49:49.668 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T21:49:43.200171+0000', 'last_change': '2024-05-08T21:49:43.200171+0000', 'last_active': '2024-05-08T21:49:43.200171+0000', 'last_peered': '2024-05-08T21:49:43.200171+0000', 'last_clean': '2024-05-08T21:49:43.200171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T21:49:43.200171+0000', 'last_undegraded': '2024-05-08T21:49:43.200171+0000', 'last_fullsized': '2024-05-08T21:49:43.200171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_clean_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T21:49:49.668 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.17 is not active+clean 2024-05-08T21:49:49.668 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T21:49:42.204534+0000', 'last_change': '2024-05-08T21:49:42.204534+0000', 'last_active': '2024-05-08T21:49:42.193474+0000', 'last_peered': '2024-05-08T21:49:42.193474+0000', 'last_clean': '2024-05-08T21:49:42.193474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T21:49:42.204534+0000', 'last_undegraded': '2024-05-08T21:49:42.204534+0000', 'last_fullsized': '2024-05-08T21:49:42.204534+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T21:49:42.193474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T21:49:42.193474+0000', 'last_clean_scrub_stamp': '2024-05-08T21:49:42.193474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-10T08:18:58.164159+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-08T21:49:49.669 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.17 is not active+clean 2024-05-08T21:49:49.669 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T21:49:43.200171+0000', 'last_change': '2024-05-08T21:49:43.200171+0000', 'last_active': '2024-05-08T21:49:43.200171+0000', 'last_peered': '2024-05-08T21:49:43.200171+0000', 'last_clean': '2024-05-08T21:49:43.200171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T21:49:43.200171+0000', 'last_undegraded': '2024-05-08T21:49:43.200171+0000', 'last_fullsized': '2024-05-08T21:49:43.200171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_clean_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T21:49:49.669 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.14 is not active+clean 2024-05-08T21:49:49.669 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T21:49:43.200171+0000', 'last_change': '2024-05-08T21:49:43.200171+0000', 'last_active': '2024-05-08T21:49:43.200171+0000', 'last_peered': '2024-05-08T21:49:43.200171+0000', 'last_clean': '2024-05-08T21:49:43.200171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T21:49:43.200171+0000', 'last_undegraded': '2024-05-08T21:49:43.200171+0000', 'last_fullsized': '2024-05-08T21:49:43.200171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_clean_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T21:49:49.669 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.14 is not active+clean 2024-05-08T21:49:49.669 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T21:49:42.203786+0000', 'last_change': '2024-05-08T21:49:42.203786+0000', 'last_active': '2024-05-08T21:49:42.193474+0000', 'last_peered': '2024-05-08T21:49:42.193474+0000', 'last_clean': '2024-05-08T21:49:42.193474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T21:49:42.203786+0000', 'last_undegraded': '2024-05-08T21:49:42.203786+0000', 'last_fullsized': '2024-05-08T21:49:42.203786+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T21:49:42.193474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T21:49:42.193474+0000', 'last_clean_scrub_stamp': '2024-05-08T21:49:42.193474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-10T05:35:17.379362+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-08T21:49:49.669 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.15 is not active+clean 2024-05-08T21:49:49.669 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T21:49:43.200171+0000', 'last_change': '2024-05-08T21:49:43.200171+0000', 'last_active': '2024-05-08T21:49:43.200171+0000', 'last_peered': '2024-05-08T21:49:43.200171+0000', 'last_clean': '2024-05-08T21:49:43.200171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T21:49:43.200171+0000', 'last_undegraded': '2024-05-08T21:49:43.200171+0000', 'last_fullsized': '2024-05-08T21:49:43.200171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_clean_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T21:49:49.669 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.13 is not active+clean 2024-05-08T21:49:49.669 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T21:49:42.206849+0000', 'last_change': '2024-05-08T21:49:42.206849+0000', 'last_active': '2024-05-08T21:49:42.193474+0000', 'last_peered': '2024-05-08T21:49:42.193474+0000', 'last_clean': '2024-05-08T21:49:42.193474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T21:49:42.206849+0000', 'last_undegraded': '2024-05-08T21:49:42.206849+0000', 'last_fullsized': '2024-05-08T21:49:42.206849+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T21:49:42.193474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T21:49:42.193474+0000', 'last_clean_scrub_stamp': '2024-05-08T21:49:42.193474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-10T09:20:34.123736+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-08T21:49:49.669 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.12 is not active+clean 2024-05-08T21:49:49.669 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T21:49:43.200171+0000', 'last_change': '2024-05-08T21:49:43.200171+0000', 'last_active': '2024-05-08T21:49:43.200171+0000', 'last_peered': '2024-05-08T21:49:43.200171+0000', 'last_clean': '2024-05-08T21:49:43.200171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T21:49:43.200171+0000', 'last_undegraded': '2024-05-08T21:49:43.200171+0000', 'last_fullsized': '2024-05-08T21:49:43.200171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_clean_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T21:49:49.670 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.13 is not active+clean 2024-05-08T21:49:49.670 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T21:49:43.200171+0000', 'last_change': '2024-05-08T21:49:43.200171+0000', 'last_active': '2024-05-08T21:49:43.200171+0000', 'last_peered': '2024-05-08T21:49:43.200171+0000', 'last_clean': '2024-05-08T21:49:43.200171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T21:49:43.200171+0000', 'last_undegraded': '2024-05-08T21:49:43.200171+0000', 'last_fullsized': '2024-05-08T21:49:43.200171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_clean_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T21:49:49.670 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.11 is not active+clean 2024-05-08T21:49:49.670 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T21:49:42.204720+0000', 'last_change': '2024-05-08T21:49:42.204720+0000', 'last_active': '2024-05-08T21:49:42.193474+0000', 'last_peered': '2024-05-08T21:49:42.193474+0000', 'last_clean': '2024-05-08T21:49:42.193474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T21:49:42.204720+0000', 'last_undegraded': '2024-05-08T21:49:42.204720+0000', 'last_fullsized': '2024-05-08T21:49:42.204720+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T21:49:42.193474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T21:49:42.193474+0000', 'last_clean_scrub_stamp': '2024-05-08T21:49:42.193474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-10T05:45:52.323917+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-08T21:49:49.670 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.10 is not active+clean 2024-05-08T21:49:49.670 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T21:49:43.200171+0000', 'last_change': '2024-05-08T21:49:43.200171+0000', 'last_active': '2024-05-08T21:49:43.200171+0000', 'last_peered': '2024-05-08T21:49:43.200171+0000', 'last_clean': '2024-05-08T21:49:43.200171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T21:49:43.200171+0000', 'last_undegraded': '2024-05-08T21:49:43.200171+0000', 'last_fullsized': '2024-05-08T21:49:43.200171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_clean_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T21:49:49.670 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.10 is not active+clean 2024-05-08T21:49:49.670 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T21:49:42.217091+0000', 'last_change': '2024-05-08T21:49:42.217091+0000', 'last_active': '2024-05-08T21:49:42.193474+0000', 'last_peered': '2024-05-08T21:49:42.193474+0000', 'last_clean': '2024-05-08T21:49:42.193474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T21:49:42.217091+0000', 'last_undegraded': '2024-05-08T21:49:42.217091+0000', 'last_fullsized': '2024-05-08T21:49:42.217091+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T21:49:42.193474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T21:49:42.193474+0000', 'last_clean_scrub_stamp': '2024-05-08T21:49:42.193474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-09T22:06:10.497167+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-08T21:49:49.670 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.11 is not active+clean 2024-05-08T21:49:49.670 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T21:49:43.200171+0000', 'last_change': '2024-05-08T21:49:43.200171+0000', 'last_active': '2024-05-08T21:49:43.200171+0000', 'last_peered': '2024-05-08T21:49:43.200171+0000', 'last_clean': '2024-05-08T21:49:43.200171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T21:49:43.200171+0000', 'last_undegraded': '2024-05-08T21:49:43.200171+0000', 'last_fullsized': '2024-05-08T21:49:43.200171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_clean_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T21:49:49.671 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.f is not active+clean 2024-05-08T21:49:49.671 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T21:49:42.209363+0000', 'last_change': '2024-05-08T21:49:42.209363+0000', 'last_active': '2024-05-08T21:49:42.193474+0000', 'last_peered': '2024-05-08T21:49:42.193474+0000', 'last_clean': '2024-05-08T21:49:42.193474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T21:49:42.209363+0000', 'last_undegraded': '2024-05-08T21:49:42.209363+0000', 'last_fullsized': '2024-05-08T21:49:42.209363+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T21:49:42.193474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T21:49:42.193474+0000', 'last_clean_scrub_stamp': '2024-05-08T21:49:42.193474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-10T04:41:35.881003+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-08T21:49:49.671 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.e is not active+clean 2024-05-08T21:49:49.671 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T21:49:43.200171+0000', 'last_change': '2024-05-08T21:49:43.200171+0000', 'last_active': '2024-05-08T21:49:43.200171+0000', 'last_peered': '2024-05-08T21:49:43.200171+0000', 'last_clean': '2024-05-08T21:49:43.200171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T21:49:43.200171+0000', 'last_undegraded': '2024-05-08T21:49:43.200171+0000', 'last_fullsized': '2024-05-08T21:49:43.200171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_clean_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T21:49:49.671 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3 is not active+clean 2024-05-08T21:49:49.671 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T21:49:43.200171+0000', 'last_change': '2024-05-08T21:49:43.200171+0000', 'last_active': '2024-05-08T21:49:43.200171+0000', 'last_peered': '2024-05-08T21:49:43.200171+0000', 'last_clean': '2024-05-08T21:49:43.200171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T21:49:43.200171+0000', 'last_undegraded': '2024-05-08T21:49:43.200171+0000', 'last_fullsized': '2024-05-08T21:49:43.200171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_clean_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T21:49:49.671 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1 is not active+clean 2024-05-08T21:49:49.671 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T21:49:42.217162+0000', 'last_change': '2024-05-08T21:49:42.217162+0000', 'last_active': '2024-05-08T21:49:42.193474+0000', 'last_peered': '2024-05-08T21:49:42.193474+0000', 'last_clean': '2024-05-08T21:49:42.193474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T21:49:42.217162+0000', 'last_undegraded': '2024-05-08T21:49:42.217162+0000', 'last_fullsized': '2024-05-08T21:49:42.217162+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T21:49:42.193474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T21:49:42.193474+0000', 'last_clean_scrub_stamp': '2024-05-08T21:49:42.193474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-10T05:35:17.379362+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-08T21:49:49.671 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2 is not active+clean 2024-05-08T21:49:49.671 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T21:49:43.200171+0000', 'last_change': '2024-05-08T21:49:43.200171+0000', 'last_active': '2024-05-08T21:49:43.200171+0000', 'last_peered': '2024-05-08T21:49:43.200171+0000', 'last_clean': '2024-05-08T21:49:43.200171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T21:49:43.200171+0000', 'last_undegraded': '2024-05-08T21:49:43.200171+0000', 'last_fullsized': '2024-05-08T21:49:43.200171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_clean_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T21:49:49.671 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1 is not active+clean 2024-05-08T21:49:49.671 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T21:49:43.200171+0000', 'last_change': '2024-05-08T21:49:43.200171+0000', 'last_active': '2024-05-08T21:49:43.200171+0000', 'last_peered': '2024-05-08T21:49:43.200171+0000', 'last_clean': '2024-05-08T21:49:43.200171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T21:49:43.200171+0000', 'last_undegraded': '2024-05-08T21:49:43.200171+0000', 'last_fullsized': '2024-05-08T21:49:43.200171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_clean_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T21:49:49.672 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.0 is not active+clean 2024-05-08T21:49:49.672 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T21:49:42.206520+0000', 'last_change': '2024-05-08T21:49:42.206520+0000', 'last_active': '2024-05-08T21:49:42.193474+0000', 'last_peered': '2024-05-08T21:49:42.193474+0000', 'last_clean': '2024-05-08T21:49:42.193474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T21:49:42.206520+0000', 'last_undegraded': '2024-05-08T21:49:42.206520+0000', 'last_fullsized': '2024-05-08T21:49:42.206520+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T21:49:42.193474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T21:49:42.193474+0000', 'last_clean_scrub_stamp': '2024-05-08T21:49:42.193474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-10T05:45:52.323917+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-08T21:49:49.672 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.5 is not active+clean 2024-05-08T21:49:49.672 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T21:49:42.206709+0000', 'last_change': '2024-05-08T21:49:42.206709+0000', 'last_active': '2024-05-08T21:49:42.193474+0000', 'last_peered': '2024-05-08T21:49:42.193474+0000', 'last_clean': '2024-05-08T21:49:42.193474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T21:49:42.206709+0000', 'last_undegraded': '2024-05-08T21:49:42.206709+0000', 'last_fullsized': '2024-05-08T21:49:42.206709+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T21:49:42.193474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T21:49:42.193474+0000', 'last_clean_scrub_stamp': '2024-05-08T21:49:42.193474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-10T08:18:58.164159+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-08T21:49:49.672 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.7 is not active+clean 2024-05-08T21:49:49.672 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T21:49:43.200171+0000', 'last_change': '2024-05-08T21:49:43.200171+0000', 'last_active': '2024-05-08T21:49:43.200171+0000', 'last_peered': '2024-05-08T21:49:43.200171+0000', 'last_clean': '2024-05-08T21:49:43.200171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T21:49:43.200171+0000', 'last_undegraded': '2024-05-08T21:49:43.200171+0000', 'last_fullsized': '2024-05-08T21:49:43.200171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_clean_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T21:49:49.672 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.7 is not active+clean 2024-05-08T21:49:49.672 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T21:49:42.203786+0000', 'last_change': '2024-05-08T21:49:42.203786+0000', 'last_active': '2024-05-08T21:49:42.193474+0000', 'last_peered': '2024-05-08T21:49:42.193474+0000', 'last_clean': '2024-05-08T21:49:42.193474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T21:49:42.203786+0000', 'last_undegraded': '2024-05-08T21:49:42.203786+0000', 'last_fullsized': '2024-05-08T21:49:42.203786+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T21:49:42.193474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T21:49:42.193474+0000', 'last_clean_scrub_stamp': '2024-05-08T21:49:42.193474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-10T08:33:28.074468+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-08T21:49:49.672 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.6 is not active+clean 2024-05-08T21:49:49.672 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T21:49:43.200171+0000', 'last_change': '2024-05-08T21:49:43.200171+0000', 'last_active': '2024-05-08T21:49:43.200171+0000', 'last_peered': '2024-05-08T21:49:43.200171+0000', 'last_clean': '2024-05-08T21:49:43.200171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T21:49:43.200171+0000', 'last_undegraded': '2024-05-08T21:49:43.200171+0000', 'last_fullsized': '2024-05-08T21:49:43.200171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_clean_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T21:49:49.672 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.8 is not active+clean 2024-05-08T21:49:49.673 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T21:49:42.207910+0000', 'last_change': '2024-05-08T21:49:42.207910+0000', 'last_active': '2024-05-08T21:49:42.193474+0000', 'last_peered': '2024-05-08T21:49:42.193474+0000', 'last_clean': '2024-05-08T21:49:42.193474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T21:49:42.207910+0000', 'last_undegraded': '2024-05-08T21:49:42.207910+0000', 'last_fullsized': '2024-05-08T21:49:42.207910+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T21:49:42.193474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T21:49:42.193474+0000', 'last_clean_scrub_stamp': '2024-05-08T21:49:42.193474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-09T22:06:10.497167+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-08T21:49:49.673 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.9 is not active+clean 2024-05-08T21:49:49.673 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T21:49:43.200171+0000', 'last_change': '2024-05-08T21:49:43.200171+0000', 'last_active': '2024-05-08T21:49:43.200171+0000', 'last_peered': '2024-05-08T21:49:43.200171+0000', 'last_clean': '2024-05-08T21:49:43.200171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T21:49:43.200171+0000', 'last_undegraded': '2024-05-08T21:49:43.200171+0000', 'last_fullsized': '2024-05-08T21:49:43.200171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_clean_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T21:49:49.673 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.8 is not active+clean 2024-05-08T21:49:49.673 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T21:49:43.200171+0000', 'last_change': '2024-05-08T21:49:43.200171+0000', 'last_active': '2024-05-08T21:49:43.200171+0000', 'last_peered': '2024-05-08T21:49:43.200171+0000', 'last_clean': '2024-05-08T21:49:43.200171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T21:49:43.200171+0000', 'last_undegraded': '2024-05-08T21:49:43.200171+0000', 'last_fullsized': '2024-05-08T21:49:43.200171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_clean_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T21:49:49.673 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.b is not active+clean 2024-05-08T21:49:49.673 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T21:49:43.200171+0000', 'last_change': '2024-05-08T21:49:43.200171+0000', 'last_active': '2024-05-08T21:49:43.200171+0000', 'last_peered': '2024-05-08T21:49:43.200171+0000', 'last_clean': '2024-05-08T21:49:43.200171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T21:49:43.200171+0000', 'last_undegraded': '2024-05-08T21:49:43.200171+0000', 'last_fullsized': '2024-05-08T21:49:43.200171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_clean_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T21:49:49.673 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.b is not active+clean 2024-05-08T21:49:49.673 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T21:49:42.206656+0000', 'last_change': '2024-05-08T21:49:42.206656+0000', 'last_active': '2024-05-08T21:49:42.193474+0000', 'last_peered': '2024-05-08T21:49:42.193474+0000', 'last_clean': '2024-05-08T21:49:42.193474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T21:49:42.206656+0000', 'last_undegraded': '2024-05-08T21:49:42.206656+0000', 'last_fullsized': '2024-05-08T21:49:42.206656+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T21:49:42.193474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T21:49:42.193474+0000', 'last_clean_scrub_stamp': '2024-05-08T21:49:42.193474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-10T02:46:03.961487+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-08T21:49:49.673 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.a is not active+clean 2024-05-08T21:49:49.673 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T21:49:43.200171+0000', 'last_change': '2024-05-08T21:49:43.200171+0000', 'last_active': '2024-05-08T21:49:43.200171+0000', 'last_peered': '2024-05-08T21:49:43.200171+0000', 'last_clean': '2024-05-08T21:49:43.200171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T21:49:43.200171+0000', 'last_undegraded': '2024-05-08T21:49:43.200171+0000', 'last_fullsized': '2024-05-08T21:49:43.200171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_clean_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T21:49:49.674 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.c is not active+clean 2024-05-08T21:49:49.674 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T21:49:42.217098+0000', 'last_change': '2024-05-08T21:49:42.217098+0000', 'last_active': '2024-05-08T21:49:42.193474+0000', 'last_peered': '2024-05-08T21:49:42.193474+0000', 'last_clean': '2024-05-08T21:49:42.193474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T21:49:42.217098+0000', 'last_undegraded': '2024-05-08T21:49:42.217098+0000', 'last_fullsized': '2024-05-08T21:49:42.217098+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T21:49:42.193474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T21:49:42.193474+0000', 'last_clean_scrub_stamp': '2024-05-08T21:49:42.193474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-10T08:33:28.074468+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-08T21:49:49.674 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.d is not active+clean 2024-05-08T21:49:49.674 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T21:49:43.200171+0000', 'last_change': '2024-05-08T21:49:43.200171+0000', 'last_active': '2024-05-08T21:49:43.200171+0000', 'last_peered': '2024-05-08T21:49:43.200171+0000', 'last_clean': '2024-05-08T21:49:43.200171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T21:49:43.200171+0000', 'last_undegraded': '2024-05-08T21:49:43.200171+0000', 'last_fullsized': '2024-05-08T21:49:43.200171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_clean_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T21:49:49.674 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.e is not active+clean 2024-05-08T21:49:49.674 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T21:49:42.217041+0000', 'last_change': '2024-05-08T21:49:42.217041+0000', 'last_active': '2024-05-08T21:49:42.193474+0000', 'last_peered': '2024-05-08T21:49:42.193474+0000', 'last_clean': '2024-05-08T21:49:42.193474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T21:49:42.217041+0000', 'last_undegraded': '2024-05-08T21:49:42.217041+0000', 'last_fullsized': '2024-05-08T21:49:42.217041+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T21:49:42.193474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T21:49:42.193474+0000', 'last_clean_scrub_stamp': '2024-05-08T21:49:42.193474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-10T08:18:58.164159+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-08T21:49:49.674 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.f is not active+clean 2024-05-08T21:49:49.674 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T21:49:43.200171+0000', 'last_change': '2024-05-08T21:49:43.200171+0000', 'last_active': '2024-05-08T21:49:43.200171+0000', 'last_peered': '2024-05-08T21:49:43.200171+0000', 'last_clean': '2024-05-08T21:49:43.200171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T21:49:43.200171+0000', 'last_undegraded': '2024-05-08T21:49:43.200171+0000', 'last_fullsized': '2024-05-08T21:49:43.200171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_clean_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T21:49:49.674 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.20 is not active+clean 2024-05-08T21:49:49.674 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T21:49:43.200171+0000', 'last_change': '2024-05-08T21:49:43.200171+0000', 'last_active': '2024-05-08T21:49:43.200171+0000', 'last_peered': '2024-05-08T21:49:43.200171+0000', 'last_clean': '2024-05-08T21:49:43.200171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T21:49:43.200171+0000', 'last_undegraded': '2024-05-08T21:49:43.200171+0000', 'last_fullsized': '2024-05-08T21:49:43.200171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_clean_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T21:49:49.674 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.21 is not active+clean 2024-05-08T21:49:49.675 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T21:49:43.200171+0000', 'last_change': '2024-05-08T21:49:43.200171+0000', 'last_active': '2024-05-08T21:49:43.200171+0000', 'last_peered': '2024-05-08T21:49:43.200171+0000', 'last_clean': '2024-05-08T21:49:43.200171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T21:49:43.200171+0000', 'last_undegraded': '2024-05-08T21:49:43.200171+0000', 'last_fullsized': '2024-05-08T21:49:43.200171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_clean_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T21:49:49.675 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.23 is not active+clean 2024-05-08T21:49:49.675 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T21:49:43.200171+0000', 'last_change': '2024-05-08T21:49:43.200171+0000', 'last_active': '2024-05-08T21:49:43.200171+0000', 'last_peered': '2024-05-08T21:49:43.200171+0000', 'last_clean': '2024-05-08T21:49:43.200171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T21:49:43.200171+0000', 'last_undegraded': '2024-05-08T21:49:43.200171+0000', 'last_fullsized': '2024-05-08T21:49:43.200171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_clean_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T21:49:49.675 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.24 is not active+clean 2024-05-08T21:49:49.675 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T21:49:43.200171+0000', 'last_change': '2024-05-08T21:49:43.200171+0000', 'last_active': '2024-05-08T21:49:43.200171+0000', 'last_peered': '2024-05-08T21:49:43.200171+0000', 'last_clean': '2024-05-08T21:49:43.200171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T21:49:43.200171+0000', 'last_undegraded': '2024-05-08T21:49:43.200171+0000', 'last_fullsized': '2024-05-08T21:49:43.200171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_clean_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T21:49:49.675 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.26 is not active+clean 2024-05-08T21:49:49.675 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T21:49:43.200171+0000', 'last_change': '2024-05-08T21:49:43.200171+0000', 'last_active': '2024-05-08T21:49:43.200171+0000', 'last_peered': '2024-05-08T21:49:43.200171+0000', 'last_clean': '2024-05-08T21:49:43.200171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T21:49:43.200171+0000', 'last_undegraded': '2024-05-08T21:49:43.200171+0000', 'last_fullsized': '2024-05-08T21:49:43.200171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_clean_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T21:49:49.675 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.27 is not active+clean 2024-05-08T21:49:49.675 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T21:49:43.200171+0000', 'last_change': '2024-05-08T21:49:43.200171+0000', 'last_active': '2024-05-08T21:49:43.200171+0000', 'last_peered': '2024-05-08T21:49:43.200171+0000', 'last_clean': '2024-05-08T21:49:43.200171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T21:49:43.200171+0000', 'last_undegraded': '2024-05-08T21:49:43.200171+0000', 'last_fullsized': '2024-05-08T21:49:43.200171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_clean_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T21:49:49.675 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.29 is not active+clean 2024-05-08T21:49:49.675 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T21:49:43.200171+0000', 'last_change': '2024-05-08T21:49:43.200171+0000', 'last_active': '2024-05-08T21:49:43.200171+0000', 'last_peered': '2024-05-08T21:49:43.200171+0000', 'last_clean': '2024-05-08T21:49:43.200171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T21:49:43.200171+0000', 'last_undegraded': '2024-05-08T21:49:43.200171+0000', 'last_fullsized': '2024-05-08T21:49:43.200171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_clean_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T21:49:49.675 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2b is not active+clean 2024-05-08T21:49:49.676 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T21:49:43.200171+0000', 'last_change': '2024-05-08T21:49:43.200171+0000', 'last_active': '2024-05-08T21:49:43.200171+0000', 'last_peered': '2024-05-08T21:49:43.200171+0000', 'last_clean': '2024-05-08T21:49:43.200171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T21:49:43.200171+0000', 'last_undegraded': '2024-05-08T21:49:43.200171+0000', 'last_fullsized': '2024-05-08T21:49:43.200171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_clean_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T21:49:49.676 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2c is not active+clean 2024-05-08T21:49:49.676 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T21:49:43.200171+0000', 'last_change': '2024-05-08T21:49:43.200171+0000', 'last_active': '2024-05-08T21:49:43.200171+0000', 'last_peered': '2024-05-08T21:49:43.200171+0000', 'last_clean': '2024-05-08T21:49:43.200171+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T21:49:43.200171+0000', 'last_undegraded': '2024-05-08T21:49:43.200171+0000', 'last_fullsized': '2024-05-08T21:49:43.200171+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'last_clean_scrub_stamp': '2024-05-08T21:49:43.200171+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T21:49:49.676 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-05-08T21:49:49.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.820+0000 7fe4a8149700 1 Processor -- start 2024-05-08T21:49:49.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.821+0000 7fe4a8149700 1 -- start start 2024-05-08T21:49:49.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.821+0000 7fe4a8149700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe4a0153d20 0x7fe4a015d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:49.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.821+0000 7fe4a8149700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe4a006f700 0x7fe4a00c8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:49.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.821+0000 7fe4a8149700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4a00c77e0 con 0x7fe4a00c6510 2024-05-08T21:49:49.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.821+0000 7fe4a8149700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4a00c7da0 con 0x7fe4a006f700 2024-05-08T21:49:49.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.821+0000 7fe4a8149700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4a006fc50 con 0x7fe4a0153d20 2024-05-08T21:49:49.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.822+0000 7fe4a56e4700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe4a006f700 0x7fe4a00c8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:49.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.822+0000 7fe4a56e4700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe4a006f700 0x7fe4a00c8eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38764/0 (socket says 172.21.15.73:38764) 2024-05-08T21:49:49.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.822+0000 7fe4a56e4700 1 -- 172.21.15.73:0/2216644248 learned_addr learned my addr 172.21.15.73:0/2216644248 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:49.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.822+0000 7fe4a5ee5700 1 --2- 172.21.15.73:0/2216644248 >> v2:172.21.15.115:3300/0 conn(0x7fe4a0153d20 0x7fe4a015d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:49.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.822+0000 7fe4a56e4700 1 -- 172.21.15.73:0/2216644248 >> v2:172.21.15.115:3300/0 conn(0x7fe4a0153d20 msgr2=0x7fe4a015d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:49.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.822+0000 7fe4a56e4700 1 --2- 172.21.15.73:0/2216644248 >> v2:172.21.15.115:3300/0 conn(0x7fe4a0153d20 0x7fe4a015d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:49.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.822+0000 7fe4a56e4700 1 -- 172.21.15.73:0/2216644248 >> v1:172.21.15.115:6789/0 conn(0x7fe4a00c6510 legacy=0x7fe4a006a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:49.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.822+0000 7fe4a56e4700 1 -- 172.21.15.73:0/2216644248 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a006ff30 con 0x7fe4a006f700 2024-05-08T21:49:49.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.822+0000 7fe4a56e4700 1 --2- 172.21.15.73:0/2216644248 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4a006f700 0x7fe4a00c8eb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe4a00c8e80 tx=0x7fe490009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5e39035e6995e7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:49.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.822+0000 7fe4a4ee3700 1 -- 172.21.15.73:0/2216644248 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe490004230 con 0x7fe4a006f700 2024-05-08T21:49:49.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.822+0000 7fe4a4ee3700 1 -- 172.21.15.73:0/2216644248 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe490004390 con 0x7fe4a006f700 2024-05-08T21:49:49.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.822+0000 7fe4a4ee3700 1 -- 172.21.15.73:0/2216644248 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4900036a0 con 0x7fe4a006f700 2024-05-08T21:49:49.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.823+0000 7fe4a8149700 1 -- 172.21.15.73:0/2216644248 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4a006f700 msgr2=0x7fe4a00c8eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:49.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.823+0000 7fe4a8149700 1 --2- 172.21.15.73:0/2216644248 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4a006f700 0x7fe4a00c8eb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe4a00c8e80 tx=0x7fe490009bd0 comp rx=0 tx=0).stop 2024-05-08T21:49:49.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.823+0000 7fe4a8149700 1 -- 172.21.15.73:0/2216644248 shutdown_connections 2024-05-08T21:49:49.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.823+0000 7fe4a8149700 1 --2- 172.21.15.73:0/2216644248 >> v2:172.21.15.115:3300/0 conn(0x7fe4a0153d20 0x7fe4a015d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:49.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.823+0000 7fe4a8149700 1 --2- 172.21.15.73:0/2216644248 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4a006f700 0x7fe4a00c8eb0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:49.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.823+0000 7fe4a8149700 1 -- 172.21.15.73:0/2216644248 >> 172.21.15.73:0/2216644248 conn(0x7fe4a00cc420 msgr2=0x7fe4a00cc800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:49.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.823+0000 7fe4a8149700 1 -- 172.21.15.73:0/2216644248 shutdown_connections 2024-05-08T21:49:49.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.823+0000 7fe4a8149700 1 -- 172.21.15.73:0/2216644248 wait complete. 2024-05-08T21:49:49.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.824+0000 7fe4a8149700 1 Processor -- start 2024-05-08T21:49:49.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.824+0000 7fe4a8149700 1 -- start start 2024-05-08T21:49:49.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.825+0000 7fe4a8149700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe4a006f700 0x7fe4a01f0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:49.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.825+0000 7fe4a8149700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4a00c6510 0x7fe4a015c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:49.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.825+0000 7fe4a8149700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe4a0153d20 0x7fe4a01f2400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:49.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.825+0000 7fe4a8149700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a014f920 con 0x7fe4a00c6510 2024-05-08T21:49:49.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.825+0000 7fe4a8149700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a014f430 con 0x7fe4a0153d20 2024-05-08T21:49:49.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.825+0000 7fe4a8149700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a01efb30 con 0x7fe4a006f700 2024-05-08T21:49:49.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.825+0000 7fe4a56e4700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4a00c6510 0x7fe4a015c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:49.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.825+0000 7fe4a56e4700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4a00c6510 0x7fe4a015c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38778/0 (socket says 172.21.15.73:38778) 2024-05-08T21:49:49.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.825+0000 7fe4a56e4700 1 -- 172.21.15.73:0/3630528325 learned_addr learned my addr 172.21.15.73:0/3630528325 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:49.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.825+0000 7fe4a66e6700 1 --2- 172.21.15.73:0/3630528325 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe4a0153d20 0x7fe4a01f2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:49.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.825+0000 7fe4a5ee5700 1 --2- 172.21.15.73:0/3630528325 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe4a006f700 0x7fe4a01f0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:49.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.825+0000 7fe4a56e4700 1 -- 172.21.15.73:0/3630528325 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe4a006f700 msgr2=0x7fe4a01f0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:49.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.825+0000 7fe4a56e4700 1 --2- 172.21.15.73:0/3630528325 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe4a006f700 0x7fe4a01f0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:49.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.825+0000 7fe4a56e4700 1 -- 172.21.15.73:0/3630528325 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe4a0153d20 msgr2=0x7fe4a01f2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:49.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.825+0000 7fe4a56e4700 1 --2- 172.21.15.73:0/3630528325 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe4a0153d20 0x7fe4a01f2400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:49.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.825+0000 7fe4a56e4700 1 -- 172.21.15.73:0/3630528325 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe490009550 con 0x7fe4a00c6510 2024-05-08T21:49:49.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.825+0000 7fe4a5ee5700 1 --2- 172.21.15.73:0/3630528325 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe4a006f700 0x7fe4a01f0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:49:49.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.825+0000 7fe4a56e4700 1 --2- 172.21.15.73:0/3630528325 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4a00c6510 0x7fe4a015c330 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe490009130 tx=0x7fe490004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:49.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.825+0000 7fe4967fc700 1 -- 172.21.15.73:0/3630528325 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe490003c10 con 0x7fe4a00c6510 2024-05-08T21:49:49.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.825+0000 7fe4967fc700 1 -- 172.21.15.73:0/3630528325 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe49001f070 con 0x7fe4a00c6510 2024-05-08T21:49:49.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.825+0000 7fe4967fc700 1 -- 172.21.15.73:0/3630528325 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe490011630 con 0x7fe4a00c6510 2024-05-08T21:49:49.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.825+0000 7fe4a8149700 1 -- 172.21.15.73:0/3630528325 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4a01f00b0 con 0x7fe4a00c6510 2024-05-08T21:49:49.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.825+0000 7fe4a8149700 1 -- 172.21.15.73:0/3630528325 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4a0157260 con 0x7fe4a00c6510 2024-05-08T21:49:49.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.826+0000 7fe4a8149700 1 -- 172.21.15.73:0/3630528325 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4a00c9e30 con 0x7fe4a00c6510 2024-05-08T21:49:49.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.827+0000 7fe4967fc700 1 -- 172.21.15.73:0/3630528325 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe490021030 con 0x7fe4a00c6510 2024-05-08T21:49:49.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.827+0000 7fe4967fc700 1 --2- 172.21.15.73:0/3630528325 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fe48406ac90 0x7fe48406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:49.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.827+0000 7fe4967fc700 1 -- 172.21.15.73:0/3630528325 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe49008a850 con 0x7fe4a00c6510 2024-05-08T21:49:49.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.827+0000 7fe4a5ee5700 1 --2- 172.21.15.73:0/3630528325 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fe48406ac90 0x7fe48406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:49.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.828+0000 7fe4a5ee5700 1 --2- 172.21.15.73:0/3630528325 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fe48406ac90 0x7fe48406d150 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe49c007a50 tx=0x7fe49c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:49.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:49.832+0000 7fe4967fc700 1 -- 172.21.15.73:0/3630528325 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fe4900559a0 con 0x7fe4a00c6510 2024-05-08T21:49:49.945 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:49:49.947 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:49:50.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.115+0000 7fe4a8149700 1 -- 172.21.15.73:0/3630528325 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fe4a0072490 con 0x7fe4a00c6510 2024-05-08T21:49:50.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.116+0000 7fe4967fc700 1 -- 172.21.15.73:0/3630528325 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1106 (secure 0 0 0) 0x7fe490058fc0 con 0x7fe4a00c6510 2024-05-08T21:49:50.116 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:49:50.116 INFO:teuthology.orchestra.run.smithi073.stdout:{"fsid":"143164b7-c9c7-4737-a494-7dafa5a3320c","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":23,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":21,"num_osds":8,"num_up_osds":8,"osd_up_since":1715204977,"num_in_osds":8,"osd_in_since":1715204968,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":46},{"state_name":"active+clean","count":30},{"state_name":"creating+peering","count":21}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":224706560,"bytes_avail":772869406720,"bytes_total":773094113280,"unknown_pgs_ratio":0.47422680258750916,"inactive_pgs_ratio":0.2164948433637619},"fsmap":{"epoch":8,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"e","status":"up:active","gid":4275}],"up:standby":5},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-05-08T21:49:26.223047+0000","services":{}},"progress_events":{}} 2024-05-08T21:49:50.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.118+0000 7fe4a8149700 1 -- 172.21.15.73:0/3630528325 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fe48406ac90 msgr2=0x7fe48406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:50.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.118+0000 7fe4a8149700 1 --2- 172.21.15.73:0/3630528325 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fe48406ac90 0x7fe48406d150 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe49c007a50 tx=0x7fe49c008040 comp rx=0 tx=0).stop 2024-05-08T21:49:50.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.118+0000 7fe4a8149700 1 -- 172.21.15.73:0/3630528325 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4a00c6510 msgr2=0x7fe4a015c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:50.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.118+0000 7fe4a8149700 1 --2- 172.21.15.73:0/3630528325 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4a00c6510 0x7fe4a015c330 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe490009130 tx=0x7fe490004750 comp rx=0 tx=0).stop 2024-05-08T21:49:50.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.118+0000 7fe4a8149700 1 -- 172.21.15.73:0/3630528325 shutdown_connections 2024-05-08T21:49:50.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.118+0000 7fe4a8149700 1 --2- 172.21.15.73:0/3630528325 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fe48406ac90 0x7fe48406d150 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:50.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.118+0000 7fe4a8149700 1 --2- 172.21.15.73:0/3630528325 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe4a0153d20 0x7fe4a01f2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:50.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.118+0000 7fe4a8149700 1 --2- 172.21.15.73:0/3630528325 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe4a006f700 0x7fe4a01f0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:50.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.118+0000 7fe4a8149700 1 --2- 172.21.15.73:0/3630528325 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4a00c6510 0x7fe4a015c330 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:50.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.118+0000 7fe4a8149700 1 -- 172.21.15.73:0/3630528325 >> 172.21.15.73:0/3630528325 conn(0x7fe4a00cc420 msgr2=0x7fe4a00cb110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:50.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.118+0000 7fe4a8149700 1 -- 172.21.15.73:0/3630528325 shutdown_connections 2024-05-08T21:49:50.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.118+0000 7fe4a8149700 1 -- 172.21.15.73:0/3630528325 wait complete. 2024-05-08T21:49:50.130 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-05-08T21:49:50.130 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T21:49:50.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.251+0000 7f96e8149700 1 Processor -- start 2024-05-08T21:49:50.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.251+0000 7f96e8149700 1 -- start start 2024-05-08T21:49:50.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.252+0000 7f96e8149700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f96e006afc0 0x7f96e00724e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:50.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.252+0000 7f96e8149700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f96e0072a20 0x7f96e015d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:50.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.252+0000 7f96e8149700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96e0154490 con 0x7f96e01540b0 2024-05-08T21:49:50.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.252+0000 7f96e8149700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96e006b430 con 0x7f96e006afc0 2024-05-08T21:49:50.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.252+0000 7f96e8149700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96e00c79b0 con 0x7f96e0072a20 2024-05-08T21:49:50.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.252+0000 7f96e56e4700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f96e006afc0 0x7f96e00724e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:50.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.252+0000 7f96e56e4700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f96e006afc0 0x7f96e00724e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38784/0 (socket says 172.21.15.73:38784) 2024-05-08T21:49:50.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.252+0000 7f96e56e4700 1 -- 172.21.15.73:0/4047814248 learned_addr learned my addr 172.21.15.73:0/4047814248 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:50.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.252+0000 7f96e66e6700 1 --2- 172.21.15.73:0/4047814248 >> v2:172.21.15.115:3300/0 conn(0x7f96e0072a20 0x7f96e015d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:50.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.252+0000 7f96e56e4700 1 -- 172.21.15.73:0/4047814248 >> v2:172.21.15.115:3300/0 conn(0x7f96e0072a20 msgr2=0x7f96e015d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:50.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.252+0000 7f96e56e4700 1 --2- 172.21.15.73:0/4047814248 >> v2:172.21.15.115:3300/0 conn(0x7f96e0072a20 0x7f96e015d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:50.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.252+0000 7f96e56e4700 1 -- 172.21.15.73:0/4047814248 >> v1:172.21.15.115:6789/0 conn(0x7f96e01540b0 legacy=0x7f96e0071d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:50.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.252+0000 7f96e56e4700 1 -- 172.21.15.73:0/4047814248 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e00c7c90 con 0x7f96e006afc0 2024-05-08T21:49:50.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.253+0000 7f96e56e4700 1 --2- 172.21.15.73:0/4047814248 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96e006afc0 0x7f96e00724e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f96e0071a80 tx=0x7f96dc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8d0edc336134450 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:50.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.253+0000 7f96e4ee3700 1 -- 172.21.15.73:0/4047814248 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96dc004230 con 0x7f96e006afc0 2024-05-08T21:49:50.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.253+0000 7f96e4ee3700 1 -- 172.21.15.73:0/4047814248 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96dc004390 con 0x7f96e006afc0 2024-05-08T21:49:50.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.253+0000 7f96e4ee3700 1 -- 172.21.15.73:0/4047814248 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96dc0036a0 con 0x7f96e006afc0 2024-05-08T21:49:50.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.253+0000 7f96e8149700 1 -- 172.21.15.73:0/4047814248 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96e006afc0 msgr2=0x7f96e00724e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:50.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.253+0000 7f96e8149700 1 --2- 172.21.15.73:0/4047814248 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96e006afc0 0x7f96e00724e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f96e0071a80 tx=0x7f96dc009bd0 comp rx=0 tx=0).stop 2024-05-08T21:49:50.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.253+0000 7f96e8149700 1 -- 172.21.15.73:0/4047814248 shutdown_connections 2024-05-08T21:49:50.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.253+0000 7f96e8149700 1 --2- 172.21.15.73:0/4047814248 >> v2:172.21.15.115:3300/0 conn(0x7f96e0072a20 0x7f96e015d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:50.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.253+0000 7f96e8149700 1 --2- 172.21.15.73:0/4047814248 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96e006afc0 0x7f96e00724e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:50.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.253+0000 7f96e8149700 1 -- 172.21.15.73:0/4047814248 >> 172.21.15.73:0/4047814248 conn(0x7f96e0066d70 msgr2=0x7f96e00cc500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:50.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.253+0000 7f96e8149700 1 -- 172.21.15.73:0/4047814248 shutdown_connections 2024-05-08T21:49:50.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.253+0000 7f96e8149700 1 -- 172.21.15.73:0/4047814248 wait complete. 2024-05-08T21:49:50.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.254+0000 7f96e8149700 1 Processor -- start 2024-05-08T21:49:50.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.255+0000 7f96e8149700 1 -- start start 2024-05-08T21:49:50.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.255+0000 7f96e8149700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96e006afc0 0x7f96e0155090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:50.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.255+0000 7f96e8149700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96e0072a20 0x7f96e0156960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:50.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.255+0000 7f96e8149700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f96e01540b0 0x7f96e014f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:50.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.255+0000 7f96e8149700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e00c94d0 con 0x7f96e006afc0 2024-05-08T21:49:50.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.255+0000 7f96e8149700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e01f3460 con 0x7f96e0072a20 2024-05-08T21:49:50.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.255+0000 7f96e8149700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e0157430 con 0x7f96e01540b0 2024-05-08T21:49:50.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.255+0000 7f96e5ee5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96e006afc0 0x7f96e0155090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:50.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.255+0000 7f96e5ee5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96e006afc0 0x7f96e0155090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38786/0 (socket says 172.21.15.73:38786) 2024-05-08T21:49:50.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.255+0000 7f96e5ee5700 1 -- 172.21.15.73:0/49960879 learned_addr learned my addr 172.21.15.73:0/49960879 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:50.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.255+0000 7f96e56e4700 1 --2- 172.21.15.73:0/49960879 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96e0072a20 0x7f96e0156960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:50.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.255+0000 7f96e66e6700 1 --2- 172.21.15.73:0/49960879 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f96e01540b0 0x7f96e014f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:50.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.255+0000 7f96e5ee5700 1 -- 172.21.15.73:0/49960879 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f96e01540b0 msgr2=0x7f96e014f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:50.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.255+0000 7f96e5ee5700 1 --2- 172.21.15.73:0/49960879 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f96e01540b0 0x7f96e014f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:50.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.255+0000 7f96e5ee5700 1 -- 172.21.15.73:0/49960879 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96e0072a20 msgr2=0x7f96e0156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:50.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.255+0000 7f96e5ee5700 1 --2- 172.21.15.73:0/49960879 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96e0072a20 0x7f96e0156960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:50.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.256+0000 7f96e5ee5700 1 -- 172.21.15.73:0/49960879 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96dc009550 con 0x7f96e006afc0 2024-05-08T21:49:50.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.256+0000 7f96e56e4700 1 --2- 172.21.15.73:0/49960879 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96e0072a20 0x7f96e0156960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:49:50.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.256+0000 7f96e66e6700 1 --2- 172.21.15.73:0/49960879 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f96e01540b0 0x7f96e014f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:49:50.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.256+0000 7f96e5ee5700 1 --2- 172.21.15.73:0/49960879 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96e006afc0 0x7f96e0155090 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f96d000b470 tx=0x7f96d000b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:50.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.256+0000 7f96d67fc700 1 -- 172.21.15.73:0/49960879 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d0011830 con 0x7f96e006afc0 2024-05-08T21:49:50.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.256+0000 7f96d67fc700 1 -- 172.21.15.73:0/49960879 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d0011990 con 0x7f96e006afc0 2024-05-08T21:49:50.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.256+0000 7f96e8149700 1 -- 172.21.15.73:0/49960879 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96e01f36b0 con 0x7f96e006afc0 2024-05-08T21:49:50.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.256+0000 7f96d67fc700 1 -- 172.21.15.73:0/49960879 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d0011d40 con 0x7f96e006afc0 2024-05-08T21:49:50.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.256+0000 7f96e8149700 1 -- 172.21.15.73:0/49960879 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96e01f3c70 con 0x7f96e006afc0 2024-05-08T21:49:50.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.257+0000 7f96e8149700 1 -- 172.21.15.73:0/49960879 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96e00c7220 con 0x7f96e006afc0 2024-05-08T21:49:50.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.257+0000 7f96d67fc700 1 -- 172.21.15.73:0/49960879 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f96d001a400 con 0x7f96e006afc0 2024-05-08T21:49:50.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.257+0000 7f96d67fc700 1 --2- 172.21.15.73:0/49960879 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f96c406ac90 0x7f96c406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:50.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.258+0000 7f96e56e4700 1 --2- 172.21.15.73:0/49960879 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f96c406ac90 0x7f96c406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:50.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.258+0000 7f96d67fc700 1 -- 172.21.15.73:0/49960879 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f96d0089410 con 0x7f96e006afc0 2024-05-08T21:49:50.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.258+0000 7f96e56e4700 1 --2- 172.21.15.73:0/49960879 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f96c406ac90 0x7f96c406d150 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f96e01555d0 tx=0x7f96dc008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:50.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.262+0000 7f96d67fc700 1 -- 172.21.15.73:0/49960879 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f96d0054550 con 0x7f96e006afc0 2024-05-08T21:49:50.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.455+0000 7f96e8149700 1 -- 172.21.15.73:0/49960879 --> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f96e00c8250 con 0x7f96c406ac90 2024-05-08T21:49:50.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.462+0000 7f96d67fc700 1 -- 172.21.15.73:0/49960879 <== mgr.4104 v2:172.21.15.73:6832/46949 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264576 (secure 0 0 0) 0x7f96dc020070 con 0x7f96c406ac90 2024-05-08T21:49:50.465 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:49:50.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.465+0000 7f96e8149700 1 -- 172.21.15.73:0/49960879 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f96c406ac90 msgr2=0x7f96c406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:50.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.465+0000 7f96e8149700 1 --2- 172.21.15.73:0/49960879 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f96c406ac90 0x7f96c406d150 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f96e01555d0 tx=0x7f96dc008030 comp rx=0 tx=0).stop 2024-05-08T21:49:50.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.465+0000 7f96e8149700 1 -- 172.21.15.73:0/49960879 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96e006afc0 msgr2=0x7f96e0155090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:50.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.465+0000 7f96e8149700 1 --2- 172.21.15.73:0/49960879 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96e006afc0 0x7f96e0155090 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f96d000b470 tx=0x7f96d000b830 comp rx=0 tx=0).stop 2024-05-08T21:49:50.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.465+0000 7f96e8149700 1 -- 172.21.15.73:0/49960879 shutdown_connections 2024-05-08T21:49:50.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.465+0000 7f96e8149700 1 --2- 172.21.15.73:0/49960879 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f96c406ac90 0x7f96c406d150 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:50.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.465+0000 7f96e8149700 1 --2- 172.21.15.73:0/49960879 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f96e01540b0 0x7f96e014f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:50.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.465+0000 7f96e8149700 1 --2- 172.21.15.73:0/49960879 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96e006afc0 0x7f96e0155090 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:50.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.465+0000 7f96e8149700 1 --2- 172.21.15.73:0/49960879 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96e0072a20 0x7f96e0156960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:50.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.465+0000 7f96e8149700 1 -- 172.21.15.73:0/49960879 >> 172.21.15.73:0/49960879 conn(0x7f96e0066d70 msgr2=0x7f96e0151890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:50.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.465+0000 7f96e8149700 1 -- 172.21.15.73:0/49960879 shutdown_connections 2024-05-08T21:49:50.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:50.465+0000 7f96e8149700 1 -- 172.21.15.73:0/49960879 wait complete. 2024-05-08T21:49:50.468 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-05-08T21:49:50.477 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-05-08T21:49:49.951325+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":164,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219020,"kb_used_data":2792,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755700,"statfs":{"total":773094113280,"available":772869836800,"internally_reserved":0,"allocated":2859008,"data_stored":1765448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.748891"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.928360+0000","last_change":"2024-05-08T21:49:43.775912+0000","last_active":"2024-05-08T21:49:44.928360+0000","last_peered":"2024-05-08T21:49:44.928360+0000","last_clean":"2024-05-08T21:49:44.928360+0000","last_became_active":"2024-05-08T21:49:43.775657+0000","last_became_peered":"2024-05-08T21:49:43.775657+0000","last_unstale":"2024-05-08T21:49:44.928360+0000","last_undegraded":"2024-05-08T21:49:44.928360+0000","last_fullsized":"2024-05-08T21:49:44.928360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:10:07.209965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755108+0000","last_change":"2024-05-08T21:49:43.766984+0000","last_active":"2024-05-08T21:49:44.755108+0000","last_peered":"2024-05-08T21:49:44.755108+0000","last_clean":"2024-05-08T21:49:44.755108+0000","last_became_active":"2024-05-08T21:49:43.765995+0000","last_became_peered":"2024-05-08T21:49:43.765995+0000","last_unstale":"2024-05-08T21:49:44.755108+0000","last_undegraded":"2024-05-08T21:49:44.755108+0000","last_fullsized":"2024-05-08T21:49:44.755108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:21:41.238890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.926947+0000","last_change":"2024-05-08T21:49:43.766107+0000","last_active":"2024-05-08T21:49:44.926947+0000","last_peered":"2024-05-08T21:49:44.926947+0000","last_clean":"2024-05-08T21:49:44.926947+0000","last_became_active":"2024-05-08T21:49:43.765874+0000","last_became_peered":"2024-05-08T21:49:43.765874+0000","last_unstale":"2024-05-08T21:49:44.926947+0000","last_undegraded":"2024-05-08T21:49:44.926947+0000","last_fullsized":"2024-05-08T21:49:44.926947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:06:50.769169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757017+0000","last_change":"2024-05-08T21:49:43.766355+0000","last_active":"2024-05-08T21:49:44.757017+0000","last_peered":"2024-05-08T21:49:44.757017+0000","last_clean":"2024-05-08T21:49:44.757017+0000","last_became_active":"2024-05-08T21:49:43.765507+0000","last_became_peered":"2024-05-08T21:49:43.765507+0000","last_unstale":"2024-05-08T21:49:44.757017+0000","last_undegraded":"2024-05-08T21:49:44.757017+0000","last_fullsized":"2024-05-08T21:49:44.757017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:09:09.676078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927361+0000","last_change":"2024-05-08T21:49:43.770346+0000","last_active":"2024-05-08T21:49:44.927361+0000","last_peered":"2024-05-08T21:49:44.927361+0000","last_clean":"2024-05-08T21:49:44.927361+0000","last_became_active":"2024-05-08T21:49:43.770067+0000","last_became_peered":"2024-05-08T21:49:43.770067+0000","last_unstale":"2024-05-08T21:49:44.927361+0000","last_undegraded":"2024-05-08T21:49:44.927361+0000","last_fullsized":"2024-05-08T21:49:44.927361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:04:14.416894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756907+0000","last_change":"2024-05-08T21:49:43.771390+0000","last_active":"2024-05-08T21:49:44.756907+0000","last_peered":"2024-05-08T21:49:44.756907+0000","last_clean":"2024-05-08T21:49:44.756907+0000","last_became_active":"2024-05-08T21:49:43.770893+0000","last_became_peered":"2024-05-08T21:49:43.770893+0000","last_unstale":"2024-05-08T21:49:44.756907+0000","last_undegraded":"2024-05-08T21:49:44.756907+0000","last_fullsized":"2024-05-08T21:49:44.756907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:28.979468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927055+0000","last_change":"2024-05-08T21:49:43.769981+0000","last_active":"2024-05-08T21:49:44.927055+0000","last_peered":"2024-05-08T21:49:44.927055+0000","last_clean":"2024-05-08T21:49:44.927055+0000","last_became_active":"2024-05-08T21:49:43.769667+0000","last_became_peered":"2024-05-08T21:49:43.769667+0000","last_unstale":"2024-05-08T21:49:44.927055+0000","last_undegraded":"2024-05-08T21:49:44.927055+0000","last_fullsized":"2024-05-08T21:49:44.927055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:12:00.381761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927368+0000","last_change":"2024-05-08T21:49:43.771078+0000","last_active":"2024-05-08T21:49:44.927368+0000","last_peered":"2024-05-08T21:49:44.927368+0000","last_clean":"2024-05-08T21:49:44.927368+0000","last_became_active":"2024-05-08T21:49:43.770912+0000","last_became_peered":"2024-05-08T21:49:43.770912+0000","last_unstale":"2024-05-08T21:49:44.927368+0000","last_undegraded":"2024-05-08T21:49:44.927368+0000","last_fullsized":"2024-05-08T21:49:44.927368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:12:00.381761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.928368+0000","last_change":"2024-05-08T21:49:43.775880+0000","last_active":"2024-05-08T21:49:44.928368+0000","last_peered":"2024-05-08T21:49:44.928368+0000","last_clean":"2024-05-08T21:49:44.928368+0000","last_became_active":"2024-05-08T21:49:43.775404+0000","last_became_peered":"2024-05-08T21:49:43.775404+0000","last_unstale":"2024-05-08T21:49:44.928368+0000","last_undegraded":"2024-05-08T21:49:44.928368+0000","last_fullsized":"2024-05-08T21:49:44.928368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:23:24.559669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756369+0000","last_change":"2024-05-08T21:49:43.772784+0000","last_active":"2024-05-08T21:49:44.756369+0000","last_peered":"2024-05-08T21:49:44.756369+0000","last_clean":"2024-05-08T21:49:44.756369+0000","last_became_active":"2024-05-08T21:49:43.772505+0000","last_became_peered":"2024-05-08T21:49:43.772505+0000","last_unstale":"2024-05-08T21:49:44.756369+0000","last_undegraded":"2024-05-08T21:49:44.756369+0000","last_fullsized":"2024-05-08T21:49:44.756369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:19:28.925404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756079+0000","last_change":"2024-05-08T21:49:43.771781+0000","last_active":"2024-05-08T21:49:44.756079+0000","last_peered":"2024-05-08T21:49:44.756079+0000","last_clean":"2024-05-08T21:49:44.756079+0000","last_became_active":"2024-05-08T21:49:43.771457+0000","last_became_peered":"2024-05-08T21:49:43.771457+0000","last_unstale":"2024-05-08T21:49:44.756079+0000","last_undegraded":"2024-05-08T21:49:44.756079+0000","last_fullsized":"2024-05-08T21:49:44.756079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:43.798909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927611+0000","last_change":"2024-05-08T21:49:43.764249+0000","last_active":"2024-05-08T21:49:44.927611+0000","last_peered":"2024-05-08T21:49:44.927611+0000","last_clean":"2024-05-08T21:49:44.927611+0000","last_became_active":"2024-05-08T21:49:43.763986+0000","last_became_peered":"2024-05-08T21:49:43.763986+0000","last_unstale":"2024-05-08T21:49:44.927611+0000","last_undegraded":"2024-05-08T21:49:44.927611+0000","last_fullsized":"2024-05-08T21:49:44.927611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:33:13.833915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927054+0000","last_change":"2024-05-08T21:49:43.761127+0000","last_active":"2024-05-08T21:49:44.927054+0000","last_peered":"2024-05-08T21:49:44.927054+0000","last_clean":"2024-05-08T21:49:44.927054+0000","last_became_active":"2024-05-08T21:49:43.760874+0000","last_became_peered":"2024-05-08T21:49:43.760874+0000","last_unstale":"2024-05-08T21:49:44.927054+0000","last_undegraded":"2024-05-08T21:49:44.927054+0000","last_fullsized":"2024-05-08T21:49:44.927054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:17:34.570817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.926846+0000","last_change":"2024-05-08T21:49:43.765829+0000","last_active":"2024-05-08T21:49:44.926846+0000","last_peered":"2024-05-08T21:49:44.926846+0000","last_clean":"2024-05-08T21:49:44.926846+0000","last_became_active":"2024-05-08T21:49:43.765566+0000","last_became_peered":"2024-05-08T21:49:43.765566+0000","last_unstale":"2024-05-08T21:49:44.926846+0000","last_undegraded":"2024-05-08T21:49:44.926846+0000","last_fullsized":"2024-05-08T21:49:44.926846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:39.954320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.754916+0000","last_change":"2024-05-08T21:49:43.765080+0000","last_active":"2024-05-08T21:49:44.754916+0000","last_peered":"2024-05-08T21:49:44.754916+0000","last_clean":"2024-05-08T21:49:44.754916+0000","last_became_active":"2024-05-08T21:49:43.764810+0000","last_became_peered":"2024-05-08T21:49:43.764810+0000","last_unstale":"2024-05-08T21:49:44.754916+0000","last_undegraded":"2024-05-08T21:49:44.754916+0000","last_fullsized":"2024-05-08T21:49:44.754916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:24:11.223913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756634+0000","last_change":"2024-05-08T21:49:43.766717+0000","last_active":"2024-05-08T21:49:44.756634+0000","last_peered":"2024-05-08T21:49:44.756634+0000","last_clean":"2024-05-08T21:49:44.756634+0000","last_became_active":"2024-05-08T21:49:43.766427+0000","last_became_peered":"2024-05-08T21:49:43.766427+0000","last_unstale":"2024-05-08T21:49:44.756634+0000","last_undegraded":"2024-05-08T21:49:44.756634+0000","last_fullsized":"2024-05-08T21:49:44.756634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:49:22.833820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757256+0000","last_change":"2024-05-08T21:49:43.776929+0000","last_active":"2024-05-08T21:49:44.757256+0000","last_peered":"2024-05-08T21:49:44.757256+0000","last_clean":"2024-05-08T21:49:44.757256+0000","last_became_active":"2024-05-08T21:49:43.776509+0000","last_became_peered":"2024-05-08T21:49:43.776509+0000","last_unstale":"2024-05-08T21:49:44.757256+0000","last_undegraded":"2024-05-08T21:49:44.757256+0000","last_fullsized":"2024-05-08T21:49:44.757256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:26.199459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.926679+0000","last_change":"2024-05-08T21:49:43.762646+0000","last_active":"2024-05-08T21:49:44.926679+0000","last_peered":"2024-05-08T21:49:44.926679+0000","last_clean":"2024-05-08T21:49:44.926679+0000","last_became_active":"2024-05-08T21:49:43.762237+0000","last_became_peered":"2024-05-08T21:49:43.762237+0000","last_unstale":"2024-05-08T21:49:44.926679+0000","last_undegraded":"2024-05-08T21:49:44.926679+0000","last_fullsized":"2024-05-08T21:49:44.926679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:46:08.821947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927249+0000","last_change":"2024-05-08T21:49:43.774729+0000","last_active":"2024-05-08T21:49:44.927249+0000","last_peered":"2024-05-08T21:49:44.927249+0000","last_clean":"2024-05-08T21:49:44.927249+0000","last_became_active":"2024-05-08T21:49:43.774450+0000","last_became_peered":"2024-05-08T21:49:43.774450+0000","last_unstale":"2024-05-08T21:49:44.927249+0000","last_undegraded":"2024-05-08T21:49:44.927249+0000","last_fullsized":"2024-05-08T21:49:44.927249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:25.661350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.759176+0000","last_change":"2024-05-08T21:49:43.219461+0000","last_active":"2024-05-08T21:49:43.759176+0000","last_peered":"2024-05-08T21:49:43.759176+0000","last_clean":"2024-05-08T21:49:43.759176+0000","last_became_active":"2024-05-08T21:49:43.219161+0000","last_became_peered":"2024-05-08T21:49:43.219161+0000","last_unstale":"2024-05-08T21:49:43.759176+0000","last_undegraded":"2024-05-08T21:49:43.759176+0000","last_fullsized":"2024-05-08T21:49:43.759176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:02:45.778415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927036+0000","last_change":"2024-05-08T21:49:43.764252+0000","last_active":"2024-05-08T21:49:44.927036+0000","last_peered":"2024-05-08T21:49:44.927036+0000","last_clean":"2024-05-08T21:49:44.927036+0000","last_became_active":"2024-05-08T21:49:43.764045+0000","last_became_peered":"2024-05-08T21:49:43.764045+0000","last_unstale":"2024-05-08T21:49:44.927036+0000","last_undegraded":"2024-05-08T21:49:44.927036+0000","last_fullsized":"2024-05-08T21:49:44.927036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:43.798909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.754559+0000","last_change":"2024-05-08T21:49:43.221599+0000","last_active":"2024-05-08T21:49:43.754559+0000","last_peered":"2024-05-08T21:49:43.754559+0000","last_clean":"2024-05-08T21:49:43.754559+0000","last_became_active":"2024-05-08T21:49:43.221309+0000","last_became_peered":"2024-05-08T21:49:43.221309+0000","last_unstale":"2024-05-08T21:49:43.754559+0000","last_undegraded":"2024-05-08T21:49:43.754559+0000","last_fullsized":"2024-05-08T21:49:43.754559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:17.379362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927796+0000","last_change":"2024-05-08T21:49:43.771523+0000","last_active":"2024-05-08T21:49:44.927796+0000","last_peered":"2024-05-08T21:49:44.927796+0000","last_clean":"2024-05-08T21:49:44.927796+0000","last_became_active":"2024-05-08T21:49:43.771295+0000","last_became_peered":"2024-05-08T21:49:43.771295+0000","last_unstale":"2024-05-08T21:49:44.927796+0000","last_undegraded":"2024-05-08T21:49:44.927796+0000","last_fullsized":"2024-05-08T21:49:44.927796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:53:14.774835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.765851+0000","last_change":"2024-05-08T21:49:43.226637+0000","last_active":"2024-05-08T21:49:43.765851+0000","last_peered":"2024-05-08T21:49:43.765851+0000","last_clean":"2024-05-08T21:49:43.765851+0000","last_became_active":"2024-05-08T21:49:43.226284+0000","last_became_peered":"2024-05-08T21:49:43.226284+0000","last_unstale":"2024-05-08T21:49:43.765851+0000","last_undegraded":"2024-05-08T21:49:43.765851+0000","last_fullsized":"2024-05-08T21:49:43.765851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:01.844011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756849+0000","last_change":"2024-05-08T21:49:43.766694+0000","last_active":"2024-05-08T21:49:44.756849+0000","last_peered":"2024-05-08T21:49:44.756849+0000","last_clean":"2024-05-08T21:49:44.756849+0000","last_became_active":"2024-05-08T21:49:43.766079+0000","last_became_peered":"2024-05-08T21:49:43.766079+0000","last_unstale":"2024-05-08T21:49:44.756849+0000","last_undegraded":"2024-05-08T21:49:44.756849+0000","last_fullsized":"2024-05-08T21:49:44.756849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:01:16.682080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.756711+0000","last_change":"2024-05-08T21:49:43.230152+0000","last_active":"2024-05-08T21:49:43.756711+0000","last_peered":"2024-05-08T21:49:43.756711+0000","last_clean":"2024-05-08T21:49:43.756711+0000","last_became_active":"2024-05-08T21:49:43.229891+0000","last_became_peered":"2024-05-08T21:49:43.229891+0000","last_unstale":"2024-05-08T21:49:43.756711+0000","last_undegraded":"2024-05-08T21:49:43.756711+0000","last_fullsized":"2024-05-08T21:49:43.756711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:33:12.827218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757018+0000","last_change":"2024-05-08T21:49:43.771097+0000","last_active":"2024-05-08T21:49:44.757018+0000","last_peered":"2024-05-08T21:49:44.757018+0000","last_clean":"2024-05-08T21:49:44.757018+0000","last_became_active":"2024-05-08T21:49:43.770727+0000","last_became_peered":"2024-05-08T21:49:43.770727+0000","last_unstale":"2024-05-08T21:49:44.757018+0000","last_undegraded":"2024-05-08T21:49:44.757018+0000","last_fullsized":"2024-05-08T21:49:44.757018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:24:02.741766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.752948+0000","last_change":"2024-05-08T21:49:43.220418+0000","last_active":"2024-05-08T21:49:43.752948+0000","last_peered":"2024-05-08T21:49:43.752948+0000","last_clean":"2024-05-08T21:49:43.752948+0000","last_became_active":"2024-05-08T21:49:43.220090+0000","last_became_peered":"2024-05-08T21:49:43.220090+0000","last_unstale":"2024-05-08T21:49:43.752948+0000","last_undegraded":"2024-05-08T21:49:43.752948+0000","last_fullsized":"2024-05-08T21:49:43.752948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:33:28.074468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927692+0000","last_change":"2024-05-08T21:49:43.762664+0000","last_active":"2024-05-08T21:49:44.927692+0000","last_peered":"2024-05-08T21:49:44.927692+0000","last_clean":"2024-05-08T21:49:44.927692+0000","last_became_active":"2024-05-08T21:49:43.762351+0000","last_became_peered":"2024-05-08T21:49:43.762351+0000","last_unstale":"2024-05-08T21:49:44.927692+0000","last_undegraded":"2024-05-08T21:49:44.927692+0000","last_fullsized":"2024-05-08T21:49:44.927692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:53.330614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.757078+0000","last_change":"2024-05-08T21:49:43.220518+0000","last_active":"2024-05-08T21:49:43.757078+0000","last_peered":"2024-05-08T21:49:43.757078+0000","last_clean":"2024-05-08T21:49:43.757078+0000","last_became_active":"2024-05-08T21:49:43.218473+0000","last_became_peered":"2024-05-08T21:49:43.218473+0000","last_unstale":"2024-05-08T21:49:43.757078+0000","last_undegraded":"2024-05-08T21:49:43.757078+0000","last_fullsized":"2024-05-08T21:49:43.757078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:10.497167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927324+0000","last_change":"2024-05-08T21:49:43.770935+0000","last_active":"2024-05-08T21:49:44.927324+0000","last_peered":"2024-05-08T21:49:44.927324+0000","last_clean":"2024-05-08T21:49:44.927324+0000","last_became_active":"2024-05-08T21:49:43.770677+0000","last_became_peered":"2024-05-08T21:49:43.770677+0000","last_unstale":"2024-05-08T21:49:44.927324+0000","last_undegraded":"2024-05-08T21:49:44.927324+0000","last_fullsized":"2024-05-08T21:49:44.927324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:04:14.416894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.752777+0000","last_change":"2024-05-08T21:49:43.221027+0000","last_active":"2024-05-08T21:49:43.752777+0000","last_peered":"2024-05-08T21:49:43.752777+0000","last_clean":"2024-05-08T21:49:43.752777+0000","last_became_active":"2024-05-08T21:49:43.220780+0000","last_became_peered":"2024-05-08T21:49:43.220780+0000","last_unstale":"2024-05-08T21:49:43.752777+0000","last_undegraded":"2024-05-08T21:49:43.752777+0000","last_fullsized":"2024-05-08T21:49:43.752777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:20:34.123736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927461+0000","last_change":"2024-05-08T21:49:43.766815+0000","last_active":"2024-05-08T21:49:44.927461+0000","last_peered":"2024-05-08T21:49:44.927461+0000","last_clean":"2024-05-08T21:49:44.927461+0000","last_became_active":"2024-05-08T21:49:43.766568+0000","last_became_peered":"2024-05-08T21:49:43.766568+0000","last_unstale":"2024-05-08T21:49:44.927461+0000","last_undegraded":"2024-05-08T21:49:44.927461+0000","last_fullsized":"2024-05-08T21:49:44.927461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:41:45.602022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756625+0000","last_change":"2024-05-08T21:49:43.225299+0000","last_active":"2024-05-08T21:49:44.756625+0000","last_peered":"2024-05-08T21:49:44.756625+0000","last_clean":"2024-05-08T21:49:44.756625+0000","last_became_active":"2024-05-08T21:49:43.225057+0000","last_became_peered":"2024-05-08T21:49:43.225057+0000","last_unstale":"2024-05-08T21:49:44.756625+0000","last_undegraded":"2024-05-08T21:49:44.756625+0000","last_fullsized":"2024-05-08T21:49:44.756625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:38:43.069159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755021+0000","last_change":"2024-05-08T21:49:43.757361+0000","last_active":"2024-05-08T21:49:44.755021+0000","last_peered":"2024-05-08T21:49:44.755021+0000","last_clean":"2024-05-08T21:49:44.755021+0000","last_became_active":"2024-05-08T21:49:43.757092+0000","last_became_peered":"2024-05-08T21:49:43.757092+0000","last_unstale":"2024-05-08T21:49:44.755021+0000","last_undegraded":"2024-05-08T21:49:44.755021+0000","last_fullsized":"2024-05-08T21:49:44.755021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:24:02.741766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.756381+0000","last_change":"2024-05-08T21:49:43.229405+0000","last_active":"2024-05-08T21:49:43.756381+0000","last_peered":"2024-05-08T21:49:43.756381+0000","last_clean":"2024-05-08T21:49:43.756381+0000","last_became_active":"2024-05-08T21:49:43.229105+0000","last_became_peered":"2024-05-08T21:49:43.229105+0000","last_unstale":"2024-05-08T21:49:43.756381+0000","last_undegraded":"2024-05-08T21:49:43.756381+0000","last_fullsized":"2024-05-08T21:49:43.756381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:18:58.164159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757172+0000","last_change":"2024-05-08T21:49:43.773243+0000","last_active":"2024-05-08T21:49:44.757172+0000","last_peered":"2024-05-08T21:49:44.757172+0000","last_clean":"2024-05-08T21:49:44.757172+0000","last_became_active":"2024-05-08T21:49:43.772944+0000","last_became_peered":"2024-05-08T21:49:43.772944+0000","last_unstale":"2024-05-08T21:49:44.757172+0000","last_undegraded":"2024-05-08T21:49:44.757172+0000","last_fullsized":"2024-05-08T21:49:44.757172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:21:41.238890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757107+0000","last_change":"2024-05-08T21:49:43.224999+0000","last_active":"2024-05-08T21:49:44.757107+0000","last_peered":"2024-05-08T21:49:44.757107+0000","last_clean":"2024-05-08T21:49:44.757107+0000","last_became_active":"2024-05-08T21:49:43.223476+0000","last_became_peered":"2024-05-08T21:49:43.223476+0000","last_unstale":"2024-05-08T21:49:44.757107+0000","last_undegraded":"2024-05-08T21:49:44.757107+0000","last_fullsized":"2024-05-08T21:49:44.757107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:09:12.983430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927734+0000","last_change":"2024-05-08T21:49:43.771526+0000","last_active":"2024-05-08T21:49:44.927734+0000","last_peered":"2024-05-08T21:49:44.927734+0000","last_clean":"2024-05-08T21:49:44.927734+0000","last_became_active":"2024-05-08T21:49:43.771279+0000","last_became_peered":"2024-05-08T21:49:43.771279+0000","last_unstale":"2024-05-08T21:49:44.927734+0000","last_undegraded":"2024-05-08T21:49:44.927734+0000","last_fullsized":"2024-05-08T21:49:44.927734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:41:45.602022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755246+0000","last_change":"2024-05-08T21:49:43.224378+0000","last_active":"2024-05-08T21:49:44.755246+0000","last_peered":"2024-05-08T21:49:44.755246+0000","last_clean":"2024-05-08T21:49:44.755246+0000","last_became_active":"2024-05-08T21:49:43.224164+0000","last_became_peered":"2024-05-08T21:49:43.224164+0000","last_unstale":"2024-05-08T21:49:44.755246+0000","last_undegraded":"2024-05-08T21:49:44.755246+0000","last_fullsized":"2024-05-08T21:49:44.755246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:06:10.276907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927552+0000","last_change":"2024-05-08T21:49:43.772948+0000","last_active":"2024-05-08T21:49:44.927552+0000","last_peered":"2024-05-08T21:49:44.927552+0000","last_clean":"2024-05-08T21:49:44.927552+0000","last_became_active":"2024-05-08T21:49:43.772685+0000","last_became_peered":"2024-05-08T21:49:43.772685+0000","last_unstale":"2024-05-08T21:49:44.927552+0000","last_undegraded":"2024-05-08T21:49:44.927552+0000","last_fullsized":"2024-05-08T21:49:44.927552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:02.850708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.758779+0000","last_change":"2024-05-08T21:49:43.222308+0000","last_active":"2024-05-08T21:49:43.758779+0000","last_peered":"2024-05-08T21:49:43.758779+0000","last_clean":"2024-05-08T21:49:43.758779+0000","last_became_active":"2024-05-08T21:49:43.221844+0000","last_became_peered":"2024-05-08T21:49:43.221844+0000","last_unstale":"2024-05-08T21:49:43.758779+0000","last_undegraded":"2024-05-08T21:49:43.758779+0000","last_fullsized":"2024-05-08T21:49:43.758779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:17.379362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927374+0000","last_change":"2024-05-08T21:49:43.773923+0000","last_active":"2024-05-08T21:49:44.927374+0000","last_peered":"2024-05-08T21:49:44.927374+0000","last_clean":"2024-05-08T21:49:44.927374+0000","last_became_active":"2024-05-08T21:49:43.772037+0000","last_became_peered":"2024-05-08T21:49:43.772037+0000","last_unstale":"2024-05-08T21:49:44.927374+0000","last_undegraded":"2024-05-08T21:49:44.927374+0000","last_fullsized":"2024-05-08T21:49:44.927374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:52:32.629407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.762457+0000","last_change":"2024-05-08T21:49:43.219473+0000","last_active":"2024-05-08T21:49:43.762457+0000","last_peered":"2024-05-08T21:49:43.762457+0000","last_clean":"2024-05-08T21:49:43.762457+0000","last_became_active":"2024-05-08T21:49:43.219186+0000","last_became_peered":"2024-05-08T21:49:43.219186+0000","last_unstale":"2024-05-08T21:49:43.762457+0000","last_undegraded":"2024-05-08T21:49:43.762457+0000","last_fullsized":"2024-05-08T21:49:43.762457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:20:34.123736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.926751+0000","last_change":"2024-05-08T21:49:43.775135+0000","last_active":"2024-05-08T21:49:44.926751+0000","last_peered":"2024-05-08T21:49:44.926751+0000","last_clean":"2024-05-08T21:49:44.926751+0000","last_became_active":"2024-05-08T21:49:43.774919+0000","last_became_peered":"2024-05-08T21:49:43.774919+0000","last_unstale":"2024-05-08T21:49:44.926751+0000","last_undegraded":"2024-05-08T21:49:44.926751+0000","last_fullsized":"2024-05-08T21:49:44.926751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:01:00.614249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757128+0000","last_change":"2024-05-08T21:49:43.227386+0000","last_active":"2024-05-08T21:49:44.757128+0000","last_peered":"2024-05-08T21:49:44.757128+0000","last_clean":"2024-05-08T21:49:44.757128+0000","last_became_active":"2024-05-08T21:49:43.227065+0000","last_became_peered":"2024-05-08T21:49:43.227065+0000","last_unstale":"2024-05-08T21:49:44.757128+0000","last_undegraded":"2024-05-08T21:49:44.757128+0000","last_fullsized":"2024-05-08T21:49:44.757128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:43:48.019170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927424+0000","last_change":"2024-05-08T21:49:43.770509+0000","last_active":"2024-05-08T21:49:44.927424+0000","last_peered":"2024-05-08T21:49:44.927424+0000","last_clean":"2024-05-08T21:49:44.927424+0000","last_became_active":"2024-05-08T21:49:43.770180+0000","last_became_peered":"2024-05-08T21:49:43.770180+0000","last_unstale":"2024-05-08T21:49:44.927424+0000","last_undegraded":"2024-05-08T21:49:44.927424+0000","last_fullsized":"2024-05-08T21:49:44.927424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:00:38.941899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.756153+0000","last_change":"2024-05-08T21:49:43.220942+0000","last_active":"2024-05-08T21:49:43.756153+0000","last_peered":"2024-05-08T21:49:43.756153+0000","last_clean":"2024-05-08T21:49:43.756153+0000","last_became_active":"2024-05-08T21:49:43.220641+0000","last_became_peered":"2024-05-08T21:49:43.220641+0000","last_unstale":"2024-05-08T21:49:43.756153+0000","last_undegraded":"2024-05-08T21:49:43.756153+0000","last_fullsized":"2024-05-08T21:49:43.756153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:52.323917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755763+0000","last_change":"2024-05-08T21:49:43.766269+0000","last_active":"2024-05-08T21:49:44.755763+0000","last_peered":"2024-05-08T21:49:44.755763+0000","last_clean":"2024-05-08T21:49:44.755763+0000","last_became_active":"2024-05-08T21:49:43.765945+0000","last_became_peered":"2024-05-08T21:49:43.765945+0000","last_unstale":"2024-05-08T21:49:44.755763+0000","last_undegraded":"2024-05-08T21:49:44.755763+0000","last_fullsized":"2024-05-08T21:49:44.755763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:17:34.570817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.751764+0000","last_change":"2024-05-08T21:49:43.208328+0000","last_active":"2024-05-08T21:49:43.751764+0000","last_peered":"2024-05-08T21:49:43.751764+0000","last_clean":"2024-05-08T21:49:43.751764+0000","last_became_active":"2024-05-08T21:49:43.208013+0000","last_became_peered":"2024-05-08T21:49:43.208013+0000","last_unstale":"2024-05-08T21:49:43.751764+0000","last_undegraded":"2024-05-08T21:49:43.751764+0000","last_fullsized":"2024-05-08T21:49:43.751764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:10.497167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.928099+0000","last_change":"2024-05-08T21:49:43.774210+0000","last_active":"2024-05-08T21:49:44.928099+0000","last_peered":"2024-05-08T21:49:44.928099+0000","last_clean":"2024-05-08T21:49:44.928099+0000","last_became_active":"2024-05-08T21:49:43.773933+0000","last_became_peered":"2024-05-08T21:49:43.773933+0000","last_unstale":"2024-05-08T21:49:44.928099+0000","last_undegraded":"2024-05-08T21:49:44.928099+0000","last_fullsized":"2024-05-08T21:49:44.928099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:10:25.398535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.756269+0000","last_change":"2024-05-08T21:49:43.217456+0000","last_active":"2024-05-08T21:49:43.756269+0000","last_peered":"2024-05-08T21:49:43.756269+0000","last_clean":"2024-05-08T21:49:43.756269+0000","last_became_active":"2024-05-08T21:49:43.216822+0000","last_became_peered":"2024-05-08T21:49:43.216822+0000","last_unstale":"2024-05-08T21:49:43.756269+0000","last_undegraded":"2024-05-08T21:49:43.756269+0000","last_fullsized":"2024-05-08T21:49:43.756269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:41:35.881003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927764+0000","last_change":"2024-05-08T21:49:43.770066+0000","last_active":"2024-05-08T21:49:44.927764+0000","last_peered":"2024-05-08T21:49:44.927764+0000","last_clean":"2024-05-08T21:49:44.927764+0000","last_became_active":"2024-05-08T21:49:43.769762+0000","last_became_peered":"2024-05-08T21:49:43.769762+0000","last_unstale":"2024-05-08T21:49:44.927764+0000","last_undegraded":"2024-05-08T21:49:44.927764+0000","last_fullsized":"2024-05-08T21:49:44.927764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:40:20.301747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755188+0000","last_change":"2024-05-08T21:49:43.215293+0000","last_active":"2024-05-08T21:49:44.755188+0000","last_peered":"2024-05-08T21:49:44.755188+0000","last_clean":"2024-05-08T21:49:44.755188+0000","last_became_active":"2024-05-08T21:49:43.215048+0000","last_became_peered":"2024-05-08T21:49:43.215048+0000","last_unstale":"2024-05-08T21:49:44.755188+0000","last_undegraded":"2024-05-08T21:49:44.755188+0000","last_fullsized":"2024-05-08T21:49:44.755188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:43:48.019170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757129+0000","last_change":"2024-05-08T21:49:43.770326+0000","last_active":"2024-05-08T21:49:44.757129+0000","last_peered":"2024-05-08T21:49:44.757129+0000","last_clean":"2024-05-08T21:49:44.757129+0000","last_became_active":"2024-05-08T21:49:43.770029+0000","last_became_peered":"2024-05-08T21:49:43.770029+0000","last_unstale":"2024-05-08T21:49:44.757129+0000","last_undegraded":"2024-05-08T21:49:44.757129+0000","last_fullsized":"2024-05-08T21:49:44.757129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:33:33.642847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757017+0000","last_change":"2024-05-08T21:49:43.227710+0000","last_active":"2024-05-08T21:49:44.757017+0000","last_peered":"2024-05-08T21:49:44.757017+0000","last_clean":"2024-05-08T21:49:44.757017+0000","last_became_active":"2024-05-08T21:49:43.227430+0000","last_became_peered":"2024-05-08T21:49:43.227430+0000","last_unstale":"2024-05-08T21:49:44.757017+0000","last_undegraded":"2024-05-08T21:49:44.757017+0000","last_fullsized":"2024-05-08T21:49:44.757017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:05:58.875400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.928131+0000","last_change":"2024-05-08T21:49:43.768588+0000","last_active":"2024-05-08T21:49:44.928131+0000","last_peered":"2024-05-08T21:49:44.928131+0000","last_clean":"2024-05-08T21:49:44.928131+0000","last_became_active":"2024-05-08T21:49:43.768307+0000","last_became_peered":"2024-05-08T21:49:43.768307+0000","last_unstale":"2024-05-08T21:49:44.928131+0000","last_undegraded":"2024-05-08T21:49:44.928131+0000","last_fullsized":"2024-05-08T21:49:44.928131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:04.968184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.754953+0000","last_change":"2024-05-08T21:49:43.758618+0000","last_active":"2024-05-08T21:49:44.754953+0000","last_peered":"2024-05-08T21:49:44.754953+0000","last_clean":"2024-05-08T21:49:44.754953+0000","last_became_active":"2024-05-08T21:49:43.758367+0000","last_became_peered":"2024-05-08T21:49:43.758367+0000","last_unstale":"2024-05-08T21:49:44.754953+0000","last_undegraded":"2024-05-08T21:49:44.754953+0000","last_fullsized":"2024-05-08T21:49:44.754953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:30:06.569971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.751866+0000","last_change":"2024-05-08T21:49:43.217410+0000","last_active":"2024-05-08T21:49:43.751866+0000","last_peered":"2024-05-08T21:49:43.751866+0000","last_clean":"2024-05-08T21:49:43.751866+0000","last_became_active":"2024-05-08T21:49:43.217133+0000","last_became_peered":"2024-05-08T21:49:43.217133+0000","last_unstale":"2024-05-08T21:49:43.751866+0000","last_undegraded":"2024-05-08T21:49:43.751866+0000","last_fullsized":"2024-05-08T21:49:43.751866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:17.379362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.926897+0000","last_change":"2024-05-08T21:49:43.771651+0000","last_active":"2024-05-08T21:49:44.926897+0000","last_peered":"2024-05-08T21:49:44.926897+0000","last_clean":"2024-05-08T21:49:44.926897+0000","last_became_active":"2024-05-08T21:49:43.771451+0000","last_became_peered":"2024-05-08T21:49:43.771451+0000","last_unstale":"2024-05-08T21:49:44.926897+0000","last_undegraded":"2024-05-08T21:49:44.926897+0000","last_fullsized":"2024-05-08T21:49:44.926897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:00:38.941899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756759+0000","last_change":"2024-05-08T21:49:43.224929+0000","last_active":"2024-05-08T21:49:44.756759+0000","last_peered":"2024-05-08T21:49:44.756759+0000","last_clean":"2024-05-08T21:49:44.756759+0000","last_became_active":"2024-05-08T21:49:43.223469+0000","last_became_peered":"2024-05-08T21:49:43.223469+0000","last_unstale":"2024-05-08T21:49:44.756759+0000","last_undegraded":"2024-05-08T21:49:44.756759+0000","last_fullsized":"2024-05-08T21:49:44.756759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:27.504127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":164,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.756621+0000","last_change":"2024-05-08T21:49:38.626519+0000","last_active":"2024-05-08T21:49:43.756621+0000","last_peered":"2024-05-08T21:49:43.756621+0000","last_clean":"2024-05-08T21:49:43.756621+0000","last_became_active":"2024-05-08T21:49:38.626159+0000","last_became_peered":"2024-05-08T21:49:38.626159+0000","last_unstale":"2024-05-08T21:49:43.756621+0000","last_undegraded":"2024-05-08T21:49:43.756621+0000","last_fullsized":"2024-05-08T21:49:43.756621+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:36.031649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:36.031649+0000","last_clean_scrub_stamp":"2024-05-08T21:49:36.031649+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:12:04.846500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.926994+0000","last_change":"2024-05-08T21:49:43.770966+0000","last_active":"2024-05-08T21:49:44.926994+0000","last_peered":"2024-05-08T21:49:44.926994+0000","last_clean":"2024-05-08T21:49:44.926994+0000","last_became_active":"2024-05-08T21:49:43.770711+0000","last_became_peered":"2024-05-08T21:49:43.770711+0000","last_unstale":"2024-05-08T21:49:44.926994+0000","last_undegraded":"2024-05-08T21:49:44.926994+0000","last_fullsized":"2024-05-08T21:49:44.926994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:17:34.570817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.756729+0000","last_change":"2024-05-08T21:49:43.221086+0000","last_active":"2024-05-08T21:49:43.756729+0000","last_peered":"2024-05-08T21:49:43.756729+0000","last_clean":"2024-05-08T21:49:43.756729+0000","last_became_active":"2024-05-08T21:49:43.220539+0000","last_became_peered":"2024-05-08T21:49:43.220539+0000","last_unstale":"2024-05-08T21:49:43.756729+0000","last_undegraded":"2024-05-08T21:49:43.756729+0000","last_fullsized":"2024-05-08T21:49:43.756729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:52.323917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.765742+0000","last_change":"2024-05-08T21:49:43.222410+0000","last_active":"2024-05-08T21:49:43.765742+0000","last_peered":"2024-05-08T21:49:43.765742+0000","last_clean":"2024-05-08T21:49:43.765742+0000","last_became_active":"2024-05-08T21:49:43.222131+0000","last_became_peered":"2024-05-08T21:49:43.222131+0000","last_unstale":"2024-05-08T21:49:43.765742+0000","last_undegraded":"2024-05-08T21:49:43.765742+0000","last_fullsized":"2024-05-08T21:49:43.765742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:18:58.164159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755021+0000","last_change":"2024-05-08T21:49:43.758424+0000","last_active":"2024-05-08T21:49:44.755021+0000","last_peered":"2024-05-08T21:49:44.755021+0000","last_clean":"2024-05-08T21:49:44.755021+0000","last_became_active":"2024-05-08T21:49:43.758140+0000","last_became_peered":"2024-05-08T21:49:43.758140+0000","last_unstale":"2024-05-08T21:49:44.755021+0000","last_undegraded":"2024-05-08T21:49:44.755021+0000","last_fullsized":"2024-05-08T21:49:44.755021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:10.795540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755053+0000","last_change":"2024-05-08T21:49:43.218241+0000","last_active":"2024-05-08T21:49:44.755053+0000","last_peered":"2024-05-08T21:49:44.755053+0000","last_clean":"2024-05-08T21:49:44.755053+0000","last_became_active":"2024-05-08T21:49:43.217780+0000","last_became_peered":"2024-05-08T21:49:43.217780+0000","last_unstale":"2024-05-08T21:49:44.755053+0000","last_undegraded":"2024-05-08T21:49:44.755053+0000","last_fullsized":"2024-05-08T21:49:44.755053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:27.504127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927830+0000","last_change":"2024-05-08T21:49:43.770491+0000","last_active":"2024-05-08T21:49:44.927830+0000","last_peered":"2024-05-08T21:49:44.927830+0000","last_clean":"2024-05-08T21:49:44.927830+0000","last_became_active":"2024-05-08T21:49:43.770221+0000","last_became_peered":"2024-05-08T21:49:43.770221+0000","last_unstale":"2024-05-08T21:49:44.927830+0000","last_undegraded":"2024-05-08T21:49:44.927830+0000","last_fullsized":"2024-05-08T21:49:44.927830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:25.661350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.756267+0000","last_change":"2024-05-08T21:49:43.221345+0000","last_active":"2024-05-08T21:49:43.756267+0000","last_peered":"2024-05-08T21:49:43.756267+0000","last_clean":"2024-05-08T21:49:43.756267+0000","last_became_active":"2024-05-08T21:49:43.220953+0000","last_became_peered":"2024-05-08T21:49:43.220953+0000","last_unstale":"2024-05-08T21:49:43.756267+0000","last_undegraded":"2024-05-08T21:49:43.756267+0000","last_fullsized":"2024-05-08T21:49:43.756267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:33:28.074468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927636+0000","last_change":"2024-05-08T21:49:43.765001+0000","last_active":"2024-05-08T21:49:44.927636+0000","last_peered":"2024-05-08T21:49:44.927636+0000","last_clean":"2024-05-08T21:49:44.927636+0000","last_became_active":"2024-05-08T21:49:43.764740+0000","last_became_peered":"2024-05-08T21:49:43.764740+0000","last_unstale":"2024-05-08T21:49:44.927636+0000","last_undegraded":"2024-05-08T21:49:44.927636+0000","last_fullsized":"2024-05-08T21:49:44.927636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:18:58.836430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.756521+0000","last_change":"2024-05-08T21:49:43.221251+0000","last_active":"2024-05-08T21:49:43.756521+0000","last_peered":"2024-05-08T21:49:43.756521+0000","last_clean":"2024-05-08T21:49:43.756521+0000","last_became_active":"2024-05-08T21:49:43.220839+0000","last_became_peered":"2024-05-08T21:49:43.220839+0000","last_unstale":"2024-05-08T21:49:43.756521+0000","last_undegraded":"2024-05-08T21:49:43.756521+0000","last_fullsized":"2024-05-08T21:49:43.756521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:10.497167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927485+0000","last_change":"2024-05-08T21:49:43.762511+0000","last_active":"2024-05-08T21:49:44.927485+0000","last_peered":"2024-05-08T21:49:44.927485+0000","last_clean":"2024-05-08T21:49:44.927485+0000","last_became_active":"2024-05-08T21:49:43.762170+0000","last_became_peered":"2024-05-08T21:49:43.762170+0000","last_unstale":"2024-05-08T21:49:44.927485+0000","last_undegraded":"2024-05-08T21:49:44.927485+0000","last_fullsized":"2024-05-08T21:49:44.927485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:11.503864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.754925+0000","last_change":"2024-05-08T21:49:43.215361+0000","last_active":"2024-05-08T21:49:44.754925+0000","last_peered":"2024-05-08T21:49:44.754925+0000","last_clean":"2024-05-08T21:49:44.754925+0000","last_became_active":"2024-05-08T21:49:43.215162+0000","last_became_peered":"2024-05-08T21:49:43.215162+0000","last_unstale":"2024-05-08T21:49:44.754925+0000","last_undegraded":"2024-05-08T21:49:44.754925+0000","last_fullsized":"2024-05-08T21:49:44.754925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:05:58.875400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927416+0000","last_change":"2024-05-08T21:49:43.757512+0000","last_active":"2024-05-08T21:49:44.927416+0000","last_peered":"2024-05-08T21:49:44.927416+0000","last_clean":"2024-05-08T21:49:44.927416+0000","last_became_active":"2024-05-08T21:49:43.757233+0000","last_became_peered":"2024-05-08T21:49:43.757233+0000","last_unstale":"2024-05-08T21:49:44.927416+0000","last_undegraded":"2024-05-08T21:49:44.927416+0000","last_fullsized":"2024-05-08T21:49:44.927416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:53:14.774835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755100+0000","last_change":"2024-05-08T21:49:43.217935+0000","last_active":"2024-05-08T21:49:44.755100+0000","last_peered":"2024-05-08T21:49:44.755100+0000","last_clean":"2024-05-08T21:49:44.755100+0000","last_became_active":"2024-05-08T21:49:43.217595+0000","last_became_peered":"2024-05-08T21:49:43.217595+0000","last_unstale":"2024-05-08T21:49:44.755100+0000","last_undegraded":"2024-05-08T21:49:44.755100+0000","last_fullsized":"2024-05-08T21:49:44.755100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:38:43.069159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927301+0000","last_change":"2024-05-08T21:49:43.766816+0000","last_active":"2024-05-08T21:49:44.927301+0000","last_peered":"2024-05-08T21:49:44.927301+0000","last_clean":"2024-05-08T21:49:44.927301+0000","last_became_active":"2024-05-08T21:49:43.766596+0000","last_became_peered":"2024-05-08T21:49:43.766596+0000","last_unstale":"2024-05-08T21:49:44.927301+0000","last_undegraded":"2024-05-08T21:49:44.927301+0000","last_fullsized":"2024-05-08T21:49:44.927301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:01:00.614249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.757495+0000","last_change":"2024-05-08T21:49:43.224243+0000","last_active":"2024-05-08T21:49:43.757495+0000","last_peered":"2024-05-08T21:49:43.757495+0000","last_clean":"2024-05-08T21:49:43.757495+0000","last_became_active":"2024-05-08T21:49:43.223974+0000","last_became_peered":"2024-05-08T21:49:43.223974+0000","last_unstale":"2024-05-08T21:49:43.757495+0000","last_undegraded":"2024-05-08T21:49:43.757495+0000","last_fullsized":"2024-05-08T21:49:43.757495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:03.961487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755912+0000","last_change":"2024-05-08T21:49:43.764377+0000","last_active":"2024-05-08T21:49:44.755912+0000","last_peered":"2024-05-08T21:49:44.755912+0000","last_clean":"2024-05-08T21:49:44.755912+0000","last_became_active":"2024-05-08T21:49:43.764075+0000","last_became_peered":"2024-05-08T21:49:43.764075+0000","last_unstale":"2024-05-08T21:49:44.755912+0000","last_undegraded":"2024-05-08T21:49:44.755912+0000","last_fullsized":"2024-05-08T21:49:44.755912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:41:45.602022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.752001+0000","last_change":"2024-05-08T21:49:43.229414+0000","last_active":"2024-05-08T21:49:43.752001+0000","last_peered":"2024-05-08T21:49:43.752001+0000","last_clean":"2024-05-08T21:49:43.752001+0000","last_became_active":"2024-05-08T21:49:43.229121+0000","last_became_peered":"2024-05-08T21:49:43.229121+0000","last_unstale":"2024-05-08T21:49:43.752001+0000","last_undegraded":"2024-05-08T21:49:43.752001+0000","last_fullsized":"2024-05-08T21:49:43.752001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:33:28.074468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927480+0000","last_change":"2024-05-08T21:49:43.774111+0000","last_active":"2024-05-08T21:49:44.927480+0000","last_peered":"2024-05-08T21:49:44.927480+0000","last_clean":"2024-05-08T21:49:44.927480+0000","last_became_active":"2024-05-08T21:49:43.772528+0000","last_became_peered":"2024-05-08T21:49:43.772528+0000","last_unstale":"2024-05-08T21:49:44.927480+0000","last_undegraded":"2024-05-08T21:49:44.927480+0000","last_fullsized":"2024-05-08T21:49:44.927480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:28.983476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755187+0000","last_change":"2024-05-08T21:49:43.208581+0000","last_active":"2024-05-08T21:49:44.755187+0000","last_peered":"2024-05-08T21:49:44.755187+0000","last_clean":"2024-05-08T21:49:44.755187+0000","last_became_active":"2024-05-08T21:49:43.208326+0000","last_became_peered":"2024-05-08T21:49:43.208326+0000","last_unstale":"2024-05-08T21:49:44.755187+0000","last_undegraded":"2024-05-08T21:49:44.755187+0000","last_fullsized":"2024-05-08T21:49:44.755187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:13:35.461791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756911+0000","last_change":"2024-05-08T21:49:43.766519+0000","last_active":"2024-05-08T21:49:44.756911+0000","last_peered":"2024-05-08T21:49:44.756911+0000","last_clean":"2024-05-08T21:49:44.756911+0000","last_became_active":"2024-05-08T21:49:43.765789+0000","last_became_peered":"2024-05-08T21:49:43.765789+0000","last_unstale":"2024-05-08T21:49:44.756911+0000","last_undegraded":"2024-05-08T21:49:44.756911+0000","last_fullsized":"2024-05-08T21:49:44.756911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:23.674986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.752048+0000","last_change":"2024-05-08T21:49:43.218079+0000","last_active":"2024-05-08T21:49:43.752048+0000","last_peered":"2024-05-08T21:49:43.752048+0000","last_clean":"2024-05-08T21:49:43.752048+0000","last_became_active":"2024-05-08T21:49:43.217814+0000","last_became_peered":"2024-05-08T21:49:43.217814+0000","last_unstale":"2024-05-08T21:49:43.752048+0000","last_undegraded":"2024-05-08T21:49:43.752048+0000","last_fullsized":"2024-05-08T21:49:43.752048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:18:58.164159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.928456+0000","last_change":"2024-05-08T21:49:43.775713+0000","last_active":"2024-05-08T21:49:44.928456+0000","last_peered":"2024-05-08T21:49:44.928456+0000","last_clean":"2024-05-08T21:49:44.928456+0000","last_became_active":"2024-05-08T21:49:43.775361+0000","last_became_peered":"2024-05-08T21:49:43.775361+0000","last_unstale":"2024-05-08T21:49:44.928456+0000","last_undegraded":"2024-05-08T21:49:44.928456+0000","last_fullsized":"2024-05-08T21:49:44.928456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:48:24.482146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755727+0000","last_change":"2024-05-08T21:49:43.767129+0000","last_active":"2024-05-08T21:49:44.755727+0000","last_peered":"2024-05-08T21:49:44.755727+0000","last_clean":"2024-05-08T21:49:44.755727+0000","last_became_active":"2024-05-08T21:49:43.766789+0000","last_became_peered":"2024-05-08T21:49:43.766789+0000","last_unstale":"2024-05-08T21:49:44.755727+0000","last_undegraded":"2024-05-08T21:49:44.755727+0000","last_fullsized":"2024-05-08T21:49:44.755727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:39.954320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927246+0000","last_change":"2024-05-08T21:49:43.766157+0000","last_active":"2024-05-08T21:49:44.927246+0000","last_peered":"2024-05-08T21:49:44.927246+0000","last_clean":"2024-05-08T21:49:44.927246+0000","last_became_active":"2024-05-08T21:49:43.765843+0000","last_became_peered":"2024-05-08T21:49:43.765843+0000","last_unstale":"2024-05-08T21:49:44.927246+0000","last_undegraded":"2024-05-08T21:49:44.927246+0000","last_fullsized":"2024-05-08T21:49:44.927246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:04.968184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757080+0000","last_change":"2024-05-08T21:49:43.768929+0000","last_active":"2024-05-08T21:49:44.757080+0000","last_peered":"2024-05-08T21:49:44.757080+0000","last_clean":"2024-05-08T21:49:44.757080+0000","last_became_active":"2024-05-08T21:49:43.767606+0000","last_became_peered":"2024-05-08T21:49:43.767606+0000","last_unstale":"2024-05-08T21:49:44.757080+0000","last_undegraded":"2024-05-08T21:49:44.757080+0000","last_fullsized":"2024-05-08T21:49:44.757080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:13:06.426154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927158+0000","last_change":"2024-05-08T21:49:43.774673+0000","last_active":"2024-05-08T21:49:44.927158+0000","last_peered":"2024-05-08T21:49:44.927158+0000","last_clean":"2024-05-08T21:49:44.927158+0000","last_became_active":"2024-05-08T21:49:43.774406+0000","last_became_peered":"2024-05-08T21:49:43.774406+0000","last_unstale":"2024-05-08T21:49:44.927158+0000","last_undegraded":"2024-05-08T21:49:44.927158+0000","last_fullsized":"2024-05-08T21:49:44.927158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:43.798909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927659+0000","last_change":"2024-05-08T21:49:43.764222+0000","last_active":"2024-05-08T21:49:44.927659+0000","last_peered":"2024-05-08T21:49:44.927659+0000","last_clean":"2024-05-08T21:49:44.927659+0000","last_became_active":"2024-05-08T21:49:43.763937+0000","last_became_peered":"2024-05-08T21:49:43.763937+0000","last_unstale":"2024-05-08T21:49:44.927659+0000","last_undegraded":"2024-05-08T21:49:44.927659+0000","last_fullsized":"2024-05-08T21:49:44.927659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:04:14.416894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755114+0000","last_change":"2024-05-08T21:49:43.757318+0000","last_active":"2024-05-08T21:49:44.755114+0000","last_peered":"2024-05-08T21:49:44.755114+0000","last_clean":"2024-05-08T21:49:44.755114+0000","last_became_active":"2024-05-08T21:49:43.757083+0000","last_became_peered":"2024-05-08T21:49:43.757083+0000","last_unstale":"2024-05-08T21:49:44.755114+0000","last_undegraded":"2024-05-08T21:49:44.755114+0000","last_fullsized":"2024-05-08T21:49:44.755114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:47.551474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756302+0000","last_change":"2024-05-08T21:49:43.773491+0000","last_active":"2024-05-08T21:49:44.756302+0000","last_peered":"2024-05-08T21:49:44.756302+0000","last_clean":"2024-05-08T21:49:44.756302+0000","last_became_active":"2024-05-08T21:49:43.773203+0000","last_became_peered":"2024-05-08T21:49:43.773203+0000","last_unstale":"2024-05-08T21:49:44.756302+0000","last_undegraded":"2024-05-08T21:49:44.756302+0000","last_fullsized":"2024-05-08T21:49:44.756302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:53:14.774835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927776+0000","last_change":"2024-05-08T21:49:43.761926+0000","last_active":"2024-05-08T21:49:44.927776+0000","last_peered":"2024-05-08T21:49:44.927776+0000","last_clean":"2024-05-08T21:49:44.927776+0000","last_became_active":"2024-05-08T21:49:43.761645+0000","last_became_peered":"2024-05-08T21:49:43.761645+0000","last_unstale":"2024-05-08T21:49:44.927776+0000","last_undegraded":"2024-05-08T21:49:44.927776+0000","last_fullsized":"2024-05-08T21:49:44.927776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:10:07.209965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756761+0000","last_change":"2024-05-08T21:49:43.768942+0000","last_active":"2024-05-08T21:49:44.756761+0000","last_peered":"2024-05-08T21:49:44.756761+0000","last_clean":"2024-05-08T21:49:44.756761+0000","last_became_active":"2024-05-08T21:49:43.768673+0000","last_became_peered":"2024-05-08T21:49:43.768673+0000","last_unstale":"2024-05-08T21:49:44.756761+0000","last_undegraded":"2024-05-08T21:49:44.756761+0000","last_fullsized":"2024-05-08T21:49:44.756761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:15:41.869107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927592+0000","last_change":"2024-05-08T21:49:43.766452+0000","last_active":"2024-05-08T21:49:44.927592+0000","last_peered":"2024-05-08T21:49:44.927592+0000","last_clean":"2024-05-08T21:49:44.927592+0000","last_became_active":"2024-05-08T21:49:43.765723+0000","last_became_peered":"2024-05-08T21:49:43.765723+0000","last_unstale":"2024-05-08T21:49:44.927592+0000","last_undegraded":"2024-05-08T21:49:44.927592+0000","last_fullsized":"2024-05-08T21:49:44.927592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:19:28.925404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756863+0000","last_change":"2024-05-08T21:49:43.775098+0000","last_active":"2024-05-08T21:49:44.756863+0000","last_peered":"2024-05-08T21:49:44.756863+0000","last_clean":"2024-05-08T21:49:44.756863+0000","last_became_active":"2024-05-08T21:49:43.774808+0000","last_became_peered":"2024-05-08T21:49:43.774808+0000","last_unstale":"2024-05-08T21:49:44.756863+0000","last_undegraded":"2024-05-08T21:49:44.756863+0000","last_fullsized":"2024-05-08T21:49:44.756863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:51:15.152611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927076+0000","last_change":"2024-05-08T21:49:43.775129+0000","last_active":"2024-05-08T21:49:44.927076+0000","last_peered":"2024-05-08T21:49:44.927076+0000","last_clean":"2024-05-08T21:49:44.927076+0000","last_became_active":"2024-05-08T21:49:43.774881+0000","last_became_peered":"2024-05-08T21:49:43.774881+0000","last_unstale":"2024-05-08T21:49:44.927076+0000","last_undegraded":"2024-05-08T21:49:44.927076+0000","last_fullsized":"2024-05-08T21:49:44.927076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:19:28.925404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756057+0000","last_change":"2024-05-08T21:49:43.764163+0000","last_active":"2024-05-08T21:49:44.756057+0000","last_peered":"2024-05-08T21:49:44.756057+0000","last_clean":"2024-05-08T21:49:44.756057+0000","last_became_active":"2024-05-08T21:49:43.763907+0000","last_became_peered":"2024-05-08T21:49:43.763907+0000","last_unstale":"2024-05-08T21:49:44.756057+0000","last_undegraded":"2024-05-08T21:49:44.756057+0000","last_fullsized":"2024-05-08T21:49:44.756057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:01:00.614249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":802816,"data_stored":663457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]}]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":208896,"data_stored":73089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":73089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":73089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]}]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":802816,"data_stored":663457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":208896,"data_stored":73089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]}]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":208896,"data_stored":73089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]}]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":208896,"data_stored":73089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T21:49:53.482 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T21:49:53.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.620+0000 7f71fe96e700 1 Processor -- start 2024-05-08T21:49:53.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.620+0000 7f71fe96e700 1 -- start start 2024-05-08T21:49:53.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.621+0000 7f71fe96e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71f8157550 0x7f71f80cd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:53.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.621+0000 7f71fe96e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f71f815a9c0 0x7f71f80cda20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:53.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.621+0000 7f71fe96e700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71f806fd20 con 0x7f71f80c44e0 2024-05-08T21:49:53.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.621+0000 7f71fe96e700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71f806cf10 con 0x7f71f815a9c0 2024-05-08T21:49:53.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.621+0000 7f71fe96e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f806d730 con 0x7f71f8157550 2024-05-08T21:49:53.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.621+0000 7f71fcf0b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f71f815a9c0 0x7f71f80cda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:53.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.621+0000 7f71f7fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71f8157550 0x7f71f80cd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:53.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.621+0000 7f71fcf0b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f71f815a9c0 0x7f71f80cda20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.73:53540/0 (socket says 172.21.15.73:53540) 2024-05-08T21:49:53.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.621+0000 7f71f77fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f71f80c44e0 0x7f71f815a2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.73:46932/0 (socket says 172.21.15.73:46932) 2024-05-08T21:49:53.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.621+0000 7f71fcf0b700 1 -- 172.21.15.73:0/1903637525 learned_addr learned my addr 172.21.15.73:0/1903637525 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:53.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.621+0000 7f71f7fff700 1 -- 172.21.15.73:0/1903637525 >> v2:172.21.15.115:3300/0 conn(0x7f71f815a9c0 msgr2=0x7f71f80cda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:53.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.621+0000 7f71f7fff700 1 --2- 172.21.15.73:0/1903637525 >> v2:172.21.15.115:3300/0 conn(0x7f71f815a9c0 0x7f71f80cda20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:53.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.621+0000 7f71f7fff700 1 -- 172.21.15.73:0/1903637525 >> v1:172.21.15.115:6789/0 conn(0x7f71f80c44e0 legacy=0x7f71f815a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:53.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.621+0000 7f71f7fff700 1 -- 172.21.15.73:0/1903637525 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f8157930 con 0x7f71f8157550 2024-05-08T21:49:53.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.621+0000 7f71fcf0b700 1 --2- 172.21.15.73:0/1903637525 >> v2:172.21.15.115:3300/0 conn(0x7f71f815a9c0 0x7f71f80cda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:49:53.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.622+0000 7f71f7fff700 1 --2- 172.21.15.73:0/1903637525 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71f8157550 0x7f71f80cd4e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f71e8009840 tx=0x7f71e8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11887033e2db5eab server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:53.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.622+0000 7f71f6ffd700 1 -- 172.21.15.73:0/1903637525 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e8011830 con 0x7f71f8157550 2024-05-08T21:49:53.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.622+0000 7f71f6ffd700 1 -- 172.21.15.73:0/1903637525 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e8011990 con 0x7f71f8157550 2024-05-08T21:49:53.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.622+0000 7f71f6ffd700 1 -- 172.21.15.73:0/1903637525 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e8011d20 con 0x7f71f8157550 2024-05-08T21:49:53.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.622+0000 7f71fe96e700 1 -- 172.21.15.73:0/1903637525 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71f8157550 msgr2=0x7f71f80cd4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:53.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.622+0000 7f71fe96e700 1 --2- 172.21.15.73:0/1903637525 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71f8157550 0x7f71f80cd4e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f71e8009840 tx=0x7f71e8009b50 comp rx=0 tx=0).stop 2024-05-08T21:49:53.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.622+0000 7f71fe96e700 1 -- 172.21.15.73:0/1903637525 shutdown_connections 2024-05-08T21:49:53.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.622+0000 7f71fe96e700 1 --2- 172.21.15.73:0/1903637525 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71f8157550 0x7f71f80cd4e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:53.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.622+0000 7f71fe96e700 1 --2- 172.21.15.73:0/1903637525 >> v2:172.21.15.115:3300/0 conn(0x7f71f815a9c0 0x7f71f80cda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:53.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.622+0000 7f71fe96e700 1 -- 172.21.15.73:0/1903637525 >> 172.21.15.73:0/1903637525 conn(0x7f71f806ae10 msgr2=0x7f71f80666c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:53.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.622+0000 7f71fe96e700 1 -- 172.21.15.73:0/1903637525 shutdown_connections 2024-05-08T21:49:53.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.622+0000 7f71fe96e700 1 -- 172.21.15.73:0/1903637525 wait complete. 2024-05-08T21:49:53.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.624+0000 7f71fe96e700 1 Processor -- start 2024-05-08T21:49:53.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.624+0000 7f71fe96e700 1 -- start start 2024-05-08T21:49:53.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.624+0000 7f71fe96e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71f80c44e0 0x7f71f80aebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:53.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.624+0000 7f71fe96e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71f8157550 0x7f71f81effe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:53.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.625+0000 7f71fe96e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71f815a9c0 0x7f71f80c6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:53.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.625+0000 7f71fe96e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f80ae0f0 con 0x7f71f80c44e0 2024-05-08T21:49:53.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.625+0000 7f71fe96e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f80ad850 con 0x7f71f8157550 2024-05-08T21:49:53.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.625+0000 7f71fe96e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f80adb30 con 0x7f71f815a9c0 2024-05-08T21:49:53.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.625+0000 7f71f7fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71f80c44e0 0x7f71f80aebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:53.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.625+0000 7f71f7fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71f80c44e0 0x7f71f80aebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38790/0 (socket says 172.21.15.73:38790) 2024-05-08T21:49:53.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.625+0000 7f71f7fff700 1 -- 172.21.15.73:0/3955033756 learned_addr learned my addr 172.21.15.73:0/3955033756 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:53.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.625+0000 7f71f77fe700 1 --2- 172.21.15.73:0/3955033756 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71f8157550 0x7f71f81effe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:53.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.625+0000 7f71fcf0b700 1 --2- 172.21.15.73:0/3955033756 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71f815a9c0 0x7f71f80c6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:53.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.625+0000 7f71f7fff700 1 -- 172.21.15.73:0/3955033756 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71f815a9c0 msgr2=0x7f71f80c6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:53.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.625+0000 7f71f7fff700 1 --2- 172.21.15.73:0/3955033756 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71f815a9c0 0x7f71f80c6de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:53.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.625+0000 7f71f7fff700 1 -- 172.21.15.73:0/3955033756 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71f8157550 msgr2=0x7f71f81effe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:53.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.625+0000 7f71f7fff700 1 --2- 172.21.15.73:0/3955033756 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71f8157550 0x7f71f81effe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:53.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.625+0000 7f71f7fff700 1 -- 172.21.15.73:0/3955033756 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f0009b30 con 0x7f71f80c44e0 2024-05-08T21:49:53.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.625+0000 7f71f7fff700 1 --2- 172.21.15.73:0/3955033756 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71f80c44e0 0x7f71f80aebc0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f71e8009fd0 tx=0x7f71e8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:53.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.625+0000 7f71f4ff9700 1 -- 172.21.15.73:0/3955033756 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e80036a0 con 0x7f71f80c44e0 2024-05-08T21:49:53.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.625+0000 7f71f4ff9700 1 -- 172.21.15.73:0/3955033756 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e801f070 con 0x7f71f80c44e0 2024-05-08T21:49:53.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.625+0000 7f71fe96e700 1 -- 172.21.15.73:0/3955033756 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71e80094a0 con 0x7f71f80c44e0 2024-05-08T21:49:53.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.625+0000 7f71f4ff9700 1 -- 172.21.15.73:0/3955033756 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e8003a40 con 0x7f71f80c44e0 2024-05-08T21:49:53.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.625+0000 7f71fe96e700 1 -- 172.21.15.73:0/3955033756 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71f80c65e0 con 0x7f71f80c44e0 2024-05-08T21:49:53.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.626+0000 7f71fe96e700 1 -- 172.21.15.73:0/3955033756 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71f8068b80 con 0x7f71f80c44e0 2024-05-08T21:49:53.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.627+0000 7f71f4ff9700 1 -- 172.21.15.73:0/3955033756 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f71e8003ba0 con 0x7f71f80c44e0 2024-05-08T21:49:53.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.627+0000 7f71f4ff9700 1 --2- 172.21.15.73:0/3955033756 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f71e406ac90 0x7f71e406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:53.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.627+0000 7f71f4ff9700 1 -- 172.21.15.73:0/3955033756 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f71e8021070 con 0x7f71f80c44e0 2024-05-08T21:49:53.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.627+0000 7f71f77fe700 1 --2- 172.21.15.73:0/3955033756 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f71e406ac90 0x7f71e406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:53.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.627+0000 7f71f77fe700 1 --2- 172.21.15.73:0/3955033756 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f71e406ac90 0x7f71e406d150 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f71f80c7b90 tx=0x7f71ec007ed0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:53.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.632+0000 7f71f4ff9700 1 -- 172.21.15.73:0/3955033756 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f71e8055d50 con 0x7f71f80c44e0 2024-05-08T21:49:53.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.824+0000 7f71fe96e700 1 -- 172.21.15.73:0/3955033756 --> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f71f806f740 con 0x7f71e406ac90 2024-05-08T21:49:53.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.831+0000 7f71f4ff9700 1 -- 172.21.15.73:0/3955033756 <== mgr.4104 v2:172.21.15.73:6832/46949 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264601 (secure 0 0 0) 0x7f71f806f740 con 0x7f71e406ac90 2024-05-08T21:49:53.835 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:49:53.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.834+0000 7f71fe96e700 1 -- 172.21.15.73:0/3955033756 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f71e406ac90 msgr2=0x7f71e406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:53.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.834+0000 7f71fe96e700 1 --2- 172.21.15.73:0/3955033756 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f71e406ac90 0x7f71e406d150 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f71f80c7b90 tx=0x7f71ec007ed0 comp rx=0 tx=0).stop 2024-05-08T21:49:53.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.834+0000 7f71fe96e700 1 -- 172.21.15.73:0/3955033756 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71f80c44e0 msgr2=0x7f71f80aebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:53.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.834+0000 7f71fe96e700 1 --2- 172.21.15.73:0/3955033756 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71f80c44e0 0x7f71f80aebc0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f71e8009fd0 tx=0x7f71e8004750 comp rx=0 tx=0).stop 2024-05-08T21:49:53.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.834+0000 7f71fe96e700 1 -- 172.21.15.73:0/3955033756 shutdown_connections 2024-05-08T21:49:53.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.834+0000 7f71fe96e700 1 --2- 172.21.15.73:0/3955033756 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f71e406ac90 0x7f71e406d150 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:53.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.834+0000 7f71fe96e700 1 --2- 172.21.15.73:0/3955033756 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71f815a9c0 0x7f71f80c6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:53.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.834+0000 7f71fe96e700 1 --2- 172.21.15.73:0/3955033756 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71f80c44e0 0x7f71f80aebc0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:53.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.834+0000 7f71fe96e700 1 --2- 172.21.15.73:0/3955033756 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71f8157550 0x7f71f81effe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:53.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.834+0000 7f71fe96e700 1 -- 172.21.15.73:0/3955033756 >> 172.21.15.73:0/3955033756 conn(0x7f71f806ae10 msgr2=0x7f71f80c3730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:53.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.834+0000 7f71fe96e700 1 -- 172.21.15.73:0/3955033756 shutdown_connections 2024-05-08T21:49:53.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:53.834+0000 7f71fe96e700 1 -- 172.21.15.73:0/3955033756 wait complete. 2024-05-08T21:49:53.838 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-05-08T21:49:53.847 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-05-08T21:49:51.951936+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590528,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":164,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":121,"ondisk_log_size":121,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219020,"kb_used_data":2804,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755700,"statfs":{"total":773094113280,"available":772869836800,"internally_reserved":0,"allocated":2871296,"data_stored":1765698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":160,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.200637"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.928360+0000","last_change":"2024-05-08T21:49:43.775912+0000","last_active":"2024-05-08T21:49:44.928360+0000","last_peered":"2024-05-08T21:49:44.928360+0000","last_clean":"2024-05-08T21:49:44.928360+0000","last_became_active":"2024-05-08T21:49:43.775657+0000","last_became_peered":"2024-05-08T21:49:43.775657+0000","last_unstale":"2024-05-08T21:49:44.928360+0000","last_undegraded":"2024-05-08T21:49:44.928360+0000","last_fullsized":"2024-05-08T21:49:44.928360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:10:07.209965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755108+0000","last_change":"2024-05-08T21:49:43.766984+0000","last_active":"2024-05-08T21:49:44.755108+0000","last_peered":"2024-05-08T21:49:44.755108+0000","last_clean":"2024-05-08T21:49:44.755108+0000","last_became_active":"2024-05-08T21:49:43.765995+0000","last_became_peered":"2024-05-08T21:49:43.765995+0000","last_unstale":"2024-05-08T21:49:44.755108+0000","last_undegraded":"2024-05-08T21:49:44.755108+0000","last_fullsized":"2024-05-08T21:49:44.755108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:21:41.238890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.926947+0000","last_change":"2024-05-08T21:49:43.766107+0000","last_active":"2024-05-08T21:49:44.926947+0000","last_peered":"2024-05-08T21:49:44.926947+0000","last_clean":"2024-05-08T21:49:44.926947+0000","last_became_active":"2024-05-08T21:49:43.765874+0000","last_became_peered":"2024-05-08T21:49:43.765874+0000","last_unstale":"2024-05-08T21:49:44.926947+0000","last_undegraded":"2024-05-08T21:49:44.926947+0000","last_fullsized":"2024-05-08T21:49:44.926947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:06:50.769169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757017+0000","last_change":"2024-05-08T21:49:43.766355+0000","last_active":"2024-05-08T21:49:44.757017+0000","last_peered":"2024-05-08T21:49:44.757017+0000","last_clean":"2024-05-08T21:49:44.757017+0000","last_became_active":"2024-05-08T21:49:43.765507+0000","last_became_peered":"2024-05-08T21:49:43.765507+0000","last_unstale":"2024-05-08T21:49:44.757017+0000","last_undegraded":"2024-05-08T21:49:44.757017+0000","last_fullsized":"2024-05-08T21:49:44.757017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:09:09.676078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927361+0000","last_change":"2024-05-08T21:49:43.770346+0000","last_active":"2024-05-08T21:49:44.927361+0000","last_peered":"2024-05-08T21:49:44.927361+0000","last_clean":"2024-05-08T21:49:44.927361+0000","last_became_active":"2024-05-08T21:49:43.770067+0000","last_became_peered":"2024-05-08T21:49:43.770067+0000","last_unstale":"2024-05-08T21:49:44.927361+0000","last_undegraded":"2024-05-08T21:49:44.927361+0000","last_fullsized":"2024-05-08T21:49:44.927361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:04:14.416894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756907+0000","last_change":"2024-05-08T21:49:43.771390+0000","last_active":"2024-05-08T21:49:44.756907+0000","last_peered":"2024-05-08T21:49:44.756907+0000","last_clean":"2024-05-08T21:49:44.756907+0000","last_became_active":"2024-05-08T21:49:43.770893+0000","last_became_peered":"2024-05-08T21:49:43.770893+0000","last_unstale":"2024-05-08T21:49:44.756907+0000","last_undegraded":"2024-05-08T21:49:44.756907+0000","last_fullsized":"2024-05-08T21:49:44.756907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:28.979468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927055+0000","last_change":"2024-05-08T21:49:43.769981+0000","last_active":"2024-05-08T21:49:44.927055+0000","last_peered":"2024-05-08T21:49:44.927055+0000","last_clean":"2024-05-08T21:49:44.927055+0000","last_became_active":"2024-05-08T21:49:43.769667+0000","last_became_peered":"2024-05-08T21:49:43.769667+0000","last_unstale":"2024-05-08T21:49:44.927055+0000","last_undegraded":"2024-05-08T21:49:44.927055+0000","last_fullsized":"2024-05-08T21:49:44.927055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:12:00.381761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927368+0000","last_change":"2024-05-08T21:49:43.771078+0000","last_active":"2024-05-08T21:49:44.927368+0000","last_peered":"2024-05-08T21:49:44.927368+0000","last_clean":"2024-05-08T21:49:44.927368+0000","last_became_active":"2024-05-08T21:49:43.770912+0000","last_became_peered":"2024-05-08T21:49:43.770912+0000","last_unstale":"2024-05-08T21:49:44.927368+0000","last_undegraded":"2024-05-08T21:49:44.927368+0000","last_fullsized":"2024-05-08T21:49:44.927368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:12:00.381761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.928368+0000","last_change":"2024-05-08T21:49:43.775880+0000","last_active":"2024-05-08T21:49:44.928368+0000","last_peered":"2024-05-08T21:49:44.928368+0000","last_clean":"2024-05-08T21:49:44.928368+0000","last_became_active":"2024-05-08T21:49:43.775404+0000","last_became_peered":"2024-05-08T21:49:43.775404+0000","last_unstale":"2024-05-08T21:49:44.928368+0000","last_undegraded":"2024-05-08T21:49:44.928368+0000","last_fullsized":"2024-05-08T21:49:44.928368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:23:24.559669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756369+0000","last_change":"2024-05-08T21:49:43.772784+0000","last_active":"2024-05-08T21:49:44.756369+0000","last_peered":"2024-05-08T21:49:44.756369+0000","last_clean":"2024-05-08T21:49:44.756369+0000","last_became_active":"2024-05-08T21:49:43.772505+0000","last_became_peered":"2024-05-08T21:49:43.772505+0000","last_unstale":"2024-05-08T21:49:44.756369+0000","last_undegraded":"2024-05-08T21:49:44.756369+0000","last_fullsized":"2024-05-08T21:49:44.756369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:19:28.925404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756079+0000","last_change":"2024-05-08T21:49:43.771781+0000","last_active":"2024-05-08T21:49:44.756079+0000","last_peered":"2024-05-08T21:49:44.756079+0000","last_clean":"2024-05-08T21:49:44.756079+0000","last_became_active":"2024-05-08T21:49:43.771457+0000","last_became_peered":"2024-05-08T21:49:43.771457+0000","last_unstale":"2024-05-08T21:49:44.756079+0000","last_undegraded":"2024-05-08T21:49:44.756079+0000","last_fullsized":"2024-05-08T21:49:44.756079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:43.798909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927611+0000","last_change":"2024-05-08T21:49:43.764249+0000","last_active":"2024-05-08T21:49:44.927611+0000","last_peered":"2024-05-08T21:49:44.927611+0000","last_clean":"2024-05-08T21:49:44.927611+0000","last_became_active":"2024-05-08T21:49:43.763986+0000","last_became_peered":"2024-05-08T21:49:43.763986+0000","last_unstale":"2024-05-08T21:49:44.927611+0000","last_undegraded":"2024-05-08T21:49:44.927611+0000","last_fullsized":"2024-05-08T21:49:44.927611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:33:13.833915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927054+0000","last_change":"2024-05-08T21:49:43.761127+0000","last_active":"2024-05-08T21:49:44.927054+0000","last_peered":"2024-05-08T21:49:44.927054+0000","last_clean":"2024-05-08T21:49:44.927054+0000","last_became_active":"2024-05-08T21:49:43.760874+0000","last_became_peered":"2024-05-08T21:49:43.760874+0000","last_unstale":"2024-05-08T21:49:44.927054+0000","last_undegraded":"2024-05-08T21:49:44.927054+0000","last_fullsized":"2024-05-08T21:49:44.927054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:17:34.570817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.926846+0000","last_change":"2024-05-08T21:49:43.765829+0000","last_active":"2024-05-08T21:49:44.926846+0000","last_peered":"2024-05-08T21:49:44.926846+0000","last_clean":"2024-05-08T21:49:44.926846+0000","last_became_active":"2024-05-08T21:49:43.765566+0000","last_became_peered":"2024-05-08T21:49:43.765566+0000","last_unstale":"2024-05-08T21:49:44.926846+0000","last_undegraded":"2024-05-08T21:49:44.926846+0000","last_fullsized":"2024-05-08T21:49:44.926846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:39.954320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.754916+0000","last_change":"2024-05-08T21:49:43.765080+0000","last_active":"2024-05-08T21:49:44.754916+0000","last_peered":"2024-05-08T21:49:44.754916+0000","last_clean":"2024-05-08T21:49:44.754916+0000","last_became_active":"2024-05-08T21:49:43.764810+0000","last_became_peered":"2024-05-08T21:49:43.764810+0000","last_unstale":"2024-05-08T21:49:44.754916+0000","last_undegraded":"2024-05-08T21:49:44.754916+0000","last_fullsized":"2024-05-08T21:49:44.754916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:24:11.223913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756634+0000","last_change":"2024-05-08T21:49:43.766717+0000","last_active":"2024-05-08T21:49:44.756634+0000","last_peered":"2024-05-08T21:49:44.756634+0000","last_clean":"2024-05-08T21:49:44.756634+0000","last_became_active":"2024-05-08T21:49:43.766427+0000","last_became_peered":"2024-05-08T21:49:43.766427+0000","last_unstale":"2024-05-08T21:49:44.756634+0000","last_undegraded":"2024-05-08T21:49:44.756634+0000","last_fullsized":"2024-05-08T21:49:44.756634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:49:22.833820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757256+0000","last_change":"2024-05-08T21:49:43.776929+0000","last_active":"2024-05-08T21:49:44.757256+0000","last_peered":"2024-05-08T21:49:44.757256+0000","last_clean":"2024-05-08T21:49:44.757256+0000","last_became_active":"2024-05-08T21:49:43.776509+0000","last_became_peered":"2024-05-08T21:49:43.776509+0000","last_unstale":"2024-05-08T21:49:44.757256+0000","last_undegraded":"2024-05-08T21:49:44.757256+0000","last_fullsized":"2024-05-08T21:49:44.757256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:26.199459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.926679+0000","last_change":"2024-05-08T21:49:43.762646+0000","last_active":"2024-05-08T21:49:44.926679+0000","last_peered":"2024-05-08T21:49:44.926679+0000","last_clean":"2024-05-08T21:49:44.926679+0000","last_became_active":"2024-05-08T21:49:43.762237+0000","last_became_peered":"2024-05-08T21:49:43.762237+0000","last_unstale":"2024-05-08T21:49:44.926679+0000","last_undegraded":"2024-05-08T21:49:44.926679+0000","last_fullsized":"2024-05-08T21:49:44.926679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:46:08.821947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927249+0000","last_change":"2024-05-08T21:49:43.774729+0000","last_active":"2024-05-08T21:49:44.927249+0000","last_peered":"2024-05-08T21:49:44.927249+0000","last_clean":"2024-05-08T21:49:44.927249+0000","last_became_active":"2024-05-08T21:49:43.774450+0000","last_became_peered":"2024-05-08T21:49:43.774450+0000","last_unstale":"2024-05-08T21:49:44.927249+0000","last_undegraded":"2024-05-08T21:49:44.927249+0000","last_fullsized":"2024-05-08T21:49:44.927249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:25.661350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.759176+0000","last_change":"2024-05-08T21:49:43.219461+0000","last_active":"2024-05-08T21:49:43.759176+0000","last_peered":"2024-05-08T21:49:43.759176+0000","last_clean":"2024-05-08T21:49:43.759176+0000","last_became_active":"2024-05-08T21:49:43.219161+0000","last_became_peered":"2024-05-08T21:49:43.219161+0000","last_unstale":"2024-05-08T21:49:43.759176+0000","last_undegraded":"2024-05-08T21:49:43.759176+0000","last_fullsized":"2024-05-08T21:49:43.759176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:02:45.778415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927036+0000","last_change":"2024-05-08T21:49:43.764252+0000","last_active":"2024-05-08T21:49:44.927036+0000","last_peered":"2024-05-08T21:49:44.927036+0000","last_clean":"2024-05-08T21:49:44.927036+0000","last_became_active":"2024-05-08T21:49:43.764045+0000","last_became_peered":"2024-05-08T21:49:43.764045+0000","last_unstale":"2024-05-08T21:49:44.927036+0000","last_undegraded":"2024-05-08T21:49:44.927036+0000","last_fullsized":"2024-05-08T21:49:44.927036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:43.798909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.754559+0000","last_change":"2024-05-08T21:49:43.221599+0000","last_active":"2024-05-08T21:49:43.754559+0000","last_peered":"2024-05-08T21:49:43.754559+0000","last_clean":"2024-05-08T21:49:43.754559+0000","last_became_active":"2024-05-08T21:49:43.221309+0000","last_became_peered":"2024-05-08T21:49:43.221309+0000","last_unstale":"2024-05-08T21:49:43.754559+0000","last_undegraded":"2024-05-08T21:49:43.754559+0000","last_fullsized":"2024-05-08T21:49:43.754559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:17.379362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927796+0000","last_change":"2024-05-08T21:49:43.771523+0000","last_active":"2024-05-08T21:49:44.927796+0000","last_peered":"2024-05-08T21:49:44.927796+0000","last_clean":"2024-05-08T21:49:44.927796+0000","last_became_active":"2024-05-08T21:49:43.771295+0000","last_became_peered":"2024-05-08T21:49:43.771295+0000","last_unstale":"2024-05-08T21:49:44.927796+0000","last_undegraded":"2024-05-08T21:49:44.927796+0000","last_fullsized":"2024-05-08T21:49:44.927796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:53:14.774835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.765851+0000","last_change":"2024-05-08T21:49:43.226637+0000","last_active":"2024-05-08T21:49:43.765851+0000","last_peered":"2024-05-08T21:49:43.765851+0000","last_clean":"2024-05-08T21:49:43.765851+0000","last_became_active":"2024-05-08T21:49:43.226284+0000","last_became_peered":"2024-05-08T21:49:43.226284+0000","last_unstale":"2024-05-08T21:49:43.765851+0000","last_undegraded":"2024-05-08T21:49:43.765851+0000","last_fullsized":"2024-05-08T21:49:43.765851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:01.844011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756849+0000","last_change":"2024-05-08T21:49:43.766694+0000","last_active":"2024-05-08T21:49:44.756849+0000","last_peered":"2024-05-08T21:49:44.756849+0000","last_clean":"2024-05-08T21:49:44.756849+0000","last_became_active":"2024-05-08T21:49:43.766079+0000","last_became_peered":"2024-05-08T21:49:43.766079+0000","last_unstale":"2024-05-08T21:49:44.756849+0000","last_undegraded":"2024-05-08T21:49:44.756849+0000","last_fullsized":"2024-05-08T21:49:44.756849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:01:16.682080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.756711+0000","last_change":"2024-05-08T21:49:43.230152+0000","last_active":"2024-05-08T21:49:43.756711+0000","last_peered":"2024-05-08T21:49:43.756711+0000","last_clean":"2024-05-08T21:49:43.756711+0000","last_became_active":"2024-05-08T21:49:43.229891+0000","last_became_peered":"2024-05-08T21:49:43.229891+0000","last_unstale":"2024-05-08T21:49:43.756711+0000","last_undegraded":"2024-05-08T21:49:43.756711+0000","last_fullsized":"2024-05-08T21:49:43.756711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:33:12.827218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757018+0000","last_change":"2024-05-08T21:49:43.771097+0000","last_active":"2024-05-08T21:49:44.757018+0000","last_peered":"2024-05-08T21:49:44.757018+0000","last_clean":"2024-05-08T21:49:44.757018+0000","last_became_active":"2024-05-08T21:49:43.770727+0000","last_became_peered":"2024-05-08T21:49:43.770727+0000","last_unstale":"2024-05-08T21:49:44.757018+0000","last_undegraded":"2024-05-08T21:49:44.757018+0000","last_fullsized":"2024-05-08T21:49:44.757018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:24:02.741766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.752948+0000","last_change":"2024-05-08T21:49:43.220418+0000","last_active":"2024-05-08T21:49:43.752948+0000","last_peered":"2024-05-08T21:49:43.752948+0000","last_clean":"2024-05-08T21:49:43.752948+0000","last_became_active":"2024-05-08T21:49:43.220090+0000","last_became_peered":"2024-05-08T21:49:43.220090+0000","last_unstale":"2024-05-08T21:49:43.752948+0000","last_undegraded":"2024-05-08T21:49:43.752948+0000","last_fullsized":"2024-05-08T21:49:43.752948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:33:28.074468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927692+0000","last_change":"2024-05-08T21:49:43.762664+0000","last_active":"2024-05-08T21:49:44.927692+0000","last_peered":"2024-05-08T21:49:44.927692+0000","last_clean":"2024-05-08T21:49:44.927692+0000","last_became_active":"2024-05-08T21:49:43.762351+0000","last_became_peered":"2024-05-08T21:49:43.762351+0000","last_unstale":"2024-05-08T21:49:44.927692+0000","last_undegraded":"2024-05-08T21:49:44.927692+0000","last_fullsized":"2024-05-08T21:49:44.927692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:53.330614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.757078+0000","last_change":"2024-05-08T21:49:43.220518+0000","last_active":"2024-05-08T21:49:43.757078+0000","last_peered":"2024-05-08T21:49:43.757078+0000","last_clean":"2024-05-08T21:49:43.757078+0000","last_became_active":"2024-05-08T21:49:43.218473+0000","last_became_peered":"2024-05-08T21:49:43.218473+0000","last_unstale":"2024-05-08T21:49:43.757078+0000","last_undegraded":"2024-05-08T21:49:43.757078+0000","last_fullsized":"2024-05-08T21:49:43.757078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:10.497167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927324+0000","last_change":"2024-05-08T21:49:43.770935+0000","last_active":"2024-05-08T21:49:44.927324+0000","last_peered":"2024-05-08T21:49:44.927324+0000","last_clean":"2024-05-08T21:49:44.927324+0000","last_became_active":"2024-05-08T21:49:43.770677+0000","last_became_peered":"2024-05-08T21:49:43.770677+0000","last_unstale":"2024-05-08T21:49:44.927324+0000","last_undegraded":"2024-05-08T21:49:44.927324+0000","last_fullsized":"2024-05-08T21:49:44.927324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:04:14.416894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.752777+0000","last_change":"2024-05-08T21:49:43.221027+0000","last_active":"2024-05-08T21:49:43.752777+0000","last_peered":"2024-05-08T21:49:43.752777+0000","last_clean":"2024-05-08T21:49:43.752777+0000","last_became_active":"2024-05-08T21:49:43.220780+0000","last_became_peered":"2024-05-08T21:49:43.220780+0000","last_unstale":"2024-05-08T21:49:43.752777+0000","last_undegraded":"2024-05-08T21:49:43.752777+0000","last_fullsized":"2024-05-08T21:49:43.752777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:20:34.123736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927461+0000","last_change":"2024-05-08T21:49:43.766815+0000","last_active":"2024-05-08T21:49:44.927461+0000","last_peered":"2024-05-08T21:49:44.927461+0000","last_clean":"2024-05-08T21:49:44.927461+0000","last_became_active":"2024-05-08T21:49:43.766568+0000","last_became_peered":"2024-05-08T21:49:43.766568+0000","last_unstale":"2024-05-08T21:49:44.927461+0000","last_undegraded":"2024-05-08T21:49:44.927461+0000","last_fullsized":"2024-05-08T21:49:44.927461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:41:45.602022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756625+0000","last_change":"2024-05-08T21:49:43.225299+0000","last_active":"2024-05-08T21:49:44.756625+0000","last_peered":"2024-05-08T21:49:44.756625+0000","last_clean":"2024-05-08T21:49:44.756625+0000","last_became_active":"2024-05-08T21:49:43.225057+0000","last_became_peered":"2024-05-08T21:49:43.225057+0000","last_unstale":"2024-05-08T21:49:44.756625+0000","last_undegraded":"2024-05-08T21:49:44.756625+0000","last_fullsized":"2024-05-08T21:49:44.756625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:38:43.069159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755021+0000","last_change":"2024-05-08T21:49:43.757361+0000","last_active":"2024-05-08T21:49:44.755021+0000","last_peered":"2024-05-08T21:49:44.755021+0000","last_clean":"2024-05-08T21:49:44.755021+0000","last_became_active":"2024-05-08T21:49:43.757092+0000","last_became_peered":"2024-05-08T21:49:43.757092+0000","last_unstale":"2024-05-08T21:49:44.755021+0000","last_undegraded":"2024-05-08T21:49:44.755021+0000","last_fullsized":"2024-05-08T21:49:44.755021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:24:02.741766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.756381+0000","last_change":"2024-05-08T21:49:43.229405+0000","last_active":"2024-05-08T21:49:43.756381+0000","last_peered":"2024-05-08T21:49:43.756381+0000","last_clean":"2024-05-08T21:49:43.756381+0000","last_became_active":"2024-05-08T21:49:43.229105+0000","last_became_peered":"2024-05-08T21:49:43.229105+0000","last_unstale":"2024-05-08T21:49:43.756381+0000","last_undegraded":"2024-05-08T21:49:43.756381+0000","last_fullsized":"2024-05-08T21:49:43.756381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:18:58.164159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757172+0000","last_change":"2024-05-08T21:49:43.773243+0000","last_active":"2024-05-08T21:49:44.757172+0000","last_peered":"2024-05-08T21:49:44.757172+0000","last_clean":"2024-05-08T21:49:44.757172+0000","last_became_active":"2024-05-08T21:49:43.772944+0000","last_became_peered":"2024-05-08T21:49:43.772944+0000","last_unstale":"2024-05-08T21:49:44.757172+0000","last_undegraded":"2024-05-08T21:49:44.757172+0000","last_fullsized":"2024-05-08T21:49:44.757172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:21:41.238890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757107+0000","last_change":"2024-05-08T21:49:43.224999+0000","last_active":"2024-05-08T21:49:44.757107+0000","last_peered":"2024-05-08T21:49:44.757107+0000","last_clean":"2024-05-08T21:49:44.757107+0000","last_became_active":"2024-05-08T21:49:43.223476+0000","last_became_peered":"2024-05-08T21:49:43.223476+0000","last_unstale":"2024-05-08T21:49:44.757107+0000","last_undegraded":"2024-05-08T21:49:44.757107+0000","last_fullsized":"2024-05-08T21:49:44.757107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:09:12.983430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927734+0000","last_change":"2024-05-08T21:49:43.771526+0000","last_active":"2024-05-08T21:49:44.927734+0000","last_peered":"2024-05-08T21:49:44.927734+0000","last_clean":"2024-05-08T21:49:44.927734+0000","last_became_active":"2024-05-08T21:49:43.771279+0000","last_became_peered":"2024-05-08T21:49:43.771279+0000","last_unstale":"2024-05-08T21:49:44.927734+0000","last_undegraded":"2024-05-08T21:49:44.927734+0000","last_fullsized":"2024-05-08T21:49:44.927734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:41:45.602022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:48.757392+0000","last_change":"2024-05-08T21:49:43.224378+0000","last_active":"2024-05-08T21:49:48.757392+0000","last_peered":"2024-05-08T21:49:48.757392+0000","last_clean":"2024-05-08T21:49:48.757392+0000","last_became_active":"2024-05-08T21:49:43.224164+0000","last_became_peered":"2024-05-08T21:49:43.224164+0000","last_unstale":"2024-05-08T21:49:48.757392+0000","last_undegraded":"2024-05-08T21:49:48.757392+0000","last_fullsized":"2024-05-08T21:49:48.757392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:06:10.276907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927552+0000","last_change":"2024-05-08T21:49:43.772948+0000","last_active":"2024-05-08T21:49:44.927552+0000","last_peered":"2024-05-08T21:49:44.927552+0000","last_clean":"2024-05-08T21:49:44.927552+0000","last_became_active":"2024-05-08T21:49:43.772685+0000","last_became_peered":"2024-05-08T21:49:43.772685+0000","last_unstale":"2024-05-08T21:49:44.927552+0000","last_undegraded":"2024-05-08T21:49:44.927552+0000","last_fullsized":"2024-05-08T21:49:44.927552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:02.850708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.758779+0000","last_change":"2024-05-08T21:49:43.222308+0000","last_active":"2024-05-08T21:49:43.758779+0000","last_peered":"2024-05-08T21:49:43.758779+0000","last_clean":"2024-05-08T21:49:43.758779+0000","last_became_active":"2024-05-08T21:49:43.221844+0000","last_became_peered":"2024-05-08T21:49:43.221844+0000","last_unstale":"2024-05-08T21:49:43.758779+0000","last_undegraded":"2024-05-08T21:49:43.758779+0000","last_fullsized":"2024-05-08T21:49:43.758779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:17.379362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927374+0000","last_change":"2024-05-08T21:49:43.773923+0000","last_active":"2024-05-08T21:49:44.927374+0000","last_peered":"2024-05-08T21:49:44.927374+0000","last_clean":"2024-05-08T21:49:44.927374+0000","last_became_active":"2024-05-08T21:49:43.772037+0000","last_became_peered":"2024-05-08T21:49:43.772037+0000","last_unstale":"2024-05-08T21:49:44.927374+0000","last_undegraded":"2024-05-08T21:49:44.927374+0000","last_fullsized":"2024-05-08T21:49:44.927374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:52:32.629407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.762457+0000","last_change":"2024-05-08T21:49:43.219473+0000","last_active":"2024-05-08T21:49:43.762457+0000","last_peered":"2024-05-08T21:49:43.762457+0000","last_clean":"2024-05-08T21:49:43.762457+0000","last_became_active":"2024-05-08T21:49:43.219186+0000","last_became_peered":"2024-05-08T21:49:43.219186+0000","last_unstale":"2024-05-08T21:49:43.762457+0000","last_undegraded":"2024-05-08T21:49:43.762457+0000","last_fullsized":"2024-05-08T21:49:43.762457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:20:34.123736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.926751+0000","last_change":"2024-05-08T21:49:43.775135+0000","last_active":"2024-05-08T21:49:44.926751+0000","last_peered":"2024-05-08T21:49:44.926751+0000","last_clean":"2024-05-08T21:49:44.926751+0000","last_became_active":"2024-05-08T21:49:43.774919+0000","last_became_peered":"2024-05-08T21:49:43.774919+0000","last_unstale":"2024-05-08T21:49:44.926751+0000","last_undegraded":"2024-05-08T21:49:44.926751+0000","last_fullsized":"2024-05-08T21:49:44.926751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:01:00.614249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757128+0000","last_change":"2024-05-08T21:49:43.227386+0000","last_active":"2024-05-08T21:49:44.757128+0000","last_peered":"2024-05-08T21:49:44.757128+0000","last_clean":"2024-05-08T21:49:44.757128+0000","last_became_active":"2024-05-08T21:49:43.227065+0000","last_became_peered":"2024-05-08T21:49:43.227065+0000","last_unstale":"2024-05-08T21:49:44.757128+0000","last_undegraded":"2024-05-08T21:49:44.757128+0000","last_fullsized":"2024-05-08T21:49:44.757128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:43:48.019170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927424+0000","last_change":"2024-05-08T21:49:43.770509+0000","last_active":"2024-05-08T21:49:44.927424+0000","last_peered":"2024-05-08T21:49:44.927424+0000","last_clean":"2024-05-08T21:49:44.927424+0000","last_became_active":"2024-05-08T21:49:43.770180+0000","last_became_peered":"2024-05-08T21:49:43.770180+0000","last_unstale":"2024-05-08T21:49:44.927424+0000","last_undegraded":"2024-05-08T21:49:44.927424+0000","last_fullsized":"2024-05-08T21:49:44.927424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:00:38.941899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.756153+0000","last_change":"2024-05-08T21:49:43.220942+0000","last_active":"2024-05-08T21:49:43.756153+0000","last_peered":"2024-05-08T21:49:43.756153+0000","last_clean":"2024-05-08T21:49:43.756153+0000","last_became_active":"2024-05-08T21:49:43.220641+0000","last_became_peered":"2024-05-08T21:49:43.220641+0000","last_unstale":"2024-05-08T21:49:43.756153+0000","last_undegraded":"2024-05-08T21:49:43.756153+0000","last_fullsized":"2024-05-08T21:49:43.756153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:52.323917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755763+0000","last_change":"2024-05-08T21:49:43.766269+0000","last_active":"2024-05-08T21:49:44.755763+0000","last_peered":"2024-05-08T21:49:44.755763+0000","last_clean":"2024-05-08T21:49:44.755763+0000","last_became_active":"2024-05-08T21:49:43.765945+0000","last_became_peered":"2024-05-08T21:49:43.765945+0000","last_unstale":"2024-05-08T21:49:44.755763+0000","last_undegraded":"2024-05-08T21:49:44.755763+0000","last_fullsized":"2024-05-08T21:49:44.755763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:17:34.570817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.751764+0000","last_change":"2024-05-08T21:49:43.208328+0000","last_active":"2024-05-08T21:49:43.751764+0000","last_peered":"2024-05-08T21:49:43.751764+0000","last_clean":"2024-05-08T21:49:43.751764+0000","last_became_active":"2024-05-08T21:49:43.208013+0000","last_became_peered":"2024-05-08T21:49:43.208013+0000","last_unstale":"2024-05-08T21:49:43.751764+0000","last_undegraded":"2024-05-08T21:49:43.751764+0000","last_fullsized":"2024-05-08T21:49:43.751764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:10.497167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.928099+0000","last_change":"2024-05-08T21:49:43.774210+0000","last_active":"2024-05-08T21:49:44.928099+0000","last_peered":"2024-05-08T21:49:44.928099+0000","last_clean":"2024-05-08T21:49:44.928099+0000","last_became_active":"2024-05-08T21:49:43.773933+0000","last_became_peered":"2024-05-08T21:49:43.773933+0000","last_unstale":"2024-05-08T21:49:44.928099+0000","last_undegraded":"2024-05-08T21:49:44.928099+0000","last_fullsized":"2024-05-08T21:49:44.928099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:10:25.398535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.756269+0000","last_change":"2024-05-08T21:49:43.217456+0000","last_active":"2024-05-08T21:49:43.756269+0000","last_peered":"2024-05-08T21:49:43.756269+0000","last_clean":"2024-05-08T21:49:43.756269+0000","last_became_active":"2024-05-08T21:49:43.216822+0000","last_became_peered":"2024-05-08T21:49:43.216822+0000","last_unstale":"2024-05-08T21:49:43.756269+0000","last_undegraded":"2024-05-08T21:49:43.756269+0000","last_fullsized":"2024-05-08T21:49:43.756269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:41:35.881003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927764+0000","last_change":"2024-05-08T21:49:43.770066+0000","last_active":"2024-05-08T21:49:44.927764+0000","last_peered":"2024-05-08T21:49:44.927764+0000","last_clean":"2024-05-08T21:49:44.927764+0000","last_became_active":"2024-05-08T21:49:43.769762+0000","last_became_peered":"2024-05-08T21:49:43.769762+0000","last_unstale":"2024-05-08T21:49:44.927764+0000","last_undegraded":"2024-05-08T21:49:44.927764+0000","last_fullsized":"2024-05-08T21:49:44.927764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:40:20.301747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755188+0000","last_change":"2024-05-08T21:49:43.215293+0000","last_active":"2024-05-08T21:49:44.755188+0000","last_peered":"2024-05-08T21:49:44.755188+0000","last_clean":"2024-05-08T21:49:44.755188+0000","last_became_active":"2024-05-08T21:49:43.215048+0000","last_became_peered":"2024-05-08T21:49:43.215048+0000","last_unstale":"2024-05-08T21:49:44.755188+0000","last_undegraded":"2024-05-08T21:49:44.755188+0000","last_fullsized":"2024-05-08T21:49:44.755188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:43:48.019170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757129+0000","last_change":"2024-05-08T21:49:43.770326+0000","last_active":"2024-05-08T21:49:44.757129+0000","last_peered":"2024-05-08T21:49:44.757129+0000","last_clean":"2024-05-08T21:49:44.757129+0000","last_became_active":"2024-05-08T21:49:43.770029+0000","last_became_peered":"2024-05-08T21:49:43.770029+0000","last_unstale":"2024-05-08T21:49:44.757129+0000","last_undegraded":"2024-05-08T21:49:44.757129+0000","last_fullsized":"2024-05-08T21:49:44.757129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:33:33.642847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757017+0000","last_change":"2024-05-08T21:49:43.227710+0000","last_active":"2024-05-08T21:49:44.757017+0000","last_peered":"2024-05-08T21:49:44.757017+0000","last_clean":"2024-05-08T21:49:44.757017+0000","last_became_active":"2024-05-08T21:49:43.227430+0000","last_became_peered":"2024-05-08T21:49:43.227430+0000","last_unstale":"2024-05-08T21:49:44.757017+0000","last_undegraded":"2024-05-08T21:49:44.757017+0000","last_fullsized":"2024-05-08T21:49:44.757017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:05:58.875400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.928131+0000","last_change":"2024-05-08T21:49:43.768588+0000","last_active":"2024-05-08T21:49:44.928131+0000","last_peered":"2024-05-08T21:49:44.928131+0000","last_clean":"2024-05-08T21:49:44.928131+0000","last_became_active":"2024-05-08T21:49:43.768307+0000","last_became_peered":"2024-05-08T21:49:43.768307+0000","last_unstale":"2024-05-08T21:49:44.928131+0000","last_undegraded":"2024-05-08T21:49:44.928131+0000","last_fullsized":"2024-05-08T21:49:44.928131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:04.968184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.754953+0000","last_change":"2024-05-08T21:49:43.758618+0000","last_active":"2024-05-08T21:49:44.754953+0000","last_peered":"2024-05-08T21:49:44.754953+0000","last_clean":"2024-05-08T21:49:44.754953+0000","last_became_active":"2024-05-08T21:49:43.758367+0000","last_became_peered":"2024-05-08T21:49:43.758367+0000","last_unstale":"2024-05-08T21:49:44.754953+0000","last_undegraded":"2024-05-08T21:49:44.754953+0000","last_fullsized":"2024-05-08T21:49:44.754953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:30:06.569971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.751866+0000","last_change":"2024-05-08T21:49:43.217410+0000","last_active":"2024-05-08T21:49:43.751866+0000","last_peered":"2024-05-08T21:49:43.751866+0000","last_clean":"2024-05-08T21:49:43.751866+0000","last_became_active":"2024-05-08T21:49:43.217133+0000","last_became_peered":"2024-05-08T21:49:43.217133+0000","last_unstale":"2024-05-08T21:49:43.751866+0000","last_undegraded":"2024-05-08T21:49:43.751866+0000","last_fullsized":"2024-05-08T21:49:43.751866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:17.379362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.926897+0000","last_change":"2024-05-08T21:49:43.771651+0000","last_active":"2024-05-08T21:49:44.926897+0000","last_peered":"2024-05-08T21:49:44.926897+0000","last_clean":"2024-05-08T21:49:44.926897+0000","last_became_active":"2024-05-08T21:49:43.771451+0000","last_became_peered":"2024-05-08T21:49:43.771451+0000","last_unstale":"2024-05-08T21:49:44.926897+0000","last_undegraded":"2024-05-08T21:49:44.926897+0000","last_fullsized":"2024-05-08T21:49:44.926897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:00:38.941899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756759+0000","last_change":"2024-05-08T21:49:43.224929+0000","last_active":"2024-05-08T21:49:44.756759+0000","last_peered":"2024-05-08T21:49:44.756759+0000","last_clean":"2024-05-08T21:49:44.756759+0000","last_became_active":"2024-05-08T21:49:43.223469+0000","last_became_peered":"2024-05-08T21:49:43.223469+0000","last_unstale":"2024-05-08T21:49:44.756759+0000","last_undegraded":"2024-05-08T21:49:44.756759+0000","last_fullsized":"2024-05-08T21:49:44.756759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:27.504127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":164,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.756621+0000","last_change":"2024-05-08T21:49:38.626519+0000","last_active":"2024-05-08T21:49:43.756621+0000","last_peered":"2024-05-08T21:49:43.756621+0000","last_clean":"2024-05-08T21:49:43.756621+0000","last_became_active":"2024-05-08T21:49:38.626159+0000","last_became_peered":"2024-05-08T21:49:38.626159+0000","last_unstale":"2024-05-08T21:49:43.756621+0000","last_undegraded":"2024-05-08T21:49:43.756621+0000","last_fullsized":"2024-05-08T21:49:43.756621+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:36.031649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:36.031649+0000","last_clean_scrub_stamp":"2024-05-08T21:49:36.031649+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:12:04.846500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.926994+0000","last_change":"2024-05-08T21:49:43.770966+0000","last_active":"2024-05-08T21:49:44.926994+0000","last_peered":"2024-05-08T21:49:44.926994+0000","last_clean":"2024-05-08T21:49:44.926994+0000","last_became_active":"2024-05-08T21:49:43.770711+0000","last_became_peered":"2024-05-08T21:49:43.770711+0000","last_unstale":"2024-05-08T21:49:44.926994+0000","last_undegraded":"2024-05-08T21:49:44.926994+0000","last_fullsized":"2024-05-08T21:49:44.926994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:17:34.570817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.756729+0000","last_change":"2024-05-08T21:49:43.221086+0000","last_active":"2024-05-08T21:49:43.756729+0000","last_peered":"2024-05-08T21:49:43.756729+0000","last_clean":"2024-05-08T21:49:43.756729+0000","last_became_active":"2024-05-08T21:49:43.220539+0000","last_became_peered":"2024-05-08T21:49:43.220539+0000","last_unstale":"2024-05-08T21:49:43.756729+0000","last_undegraded":"2024-05-08T21:49:43.756729+0000","last_fullsized":"2024-05-08T21:49:43.756729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:52.323917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.765742+0000","last_change":"2024-05-08T21:49:43.222410+0000","last_active":"2024-05-08T21:49:43.765742+0000","last_peered":"2024-05-08T21:49:43.765742+0000","last_clean":"2024-05-08T21:49:43.765742+0000","last_became_active":"2024-05-08T21:49:43.222131+0000","last_became_peered":"2024-05-08T21:49:43.222131+0000","last_unstale":"2024-05-08T21:49:43.765742+0000","last_undegraded":"2024-05-08T21:49:43.765742+0000","last_fullsized":"2024-05-08T21:49:43.765742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:18:58.164159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755021+0000","last_change":"2024-05-08T21:49:43.758424+0000","last_active":"2024-05-08T21:49:44.755021+0000","last_peered":"2024-05-08T21:49:44.755021+0000","last_clean":"2024-05-08T21:49:44.755021+0000","last_became_active":"2024-05-08T21:49:43.758140+0000","last_became_peered":"2024-05-08T21:49:43.758140+0000","last_unstale":"2024-05-08T21:49:44.755021+0000","last_undegraded":"2024-05-08T21:49:44.755021+0000","last_fullsized":"2024-05-08T21:49:44.755021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:10.795540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755053+0000","last_change":"2024-05-08T21:49:43.218241+0000","last_active":"2024-05-08T21:49:44.755053+0000","last_peered":"2024-05-08T21:49:44.755053+0000","last_clean":"2024-05-08T21:49:44.755053+0000","last_became_active":"2024-05-08T21:49:43.217780+0000","last_became_peered":"2024-05-08T21:49:43.217780+0000","last_unstale":"2024-05-08T21:49:44.755053+0000","last_undegraded":"2024-05-08T21:49:44.755053+0000","last_fullsized":"2024-05-08T21:49:44.755053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:27.504127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927830+0000","last_change":"2024-05-08T21:49:43.770491+0000","last_active":"2024-05-08T21:49:44.927830+0000","last_peered":"2024-05-08T21:49:44.927830+0000","last_clean":"2024-05-08T21:49:44.927830+0000","last_became_active":"2024-05-08T21:49:43.770221+0000","last_became_peered":"2024-05-08T21:49:43.770221+0000","last_unstale":"2024-05-08T21:49:44.927830+0000","last_undegraded":"2024-05-08T21:49:44.927830+0000","last_fullsized":"2024-05-08T21:49:44.927830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:25.661350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.756267+0000","last_change":"2024-05-08T21:49:43.221345+0000","last_active":"2024-05-08T21:49:43.756267+0000","last_peered":"2024-05-08T21:49:43.756267+0000","last_clean":"2024-05-08T21:49:43.756267+0000","last_became_active":"2024-05-08T21:49:43.220953+0000","last_became_peered":"2024-05-08T21:49:43.220953+0000","last_unstale":"2024-05-08T21:49:43.756267+0000","last_undegraded":"2024-05-08T21:49:43.756267+0000","last_fullsized":"2024-05-08T21:49:43.756267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:33:28.074468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927636+0000","last_change":"2024-05-08T21:49:43.765001+0000","last_active":"2024-05-08T21:49:44.927636+0000","last_peered":"2024-05-08T21:49:44.927636+0000","last_clean":"2024-05-08T21:49:44.927636+0000","last_became_active":"2024-05-08T21:49:43.764740+0000","last_became_peered":"2024-05-08T21:49:43.764740+0000","last_unstale":"2024-05-08T21:49:44.927636+0000","last_undegraded":"2024-05-08T21:49:44.927636+0000","last_fullsized":"2024-05-08T21:49:44.927636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:18:58.836430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.756521+0000","last_change":"2024-05-08T21:49:43.221251+0000","last_active":"2024-05-08T21:49:43.756521+0000","last_peered":"2024-05-08T21:49:43.756521+0000","last_clean":"2024-05-08T21:49:43.756521+0000","last_became_active":"2024-05-08T21:49:43.220839+0000","last_became_peered":"2024-05-08T21:49:43.220839+0000","last_unstale":"2024-05-08T21:49:43.756521+0000","last_undegraded":"2024-05-08T21:49:43.756521+0000","last_fullsized":"2024-05-08T21:49:43.756521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:10.497167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927485+0000","last_change":"2024-05-08T21:49:43.762511+0000","last_active":"2024-05-08T21:49:44.927485+0000","last_peered":"2024-05-08T21:49:44.927485+0000","last_clean":"2024-05-08T21:49:44.927485+0000","last_became_active":"2024-05-08T21:49:43.762170+0000","last_became_peered":"2024-05-08T21:49:43.762170+0000","last_unstale":"2024-05-08T21:49:44.927485+0000","last_undegraded":"2024-05-08T21:49:44.927485+0000","last_fullsized":"2024-05-08T21:49:44.927485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:11.503864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.754925+0000","last_change":"2024-05-08T21:49:43.215361+0000","last_active":"2024-05-08T21:49:44.754925+0000","last_peered":"2024-05-08T21:49:44.754925+0000","last_clean":"2024-05-08T21:49:44.754925+0000","last_became_active":"2024-05-08T21:49:43.215162+0000","last_became_peered":"2024-05-08T21:49:43.215162+0000","last_unstale":"2024-05-08T21:49:44.754925+0000","last_undegraded":"2024-05-08T21:49:44.754925+0000","last_fullsized":"2024-05-08T21:49:44.754925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:05:58.875400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927416+0000","last_change":"2024-05-08T21:49:43.757512+0000","last_active":"2024-05-08T21:49:44.927416+0000","last_peered":"2024-05-08T21:49:44.927416+0000","last_clean":"2024-05-08T21:49:44.927416+0000","last_became_active":"2024-05-08T21:49:43.757233+0000","last_became_peered":"2024-05-08T21:49:43.757233+0000","last_unstale":"2024-05-08T21:49:44.927416+0000","last_undegraded":"2024-05-08T21:49:44.927416+0000","last_fullsized":"2024-05-08T21:49:44.927416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:53:14.774835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755100+0000","last_change":"2024-05-08T21:49:43.217935+0000","last_active":"2024-05-08T21:49:44.755100+0000","last_peered":"2024-05-08T21:49:44.755100+0000","last_clean":"2024-05-08T21:49:44.755100+0000","last_became_active":"2024-05-08T21:49:43.217595+0000","last_became_peered":"2024-05-08T21:49:43.217595+0000","last_unstale":"2024-05-08T21:49:44.755100+0000","last_undegraded":"2024-05-08T21:49:44.755100+0000","last_fullsized":"2024-05-08T21:49:44.755100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:38:43.069159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927301+0000","last_change":"2024-05-08T21:49:43.766816+0000","last_active":"2024-05-08T21:49:44.927301+0000","last_peered":"2024-05-08T21:49:44.927301+0000","last_clean":"2024-05-08T21:49:44.927301+0000","last_became_active":"2024-05-08T21:49:43.766596+0000","last_became_peered":"2024-05-08T21:49:43.766596+0000","last_unstale":"2024-05-08T21:49:44.927301+0000","last_undegraded":"2024-05-08T21:49:44.927301+0000","last_fullsized":"2024-05-08T21:49:44.927301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:01:00.614249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.757495+0000","last_change":"2024-05-08T21:49:43.224243+0000","last_active":"2024-05-08T21:49:43.757495+0000","last_peered":"2024-05-08T21:49:43.757495+0000","last_clean":"2024-05-08T21:49:43.757495+0000","last_became_active":"2024-05-08T21:49:43.223974+0000","last_became_peered":"2024-05-08T21:49:43.223974+0000","last_unstale":"2024-05-08T21:49:43.757495+0000","last_undegraded":"2024-05-08T21:49:43.757495+0000","last_fullsized":"2024-05-08T21:49:43.757495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:03.961487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755912+0000","last_change":"2024-05-08T21:49:43.764377+0000","last_active":"2024-05-08T21:49:44.755912+0000","last_peered":"2024-05-08T21:49:44.755912+0000","last_clean":"2024-05-08T21:49:44.755912+0000","last_became_active":"2024-05-08T21:49:43.764075+0000","last_became_peered":"2024-05-08T21:49:43.764075+0000","last_unstale":"2024-05-08T21:49:44.755912+0000","last_undegraded":"2024-05-08T21:49:44.755912+0000","last_fullsized":"2024-05-08T21:49:44.755912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:41:45.602022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.752001+0000","last_change":"2024-05-08T21:49:43.229414+0000","last_active":"2024-05-08T21:49:43.752001+0000","last_peered":"2024-05-08T21:49:43.752001+0000","last_clean":"2024-05-08T21:49:43.752001+0000","last_became_active":"2024-05-08T21:49:43.229121+0000","last_became_peered":"2024-05-08T21:49:43.229121+0000","last_unstale":"2024-05-08T21:49:43.752001+0000","last_undegraded":"2024-05-08T21:49:43.752001+0000","last_fullsized":"2024-05-08T21:49:43.752001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:33:28.074468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927480+0000","last_change":"2024-05-08T21:49:43.774111+0000","last_active":"2024-05-08T21:49:44.927480+0000","last_peered":"2024-05-08T21:49:44.927480+0000","last_clean":"2024-05-08T21:49:44.927480+0000","last_became_active":"2024-05-08T21:49:43.772528+0000","last_became_peered":"2024-05-08T21:49:43.772528+0000","last_unstale":"2024-05-08T21:49:44.927480+0000","last_undegraded":"2024-05-08T21:49:44.927480+0000","last_fullsized":"2024-05-08T21:49:44.927480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:28.983476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:46.015933+0000","last_change":"2024-05-08T21:49:43.208581+0000","last_active":"2024-05-08T21:49:46.015933+0000","last_peered":"2024-05-08T21:49:46.015933+0000","last_clean":"2024-05-08T21:49:46.015933+0000","last_became_active":"2024-05-08T21:49:43.208326+0000","last_became_peered":"2024-05-08T21:49:43.208326+0000","last_unstale":"2024-05-08T21:49:46.015933+0000","last_undegraded":"2024-05-08T21:49:46.015933+0000","last_fullsized":"2024-05-08T21:49:46.015933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:13:35.461791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756911+0000","last_change":"2024-05-08T21:49:43.766519+0000","last_active":"2024-05-08T21:49:44.756911+0000","last_peered":"2024-05-08T21:49:44.756911+0000","last_clean":"2024-05-08T21:49:44.756911+0000","last_became_active":"2024-05-08T21:49:43.765789+0000","last_became_peered":"2024-05-08T21:49:43.765789+0000","last_unstale":"2024-05-08T21:49:44.756911+0000","last_undegraded":"2024-05-08T21:49:44.756911+0000","last_fullsized":"2024-05-08T21:49:44.756911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:23.674986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.752048+0000","last_change":"2024-05-08T21:49:43.218079+0000","last_active":"2024-05-08T21:49:43.752048+0000","last_peered":"2024-05-08T21:49:43.752048+0000","last_clean":"2024-05-08T21:49:43.752048+0000","last_became_active":"2024-05-08T21:49:43.217814+0000","last_became_peered":"2024-05-08T21:49:43.217814+0000","last_unstale":"2024-05-08T21:49:43.752048+0000","last_undegraded":"2024-05-08T21:49:43.752048+0000","last_fullsized":"2024-05-08T21:49:43.752048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:18:58.164159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.928456+0000","last_change":"2024-05-08T21:49:43.775713+0000","last_active":"2024-05-08T21:49:44.928456+0000","last_peered":"2024-05-08T21:49:44.928456+0000","last_clean":"2024-05-08T21:49:44.928456+0000","last_became_active":"2024-05-08T21:49:43.775361+0000","last_became_peered":"2024-05-08T21:49:43.775361+0000","last_unstale":"2024-05-08T21:49:44.928456+0000","last_undegraded":"2024-05-08T21:49:44.928456+0000","last_fullsized":"2024-05-08T21:49:44.928456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:48:24.482146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755727+0000","last_change":"2024-05-08T21:49:43.767129+0000","last_active":"2024-05-08T21:49:44.755727+0000","last_peered":"2024-05-08T21:49:44.755727+0000","last_clean":"2024-05-08T21:49:44.755727+0000","last_became_active":"2024-05-08T21:49:43.766789+0000","last_became_peered":"2024-05-08T21:49:43.766789+0000","last_unstale":"2024-05-08T21:49:44.755727+0000","last_undegraded":"2024-05-08T21:49:44.755727+0000","last_fullsized":"2024-05-08T21:49:44.755727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:39.954320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927246+0000","last_change":"2024-05-08T21:49:43.766157+0000","last_active":"2024-05-08T21:49:44.927246+0000","last_peered":"2024-05-08T21:49:44.927246+0000","last_clean":"2024-05-08T21:49:44.927246+0000","last_became_active":"2024-05-08T21:49:43.765843+0000","last_became_peered":"2024-05-08T21:49:43.765843+0000","last_unstale":"2024-05-08T21:49:44.927246+0000","last_undegraded":"2024-05-08T21:49:44.927246+0000","last_fullsized":"2024-05-08T21:49:44.927246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:04.968184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757080+0000","last_change":"2024-05-08T21:49:43.768929+0000","last_active":"2024-05-08T21:49:44.757080+0000","last_peered":"2024-05-08T21:49:44.757080+0000","last_clean":"2024-05-08T21:49:44.757080+0000","last_became_active":"2024-05-08T21:49:43.767606+0000","last_became_peered":"2024-05-08T21:49:43.767606+0000","last_unstale":"2024-05-08T21:49:44.757080+0000","last_undegraded":"2024-05-08T21:49:44.757080+0000","last_fullsized":"2024-05-08T21:49:44.757080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:13:06.426154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927158+0000","last_change":"2024-05-08T21:49:43.774673+0000","last_active":"2024-05-08T21:49:44.927158+0000","last_peered":"2024-05-08T21:49:44.927158+0000","last_clean":"2024-05-08T21:49:44.927158+0000","last_became_active":"2024-05-08T21:49:43.774406+0000","last_became_peered":"2024-05-08T21:49:43.774406+0000","last_unstale":"2024-05-08T21:49:44.927158+0000","last_undegraded":"2024-05-08T21:49:44.927158+0000","last_fullsized":"2024-05-08T21:49:44.927158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:43.798909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927659+0000","last_change":"2024-05-08T21:49:43.764222+0000","last_active":"2024-05-08T21:49:44.927659+0000","last_peered":"2024-05-08T21:49:44.927659+0000","last_clean":"2024-05-08T21:49:44.927659+0000","last_became_active":"2024-05-08T21:49:43.763937+0000","last_became_peered":"2024-05-08T21:49:43.763937+0000","last_unstale":"2024-05-08T21:49:44.927659+0000","last_undegraded":"2024-05-08T21:49:44.927659+0000","last_fullsized":"2024-05-08T21:49:44.927659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:04:14.416894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755114+0000","last_change":"2024-05-08T21:49:43.757318+0000","last_active":"2024-05-08T21:49:44.755114+0000","last_peered":"2024-05-08T21:49:44.755114+0000","last_clean":"2024-05-08T21:49:44.755114+0000","last_became_active":"2024-05-08T21:49:43.757083+0000","last_became_peered":"2024-05-08T21:49:43.757083+0000","last_unstale":"2024-05-08T21:49:44.755114+0000","last_undegraded":"2024-05-08T21:49:44.755114+0000","last_fullsized":"2024-05-08T21:49:44.755114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:47.551474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756302+0000","last_change":"2024-05-08T21:49:43.773491+0000","last_active":"2024-05-08T21:49:44.756302+0000","last_peered":"2024-05-08T21:49:44.756302+0000","last_clean":"2024-05-08T21:49:44.756302+0000","last_became_active":"2024-05-08T21:49:43.773203+0000","last_became_peered":"2024-05-08T21:49:43.773203+0000","last_unstale":"2024-05-08T21:49:44.756302+0000","last_undegraded":"2024-05-08T21:49:44.756302+0000","last_fullsized":"2024-05-08T21:49:44.756302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:53:14.774835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927776+0000","last_change":"2024-05-08T21:49:43.761926+0000","last_active":"2024-05-08T21:49:44.927776+0000","last_peered":"2024-05-08T21:49:44.927776+0000","last_clean":"2024-05-08T21:49:44.927776+0000","last_became_active":"2024-05-08T21:49:43.761645+0000","last_became_peered":"2024-05-08T21:49:43.761645+0000","last_unstale":"2024-05-08T21:49:44.927776+0000","last_undegraded":"2024-05-08T21:49:44.927776+0000","last_fullsized":"2024-05-08T21:49:44.927776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:10:07.209965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756761+0000","last_change":"2024-05-08T21:49:43.768942+0000","last_active":"2024-05-08T21:49:44.756761+0000","last_peered":"2024-05-08T21:49:44.756761+0000","last_clean":"2024-05-08T21:49:44.756761+0000","last_became_active":"2024-05-08T21:49:43.768673+0000","last_became_peered":"2024-05-08T21:49:43.768673+0000","last_unstale":"2024-05-08T21:49:44.756761+0000","last_undegraded":"2024-05-08T21:49:44.756761+0000","last_fullsized":"2024-05-08T21:49:44.756761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:15:41.869107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927592+0000","last_change":"2024-05-08T21:49:43.766452+0000","last_active":"2024-05-08T21:49:44.927592+0000","last_peered":"2024-05-08T21:49:44.927592+0000","last_clean":"2024-05-08T21:49:44.927592+0000","last_became_active":"2024-05-08T21:49:43.765723+0000","last_became_peered":"2024-05-08T21:49:43.765723+0000","last_unstale":"2024-05-08T21:49:44.927592+0000","last_undegraded":"2024-05-08T21:49:44.927592+0000","last_fullsized":"2024-05-08T21:49:44.927592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:19:28.925404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756863+0000","last_change":"2024-05-08T21:49:43.775098+0000","last_active":"2024-05-08T21:49:44.756863+0000","last_peered":"2024-05-08T21:49:44.756863+0000","last_clean":"2024-05-08T21:49:44.756863+0000","last_became_active":"2024-05-08T21:49:43.774808+0000","last_became_peered":"2024-05-08T21:49:43.774808+0000","last_unstale":"2024-05-08T21:49:44.756863+0000","last_undegraded":"2024-05-08T21:49:44.756863+0000","last_fullsized":"2024-05-08T21:49:44.756863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:51:15.152611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927076+0000","last_change":"2024-05-08T21:49:43.775129+0000","last_active":"2024-05-08T21:49:44.927076+0000","last_peered":"2024-05-08T21:49:44.927076+0000","last_clean":"2024-05-08T21:49:44.927076+0000","last_became_active":"2024-05-08T21:49:43.774881+0000","last_became_peered":"2024-05-08T21:49:43.774881+0000","last_unstale":"2024-05-08T21:49:44.927076+0000","last_undegraded":"2024-05-08T21:49:44.927076+0000","last_fullsized":"2024-05-08T21:49:44.927076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:19:28.925404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756057+0000","last_change":"2024-05-08T21:49:43.764163+0000","last_active":"2024-05-08T21:49:44.756057+0000","last_peered":"2024-05-08T21:49:44.756057+0000","last_clean":"2024-05-08T21:49:44.756057+0000","last_became_active":"2024-05-08T21:49:43.763907+0000","last_became_peered":"2024-05-08T21:49:43.763907+0000","last_unstale":"2024-05-08T21:49:44.756057+0000","last_undegraded":"2024-05-08T21:49:44.756057+0000","last_fullsized":"2024-05-08T21:49:44.756057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:01:00.614249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":160,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":802816,"data_stored":663457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]}]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":208896,"data_stored":73089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":212992,"data_stored":73179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":217088,"data_stored":73249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.247}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]}]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":802816,"data_stored":663457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":208896,"data_stored":73089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]}]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":208896,"data_stored":73089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]}]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":208896,"data_stored":73089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T21:49:53.852 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-05-08T21:49:53.852 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-08T21:49:53.852 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-05-08T21:49:53.852 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-05-08T21:49:53.853 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-05-08T21:49:54.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.008+0000 7f85e69a9700 1 Processor -- start 2024-05-08T21:49:54.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.009+0000 7f85e69a9700 1 -- start start 2024-05-08T21:49:54.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.009+0000 7f85e69a9700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f85e0072080 0x7f85e0072460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:54.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.009+0000 7f85e69a9700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f85e00c3490 0x7f85e0156dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:54.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.009+0000 7f85e69a9700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85e00c3f10 con 0x7f85e00c3a00 2024-05-08T21:49:54.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.009+0000 7f85e69a9700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85e00729a0 con 0x7f85e0072080 2024-05-08T21:49:54.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.009+0000 7f85e69a9700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85e00c41b0 con 0x7f85e00c3490 2024-05-08T21:49:54.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.009+0000 7f85dffff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f85e0072080 0x7f85e0072460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:54.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.009+0000 7f85e4f46700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f85e00c3a00 0x7f85e0159f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:51740/0 (socket says 172.21.15.73:51740) 2024-05-08T21:49:54.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.009+0000 7f85e4f46700 1 -- 172.21.15.73:0/1047622895 learned_addr learned my addr 172.21.15.73:0/1047622895 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:49:54.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.010+0000 7f85df7fe700 1 --2- 172.21.15.73:0/1047622895 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f85e00c3490 0x7f85e0156dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:54.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.010+0000 7f85dffff700 1 -- 172.21.15.73:0/1047622895 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f85e00c3490 msgr2=0x7f85e0156dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:54.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.010+0000 7f85dffff700 1 --2- 172.21.15.73:0/1047622895 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f85e00c3490 0x7f85e0156dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:54.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.010+0000 7f85dffff700 1 -- 172.21.15.73:0/1047622895 >> v1:172.21.15.73:6789/0 conn(0x7f85e00c3a00 legacy=0x7f85e0159f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:54.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.010+0000 7f85dffff700 1 -- 172.21.15.73:0/1047622895 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e00c7820 con 0x7f85e0072080 2024-05-08T21:49:54.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.010+0000 7f85deffd700 1 -- 172.21.15.73:0/1047622895 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1175360266 0 0) 0x7f85e00c3f10 con 0x7f85e00c3a00 2024-05-08T21:49:54.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.010+0000 7f85dffff700 1 --2- 172.21.15.73:0/1047622895 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85e0072080 0x7f85e0072460 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f85d4009840 tx=0x7f85d4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad49ff76f5230ce server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:54.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.010+0000 7f85deffd700 1 -- 172.21.15.73:0/1047622895 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d4011830 con 0x7f85e0072080 2024-05-08T21:49:54.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.010+0000 7f85deffd700 1 -- 172.21.15.73:0/1047622895 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85d4011990 con 0x7f85e0072080 2024-05-08T21:49:54.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.010+0000 7f85deffd700 1 -- 172.21.15.73:0/1047622895 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d4011d20 con 0x7f85e0072080 2024-05-08T21:49:54.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.010+0000 7f85e69a9700 1 -- 172.21.15.73:0/1047622895 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85e0072080 msgr2=0x7f85e0072460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:54.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.010+0000 7f85e69a9700 1 --2- 172.21.15.73:0/1047622895 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85e0072080 0x7f85e0072460 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f85d4009840 tx=0x7f85d4009b50 comp rx=0 tx=0).stop 2024-05-08T21:49:54.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.010+0000 7f85e69a9700 1 -- 172.21.15.73:0/1047622895 shutdown_connections 2024-05-08T21:49:54.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.011+0000 7f85e69a9700 1 --2- 172.21.15.73:0/1047622895 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85e0072080 0x7f85e0072460 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:54.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.011+0000 7f85e69a9700 1 --2- 172.21.15.73:0/1047622895 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f85e00c3490 0x7f85e0156dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:54.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.011+0000 7f85e69a9700 1 -- 172.21.15.73:0/1047622895 >> 172.21.15.73:0/1047622895 conn(0x7f85e0066d70 msgr2=0x7f85e00cc500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:54.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.011+0000 7f85e69a9700 1 -- 172.21.15.73:0/1047622895 shutdown_connections 2024-05-08T21:49:54.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.011+0000 7f85e69a9700 1 -- 172.21.15.73:0/1047622895 wait complete. 2024-05-08T21:49:54.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.012+0000 7f85e69a9700 1 Processor -- start 2024-05-08T21:49:54.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.012+0000 7f85e69a9700 1 -- start start 2024-05-08T21:49:54.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.013+0000 7f85e69a9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85e0072080 0x7f85e01f1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:54.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.013+0000 7f85e69a9700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85e00c3490 0x7f85e01ed500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:54.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.013+0000 7f85e69a9700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f85e00c3a00 0x7f85e01e2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:54.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.013+0000 7f85e69a9700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e01f0b10 con 0x7f85e0072080 2024-05-08T21:49:54.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.013+0000 7f85e69a9700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e0154760 con 0x7f85e00c3490 2024-05-08T21:49:54.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.013+0000 7f85e69a9700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85e014a8a0 con 0x7f85e00c3a00 2024-05-08T21:49:54.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.013+0000 7f85dffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85e0072080 0x7f85e01f1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:54.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.013+0000 7f85dffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85e0072080 0x7f85e01f1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38800/0 (socket says 172.21.15.73:38800) 2024-05-08T21:49:54.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.013+0000 7f85dffff700 1 -- 172.21.15.73:0/1152970991 learned_addr learned my addr 172.21.15.73:0/1152970991 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:54.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.013+0000 7f85df7fe700 1 --2- 172.21.15.73:0/1152970991 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85e00c3490 0x7f85e01ed500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:54.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.013+0000 7f85e4f46700 1 --2- 172.21.15.73:0/1152970991 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f85e00c3a00 0x7f85e01e2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:54.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.013+0000 7f85dffff700 1 -- 172.21.15.73:0/1152970991 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f85e00c3a00 msgr2=0x7f85e01e2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:54.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.013+0000 7f85dffff700 1 --2- 172.21.15.73:0/1152970991 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f85e00c3a00 0x7f85e01e2ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:54.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.013+0000 7f85dffff700 1 -- 172.21.15.73:0/1152970991 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85e00c3490 msgr2=0x7f85e01ed500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:54.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.013+0000 7f85dffff700 1 --2- 172.21.15.73:0/1152970991 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85e00c3490 0x7f85e01ed500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:54.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.013+0000 7f85dffff700 1 -- 172.21.15.73:0/1152970991 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85d40094a0 con 0x7f85e0072080 2024-05-08T21:49:54.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.013+0000 7f85df7fe700 1 --2- 172.21.15.73:0/1152970991 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85e00c3490 0x7f85e01ed500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:49:54.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.013+0000 7f85dffff700 1 --2- 172.21.15.73:0/1152970991 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85e0072080 0x7f85e01f1580 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f85d4000c00 tx=0x7f85d4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:54.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.013+0000 7f85dcff9700 1 -- 172.21.15.73:0/1152970991 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d40045f0 con 0x7f85e0072080 2024-05-08T21:49:54.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.013+0000 7f85dcff9700 1 -- 172.21.15.73:0/1152970991 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85d401f070 con 0x7f85e0072080 2024-05-08T21:49:54.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.013+0000 7f85e69a9700 1 -- 172.21.15.73:0/1152970991 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85e014ab60 con 0x7f85e0072080 2024-05-08T21:49:54.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.013+0000 7f85dcff9700 1 -- 172.21.15.73:0/1152970991 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d4003ae0 con 0x7f85e0072080 2024-05-08T21:49:54.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.013+0000 7f85e69a9700 1 -- 172.21.15.73:0/1152970991 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85e01f1060 con 0x7f85e0072080 2024-05-08T21:49:54.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.014+0000 7f85e69a9700 1 -- 172.21.15.73:0/1152970991 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85e0068b80 con 0x7f85e0072080 2024-05-08T21:49:54.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.015+0000 7f85dcff9700 1 -- 172.21.15.73:0/1152970991 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f85d4003c40 con 0x7f85e0072080 2024-05-08T21:49:54.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.015+0000 7f85dcff9700 1 --2- 172.21.15.73:0/1152970991 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f85cc06ac90 0x7f85cc06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:54.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.015+0000 7f85df7fe700 1 --2- 172.21.15.73:0/1152970991 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f85cc06ac90 0x7f85cc06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:54.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.015+0000 7f85dcff9700 1 -- 172.21.15.73:0/1152970991 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f85d4021070 con 0x7f85e0072080 2024-05-08T21:49:54.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.015+0000 7f85df7fe700 1 --2- 172.21.15.73:0/1152970991 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f85cc06ac90 0x7f85cc06d150 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f85e014ef20 tx=0x7f85d0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:54.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.020+0000 7f85dcff9700 1 -- 172.21.15.73:0/1152970991 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f85d4090020 con 0x7f85e0072080 2024-05-08T21:49:54.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.277+0000 7f85e69a9700 1 -- 172.21.15.73:0/1152970991 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f85e0072c30 con 0x7f85e0072080 2024-05-08T21:49:54.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.279+0000 7f85dcff9700 1 -- 172.21.15.73:0/1152970991 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+170937 (secure 0 0 0) 0x7f85d4015070 con 0x7f85e0072080 2024-05-08T21:49:54.282 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:49:54.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.282+0000 7f85e69a9700 1 -- 172.21.15.73:0/1152970991 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f85cc06ac90 msgr2=0x7f85cc06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:54.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.282+0000 7f85e69a9700 1 --2- 172.21.15.73:0/1152970991 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f85cc06ac90 0x7f85cc06d150 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f85e014ef20 tx=0x7f85d0008040 comp rx=0 tx=0).stop 2024-05-08T21:49:54.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.282+0000 7f85e69a9700 1 -- 172.21.15.73:0/1152970991 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85e0072080 msgr2=0x7f85e01f1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:54.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.282+0000 7f85e69a9700 1 --2- 172.21.15.73:0/1152970991 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85e0072080 0x7f85e01f1580 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f85d4000c00 tx=0x7f85d4004750 comp rx=0 tx=0).stop 2024-05-08T21:49:54.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.282+0000 7f85e69a9700 1 -- 172.21.15.73:0/1152970991 shutdown_connections 2024-05-08T21:49:54.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.282+0000 7f85e69a9700 1 --2- 172.21.15.73:0/1152970991 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f85cc06ac90 0x7f85cc06d150 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:54.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.282+0000 7f85e69a9700 1 --2- 172.21.15.73:0/1152970991 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f85e00c3a00 0x7f85e01e2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:54.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.282+0000 7f85e69a9700 1 --2- 172.21.15.73:0/1152970991 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85e0072080 0x7f85e01f1580 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:54.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.282+0000 7f85e69a9700 1 --2- 172.21.15.73:0/1152970991 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85e00c3490 0x7f85e01ed500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:54.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.282+0000 7f85e69a9700 1 -- 172.21.15.73:0/1152970991 >> 172.21.15.73:0/1152970991 conn(0x7f85e0066d70 msgr2=0x7f85e00c8fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:54.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.282+0000 7f85e69a9700 1 -- 172.21.15.73:0/1152970991 shutdown_connections 2024-05-08T21:49:54.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.282+0000 7f85e69a9700 1 -- 172.21.15.73:0/1152970991 wait complete. 2024-05-08T21:49:54.295 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":5,"flags":0,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":46949},{"type":"v1","addr":"172.21.15.73:6833","nonce":46949}]},"active_addr":"172.21.15.73:6833/46949","active_change":"2024-05-08T21:49:31.941485+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4105,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":2115500931}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":3327735436}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":1762566321}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":2134329430}]}]} 2024-05-08T21:49:54.299 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-05-08T21:49:54.299 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-08T21:49:54.299 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T21:49:54.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.419+0000 7f161bd37700 1 Processor -- start 2024-05-08T21:49:54.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.419+0000 7f161bd37700 1 -- start start 2024-05-08T21:49:54.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.420+0000 7f161bd37700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f16141587e0 0x7f16140b3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:54.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.420+0000 7f161bd37700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1614157b70 0x7f16140b1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:54.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.420+0000 7f161bd37700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16140b36b0 con 0x7f16140c7700 2024-05-08T21:49:54.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.420+0000 7f161bd37700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16140b10e0 con 0x7f1614157b70 2024-05-08T21:49:54.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.420+0000 7f161bd37700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16140c82f0 con 0x7f16141587e0 2024-05-08T21:49:54.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.420+0000 7f161a2d4700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f16140c7700 0x7f16140c8880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:51752/0 (socket says 172.21.15.73:51752) 2024-05-08T21:49:54.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.420+0000 7f161a2d4700 1 -- 172.21.15.73:0/715380740 learned_addr learned my addr 172.21.15.73:0/715380740 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:49:54.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.420+0000 7f16192d2700 1 --2- 172.21.15.73:0/715380740 >> v2:172.21.15.115:3300/0 conn(0x7f1614157b70 0x7f16140b1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:54.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.420+0000 7f1619ad3700 1 --2- 172.21.15.73:0/715380740 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f16141587e0 0x7f16140b3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:54.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.420+0000 7f1618ad1700 1 -- 172.21.15.73:0/715380740 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1900587937 0 0) 0x7f160c001490 con 0x7f16140c7700 2024-05-08T21:49:54.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.420+0000 7f1618ad1700 1 -- 172.21.15.73:0/715380740 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16000035b0 con 0x7f16140c7700 2024-05-08T21:49:54.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.420+0000 7f16192d2700 1 -- 172.21.15.73:0/715380740 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f16141587e0 msgr2=0x7f16140b3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:54.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.420+0000 7f16192d2700 1 --2- 172.21.15.73:0/715380740 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f16141587e0 0x7f16140b3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:54.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.420+0000 7f16192d2700 1 -- 172.21.15.73:0/715380740 >> v1:172.21.15.73:6789/0 conn(0x7f16140c7700 legacy=0x7f16140c8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:54.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.420+0000 7f16192d2700 1 -- 172.21.15.73:0/715380740 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16140c9eb0 con 0x7f1614157b70 2024-05-08T21:49:54.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.420+0000 7f1619ad3700 1 --2- 172.21.15.73:0/715380740 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f16141587e0 0x7f16140b3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:49:54.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.420+0000 7f16192d2700 1 --2- 172.21.15.73:0/715380740 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1614157b70 0x7f16140b1570 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1604009870 tx=0x7f1604009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bce778f00dced5fb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:54.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.421+0000 7f1618ad1700 1 -- 172.21.15.73:0/715380740 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1604011830 con 0x7f1614157b70 2024-05-08T21:49:54.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.421+0000 7f1618ad1700 1 -- 172.21.15.73:0/715380740 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1604011990 con 0x7f1614157b70 2024-05-08T21:49:54.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.421+0000 7f1618ad1700 1 -- 172.21.15.73:0/715380740 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1604011d00 con 0x7f1614157b70 2024-05-08T21:49:54.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.421+0000 7f161bd37700 1 -- 172.21.15.73:0/715380740 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1614157b70 msgr2=0x7f16140b1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:54.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.421+0000 7f161bd37700 1 --2- 172.21.15.73:0/715380740 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1614157b70 0x7f16140b1570 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1604009870 tx=0x7f1604009b80 comp rx=0 tx=0).stop 2024-05-08T21:49:54.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.421+0000 7f161bd37700 1 -- 172.21.15.73:0/715380740 shutdown_connections 2024-05-08T21:49:54.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.421+0000 7f161bd37700 1 --2- 172.21.15.73:0/715380740 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f16141587e0 0x7f16140b3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:54.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.421+0000 7f161bd37700 1 --2- 172.21.15.73:0/715380740 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1614157b70 0x7f16140b1570 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:54.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.421+0000 7f161bd37700 1 -- 172.21.15.73:0/715380740 >> 172.21.15.73:0/715380740 conn(0x7f1614070600 msgr2=0x7f1614070a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:54.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.421+0000 7f161bd37700 1 -- 172.21.15.73:0/715380740 shutdown_connections 2024-05-08T21:49:54.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.421+0000 7f161bd37700 1 -- 172.21.15.73:0/715380740 wait complete. 2024-05-08T21:49:54.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.422+0000 7f161bd37700 1 Processor -- start 2024-05-08T21:49:54.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.422+0000 7f161bd37700 1 -- start start 2024-05-08T21:49:54.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.423+0000 7f161bd37700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f16140c7700 0x7f16141ed6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:54.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.423+0000 7f161bd37700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1614157b70 0x7f161414f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:54.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.423+0000 7f161bd37700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16141587e0 0x7f16140cbb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:54.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.423+0000 7f161bd37700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16141498c0 con 0x7f16141587e0 2024-05-08T21:49:54.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.423+0000 7f161bd37700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f161414b650 con 0x7f1614157b70 2024-05-08T21:49:54.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.423+0000 7f161bd37700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f161414b930 con 0x7f16140c7700 2024-05-08T21:49:54.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.423+0000 7f161a2d4700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16141587e0 0x7f16140cbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:54.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.423+0000 7f161a2d4700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16141587e0 0x7f16140cbb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38816/0 (socket says 172.21.15.73:38816) 2024-05-08T21:49:54.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.423+0000 7f161a2d4700 1 -- 172.21.15.73:0/3687126586 learned_addr learned my addr 172.21.15.73:0/3687126586 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:54.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.423+0000 7f161a2d4700 1 -- 172.21.15.73:0/3687126586 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f16140c7700 msgr2=0x7f16141ed6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:54.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.423+0000 7f161a2d4700 1 --2- 172.21.15.73:0/3687126586 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f16140c7700 0x7f16141ed6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:54.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.423+0000 7f161a2d4700 1 -- 172.21.15.73:0/3687126586 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1614157b70 msgr2=0x7f161414f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:54.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.423+0000 7f16192d2700 1 --2- 172.21.15.73:0/3687126586 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1614157b70 0x7f161414f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:54.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.423+0000 7f161a2d4700 1 --2- 172.21.15.73:0/3687126586 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1614157b70 0x7f161414f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:54.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.423+0000 7f161a2d4700 1 -- 172.21.15.73:0/3687126586 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16100094a0 con 0x7f16141587e0 2024-05-08T21:49:54.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.424+0000 7f161a2d4700 1 --2- 172.21.15.73:0/3687126586 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16141587e0 0x7f16140cbb50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f160c00cae0 tx=0x7f160c00cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:54.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.424+0000 7f160a7fc700 1 -- 172.21.15.73:0/3687126586 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160c00aa80 con 0x7f16141587e0 2024-05-08T21:49:54.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.424+0000 7f160a7fc700 1 -- 172.21.15.73:0/3687126586 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f160c00abe0 con 0x7f16141587e0 2024-05-08T21:49:54.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.424+0000 7f160a7fc700 1 -- 172.21.15.73:0/3687126586 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160c012400 con 0x7f16141587e0 2024-05-08T21:49:54.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.424+0000 7f161bd37700 1 -- 172.21.15.73:0/3687126586 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16040094a0 con 0x7f16141587e0 2024-05-08T21:49:54.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.424+0000 7f161bd37700 1 -- 172.21.15.73:0/3687126586 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f161414bef0 con 0x7f16141587e0 2024-05-08T21:49:54.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.425+0000 7f161bd37700 1 -- 172.21.15.73:0/3687126586 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f161406b6c0 con 0x7f16141587e0 2024-05-08T21:49:54.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.425+0000 7f160a7fc700 1 -- 172.21.15.73:0/3687126586 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f160c01b3b0 con 0x7f16141587e0 2024-05-08T21:49:54.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.425+0000 7f160a7fc700 1 --2- 172.21.15.73:0/3687126586 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f15f806ac90 0x7f15f806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:54.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.426+0000 7f1619ad3700 1 --2- 172.21.15.73:0/3687126586 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f15f806ac90 0x7f15f806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:54.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.426+0000 7f160a7fc700 1 -- 172.21.15.73:0/3687126586 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f160c088ec0 con 0x7f16141587e0 2024-05-08T21:49:54.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.426+0000 7f1619ad3700 1 --2- 172.21.15.73:0/3687126586 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f15f806ac90 0x7f15f806d150 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1610006f10 tx=0x7f1610006e60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:54.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.430+0000 7f160a7fc700 1 -- 172.21.15.73:0/3687126586 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f160c0540a0 con 0x7f16141587e0 2024-05-08T21:49:54.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.625+0000 7f161bd37700 1 -- 172.21.15.73:0/3687126586 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f16140b36b0 con 0x7f16141587e0 2024-05-08T21:49:54.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.626+0000 7f160a7fc700 1 -- 172.21.15.73:0/3687126586 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16037 (secure 0 0 0) 0x7f16140b36b0 con 0x7f16141587e0 2024-05-08T21:49:54.627 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:49:54.627 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":21,"fsid":"143164b7-c9c7-4737-a494-7dafa5a3320c","created":"2024-05-08T21:49:26.221909+0000","modified":"2024-05-08T21:49:44.748794+0000","last_up_change":"2024-05-08T21:49:37.118386+0000","last_in_change":"2024-05-08T21:49:28.836944+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T21:49:35.998578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T21:49:42.171760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T21:49:42.576293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6b7439c1-daaa-44af-8333-a455f9e9dc67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":47228},{"type":"v1","addr":"172.21.15.73:6809","nonce":47228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":47228},{"type":"v1","addr":"172.21.15.73:6811","nonce":47228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":47228},{"type":"v1","addr":"172.21.15.73:6815","nonce":47228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":47228},{"type":"v1","addr":"172.21.15.73:6813","nonce":47228}]},"public_addr":"172.21.15.73:6809/47228","cluster_addr":"172.21.15.73:6811/47228","heartbeat_back_addr":"172.21.15.73:6815/47228","heartbeat_front_addr":"172.21.15.73:6813/47228","state":["exists","up"]},{"osd":1,"uuid":"fb67886a-d7f7-45ac-832f-36c871c8a208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":47227},{"type":"v1","addr":"172.21.15.73:6801","nonce":47227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":47227},{"type":"v1","addr":"172.21.15.73:6803","nonce":47227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":47227},{"type":"v1","addr":"172.21.15.73:6807","nonce":47227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":47227},{"type":"v1","addr":"172.21.15.73:6805","nonce":47227}]},"public_addr":"172.21.15.73:6801/47227","cluster_addr":"172.21.15.73:6803/47227","heartbeat_back_addr":"172.21.15.73:6807/47227","heartbeat_front_addr":"172.21.15.73:6805/47227","state":["exists","up"]},{"osd":2,"uuid":"a5cd6e98-6621-473a-bfb8-5c648abbb563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":47229},{"type":"v1","addr":"172.21.15.73:6817","nonce":47229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":47229},{"type":"v1","addr":"172.21.15.73:6819","nonce":47229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":47229},{"type":"v1","addr":"172.21.15.73:6823","nonce":47229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":47229},{"type":"v1","addr":"172.21.15.73:6821","nonce":47229}]},"public_addr":"172.21.15.73:6817/47229","cluster_addr":"172.21.15.73:6819/47229","heartbeat_back_addr":"172.21.15.73:6823/47229","heartbeat_front_addr":"172.21.15.73:6821/47229","state":["exists","up"]},{"osd":3,"uuid":"36927c20-4241-4f3b-91b5-a6a6f27598e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":47232},{"type":"v1","addr":"172.21.15.73:6825","nonce":47232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":47232},{"type":"v1","addr":"172.21.15.73:6827","nonce":47232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":47232},{"type":"v1","addr":"172.21.15.73:6831","nonce":47232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":47232},{"type":"v1","addr":"172.21.15.73:6829","nonce":47232}]},"public_addr":"172.21.15.73:6825/47232","cluster_addr":"172.21.15.73:6827/47232","heartbeat_back_addr":"172.21.15.73:6831/47232","heartbeat_front_addr":"172.21.15.73:6829/47232","state":["exists","up"]},{"osd":4,"uuid":"4ebe0a18-8216-4815-878a-39c39a6cd3fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":47200},{"type":"v1","addr":"172.21.15.115:6801","nonce":47200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":47200},{"type":"v1","addr":"172.21.15.115:6803","nonce":47200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":47200},{"type":"v1","addr":"172.21.15.115:6807","nonce":47200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":47200},{"type":"v1","addr":"172.21.15.115:6805","nonce":47200}]},"public_addr":"172.21.15.115:6801/47200","cluster_addr":"172.21.15.115:6803/47200","heartbeat_back_addr":"172.21.15.115:6807/47200","heartbeat_front_addr":"172.21.15.115:6805/47200","state":["exists","up"]},{"osd":5,"uuid":"957f0ac1-5f26-4f02-8c05-488e6b67ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":47201},{"type":"v1","addr":"172.21.15.115:6809","nonce":47201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":47201},{"type":"v1","addr":"172.21.15.115:6811","nonce":47201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":47201},{"type":"v1","addr":"172.21.15.115:6815","nonce":47201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":47201},{"type":"v1","addr":"172.21.15.115:6813","nonce":47201}]},"public_addr":"172.21.15.115:6809/47201","cluster_addr":"172.21.15.115:6811/47201","heartbeat_back_addr":"172.21.15.115:6815/47201","heartbeat_front_addr":"172.21.15.115:6813/47201","state":["exists","up"]},{"osd":6,"uuid":"f5a6768f-ba7f-4f66-b335-0c303b158e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":47202},{"type":"v1","addr":"172.21.15.115:6817","nonce":47202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":47202},{"type":"v1","addr":"172.21.15.115:6819","nonce":47202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":47202},{"type":"v1","addr":"172.21.15.115:6823","nonce":47202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":47202},{"type":"v1","addr":"172.21.15.115:6821","nonce":47202}]},"public_addr":"172.21.15.115:6817/47202","cluster_addr":"172.21.15.115:6819/47202","heartbeat_back_addr":"172.21.15.115:6823/47202","heartbeat_front_addr":"172.21.15.115:6821/47202","state":["exists","up"]},{"osd":7,"uuid":"f4187743-f9e6-42e6-aca9-0604a58db1ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":47211},{"type":"v1","addr":"172.21.15.115:6825","nonce":47211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":47211},{"type":"v1","addr":"172.21.15.115:6827","nonce":47211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":47211},{"type":"v1","addr":"172.21.15.115:6831","nonce":47211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":47211},{"type":"v1","addr":"172.21.15.115:6829","nonce":47211}]},"public_addr":"172.21.15.115:6825/47211","cluster_addr":"172.21.15.115:6827/47211","heartbeat_back_addr":"172.21.15.115:6831/47211","heartbeat_front_addr":"172.21.15.115:6829/47211","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:33.996335+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:33.687451+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:34.072549+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:33.997588+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:34.047260+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:34.876272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:33.965472+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:34.038637+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T21:49:54.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.628+0000 7f161bd37700 1 -- 172.21.15.73:0/3687126586 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f15f806ac90 msgr2=0x7f15f806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:54.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.628+0000 7f161bd37700 1 --2- 172.21.15.73:0/3687126586 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f15f806ac90 0x7f15f806d150 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1610006f10 tx=0x7f1610006e60 comp rx=0 tx=0).stop 2024-05-08T21:49:54.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.628+0000 7f161bd37700 1 -- 172.21.15.73:0/3687126586 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16141587e0 msgr2=0x7f16140cbb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:54.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.628+0000 7f161bd37700 1 --2- 172.21.15.73:0/3687126586 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16141587e0 0x7f16140cbb50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f160c00cae0 tx=0x7f160c00cea0 comp rx=0 tx=0).stop 2024-05-08T21:49:54.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.628+0000 7f161bd37700 1 -- 172.21.15.73:0/3687126586 shutdown_connections 2024-05-08T21:49:54.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.628+0000 7f161bd37700 1 --2- 172.21.15.73:0/3687126586 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f15f806ac90 0x7f15f806d150 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:54.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.628+0000 7f161bd37700 1 --2- 172.21.15.73:0/3687126586 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16141587e0 0x7f16140cbb50 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:54.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.628+0000 7f161bd37700 1 --2- 172.21.15.73:0/3687126586 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f16140c7700 0x7f16141ed6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:54.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.628+0000 7f161bd37700 1 --2- 172.21.15.73:0/3687126586 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1614157b70 0x7f161414f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:54.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.628+0000 7f161bd37700 1 -- 172.21.15.73:0/3687126586 >> 172.21.15.73:0/3687126586 conn(0x7f1614070600 msgr2=0x7f1614156450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:54.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.628+0000 7f161bd37700 1 -- 172.21.15.73:0/3687126586 shutdown_connections 2024-05-08T21:49:54.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.628+0000 7f161bd37700 1 -- 172.21.15.73:0/3687126586 wait complete. 2024-05-08T21:49:54.642 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-08T21:49:54.642 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T21:49:54.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.761+0000 7fb0229b1700 1 Processor -- start 2024-05-08T21:49:54.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.761+0000 7fb0229b1700 1 -- start start 2024-05-08T21:49:54.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.762+0000 7fb0229b1700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb01c072980 0x7fb01c06f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:54.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.762+0000 7fb0229b1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb01c072260 0x7fb01c159d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:54.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.762+0000 7fb0229b1700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb01c072d60 0x7fb01c15a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:54.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.762+0000 7fb0229b1700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb01c070120 con 0x7fb01c072980 2024-05-08T21:49:54.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.762+0000 7fb0229b1700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb01c15dfc0 con 0x7fb01c072d60 2024-05-08T21:49:54.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.762+0000 7fb0229b1700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb01c06feb0 con 0x7fb01c072260 2024-05-08T21:49:54.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.762+0000 7fb01bfff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb01c072980 0x7fb01c06f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:54.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.762+0000 7fb01bfff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb01c072980 0x7fb01c06f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38828/0 (socket says 172.21.15.73:38828) 2024-05-08T21:49:54.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.762+0000 7fb01bfff700 1 -- 172.21.15.73:0/2778125094 learned_addr learned my addr 172.21.15.73:0/2778125094 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:54.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.762+0000 7fb01b7fe700 1 --2- 172.21.15.73:0/2778125094 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb01c072260 0x7fb01c159d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:54.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.762+0000 7fb020f4e700 1 --2- 172.21.15.73:0/2778125094 >> v2:172.21.15.115:3300/0 conn(0x7fb01c072d60 0x7fb01c15a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:54.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.762+0000 7fb01bfff700 1 -- 172.21.15.73:0/2778125094 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb01c072260 msgr2=0x7fb01c159d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:54.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.762+0000 7fb01bfff700 1 --2- 172.21.15.73:0/2778125094 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb01c072260 0x7fb01c159d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:54.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.762+0000 7fb01bfff700 1 -- 172.21.15.73:0/2778125094 >> v2:172.21.15.115:3300/0 conn(0x7fb01c072d60 msgr2=0x7fb01c15a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:54.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.762+0000 7fb01bfff700 1 --2- 172.21.15.73:0/2778125094 >> v2:172.21.15.115:3300/0 conn(0x7fb01c072d60 0x7fb01c15a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:54.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.762+0000 7fb01bfff700 1 -- 172.21.15.73:0/2778125094 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb01c15d3b0 con 0x7fb01c072980 2024-05-08T21:49:54.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.762+0000 7fb020f4e700 1 --2- 172.21.15.73:0/2778125094 >> v2:172.21.15.115:3300/0 conn(0x7fb01c072d60 0x7fb01c15a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:49:54.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.762+0000 7fb01bfff700 1 --2- 172.21.15.73:0/2778125094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb01c072980 0x7fb01c06f970 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb01c15e310 tx=0x7fb00c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cda7f7346626824 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:54.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.763+0000 7fb01affd700 1 -- 172.21.15.73:0/2778125094 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00c00b870 con 0x7fb01c072980 2024-05-08T21:49:54.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.763+0000 7fb01affd700 1 -- 172.21.15.73:0/2778125094 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb00c00b9d0 con 0x7fb01c072980 2024-05-08T21:49:54.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.763+0000 7fb01affd700 1 -- 172.21.15.73:0/2778125094 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00c00bd60 con 0x7fb01c072980 2024-05-08T21:49:54.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.763+0000 7fb0229b1700 1 -- 172.21.15.73:0/2778125094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb01c072980 msgr2=0x7fb01c06f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:54.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.763+0000 7fb0229b1700 1 --2- 172.21.15.73:0/2778125094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb01c072980 0x7fb01c06f970 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb01c15e310 tx=0x7fb00c009bd0 comp rx=0 tx=0).stop 2024-05-08T21:49:54.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.763+0000 7fb0229b1700 1 -- 172.21.15.73:0/2778125094 shutdown_connections 2024-05-08T21:49:54.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.763+0000 7fb0229b1700 1 --2- 172.21.15.73:0/2778125094 >> v2:172.21.15.115:3300/0 conn(0x7fb01c072d60 0x7fb01c15a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:54.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.763+0000 7fb0229b1700 1 --2- 172.21.15.73:0/2778125094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb01c072980 0x7fb01c06f970 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:54.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.763+0000 7fb0229b1700 1 --2- 172.21.15.73:0/2778125094 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb01c072260 0x7fb01c159d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:54.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.763+0000 7fb0229b1700 1 -- 172.21.15.73:0/2778125094 >> 172.21.15.73:0/2778125094 conn(0x7fb01c066cf0 msgr2=0x7fb01c06bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:54.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.763+0000 7fb0229b1700 1 -- 172.21.15.73:0/2778125094 shutdown_connections 2024-05-08T21:49:54.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.763+0000 7fb0229b1700 1 -- 172.21.15.73:0/2778125094 wait complete. 2024-05-08T21:49:54.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.764+0000 7fb0229b1700 1 Processor -- start 2024-05-08T21:49:54.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.765+0000 7fb0229b1700 1 -- start start 2024-05-08T21:49:54.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.765+0000 7fb0229b1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb01c072260 0x7fb01c0ccf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:54.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.765+0000 7fb0229b1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb01c072980 0x7fb01c15c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:54.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.765+0000 7fb0229b1700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb01c072d60 0x7fb01c0c46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:54.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.765+0000 7fb0229b1700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01c0c4290 con 0x7fb01c072260 2024-05-08T21:49:54.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.765+0000 7fb0229b1700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01c0c57d0 con 0x7fb01c072d60 2024-05-08T21:49:54.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.765+0000 7fb0229b1700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb01c0c5a90 con 0x7fb01c072980 2024-05-08T21:49:54.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.765+0000 7fb01bfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb01c072260 0x7fb01c0ccf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:54.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.765+0000 7fb01bfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb01c072260 0x7fb01c0ccf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38830/0 (socket says 172.21.15.73:38830) 2024-05-08T21:49:54.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.765+0000 7fb01bfff700 1 -- 172.21.15.73:0/368298737 learned_addr learned my addr 172.21.15.73:0/368298737 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:54.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.766+0000 7fb01bfff700 1 -- 172.21.15.73:0/368298737 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb01c072980 msgr2=0x7fb01c15c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:54.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.766+0000 7fb020f4e700 1 --2- 172.21.15.73:0/368298737 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb01c072d60 0x7fb01c0c46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:54.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.766+0000 7fb01b7fe700 1 --2- 172.21.15.73:0/368298737 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb01c072980 0x7fb01c15c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:54.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.766+0000 7fb01bfff700 1 --2- 172.21.15.73:0/368298737 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb01c072980 0x7fb01c15c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:54.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.766+0000 7fb01bfff700 1 -- 172.21.15.73:0/368298737 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb01c072d60 msgr2=0x7fb01c0c46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:54.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.766+0000 7fb01bfff700 1 --2- 172.21.15.73:0/368298737 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb01c072d60 0x7fb01c0c46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:54.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.766+0000 7fb01bfff700 1 -- 172.21.15.73:0/368298737 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb00c009550 con 0x7fb01c072260 2024-05-08T21:49:54.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.766+0000 7fb01bfff700 1 --2- 172.21.15.73:0/368298737 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb01c072260 0x7fb01c0ccf10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb00c009c10 tx=0x7fb00c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:54.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.766+0000 7fb018ff9700 1 -- 172.21.15.73:0/368298737 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00c004250 con 0x7fb01c072260 2024-05-08T21:49:54.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.766+0000 7fb018ff9700 1 -- 172.21.15.73:0/368298737 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb00c01f070 con 0x7fb01c072260 2024-05-08T21:49:54.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.766+0000 7fb0229b1700 1 -- 172.21.15.73:0/368298737 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb01c1f0220 con 0x7fb01c072260 2024-05-08T21:49:54.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.766+0000 7fb018ff9700 1 -- 172.21.15.73:0/368298737 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00c0045d0 con 0x7fb01c072260 2024-05-08T21:49:54.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.766+0000 7fb0229b1700 1 -- 172.21.15.73:0/368298737 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb01c15cbd0 con 0x7fb01c072260 2024-05-08T21:49:54.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.767+0000 7fb0229b1700 1 -- 172.21.15.73:0/368298737 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb01c0c4530 con 0x7fb01c072260 2024-05-08T21:49:54.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.767+0000 7fb018ff9700 1 -- 172.21.15.73:0/368298737 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb00c021030 con 0x7fb01c072260 2024-05-08T21:49:54.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.768+0000 7fb018ff9700 1 --2- 172.21.15.73:0/368298737 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fb00806ac90 0x7fb00806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:54.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.768+0000 7fb018ff9700 1 -- 172.21.15.73:0/368298737 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb00c08a880 con 0x7fb01c072260 2024-05-08T21:49:54.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.768+0000 7fb01b7fe700 1 --2- 172.21.15.73:0/368298737 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fb00806ac90 0x7fb00806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:54.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.768+0000 7fb01b7fe700 1 --2- 172.21.15.73:0/368298737 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fb00806ac90 0x7fb00806d150 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb01c150bb0 tx=0x7fb010008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:54.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.772+0000 7fb018ff9700 1 -- 172.21.15.73:0/368298737 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fb00c055b80 con 0x7fb01c072260 2024-05-08T21:49:54.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.971+0000 7fb0229b1700 1 -- 172.21.15.73:0/368298737 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb01c1f0080 con 0x7fb01c072260 2024-05-08T21:49:54.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.972+0000 7fb018ff9700 1 -- 172.21.15.73:0/368298737 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16037 (secure 0 0 0) 0x7fb01c1f0080 con 0x7fb01c072260 2024-05-08T21:49:54.973 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:49:54.974 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":21,"fsid":"143164b7-c9c7-4737-a494-7dafa5a3320c","created":"2024-05-08T21:49:26.221909+0000","modified":"2024-05-08T21:49:44.748794+0000","last_up_change":"2024-05-08T21:49:37.118386+0000","last_in_change":"2024-05-08T21:49:28.836944+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T21:49:35.998578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T21:49:42.171760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T21:49:42.576293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6b7439c1-daaa-44af-8333-a455f9e9dc67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":47228},{"type":"v1","addr":"172.21.15.73:6809","nonce":47228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":47228},{"type":"v1","addr":"172.21.15.73:6811","nonce":47228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":47228},{"type":"v1","addr":"172.21.15.73:6815","nonce":47228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":47228},{"type":"v1","addr":"172.21.15.73:6813","nonce":47228}]},"public_addr":"172.21.15.73:6809/47228","cluster_addr":"172.21.15.73:6811/47228","heartbeat_back_addr":"172.21.15.73:6815/47228","heartbeat_front_addr":"172.21.15.73:6813/47228","state":["exists","up"]},{"osd":1,"uuid":"fb67886a-d7f7-45ac-832f-36c871c8a208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":47227},{"type":"v1","addr":"172.21.15.73:6801","nonce":47227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":47227},{"type":"v1","addr":"172.21.15.73:6803","nonce":47227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":47227},{"type":"v1","addr":"172.21.15.73:6807","nonce":47227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":47227},{"type":"v1","addr":"172.21.15.73:6805","nonce":47227}]},"public_addr":"172.21.15.73:6801/47227","cluster_addr":"172.21.15.73:6803/47227","heartbeat_back_addr":"172.21.15.73:6807/47227","heartbeat_front_addr":"172.21.15.73:6805/47227","state":["exists","up"]},{"osd":2,"uuid":"a5cd6e98-6621-473a-bfb8-5c648abbb563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":47229},{"type":"v1","addr":"172.21.15.73:6817","nonce":47229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":47229},{"type":"v1","addr":"172.21.15.73:6819","nonce":47229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":47229},{"type":"v1","addr":"172.21.15.73:6823","nonce":47229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":47229},{"type":"v1","addr":"172.21.15.73:6821","nonce":47229}]},"public_addr":"172.21.15.73:6817/47229","cluster_addr":"172.21.15.73:6819/47229","heartbeat_back_addr":"172.21.15.73:6823/47229","heartbeat_front_addr":"172.21.15.73:6821/47229","state":["exists","up"]},{"osd":3,"uuid":"36927c20-4241-4f3b-91b5-a6a6f27598e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":47232},{"type":"v1","addr":"172.21.15.73:6825","nonce":47232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":47232},{"type":"v1","addr":"172.21.15.73:6827","nonce":47232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":47232},{"type":"v1","addr":"172.21.15.73:6831","nonce":47232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":47232},{"type":"v1","addr":"172.21.15.73:6829","nonce":47232}]},"public_addr":"172.21.15.73:6825/47232","cluster_addr":"172.21.15.73:6827/47232","heartbeat_back_addr":"172.21.15.73:6831/47232","heartbeat_front_addr":"172.21.15.73:6829/47232","state":["exists","up"]},{"osd":4,"uuid":"4ebe0a18-8216-4815-878a-39c39a6cd3fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":47200},{"type":"v1","addr":"172.21.15.115:6801","nonce":47200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":47200},{"type":"v1","addr":"172.21.15.115:6803","nonce":47200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":47200},{"type":"v1","addr":"172.21.15.115:6807","nonce":47200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":47200},{"type":"v1","addr":"172.21.15.115:6805","nonce":47200}]},"public_addr":"172.21.15.115:6801/47200","cluster_addr":"172.21.15.115:6803/47200","heartbeat_back_addr":"172.21.15.115:6807/47200","heartbeat_front_addr":"172.21.15.115:6805/47200","state":["exists","up"]},{"osd":5,"uuid":"957f0ac1-5f26-4f02-8c05-488e6b67ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":47201},{"type":"v1","addr":"172.21.15.115:6809","nonce":47201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":47201},{"type":"v1","addr":"172.21.15.115:6811","nonce":47201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":47201},{"type":"v1","addr":"172.21.15.115:6815","nonce":47201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":47201},{"type":"v1","addr":"172.21.15.115:6813","nonce":47201}]},"public_addr":"172.21.15.115:6809/47201","cluster_addr":"172.21.15.115:6811/47201","heartbeat_back_addr":"172.21.15.115:6815/47201","heartbeat_front_addr":"172.21.15.115:6813/47201","state":["exists","up"]},{"osd":6,"uuid":"f5a6768f-ba7f-4f66-b335-0c303b158e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":47202},{"type":"v1","addr":"172.21.15.115:6817","nonce":47202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":47202},{"type":"v1","addr":"172.21.15.115:6819","nonce":47202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":47202},{"type":"v1","addr":"172.21.15.115:6823","nonce":47202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":47202},{"type":"v1","addr":"172.21.15.115:6821","nonce":47202}]},"public_addr":"172.21.15.115:6817/47202","cluster_addr":"172.21.15.115:6819/47202","heartbeat_back_addr":"172.21.15.115:6823/47202","heartbeat_front_addr":"172.21.15.115:6821/47202","state":["exists","up"]},{"osd":7,"uuid":"f4187743-f9e6-42e6-aca9-0604a58db1ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":47211},{"type":"v1","addr":"172.21.15.115:6825","nonce":47211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":47211},{"type":"v1","addr":"172.21.15.115:6827","nonce":47211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":47211},{"type":"v1","addr":"172.21.15.115:6831","nonce":47211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":47211},{"type":"v1","addr":"172.21.15.115:6829","nonce":47211}]},"public_addr":"172.21.15.115:6825/47211","cluster_addr":"172.21.15.115:6827/47211","heartbeat_back_addr":"172.21.15.115:6831/47211","heartbeat_front_addr":"172.21.15.115:6829/47211","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:33.996335+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:33.687451+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:34.072549+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:33.997588+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:34.047260+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:34.876272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:33.965472+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:34.038637+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T21:49:54.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.974+0000 7fb0229b1700 1 -- 172.21.15.73:0/368298737 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fb00806ac90 msgr2=0x7fb00806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:54.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.974+0000 7fb0229b1700 1 --2- 172.21.15.73:0/368298737 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fb00806ac90 0x7fb00806d150 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb01c150bb0 tx=0x7fb010008040 comp rx=0 tx=0).stop 2024-05-08T21:49:54.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.974+0000 7fb0229b1700 1 -- 172.21.15.73:0/368298737 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb01c072260 msgr2=0x7fb01c0ccf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:54.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.974+0000 7fb0229b1700 1 --2- 172.21.15.73:0/368298737 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb01c072260 0x7fb01c0ccf10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb00c009c10 tx=0x7fb00c004750 comp rx=0 tx=0).stop 2024-05-08T21:49:54.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.974+0000 7fb0229b1700 1 -- 172.21.15.73:0/368298737 shutdown_connections 2024-05-08T21:49:54.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.974+0000 7fb0229b1700 1 --2- 172.21.15.73:0/368298737 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fb00806ac90 0x7fb00806d150 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:54.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.974+0000 7fb0229b1700 1 --2- 172.21.15.73:0/368298737 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb01c072d60 0x7fb01c0c46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:54.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.974+0000 7fb0229b1700 1 --2- 172.21.15.73:0/368298737 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb01c072260 0x7fb01c0ccf10 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:54.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.974+0000 7fb0229b1700 1 --2- 172.21.15.73:0/368298737 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb01c072980 0x7fb01c15c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:54.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.974+0000 7fb0229b1700 1 -- 172.21.15.73:0/368298737 >> 172.21.15.73:0/368298737 conn(0x7fb01c066cf0 msgr2=0x7fb01c1529c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:54.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.974+0000 7fb0229b1700 1 -- 172.21.15.73:0/368298737 shutdown_connections 2024-05-08T21:49:54.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:54.974+0000 7fb0229b1700 1 -- 172.21.15.73:0/368298737 wait complete. 2024-05-08T21:49:54.988 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-08T21:49:54.988 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-08T21:49:54.989 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-08T21:49:54.989 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-08T21:49:54.989 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-05-08T21:49:54.990 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-05-08T21:49:54.990 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-05-08T21:49:54.991 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-05-08T21:49:55.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.186+0000 7fb09e7d5700 1 Processor -- start 2024-05-08T21:49:55.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.186+0000 7fb09e7d5700 1 -- start start 2024-05-08T21:49:55.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.188+0000 7fb09e7d5700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb0980c7b50 0x7fb098071050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.188+0000 7fb09e7d5700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb098071590 0x7fb09806e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.188+0000 7fb09e7d5700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0980c6f30 con 0x7fb09814ff30 2024-05-08T21:49:55.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.188+0000 7fb09e7d5700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0980c6b10 con 0x7fb098071590 2024-05-08T21:49:55.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.188+0000 7fb09e7d5700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0980c5f60 con 0x7fb0980c7b50 2024-05-08T21:49:55.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.188+0000 7fb09cd72700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb098071590 0x7fb09806e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.188+0000 7fb09cd72700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb098071590 0x7fb09806e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.73:53602/0 (socket says 172.21.15.73:53602) 2024-05-08T21:49:55.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.188+0000 7fb09cd72700 1 -- 172.21.15.73:0/2565434114 learned_addr learned my addr 172.21.15.73:0/2565434114 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:55.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.189+0000 7fb0977fe700 1 --2- 172.21.15.73:0/2565434114 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb0980c7b50 0x7fb098071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.189+0000 7fb09cd72700 1 -- 172.21.15.73:0/2565434114 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb0980c7b50 msgr2=0x7fb098071050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:55.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.189+0000 7fb09cd72700 1 --2- 172.21.15.73:0/2565434114 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb0980c7b50 0x7fb098071050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.189+0000 7fb09cd72700 1 -- 172.21.15.73:0/2565434114 >> v1:172.21.15.115:6789/0 conn(0x7fb09814ff30 legacy=0x7fb0981566c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T21:49:55.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.189+0000 7fb09cd72700 1 -- 172.21.15.73:0/2565434114 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb09806f2e0 con 0x7fb098071590 2024-05-08T21:49:55.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.190+0000 7fb09cd72700 1 --2- 172.21.15.73:0/2565434114 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb098071590 0x7fb09806e360 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb0880088f0 tx=0x7fb08800d330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca3963f9d2c2f28a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:55.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.190+0000 7fb096ffd700 1 -- 172.21.15.73:0/2565434114 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb088010070 con 0x7fb098071590 2024-05-08T21:49:55.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.190+0000 7fb096ffd700 1 -- 172.21.15.73:0/2565434114 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb08800da40 con 0x7fb098071590 2024-05-08T21:49:55.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.190+0000 7fb096ffd700 1 -- 172.21.15.73:0/2565434114 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb08800ddd0 con 0x7fb098071590 2024-05-08T21:49:55.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.191+0000 7fb09e7d5700 1 -- 172.21.15.73:0/2565434114 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb098071590 msgr2=0x7fb09806e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.191+0000 7fb09e7d5700 1 --2- 172.21.15.73:0/2565434114 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb098071590 0x7fb09806e360 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb0880088f0 tx=0x7fb08800d330 comp rx=0 tx=0).stop 2024-05-08T21:49:55.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.191+0000 7fb09e7d5700 1 -- 172.21.15.73:0/2565434114 shutdown_connections 2024-05-08T21:49:55.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.191+0000 7fb09e7d5700 1 --2- 172.21.15.73:0/2565434114 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb098071590 0x7fb09806e360 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.191+0000 7fb09e7d5700 1 --2- 172.21.15.73:0/2565434114 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb0980c7b50 0x7fb098071050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.191+0000 7fb09e7d5700 1 -- 172.21.15.73:0/2565434114 >> 172.21.15.73:0/2565434114 conn(0x7fb0980cb560 msgr2=0x7fb0980cb970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:55.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.191+0000 7fb09e7d5700 1 -- 172.21.15.73:0/2565434114 shutdown_connections 2024-05-08T21:49:55.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.191+0000 7fb09e7d5700 1 -- 172.21.15.73:0/2565434114 wait complete. 2024-05-08T21:49:55.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.193+0000 7fb09e7d5700 1 Processor -- start 2024-05-08T21:49:55.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.193+0000 7fb09e7d5700 1 -- start start 2024-05-08T21:49:55.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.194+0000 7fb09e7d5700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb098071590 0x7fb0980c0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.195+0000 7fb09e7d5700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb0980c7b50 0x7fb0981f72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.195+0000 7fb09e7d5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb09814ff30 0x7fb0981f7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.195+0000 7fb09e7d5700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb098154320 con 0x7fb09814ff30 2024-05-08T21:49:55.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.195+0000 7fb09e7d5700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0980c3fb0 con 0x7fb098071590 2024-05-08T21:49:55.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.195+0000 7fb09e7d5700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0980c4290 con 0x7fb0980c7b50 2024-05-08T21:49:55.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.195+0000 7fb097fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb098071590 0x7fb0980c0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.195+0000 7fb097fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb098071590 0x7fb0980c0930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.73:53604/0 (socket says 172.21.15.73:53604) 2024-05-08T21:49:55.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.195+0000 7fb097fff700 1 -- 172.21.15.73:0/3796512631 learned_addr learned my addr 172.21.15.73:0/3796512631 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:55.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.195+0000 7fb09cd72700 1 --2- 172.21.15.73:0/3796512631 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb09814ff30 0x7fb0981f7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.195+0000 7fb0977fe700 1 --2- 172.21.15.73:0/3796512631 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb0980c7b50 0x7fb0981f72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.196+0000 7fb097fff700 1 -- 172.21.15.73:0/3796512631 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb0980c7b50 msgr2=0x7fb0981f72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.196+0000 7fb097fff700 1 --2- 172.21.15.73:0/3796512631 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb0980c7b50 0x7fb0981f72d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.196+0000 7fb097fff700 1 -- 172.21.15.73:0/3796512631 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb09814ff30 msgr2=0x7fb0981f7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.196+0000 7fb097fff700 1 --2- 172.21.15.73:0/3796512631 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb09814ff30 0x7fb0981f7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.196+0000 7fb097fff700 1 -- 172.21.15.73:0/3796512631 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0880085d0 con 0x7fb098071590 2024-05-08T21:49:55.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.197+0000 7fb097fff700 1 --2- 172.21.15.73:0/3796512631 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb098071590 0x7fb0980c0930 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb09000ba80 tx=0x7fb09000be40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:55.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.202+0000 7fb094ff9700 1 -- 172.21.15.73:0/3796512631 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09000ca80 con 0x7fb098071590 2024-05-08T21:49:55.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.202+0000 7fb094ff9700 1 -- 172.21.15.73:0/3796512631 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb09000cbe0 con 0x7fb098071590 2024-05-08T21:49:55.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.202+0000 7fb094ff9700 1 -- 172.21.15.73:0/3796512631 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb090014440 con 0x7fb098071590 2024-05-08T21:49:55.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.202+0000 7fb09e7d5700 1 -- 172.21.15.73:0/3796512631 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb098155780 con 0x7fb098071590 2024-05-08T21:49:55.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.202+0000 7fb09e7d5700 1 -- 172.21.15.73:0/3796512631 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb098072cc0 con 0x7fb098071590 2024-05-08T21:49:55.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.203+0000 7fb09e7d5700 1 -- 172.21.15.73:0/3796512631 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb078000fc0 con 0x7fb098071590 2024-05-08T21:49:55.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.204+0000 7fb094ff9700 1 -- 172.21.15.73:0/3796512631 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb090006d50 con 0x7fb098071590 2024-05-08T21:49:55.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.205+0000 7fb094ff9700 1 --2- 172.21.15.73:0/3796512631 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fb08406ad10 0x7fb08406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.205+0000 7fb094ff9700 1 -- 172.21.15.73:0/3796512631 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb090088ea0 con 0x7fb098071590 2024-05-08T21:49:55.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.205+0000 7fb094ff9700 1 --2- 172.21.15.73:0/3796512631 >> [v2:172.21.15.73:6800/47227,v1:172.21.15.73:6801/47227] conn(0x7fb084072eb0 0x7fb0840752d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.205+0000 7fb094ff9700 1 -- 172.21.15.73:0/3796512631 --> [v2:172.21.15.73:6800/47227,v1:172.21.15.73:6801/47227] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb084075980 con 0x7fb084072eb0 2024-05-08T21:49:55.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.205+0000 7fb0977fe700 1 --2- 172.21.15.73:0/3796512631 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fb08406ad10 0x7fb08406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.204+0000 7f949a2d7700 1 Processor -- start 2024-05-08T21:49:55.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.204+0000 7f949a2d7700 1 -- start start 2024-05-08T21:49:55.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.206+0000 7f949a2d7700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f94941585d0 0x7f94940c5f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.206+0000 7f949a2d7700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f949415eba0 con 0x7f9494161670 2024-05-08T21:49:55.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.206+0000 7f949a2d7700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f949415f030 con 0x7f94941581f0 2024-05-08T21:49:55.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.206+0000 7f949a2d7700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f949415e080 con 0x7f94941585d0 2024-05-08T21:49:55.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.206+0000 7fb09cd72700 1 --2- 172.21.15.73:0/3796512631 >> [v2:172.21.15.73:6800/47227,v1:172.21.15.73:6801/47227] conn(0x7fb084072eb0 0x7fb0840752d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.206+0000 7faedf750700 1 Processor -- start 2024-05-08T21:49:55.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.206+0000 7fcbae82e700 1 Processor -- start 2024-05-08T21:49:55.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.206+0000 7fb0977fe700 1 --2- 172.21.15.73:0/3796512631 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fb08406ad10 0x7fb08406d1d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb0980c9020 tx=0x7fb08c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:55.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.207+0000 7fb094ff9700 1 -- 172.21.15.73:0/3796512631 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb090009950 con 0x7fb098071590 2024-05-08T21:49:55.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.207+0000 7fb09cd72700 1 --2- 172.21.15.73:0/3796512631 >> [v2:172.21.15.73:6800/47227,v1:172.21.15.73:6801/47227] conn(0x7fb084072eb0 0x7fb0840752d0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:55.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.207+0000 7faedf750700 1 -- start start 2024-05-08T21:49:55.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.206+0000 7f9493fff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f94941581f0 0x7f94940c5190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.73:46954/0 (socket says 172.21.15.73:46954) 2024-05-08T21:49:55.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.206+0000 7f9493fff700 1 -- 172.21.15.73:0/1542823671 learned_addr learned my addr 172.21.15.73:0/1542823671 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:49:55.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.206+0000 7f94937fe700 1 --2- 172.21.15.73:0/1542823671 >> v2:172.21.15.73:3300/0 conn(0x7f94941585d0 0x7f94940c5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.206+0000 7f9492ffd700 1 -- 172.21.15.73:0/1542823671 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1801238804 0 0) 0x7f949415f030 con 0x7f94941581f0 2024-05-08T21:49:55.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.206+0000 7f9492ffd700 1 -- 172.21.15.73:0/1542823671 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f947c0035b0 con 0x7f94941581f0 2024-05-08T21:49:55.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.207+0000 7f9492ffd700 1 -- 172.21.15.73:0/1542823671 <== mon.1 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3279968767 0 0) 0x7f947c0035b0 con 0x7f94941581f0 2024-05-08T21:49:55.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.207+0000 7f94937fe700 1 -- 172.21.15.73:0/1542823671 >> v1:172.21.15.115:6789/0 conn(0x7f94941581f0 legacy=0x7f94940c5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.207+0000 7f94937fe700 1 -- 172.21.15.73:0/1542823671 >> v1:172.21.15.73:6789/0 conn(0x7f9494161670 legacy=0x7f94940c6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.207+0000 7f94937fe700 1 -- 172.21.15.73:0/1542823671 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94940c65b0 con 0x7f94941585d0 2024-05-08T21:49:55.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.207+0000 7f94937fe700 1 --2- 172.21.15.73:0/1542823671 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94941585d0 0x7f94940c5f90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f94880097c0 tx=0x7f9488009ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d10e69dc4e59d62b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:55.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.208+0000 7fb094ff9700 1 -- 172.21.15.73:0/3796512631 <== osd.1 v2:172.21.15.73:6800/47227 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fb084075980 con 0x7fb084072eb0 2024-05-08T21:49:55.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.206+0000 7fcbae82e700 1 -- start start 2024-05-08T21:49:55.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.208+0000 7fcbae82e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcba814fe00 0x7fcba8159270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.208+0000 7fcbae82e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcba8070880 0x7fcba8156590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.208+0000 7fcbae82e700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcba815a1a0 con 0x7fcba806e270 2024-05-08T21:49:55.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.208+0000 7fcbae82e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcba8159900 con 0x7fcba8070880 2024-05-08T21:49:55.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.208+0000 7fcbae82e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcba8159be0 con 0x7fcba814fe00 2024-05-08T21:49:55.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.208+0000 7fcba7fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcba814fe00 0x7fcba8159270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.208+0000 7fcba7fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcba814fe00 0x7fcba8159270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.73:52564/0 (socket says 172.21.15.73:52564) 2024-05-08T21:49:55.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.208+0000 7fcba7fff700 1 -- 172.21.15.73:0/2875138798 learned_addr learned my addr 172.21.15.73:0/2875138798 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:55.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.208+0000 7fcba7fff700 1 -- 172.21.15.73:0/2875138798 >> v2:172.21.15.73:3300/0 conn(0x7fcba8070880 msgr2=0x7fcba8156590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:55.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.208+0000 7fcba7fff700 1 --2- 172.21.15.73:0/2875138798 >> v2:172.21.15.73:3300/0 conn(0x7fcba8070880 0x7fcba8156590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.208+0000 7fcba7fff700 1 -- 172.21.15.73:0/2875138798 >> v1:172.21.15.115:6789/0 conn(0x7fcba806e270 legacy=0x7fcba806a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:55.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.208+0000 7fcba7fff700 1 -- 172.21.15.73:0/2875138798 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcba8159ec0 con 0x7fcba814fe00 2024-05-08T21:49:55.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.209+0000 7fcba7fff700 1 --2- 172.21.15.73:0/2875138798 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcba814fe00 0x7fcba8159270 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fcba0009730 tx=0x7fcba0009760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dbb06f0749d46081 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:55.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.209+0000 7faedf750700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7faed8159270 0x7faed8070880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.209+0000 7faedf750700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faed8156ca0 con 0x7faed814fe00 2024-05-08T21:49:55.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.209+0000 7faedf750700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faed81596c0 con 0x7faed806e270 2024-05-08T21:49:55.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.209+0000 7faedf750700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faed815a1a0 con 0x7faed8159270 2024-05-08T21:49:55.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.209+0000 7faedd4ec700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7faed814fe00 0x7faed8156590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:51776/0 (socket says 172.21.15.73:51776) 2024-05-08T21:49:55.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.209+0000 7faedd4ec700 1 -- 172.21.15.73:0/1071437036 learned_addr learned my addr 172.21.15.73:0/1071437036 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:49:55.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.209+0000 7fcba6ffd700 1 -- 172.21.15.73:0/2875138798 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba0003c20 con 0x7fcba814fe00 2024-05-08T21:49:55.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.209+0000 7fcba6ffd700 1 -- 172.21.15.73:0/2875138798 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcba0003d80 con 0x7fcba814fe00 2024-05-08T21:49:55.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.209+0000 7fcba6ffd700 1 -- 172.21.15.73:0/2875138798 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba000c930 con 0x7fcba814fe00 2024-05-08T21:49:55.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.209+0000 7faedcceb700 1 --2- 172.21.15.73:0/1071437036 >> v2:172.21.15.115:3300/0 conn(0x7faed8159270 0x7faed8070880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.209+0000 7faecffff700 1 -- 172.21.15.73:0/1071437036 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 535777640 0 0) 0x7faed0001490 con 0x7faed814fe00 2024-05-08T21:49:55.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.209+0000 7faecffff700 1 -- 172.21.15.73:0/1071437036 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faec4003590 con 0x7faed814fe00 2024-05-08T21:49:55.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.208+0000 7f9492ffd700 1 -- 172.21.15.73:0/1542823671 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9484001670 con 0x7f94941585d0 2024-05-08T21:49:55.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.208+0000 7f9492ffd700 1 -- 172.21.15.73:0/1542823671 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9488004030 con 0x7f94941585d0 2024-05-08T21:49:55.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.208+0000 7f9492ffd700 1 -- 172.21.15.73:0/1542823671 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94880043c0 con 0x7f94941585d0 2024-05-08T21:49:55.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.210+0000 7faecffff700 1 -- 172.21.15.73:0/1071437036 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2060310911 0 0) 0x7faec4003590 con 0x7faed814fe00 2024-05-08T21:49:55.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.210+0000 7faecffff700 1 -- 172.21.15.73:0/1071437036 >> v2:172.21.15.115:3300/0 conn(0x7faed8159270 msgr2=0x7faed8070880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:55.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.210+0000 7faecffff700 1 --2- 172.21.15.73:0/1071437036 >> v2:172.21.15.115:3300/0 conn(0x7faed8159270 0x7faed8070880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.210+0000 7faecffff700 1 -- 172.21.15.73:0/1071437036 >> v1:172.21.15.115:6789/0 conn(0x7faed806e270 legacy=0x7faed8160600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.210+0000 7faecffff700 1 -- 172.21.15.73:0/1071437036 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed8159900 con 0x7faed814fe00 2024-05-08T21:49:55.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.210+0000 7faecffff700 1 -- 172.21.15.73:0/1071437036 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 953298616 0 0) 0x7faed0001b80 con 0x7faed814fe00 2024-05-08T21:49:55.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.210+0000 7faecffff700 1 -- 172.21.15.73:0/1071437036 >> v1:172.21.15.73:6789/0 conn(0x7faed814fe00 legacy=0x7faed8156590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.210+0000 7faecffff700 1 --2- 172.21.15.73:0/1071437036 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faec4003d60 0x7faec4004180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.210+0000 7faecffff700 1 --2- 172.21.15.73:0/1071437036 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faec40046c0 0x7faec4008e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.210+0000 7faecffff700 1 --2- 172.21.15.73:0/1071437036 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faec4009420 0x7faec40098a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.210+0000 7faecffff700 1 -- 172.21.15.73:0/1071437036 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed815a1a0 con 0x7faec4003d60 2024-05-08T21:49:55.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.210+0000 7faecffff700 1 -- 172.21.15.73:0/1071437036 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec400a130 con 0x7faec40046c0 2024-05-08T21:49:55.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.210+0000 7faecffff700 1 -- 172.21.15.73:0/1071437036 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faec400a2f0 con 0x7faec4009420 2024-05-08T21:49:55.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.210+0000 7fcbae82e700 1 -- 172.21.15.73:0/2875138798 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcba814fe00 msgr2=0x7fcba8159270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.210+0000 7fcbae82e700 1 --2- 172.21.15.73:0/2875138798 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcba814fe00 0x7fcba8159270 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fcba0009730 tx=0x7fcba0009760 comp rx=0 tx=0).stop 2024-05-08T21:49:55.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.210+0000 7faedd4ec700 1 --2- 172.21.15.73:0/1071437036 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faec4003d60 0x7faec4004180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.210+0000 7fcbae82e700 1 -- 172.21.15.73:0/2875138798 shutdown_connections 2024-05-08T21:49:55.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.210+0000 7fcbae82e700 1 --2- 172.21.15.73:0/2875138798 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcba814fe00 0x7fcba8159270 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.210+0000 7fcbae82e700 1 --2- 172.21.15.73:0/2875138798 >> v2:172.21.15.73:3300/0 conn(0x7fcba8070880 0x7fcba8156590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.210+0000 7fcbae82e700 1 -- 172.21.15.73:0/2875138798 >> 172.21.15.73:0/2875138798 conn(0x7fcba80cb230 msgr2=0x7fcba80cb610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:55.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.210+0000 7fcbae82e700 1 -- 172.21.15.73:0/2875138798 shutdown_connections 2024-05-08T21:49:55.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.211+0000 7faedd4ec700 1 -- 172.21.15.73:0/1071437036 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faec4009420 msgr2=0x7faec40098a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:55.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.211+0000 7faedd4ec700 1 --2- 172.21.15.73:0/1071437036 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faec4009420 0x7faec40098a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.211+0000 7faedd4ec700 1 -- 172.21.15.73:0/1071437036 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faec40046c0 msgr2=0x7faec4008e90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T21:49:55.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.211+0000 7faedd4ec700 1 --2- 172.21.15.73:0/1071437036 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faec40046c0 0x7faec4008e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.211+0000 7faedd4ec700 1 -- 172.21.15.73:0/1071437036 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed8159900 con 0x7faec4003d60 2024-05-08T21:49:55.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.211+0000 7f949a2d7700 1 -- 172.21.15.73:0/1542823671 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94941585d0 msgr2=0x7f94940c5f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.211+0000 7f949a2d7700 1 --2- 172.21.15.73:0/1542823671 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94941585d0 0x7f94940c5f90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f94880097c0 tx=0x7f9488009ad0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.211+0000 7faedd4ec700 1 --2- 172.21.15.73:0/1071437036 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faec4003d60 0x7faec4004180 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7faed000a870 tx=0x7faec4004de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d56edc456cd9e3b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:55.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.211+0000 7faeddced700 1 -- 172.21.15.73:0/1071437036 reap_dead start 2024-05-08T21:49:55.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.212+0000 7faecffff700 1 -- 172.21.15.73:0/1071437036 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed0012600 con 0x7faec4003d60 2024-05-08T21:49:55.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.212+0000 7faecffff700 1 -- 172.21.15.73:0/1071437036 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed0012760 con 0x7faec4003d60 2024-05-08T21:49:55.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.212+0000 7faecffff700 1 -- 172.21.15.73:0/1071437036 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed0012ad0 con 0x7faec4003d60 2024-05-08T21:49:55.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.212+0000 7f949a2d7700 1 -- 172.21.15.73:0/1542823671 shutdown_connections 2024-05-08T21:49:55.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.212+0000 7f949a2d7700 1 --2- 172.21.15.73:0/1542823671 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94941585d0 0x7f94940c5f90 secure :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f94880097c0 tx=0x7f9488009ad0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.212+0000 7f949a2d7700 1 -- 172.21.15.73:0/1542823671 >> 172.21.15.73:0/1542823671 conn(0x7f94940cb230 msgr2=0x7f94940cb610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:55.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.210+0000 7fcbae82e700 1 -- 172.21.15.73:0/2875138798 wait complete. 2024-05-08T21:49:55.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.212+0000 7fcbae82e700 1 Processor -- start 2024-05-08T21:49:55.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.213+0000 7faedf750700 1 -- 172.21.15.73:0/1071437036 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faec4003d60 msgr2=0x7faec4004180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.213+0000 7faedf750700 1 --2- 172.21.15.73:0/1071437036 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faec4003d60 0x7faec4004180 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7faed000a870 tx=0x7faec4004de0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.213+0000 7fcbae82e700 1 -- start start 2024-05-08T21:49:55.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.214+0000 7fcbae82e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcba806e270 0x7fcba81f6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.214+0000 7fcbae82e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcba8070880 0x7fcba8158c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.214+0000 7fcbae82e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcba814fe00 0x7fcba8154910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.214+0000 7fcbae82e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcba8156eb0 con 0x7fcba806e270 2024-05-08T21:49:55.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.214+0000 7fcbae82e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcba81fc090 con 0x7fcba814fe00 2024-05-08T21:49:55.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.214+0000 7fcbae82e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcba81fc2a0 con 0x7fcba8070880 2024-05-08T21:49:55.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.214+0000 7fcbacdcb700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcba814fe00 0x7fcba8154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.214+0000 7fcbacdcb700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcba814fe00 0x7fcba8154910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.73:53620/0 (socket says 172.21.15.73:53620) 2024-05-08T21:49:55.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.214+0000 7fcbacdcb700 1 -- 172.21.15.73:0/4270707465 learned_addr learned my addr 172.21.15.73:0/4270707465 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:55.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.214+0000 7fcba7fff700 1 --2- 172.21.15.73:0/4270707465 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcba806e270 0x7fcba81f6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.211+0000 7fc7c487c700 1 Processor -- start 2024-05-08T21:49:55.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.211+0000 7fc7c487c700 1 -- start start 2024-05-08T21:49:55.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.212+0000 7fc7c487c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7c0159260 0x7fc7c00ca0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.212+0000 7fc7c487c700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc7c00ca5f0 0x7fc7c00c92c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.212+0000 7fc7c487c700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7c0155ef0 con 0x7fc7c0150010 2024-05-08T21:49:55.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.212+0000 7fc7c487c700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7c0155c70 con 0x7fc7c00ca5f0 2024-05-08T21:49:55.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.212+0000 7fc7c487c700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c01503f0 con 0x7fc7c0159260 2024-05-08T21:49:55.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.213+0000 7fc7bed9d700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc7c00ca5f0 0x7fc7c00c92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.213+0000 7fc7bed9d700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc7c00ca5f0 0x7fc7c00c92c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38874/0 (socket says 172.21.15.73:38874) 2024-05-08T21:49:55.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.213+0000 7fc7bed9d700 1 -- 172.21.15.73:0/2718462328 learned_addr learned my addr 172.21.15.73:0/2718462328 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:55.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.213+0000 7fc7bed9d700 1 -- 172.21.15.73:0/2718462328 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7c0159260 msgr2=0x7fc7c00ca0b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T21:49:55.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.213+0000 7fc7bed9d700 1 --2- 172.21.15.73:0/2718462328 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7c0159260 0x7fc7c00ca0b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.213+0000 7fc7bed9d700 1 -- 172.21.15.73:0/2718462328 >> v1:172.21.15.73:6789/0 conn(0x7fc7c0150010 legacy=0x7fc7c0156380 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T21:49:55.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.213+0000 7fc7bed9d700 1 -- 172.21.15.73:0/2718462328 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c0159730 con 0x7fc7c00ca5f0 2024-05-08T21:49:55.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.214+0000 7fc7bed9d700 1 --2- 172.21.15.73:0/2718462328 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7c00ca5f0 0x7fc7c00c92c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc7b40098f0 tx=0x7fc7b4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3867592130b6db9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:55.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.214+0000 7fc7bd59a700 1 -- 172.21.15.73:0/2718462328 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b4004230 con 0x7fc7c00ca5f0 2024-05-08T21:49:55.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.214+0000 7fc7bd59a700 1 -- 172.21.15.73:0/2718462328 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7b4004390 con 0x7fc7c00ca5f0 2024-05-08T21:49:55.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.214+0000 7fc7bd59a700 1 -- 172.21.15.73:0/2718462328 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b40036a0 con 0x7fc7c00ca5f0 2024-05-08T21:49:55.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.214+0000 7faedf750700 1 -- 172.21.15.73:0/1071437036 shutdown_connections 2024-05-08T21:49:55.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.214+0000 7faedf750700 1 --2- 172.21.15.73:0/1071437036 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faec4003d60 0x7faec4004180 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.214+0000 7faedf750700 1 -- 172.21.15.73:0/1071437036 >> 172.21.15.73:0/1071437036 conn(0x7faed80cb230 msgr2=0x7faed80cb610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:55.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.215+0000 7fcbacdcb700 1 -- 172.21.15.73:0/4270707465 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcba8070880 msgr2=0x7fcba8158c50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T21:49:55.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.215+0000 7fcbacdcb700 1 --2- 172.21.15.73:0/4270707465 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcba8070880 0x7fcba8158c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.215+0000 7fcbacdcb700 1 -- 172.21.15.73:0/4270707465 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcba806e270 msgr2=0x7fcba81f6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.215+0000 7fcbacdcb700 1 --2- 172.21.15.73:0/4270707465 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcba806e270 0x7fcba81f6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.215+0000 7fcbacdcb700 1 -- 172.21.15.73:0/4270707465 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcba000c3d0 con 0x7fcba814fe00 2024-05-08T21:49:55.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.215+0000 7f949a2d7700 1 -- 172.21.15.73:0/1542823671 shutdown_connections 2024-05-08T21:49:55.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.215+0000 7f949a2d7700 1 -- 172.21.15.73:0/1542823671 wait complete. 2024-05-08T21:49:55.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.215+0000 7faedf750700 1 -- 172.21.15.73:0/1071437036 shutdown_connections 2024-05-08T21:49:55.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.215+0000 7fc7c487c700 1 -- 172.21.15.73:0/2718462328 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7c00ca5f0 msgr2=0x7fc7c00c92c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.215+0000 7fc7c487c700 1 --2- 172.21.15.73:0/2718462328 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7c00ca5f0 0x7fc7c00c92c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc7b40098f0 tx=0x7fc7b4009c00 comp rx=0 tx=0).stop 2024-05-08T21:49:55.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.215+0000 7fc7c487c700 1 -- 172.21.15.73:0/2718462328 shutdown_connections 2024-05-08T21:49:55.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.215+0000 7fc7c487c700 1 --2- 172.21.15.73:0/2718462328 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7c00ca5f0 0x7fc7c00c92c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.215+0000 7fc7c487c700 1 --2- 172.21.15.73:0/2718462328 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7c0159260 0x7fc7c00ca0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.215+0000 7fc7c487c700 1 -- 172.21.15.73:0/2718462328 >> 172.21.15.73:0/2718462328 conn(0x7fc7c00cb230 msgr2=0x7fc7c00cb610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:55.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.215+0000 7fcbacdcb700 1 --2- 172.21.15.73:0/4270707465 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcba814fe00 0x7fcba8154910 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c00c450 tx=0x7fcb9c00c760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:55.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.215+0000 7f04c7e7e700 1 Processor -- start 2024-05-08T21:49:55.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.215+0000 7f04c7e7e700 1 -- start start 2024-05-08T21:49:55.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.215+0000 7faedf750700 1 -- 172.21.15.73:0/1071437036 wait complete. 2024-05-08T21:49:55.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.216+0000 7fcba4ff9700 1 -- 172.21.15.73:0/4270707465 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9c011790 con 0x7fcba814fe00 2024-05-08T21:49:55.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.216+0000 7fcba4ff9700 1 -- 172.21.15.73:0/4270707465 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb9c0118f0 con 0x7fcba814fe00 2024-05-08T21:49:55.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.216+0000 7fcba4ff9700 1 -- 172.21.15.73:0/4270707465 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9c011ca0 con 0x7fcba814fe00 2024-05-08T21:49:55.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.216+0000 7f949a2d7700 1 Processor -- start 2024-05-08T21:49:55.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.217+0000 7f949a2d7700 1 -- start start 2024-05-08T21:49:55.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.217+0000 7f949a2d7700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94941581f0 0x7f94940ca440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.217+0000 7f949a2d7700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9494161670 0x7f9494137710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.217+0000 7f949a2d7700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f949413c340 0x7f94941543b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.217+0000 7f949a2d7700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94941548f0 con 0x7f949413c340 2024-05-08T21:49:55.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.217+0000 7f949a2d7700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f949413c7f0 con 0x7f94941581f0 2024-05-08T21:49:55.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.217+0000 7f949a2d7700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94940caa60 con 0x7f9494161670 2024-05-08T21:49:55.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.218+0000 7f9498874700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f949413c340 0x7f94941543b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.218+0000 7f9498874700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f949413c340 0x7f94941543b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38902/0 (socket says 172.21.15.73:38902) 2024-05-08T21:49:55.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.218+0000 7f9498874700 1 -- 172.21.15.73:0/987897721 learned_addr learned my addr 172.21.15.73:0/987897721 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:55.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.217+0000 7faedf750700 1 Processor -- start 2024-05-08T21:49:55.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.217+0000 7faedf750700 1 -- start start 2024-05-08T21:49:55.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.218+0000 7faedf750700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faec4003d60 0x7faed814c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.218+0000 7faedf750700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faed80c4040 0x7faed814b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.218+0000 7faedf750700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faed814b820 0x7faed80c5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.218+0000 7faedf750700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed81ef5c0 con 0x7faed80c4040 2024-05-08T21:49:55.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.218+0000 7faedf750700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed81ef2e0 con 0x7faec4003d60 2024-05-08T21:49:55.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.218+0000 7faedf750700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faed80c46a0 con 0x7faed814b820 2024-05-08T21:49:55.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.216+0000 7f6b792f5700 1 Processor -- start 2024-05-08T21:49:55.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.216+0000 7f6b792f5700 1 -- start start 2024-05-08T21:49:55.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.217+0000 7f6b792f5700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6b7415bb00 0x7f6b7415e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.217+0000 7f6b792f5700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6b740cb6e0 0x7f6b74162200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.217+0000 7f6b792f5700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b740cbcb0 con 0x7f6b740b4b00 2024-05-08T21:49:55.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.217+0000 7f6b792f5700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b741617b0 con 0x7f6b7415bb00 2024-05-08T21:49:55.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.217+0000 7f6b792f5700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b74161d70 con 0x7f6b740cb6e0 2024-05-08T21:49:55.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.217+0000 7f6b737fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6b740cb6e0 0x7f6b74162200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.217+0000 7f6b737fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6b740cb6e0 0x7f6b74162200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.73:53626/0 (socket says 172.21.15.73:53626) 2024-05-08T21:49:55.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.217+0000 7f6b737fe700 1 -- 172.21.15.73:0/993638454 learned_addr learned my addr 172.21.15.73:0/993638454 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:55.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.218+0000 7f6b737fe700 1 -- 172.21.15.73:0/993638454 >> v2:172.21.15.73:3300/0 conn(0x7f6b7415bb00 msgr2=0x7f6b7415e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:55.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.218+0000 7f6b737fe700 1 --2- 172.21.15.73:0/993638454 >> v2:172.21.15.73:3300/0 conn(0x7f6b7415bb00 0x7f6b7415e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.218+0000 7f6b737fe700 1 -- 172.21.15.73:0/993638454 >> v1:172.21.15.115:6789/0 conn(0x7f6b740b4b00 legacy=0x7f6b740cbf10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T21:49:55.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.218+0000 7f6b737fe700 1 -- 172.21.15.73:0/993638454 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b7415bee0 con 0x7f6b740cb6e0 2024-05-08T21:49:55.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.217+0000 7f04c7e7e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f04c00c53f0 0x7f04c006e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.217+0000 7f04c7e7e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04c00c7c40 con 0x7f04c006e8a0 2024-05-08T21:49:55.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.217+0000 7f04c7e7e700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04c0071320 con 0x7f04c0158410 2024-05-08T21:49:55.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.217+0000 7f04c7e7e700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04c00c2d40 con 0x7f04c00c53f0 2024-05-08T21:49:55.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.217+0000 7f04c5c1a700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f04c0158410 0x7f04c015e0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.73:46974/0 (socket says 172.21.15.73:46974) 2024-05-08T21:49:55.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.217+0000 7f04c5c1a700 1 -- 172.21.15.73:0/2455795600 learned_addr learned my addr 172.21.15.73:0/2455795600 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:49:55.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.218+0000 7f9498874700 1 -- 172.21.15.73:0/987897721 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9494161670 msgr2=0x7f9494137710 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T21:49:55.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.218+0000 7f9498874700 1 --2- 172.21.15.73:0/987897721 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9494161670 0x7f9494137710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.218+0000 7f9498874700 1 -- 172.21.15.73:0/987897721 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94941581f0 msgr2=0x7f94940ca440 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T21:49:55.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.218+0000 7f9498874700 1 --2- 172.21.15.73:0/987897721 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94941581f0 0x7f94940ca440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.218+0000 7f9498874700 1 -- 172.21.15.73:0/987897721 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94880094a0 con 0x7f949413c340 2024-05-08T21:49:55.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.217+0000 7fcbae82e700 1 -- 172.21.15.73:0/4270707465 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcba81fc580 con 0x7fcba814fe00 2024-05-08T21:49:55.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.217+0000 7fcbae82e700 1 -- 172.21.15.73:0/4270707465 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcba81fcb40 con 0x7fcba814fe00 2024-05-08T21:49:55.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.218+0000 7f6b737fe700 1 --2- 172.21.15.73:0/993638454 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6b740cb6e0 0x7f6b74162200 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6b74074460 tx=0x7f6b6c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b5d196f2cedd6dd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:55.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.218+0000 7faedd4ec700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faec4003d60 0x7faed814c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.218+0000 7f9498874700 1 --2- 172.21.15.73:0/987897721 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f949413c340 0x7f94941543b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f948c00cba0 tx=0x7f948c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:55.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.218+0000 7faedcceb700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faed80c4040 0x7faed814b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.218+0000 7faedcceb700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faed80c4040 0x7faed814b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38904/0 (socket says 172.21.15.73:38904) 2024-05-08T21:49:55.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.218+0000 7faedcceb700 1 -- 172.21.15.73:0/2143239181 learned_addr learned my addr 172.21.15.73:0/2143239181 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:55.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.218+0000 7faeddced700 1 --2- 172.21.15.73:0/2143239181 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faed814b820 0x7faed80c5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.219+0000 7faeddced700 1 -- 172.21.15.73:0/2143239181 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faec4003d60 msgr2=0x7faed814c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.219+0000 7faeddced700 1 --2- 172.21.15.73:0/2143239181 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faec4003d60 0x7faed814c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.219+0000 7faeddced700 1 -- 172.21.15.73:0/2143239181 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faed80c4040 msgr2=0x7faed814b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.219+0000 7faeddced700 1 --2- 172.21.15.73:0/2143239181 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faed80c4040 0x7faed814b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.219+0000 7faeddced700 1 -- 172.21.15.73:0/2143239181 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed80c4980 con 0x7faed814b820 2024-05-08T21:49:55.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.219+0000 7faeddced700 1 --2- 172.21.15.73:0/2143239181 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faed814b820 0x7faed80c5480 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7faed80cc1c0 tx=0x7faec800c670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:55.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.219+0000 7f04c5419700 1 --2- 172.21.15.73:0/2455795600 >> v2:172.21.15.115:3300/0 conn(0x7f04c00c53f0 0x7f04c006e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.219+0000 7fcbae82e700 1 -- 172.21.15.73:0/4270707465 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcb88000fc0 con 0x7fcba814fe00 2024-05-08T21:49:55.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.218+0000 7f9490ff9700 1 -- 172.21.15.73:0/987897721 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948c003c00 con 0x7f949413c340 2024-05-08T21:49:55.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.219+0000 7f9490ff9700 1 -- 172.21.15.73:0/987897721 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f948c003d60 con 0x7f949413c340 2024-05-08T21:49:55.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.219+0000 7f9490ff9700 1 -- 172.21.15.73:0/987897721 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948c00abc0 con 0x7f949413c340 2024-05-08T21:49:55.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.219+0000 7f949a2d7700 1 -- 172.21.15.73:0/987897721 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f949415d1c0 con 0x7f949413c340 2024-05-08T21:49:55.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.219+0000 7f949a2d7700 1 -- 172.21.15.73:0/987897721 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f949415bca0 con 0x7f949413c340 2024-05-08T21:49:55.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.219+0000 7f6b71ffb700 1 -- 172.21.15.73:0/993638454 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6c00e070 con 0x7f6b740cb6e0 2024-05-08T21:49:55.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.219+0000 7f6b71ffb700 1 -- 172.21.15.73:0/993638454 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b6c003a20 con 0x7f6b740cb6e0 2024-05-08T21:49:55.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.219+0000 7f6b71ffb700 1 -- 172.21.15.73:0/993638454 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6c003dd0 con 0x7f6b740cb6e0 2024-05-08T21:49:55.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.220+0000 7fc7c487c700 1 -- 172.21.15.73:0/2718462328 shutdown_connections 2024-05-08T21:49:55.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.219+0000 7f04c4c18700 1 -- 172.21.15.73:0/2455795600 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3088838488 0 0) 0x7f04c0071320 con 0x7f04c0158410 2024-05-08T21:49:55.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.220+0000 7f04c4c18700 1 -- 172.21.15.73:0/2455795600 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04ac0035b0 con 0x7f04c0158410 2024-05-08T21:49:55.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.220+0000 7fc7c487c700 1 -- 172.21.15.73:0/2718462328 wait complete. 2024-05-08T21:49:55.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.220+0000 7f04c5419700 1 -- 172.21.15.73:0/2455795600 >> v1:172.21.15.115:6789/0 conn(0x7f04c0158410 legacy=0x7f04c015e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.220+0000 7f04c5419700 1 -- 172.21.15.73:0/2455795600 >> v1:172.21.15.73:6789/0 conn(0x7f04c006e8a0 legacy=0x7f04c0071d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:55.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.220+0000 7f04c5419700 1 -- 172.21.15.73:0/2455795600 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c00718e0 con 0x7f04c00c53f0 2024-05-08T21:49:55.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.220+0000 7f04c5419700 1 --2- 172.21.15.73:0/2455795600 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04c00c53f0 0x7f04c006e360 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f04b8009d90 tx=0x7f04b800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8ecc1c79b9ceba3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:55.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.220+0000 7f949a2d7700 1 -- 172.21.15.73:0/987897721 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f949415c040 con 0x7f949413c340 2024-05-08T21:49:55.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.221+0000 7faecdffb700 1 -- 172.21.15.73:0/2143239181 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec8007310 con 0x7faed814b820 2024-05-08T21:49:55.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.221+0000 7faecdffb700 1 -- 172.21.15.73:0/2143239181 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec800ced0 con 0x7faed814b820 2024-05-08T21:49:55.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.221+0000 7faecdffb700 1 -- 172.21.15.73:0/2143239181 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec80076b0 con 0x7faed814b820 2024-05-08T21:49:55.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.221+0000 7faedf750700 1 -- 172.21.15.73:0/2143239181 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faed80c4f60 con 0x7faed814b820 2024-05-08T21:49:55.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.221+0000 7faedf750700 1 -- 172.21.15.73:0/2143239181 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faed80c4c60 con 0x7faed814b820 2024-05-08T21:49:55.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.221+0000 7fcba4ff9700 1 -- 172.21.15.73:0/4270707465 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fcb9c01c460 con 0x7fcba814fe00 2024-05-08T21:49:55.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.222+0000 7fc7c487c700 1 Processor -- start 2024-05-08T21:49:55.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.222+0000 7f9490ff9700 1 -- 172.21.15.73:0/987897721 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f948c00ad20 con 0x7f949413c340 2024-05-08T21:49:55.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.222+0000 7f9490ff9700 1 --2- 172.21.15.73:0/987897721 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f948006acc0 0x7f948006d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.222+0000 7f9490ff9700 1 -- 172.21.15.73:0/987897721 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f948c089550 con 0x7f949413c340 2024-05-08T21:49:55.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.222+0000 7f9490ff9700 1 --2- 172.21.15.73:0/987897721 >> [v2:172.21.15.73:6808/47228,v1:172.21.15.73:6809/47228] conn(0x7f9480072e60 0x7f9480075280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.222+0000 7f9490ff9700 1 -- 172.21.15.73:0/987897721 --> [v2:172.21.15.73:6808/47228,v1:172.21.15.73:6809/47228] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9480075930 con 0x7f9480072e60 2024-05-08T21:49:55.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.223+0000 7f9493fff700 1 --2- 172.21.15.73:0/987897721 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f948006acc0 0x7f948006d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.223+0000 7f9490ff9700 1 -- 172.21.15.73:0/987897721 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f948c054600 con 0x7f949413c340 2024-05-08T21:49:55.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.222+0000 7fcba4ff9700 1 --2- 172.21.15.73:0/4270707465 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fcb9406ad60 0x7fcb9406d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.222+0000 7fcba4ff9700 1 -- 172.21.15.73:0/4270707465 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcb9c0893a0 con 0x7fcba814fe00 2024-05-08T21:49:55.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.222+0000 7fcba4ff9700 1 --2- 172.21.15.73:0/4270707465 >> [v2:172.21.15.73:6816/47229,v1:172.21.15.73:6817/47229] conn(0x7fcb94072f80 0x7fcb940753a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.222+0000 7fcba4ff9700 1 -- 172.21.15.73:0/4270707465 --> [v2:172.21.15.73:6816/47229,v1:172.21.15.73:6817/47229] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcb94075a50 con 0x7fcb94072f80 2024-05-08T21:49:55.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.222+0000 7fcba4ff9700 1 -- 172.21.15.73:0/4270707465 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcb9c089750 con 0x7fcba814fe00 2024-05-08T21:49:55.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.223+0000 7fcba7fff700 1 --2- 172.21.15.73:0/4270707465 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fcb9406ad60 0x7fcb9406d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.223+0000 7fcba77fe700 1 --2- 172.21.15.73:0/4270707465 >> [v2:172.21.15.73:6816/47229,v1:172.21.15.73:6817/47229] conn(0x7fcb94072f80 0x7fcb940753a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.223+0000 7faedf750700 1 -- 172.21.15.73:0/2143239181 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faeb8000fc0 con 0x7faed814b820 2024-05-08T21:49:55.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.221+0000 7f6b792f5700 1 -- 172.21.15.73:0/993638454 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6b740cb6e0 msgr2=0x7f6b74162200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.221+0000 7f6b792f5700 1 --2- 172.21.15.73:0/993638454 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6b740cb6e0 0x7f6b74162200 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6b74074460 tx=0x7f6b6c00b330 comp rx=0 tx=0).stop 2024-05-08T21:49:55.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.222+0000 7fc7c487c700 1 -- start start 2024-05-08T21:49:55.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.223+0000 7fc7c487c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7c00ca5f0 0x7fc7c0158690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.223+0000 7fc7c487c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7c0150010 0x7fc7c014d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.223+0000 7fc7c487c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7c0159260 0x7fc7c0135ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.223+0000 7fc7c487c700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c0070880 con 0x7fc7c0159260 2024-05-08T21:49:55.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.223+0000 7fc7c487c700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c0070e40 con 0x7fc7c00ca5f0 2024-05-08T21:49:55.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.223+0000 7fc7c487c700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c014b510 con 0x7fc7c0150010 2024-05-08T21:49:55.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.223+0000 7fc7bdd9b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7c0150010 0x7fc7c014d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.223+0000 7fc7bdd9b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7c0150010 0x7fc7c014d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.73:52622/0 (socket says 172.21.15.73:52622) 2024-05-08T21:49:55.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.223+0000 7fc7bdd9b700 1 -- 172.21.15.73:0/1385181904 learned_addr learned my addr 172.21.15.73:0/1385181904 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:55.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.223+0000 7fc7be59c700 1 --2- 172.21.15.73:0/1385181904 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7c00ca5f0 0x7fc7c0158690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.220+0000 7f04c4c18700 1 -- 172.21.15.73:0/2455795600 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b800e070 con 0x7f04c00c53f0 2024-05-08T21:49:55.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.220+0000 7f04c4c18700 1 -- 172.21.15.73:0/2455795600 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04b800baa0 con 0x7f04c00c53f0 2024-05-08T21:49:55.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.220+0000 7f04c4c18700 1 -- 172.21.15.73:0/2455795600 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b800be50 con 0x7f04c00c53f0 2024-05-08T21:49:55.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.221+0000 7f04c7e7e700 1 -- 172.21.15.73:0/2455795600 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04c00c53f0 msgr2=0x7f04c006e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.221+0000 7f04c7e7e700 1 --2- 172.21.15.73:0/2455795600 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04c00c53f0 0x7f04c006e360 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f04b8009d90 tx=0x7f04b800b330 comp rx=0 tx=0).stop 2024-05-08T21:49:55.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.223+0000 7f04c7e7e700 1 -- 172.21.15.73:0/2455795600 shutdown_connections 2024-05-08T21:49:55.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.223+0000 7f04c7e7e700 1 --2- 172.21.15.73:0/2455795600 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04c00c53f0 0x7f04c006e360 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.223+0000 7f04c7e7e700 1 -- 172.21.15.73:0/2455795600 >> 172.21.15.73:0/2455795600 conn(0x7f04c00cb560 msgr2=0x7f04c00cb970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:55.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.223+0000 7f94937fe700 1 --2- 172.21.15.73:0/987897721 >> [v2:172.21.15.73:6808/47228,v1:172.21.15.73:6809/47228] conn(0x7f9480072e60 0x7f9480075280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.223+0000 7fc7bdd9b700 1 -- 172.21.15.73:0/1385181904 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7c00ca5f0 msgr2=0x7fc7c0158690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.223+0000 7fc7bdd9b700 1 --2- 172.21.15.73:0/1385181904 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7c00ca5f0 0x7fc7c0158690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.223+0000 7fc7bed9d700 1 --2- 172.21.15.73:0/1385181904 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7c0159260 0x7fc7c0135ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.223+0000 7fc7bdd9b700 1 -- 172.21.15.73:0/1385181904 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7c0159260 msgr2=0x7fc7c0135ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.224+0000 7fcba77fe700 1 --2- 172.21.15.73:0/4270707465 >> [v2:172.21.15.73:6816/47229,v1:172.21.15.73:6817/47229] conn(0x7fcb94072f80 0x7fcb940753a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:55.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.224+0000 7fc7bdd9b700 1 --2- 172.21.15.73:0/1385181904 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7c0159260 0x7fc7c0135ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.224+0000 7fc7bdd9b700 1 -- 172.21.15.73:0/1385181904 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b4009550 con 0x7fc7c0150010 2024-05-08T21:49:55.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.224+0000 7fc7bed9d700 1 --2- 172.21.15.73:0/1385181904 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7c0159260 0x7fc7c0135ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:49:55.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.224+0000 7fcba7fff700 1 --2- 172.21.15.73:0/4270707465 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fcb9406ad60 0x7fcb9406d220 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcba00097a0 tx=0x7fcba001a040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:55.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.224+0000 7f94937fe700 1 --2- 172.21.15.73:0/987897721 >> [v2:172.21.15.73:6808/47228,v1:172.21.15.73:6809/47228] conn(0x7f9480072e60 0x7f9480075280 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:55.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.224+0000 7faecdffb700 1 -- 172.21.15.73:0/2143239181 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7faec8005850 con 0x7faed814b820 2024-05-08T21:49:55.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.224+0000 7fc7bdd9b700 1 --2- 172.21.15.73:0/1385181904 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7c0150010 0x7fc7c014d550 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc7b000b4a0 tx=0x7fc7b000b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:55.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.224+0000 7f9493fff700 1 --2- 172.21.15.73:0/987897721 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f948006acc0 0x7f948006d180 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9484001380 tx=0x7f94840010f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:55.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.225+0000 7f9490ff9700 1 -- 172.21.15.73:0/987897721 <== osd.0 v2:172.21.15.73:6808/47228 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f9480075930 con 0x7f9480072e60 2024-05-08T21:49:55.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.224+0000 7faecdffb700 1 --2- 172.21.15.73:0/2143239181 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7faec4075180 0x7faec4077640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.224+0000 7faecdffb700 1 -- 172.21.15.73:0/2143239181 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faec8088060 con 0x7faed814b820 2024-05-08T21:49:55.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.225+0000 7faecdffb700 1 --2- 172.21.15.73:0/2143239181 >> [v2:172.21.15.73:6824/47232,v1:172.21.15.73:6825/47232] conn(0x7faec407d320 0x7faec407f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.225+0000 7faecdffb700 1 -- 172.21.15.73:0/2143239181 --> [v2:172.21.15.73:6824/47232,v1:172.21.15.73:6825/47232] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faec407fdf0 con 0x7faec407d320 2024-05-08T21:49:55.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.225+0000 7faecdffb700 1 -- 172.21.15.73:0/2143239181 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7faec8001120 con 0x7faed814b820 2024-05-08T21:49:55.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.224+0000 7f6b792f5700 1 -- 172.21.15.73:0/993638454 shutdown_connections 2024-05-08T21:49:55.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.224+0000 7f6b792f5700 1 --2- 172.21.15.73:0/993638454 >> v2:172.21.15.73:3300/0 conn(0x7f6b7415bb00 0x7f6b7415e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.224+0000 7f6b792f5700 1 --2- 172.21.15.73:0/993638454 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6b740cb6e0 0x7f6b74162200 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.224+0000 7f6b792f5700 1 -- 172.21.15.73:0/993638454 >> 172.21.15.73:0/993638454 conn(0x7f6b7406be90 msgr2=0x7f6b7406c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:55.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.224+0000 7fc7aeffd700 1 -- 172.21.15.73:0/1385181904 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b0011830 con 0x7fc7c0150010 2024-05-08T21:49:55.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.224+0000 7fc7aeffd700 1 -- 172.21.15.73:0/1385181904 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7b00119b0 con 0x7fc7c0150010 2024-05-08T21:49:55.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.224+0000 7fc7c487c700 1 -- 172.21.15.73:0/1385181904 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7c0088e10 con 0x7fc7c0150010 2024-05-08T21:49:55.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.224+0000 7fc7c487c700 1 -- 172.21.15.73:0/1385181904 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7c0070ad0 con 0x7fc7c0150010 2024-05-08T21:49:55.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.224+0000 7f04c7e7e700 1 -- 172.21.15.73:0/2455795600 shutdown_connections 2024-05-08T21:49:55.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.225+0000 7fc7c487c700 1 -- 172.21.15.73:0/1385181904 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc7c008b390 con 0x7fc7c0150010 2024-05-08T21:49:55.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.225+0000 7faedd4ec700 1 --2- 172.21.15.73:0/2143239181 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7faec4075180 0x7faec4077640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.226+0000 7faedcceb700 1 --2- 172.21.15.73:0/2143239181 >> [v2:172.21.15.73:6824/47232,v1:172.21.15.73:6825/47232] conn(0x7faec407d320 0x7faec407f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.226+0000 7faedd4ec700 1 --2- 172.21.15.73:0/2143239181 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7faec4075180 0x7faec4077640 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7faed0000f80 tx=0x7faed0009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:55.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.226+0000 7fc7aeffd700 1 -- 172.21.15.73:0/1385181904 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b0011d60 con 0x7fc7c0150010 2024-05-08T21:49:55.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.224+0000 7f04c7e7e700 1 -- 172.21.15.73:0/2455795600 wait complete. 2024-05-08T21:49:55.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.226+0000 7f04c7e7e700 1 Processor -- start 2024-05-08T21:49:55.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.226+0000 7f6b792f5700 1 -- 172.21.15.73:0/993638454 shutdown_connections 2024-05-08T21:49:55.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.226+0000 7f6b792f5700 1 -- 172.21.15.73:0/993638454 wait complete. 2024-05-08T21:49:55.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.228+0000 7f6b792f5700 1 Processor -- start 2024-05-08T21:49:55.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.226+0000 7f04c7e7e700 1 -- start start 2024-05-08T21:49:55.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.228+0000 7f04c7e7e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04c006e8a0 0x7f04c01ffd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.228+0000 7f04c7e7e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f04c00c53f0 0x7f04c0071fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.228+0000 7f04c7e7e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04c0158410 0x7f04c01fc510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.228+0000 7f04c7e7e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c015e460 con 0x7f04c006e8a0 2024-05-08T21:49:55.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.228+0000 7f04c7e7e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c0158a00 con 0x7f04c0158410 2024-05-08T21:49:55.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.228+0000 7f04c7e7e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04c01fbe00 con 0x7f04c00c53f0 2024-05-08T21:49:55.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.228+0000 7f04c5419700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f04c00c53f0 0x7f04c0071fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.228+0000 7f6b792f5700 1 -- start start 2024-05-08T21:49:55.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.228+0000 7f04c641b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04c0158410 0x7f04c01fc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.228+0000 7f04c641b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04c0158410 0x7f04c01fc510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.73:53674/0 (socket says 172.21.15.73:53674) 2024-05-08T21:49:55.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.228+0000 7f04c641b700 1 -- 172.21.15.73:0/3961246327 learned_addr learned my addr 172.21.15.73:0/3961246327 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:55.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.229+0000 7f04c5419700 1 -- 172.21.15.73:0/3961246327 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04c0158410 msgr2=0x7f04c01fc510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.229+0000 7f04c5419700 1 --2- 172.21.15.73:0/3961246327 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04c0158410 0x7f04c01fc510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.229+0000 7f04c5419700 1 -- 172.21.15.73:0/3961246327 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04c006e8a0 msgr2=0x7f04c01ffd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.229+0000 7f04c5419700 1 --2- 172.21.15.73:0/3961246327 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04c006e8a0 0x7f04c01ffd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.229+0000 7f04c5419700 1 -- 172.21.15.73:0/3961246327 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b8009a70 con 0x7f04c00c53f0 2024-05-08T21:49:55.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.226+0000 7fcba4ff9700 1 -- 172.21.15.73:0/4270707465 <== osd.2 v2:172.21.15.73:6816/47229 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fcb94075a50 con 0x7fcb94072f80 2024-05-08T21:49:55.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.229+0000 7faedcceb700 1 --2- 172.21.15.73:0/2143239181 >> [v2:172.21.15.73:6824/47232,v1:172.21.15.73:6825/47232] conn(0x7faec407d320 0x7faec407f740 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:55.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.229+0000 7f04c5419700 1 --2- 172.21.15.73:0/3961246327 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f04c00c53f0 0x7f04c0071fe0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f04b8015000 tx=0x7f04b8004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:55.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.228+0000 7fc7aeffd700 1 -- 172.21.15.73:0/1385181904 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc7b001a400 con 0x7fc7c0150010 2024-05-08T21:49:55.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.229+0000 7fc7aeffd700 1 --2- 172.21.15.73:0/1385181904 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fc7a006ad10 0x7fc7a006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.229+0000 7fc7aeffd700 1 -- 172.21.15.73:0/1385181904 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc7b0089b20 con 0x7fc7c0150010 2024-05-08T21:49:55.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.229+0000 7fc7aeffd700 1 --2- 172.21.15.73:0/1385181904 >> [v2:172.21.15.115:6808/47201,v1:172.21.15.115:6809/47201] conn(0x7fc7a0072f30 0x7fc7a0075350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.229+0000 7fc7aeffd700 1 -- 172.21.15.73:0/1385181904 --> [v2:172.21.15.115:6808/47201,v1:172.21.15.115:6809/47201] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc7a0075a00 con 0x7fc7a0072f30 2024-05-08T21:49:55.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.229+0000 7fc7aeffd700 1 -- 172.21.15.73:0/1385181904 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc7b0089ed0 con 0x7fc7c0150010 2024-05-08T21:49:55.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.230+0000 7fc7bed9d700 1 --2- 172.21.15.73:0/1385181904 >> [v2:172.21.15.115:6808/47201,v1:172.21.15.115:6809/47201] conn(0x7fc7a0072f30 0x7fc7a0075350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.230+0000 7fc7be59c700 1 --2- 172.21.15.73:0/1385181904 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fc7a006ad10 0x7fc7a006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.230+0000 7faecdffb700 1 -- 172.21.15.73:0/2143239181 <== osd.3 v2:172.21.15.73:6824/47232 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7faec407fdf0 con 0x7faec407d320 2024-05-08T21:49:55.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.229+0000 7f6b792f5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b740b4b00 0x7f6b7415f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.229+0000 7f6b792f5700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6b740cb6e0 0x7f6b7415d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.229+0000 7f6b792f5700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6b7415bb00 0x7f6b740ced70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.229+0000 7f6b792f5700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b741615c0 con 0x7f6b740b4b00 2024-05-08T21:49:55.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.229+0000 7f6b792f5700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b740cd650 con 0x7f6b740cb6e0 2024-05-08T21:49:55.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.229+0000 7f6b792f5700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b74153730 con 0x7f6b7415bb00 2024-05-08T21:49:55.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.229+0000 7f6b737fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6b7415bb00 0x7f6b740ced70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.229+0000 7f6b737fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6b7415bb00 0x7f6b740ced70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.73:52636/0 (socket says 172.21.15.73:52636) 2024-05-08T21:49:55.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.229+0000 7f6b737fe700 1 -- 172.21.15.73:0/1291862154 learned_addr learned my addr 172.21.15.73:0/1291862154 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:55.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.230+0000 7f6b737fe700 1 -- 172.21.15.73:0/1291862154 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6b740cb6e0 msgr2=0x7f6b7415d510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T21:49:55.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.230+0000 7f6b737fe700 1 --2- 172.21.15.73:0/1291862154 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6b740cb6e0 0x7f6b7415d510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.230+0000 7f6b737fe700 1 -- 172.21.15.73:0/1291862154 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b740b4b00 msgr2=0x7f6b7415f3a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T21:49:55.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.230+0000 7f6b737fe700 1 --2- 172.21.15.73:0/1291862154 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b740b4b00 0x7f6b7415f3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.230+0000 7f6b737fe700 1 -- 172.21.15.73:0/1291862154 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b6c009b30 con 0x7f6b7415bb00 2024-05-08T21:49:55.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.229+0000 7f04b67fc700 1 -- 172.21.15.73:0/3961246327 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b8004970 con 0x7f04c00c53f0 2024-05-08T21:49:55.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.229+0000 7f04b67fc700 1 -- 172.21.15.73:0/3961246327 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04b8009410 con 0x7f04c00c53f0 2024-05-08T21:49:55.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.229+0000 7f04b67fc700 1 -- 172.21.15.73:0/3961246327 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b80266a0 con 0x7f04c00c53f0 2024-05-08T21:49:55.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.229+0000 7f04c7e7e700 1 -- 172.21.15.73:0/3961246327 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04c02002c0 con 0x7f04c00c53f0 2024-05-08T21:49:55.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.229+0000 7f04c7e7e700 1 -- 172.21.15.73:0/3961246327 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04c015b230 con 0x7f04c00c53f0 2024-05-08T21:49:55.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.231+0000 7fc7bed9d700 1 --2- 172.21.15.73:0/1385181904 >> [v2:172.21.15.115:6808/47201,v1:172.21.15.115:6809/47201] conn(0x7fc7a0072f30 0x7fc7a0075350 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:55.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.231+0000 7fc7be59c700 1 --2- 172.21.15.73:0/1385181904 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fc7a006ad10 0x7fc7a006d1d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8007bf0 tx=0x7fc7b8007240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:55.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.232+0000 7fc7aeffd700 1 -- 172.21.15.73:0/1385181904 <== osd.5 v2:172.21.15.115:6808/47201 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fc7a0075a00 con 0x7fc7a0072f30 2024-05-08T21:49:55.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.233+0000 7f04b67fc700 1 -- 172.21.15.73:0/3961246327 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f04b8012430 con 0x7f04c00c53f0 2024-05-08T21:49:55.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.233+0000 7f04b67fc700 1 --2- 172.21.15.73:0/3961246327 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f04a406ad60 0x7f04a406d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.233+0000 7f04b67fc700 1 -- 172.21.15.73:0/3961246327 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f04b808b530 con 0x7f04c00c53f0 2024-05-08T21:49:55.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.234+0000 7f04c5c1a700 1 --2- 172.21.15.73:0/3961246327 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f04a406ad60 0x7f04a406d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.234+0000 7f04c5c1a700 1 --2- 172.21.15.73:0/3961246327 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f04a406ad60 0x7f04a406d220 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f04b0000c00 tx=0x7f04b0007a50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:55.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.235+0000 7f04c7e7e700 1 --2- 172.21.15.73:0/3961246327 >> [v2:172.21.15.115:6824/47211,v1:172.21.15.115:6825/47211] conn(0x7f04a80015e0 0x7f04a8003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.235+0000 7f04c7e7e700 1 -- 172.21.15.73:0/3961246327 --> [v2:172.21.15.115:6824/47211,v1:172.21.15.115:6825/47211] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f04a8006bd0 con 0x7f04a80015e0 2024-05-08T21:49:55.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.236+0000 7f6b737fe700 1 --2- 172.21.15.73:0/1291862154 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6b7415bb00 0x7f6b740ced70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6b74161eb0 tx=0x7f6b6c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:55.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.236+0000 7f6b5b7fe700 1 -- 172.21.15.73:0/1291862154 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6c004500 con 0x7f6b7415bb00 2024-05-08T21:49:55.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.236+0000 7f6b5b7fe700 1 -- 172.21.15.73:0/1291862154 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b6c004680 con 0x7f6b7415bb00 2024-05-08T21:49:55.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.236+0000 7f6b792f5700 1 -- 172.21.15.73:0/1291862154 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b74153a10 con 0x7f6b7415bb00 2024-05-08T21:49:55.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.236+0000 7f6b5b7fe700 1 -- 172.21.15.73:0/1291862154 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6c012430 con 0x7f6b7415bb00 2024-05-08T21:49:55.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.236+0000 7f6b792f5700 1 -- 172.21.15.73:0/1291862154 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b74153fd0 con 0x7f6b7415bb00 2024-05-08T21:49:55.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.237+0000 7f04c641b700 1 --2- 172.21.15.73:0/3961246327 >> [v2:172.21.15.115:6824/47211,v1:172.21.15.115:6825/47211] conn(0x7f04a80015e0 0x7f04a8003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.237+0000 7f04c641b700 1 --2- 172.21.15.73:0/3961246327 >> [v2:172.21.15.115:6824/47211,v1:172.21.15.115:6825/47211] conn(0x7f04a80015e0 0x7f04a8003aa0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:55.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.238+0000 7f04b67fc700 1 -- 172.21.15.73:0/3961246327 <== osd.7 v2:172.21.15.115:6824/47211 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f04a8006bd0 con 0x7f04a80015e0 2024-05-08T21:49:55.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.238+0000 7fb09e7d5700 1 -- 172.21.15.73:0/3796512631 --> [v2:172.21.15.73:6800/47227,v1:172.21.15.73:6801/47227] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb078002d40 con 0x7fb084072eb0 2024-05-08T21:49:55.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.238+0000 7fb094ff9700 1 -- 172.21.15.73:0/3796512631 <== osd.1 v2:172.21.15.73:6800/47227 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb078002d40 con 0x7fb084072eb0 2024-05-08T21:49:55.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.242+0000 7fb09e7d5700 1 -- 172.21.15.73:0/3796512631 >> [v2:172.21.15.73:6800/47227,v1:172.21.15.73:6801/47227] conn(0x7fb084072eb0 msgr2=0x7fb0840752d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.242+0000 7fb09e7d5700 1 --2- 172.21.15.73:0/3796512631 >> [v2:172.21.15.73:6800/47227,v1:172.21.15.73:6801/47227] conn(0x7fb084072eb0 0x7fb0840752d0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.242+0000 7fb09e7d5700 1 -- 172.21.15.73:0/3796512631 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fb08406ad10 msgr2=0x7fb08406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.242+0000 7fb09e7d5700 1 --2- 172.21.15.73:0/3796512631 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fb08406ad10 0x7fb08406d1d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb0980c9020 tx=0x7fb08c008040 comp rx=0 tx=0).stop 2024-05-08T21:49:55.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.242+0000 7fb09e7d5700 1 -- 172.21.15.73:0/3796512631 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb098071590 msgr2=0x7fb0980c0930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.242+0000 7fb09e7d5700 1 --2- 172.21.15.73:0/3796512631 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb098071590 0x7fb0980c0930 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb09000ba80 tx=0x7fb09000be40 comp rx=0 tx=0).stop 2024-05-08T21:49:55.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.244+0000 7fb09cd72700 1 -- 172.21.15.73:0/3796512631 reap_dead start 2024-05-08T21:49:55.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.244+0000 7fb09e7d5700 1 -- 172.21.15.73:0/3796512631 shutdown_connections 2024-05-08T21:49:55.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.244+0000 7fb09e7d5700 1 -- 172.21.15.73:0/3796512631 >> 172.21.15.73:0/3796512631 conn(0x7fb0980cb560 msgr2=0x7fb0980723d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:55.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.244+0000 7f6b792f5700 1 -- 172.21.15.73:0/1291862154 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6b54000fc0 con 0x7f6b7415bb00 2024-05-08T21:49:55.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.245+0000 7f221d9d7700 1 Processor -- start 2024-05-08T21:49:55.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.245+0000 7f221d9d7700 1 -- start start 2024-05-08T21:49:55.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.246+0000 7f221d9d7700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f221806bd40 0x7f22180c3100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.246+0000 7f221d9d7700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f221806c120 0x7f22180c6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.246+0000 7f221d9d7700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22180c5730 con 0x7f22180c6890 2024-05-08T21:49:55.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.246+0000 7f221d9d7700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22180c4bb0 con 0x7f221806bd40 2024-05-08T21:49:55.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.246+0000 7f221d9d7700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22180c4e90 con 0x7f221806c120 2024-05-08T21:49:55.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.246+0000 7f2216ffd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f221806bd40 0x7f22180c3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.246+0000 7f2216ffd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f221806bd40 0x7f22180c3100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.73:53678/0 (socket says 172.21.15.73:53678) 2024-05-08T21:49:55.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.246+0000 7f2216ffd700 1 -- 172.21.15.73:0/3798942100 learned_addr learned my addr 172.21.15.73:0/3798942100 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:55.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.246+0000 7f2216ffd700 1 -- 172.21.15.73:0/3798942100 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f221806c120 msgr2=0x7f22180c6350 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T21:49:55.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.246+0000 7f2216ffd700 1 --2- 172.21.15.73:0/3798942100 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f221806c120 0x7f22180c6350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.246+0000 7f2216ffd700 1 -- 172.21.15.73:0/3798942100 >> v1:172.21.15.73:6789/0 conn(0x7f22180c6890 legacy=0x7f22181506b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:55.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.246+0000 7f2216ffd700 1 -- 172.21.15.73:0/3798942100 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22180c5170 con 0x7f221806bd40 2024-05-08T21:49:55.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.247+0000 7f2216ffd700 1 --2- 172.21.15.73:0/3798942100 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f221806bd40 0x7f22180c3100 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2208009e50 tx=0x7f220800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6915c11b021c56d7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:55.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.247+0000 7f22167fc700 1 -- 172.21.15.73:0/3798942100 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f220800e070 con 0x7f221806bd40 2024-05-08T21:49:55.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.247+0000 7f22167fc700 1 -- 172.21.15.73:0/3798942100 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2208003a20 con 0x7f221806bd40 2024-05-08T21:49:55.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.247+0000 7f22167fc700 1 -- 172.21.15.73:0/3798942100 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2208003dd0 con 0x7f221806bd40 2024-05-08T21:49:55.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.247+0000 7f221d9d7700 1 -- 172.21.15.73:0/3798942100 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f221806bd40 msgr2=0x7f22180c3100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.247+0000 7f221d9d7700 1 --2- 172.21.15.73:0/3798942100 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f221806bd40 0x7f22180c3100 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2208009e50 tx=0x7f220800b330 comp rx=0 tx=0).stop 2024-05-08T21:49:55.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.247+0000 7f221d9d7700 1 -- 172.21.15.73:0/3798942100 shutdown_connections 2024-05-08T21:49:55.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.247+0000 7f221d9d7700 1 --2- 172.21.15.73:0/3798942100 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f221806bd40 0x7f22180c3100 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.248+0000 7f221d9d7700 1 --2- 172.21.15.73:0/3798942100 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f221806c120 0x7f22180c6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.248+0000 7f221d9d7700 1 -- 172.21.15.73:0/3798942100 >> 172.21.15.73:0/3798942100 conn(0x7f221806eb90 msgr2=0x7f221806ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:55.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.248+0000 7fb09e7d5700 1 -- 172.21.15.73:0/3796512631 shutdown_connections 2024-05-08T21:49:55.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.248+0000 7fb09e7d5700 1 -- 172.21.15.73:0/3796512631 wait complete. 2024-05-08T21:49:55.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.248+0000 7f6b5b7fe700 1 -- 172.21.15.73:0/1291862154 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6b6c012590 con 0x7f6b7415bb00 2024-05-08T21:49:55.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.248+0000 7f6b5b7fe700 1 --2- 172.21.15.73:0/1291862154 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f6b6006acc0 0x7f6b6006d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.249+0000 7f6b5b7fe700 1 -- 172.21.15.73:0/1291862154 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6b6c08abb0 con 0x7f6b7415bb00 2024-05-08T21:49:55.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.249+0000 7f6b5b7fe700 1 --2- 172.21.15.73:0/1291862154 >> [v2:172.21.15.115:6800/47200,v1:172.21.15.115:6801/47200] conn(0x7f6b60072e60 0x7f6b60075280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.249+0000 7f6b5b7fe700 1 -- 172.21.15.73:0/1291862154 --> [v2:172.21.15.115:6800/47200,v1:172.21.15.115:6801/47200] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6b60075930 con 0x7f6b60072e60 2024-05-08T21:49:55.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.249+0000 7faedf750700 1 -- 172.21.15.73:0/2143239181 --> [v2:172.21.15.73:6824/47232,v1:172.21.15.73:6825/47232] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7faeb8002d40 con 0x7faec407d320 2024-05-08T21:49:55.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.249+0000 7f6b72ffd700 1 --2- 172.21.15.73:0/1291862154 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f6b6006acc0 0x7f6b6006d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.249+0000 7f6b727fc700 1 --2- 172.21.15.73:0/1291862154 >> [v2:172.21.15.115:6800/47200,v1:172.21.15.115:6801/47200] conn(0x7f6b60072e60 0x7f6b60075280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.250+0000 7faecdffb700 1 -- 172.21.15.73:0/2143239181 <== osd.3 v2:172.21.15.73:6824/47232 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7faeb8002d40 con 0x7faec407d320 2024-05-08T21:49:55.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.250+0000 7faedf750700 1 -- 172.21.15.73:0/2143239181 >> [v2:172.21.15.73:6824/47232,v1:172.21.15.73:6825/47232] conn(0x7faec407d320 msgr2=0x7faec407f740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.250+0000 7faedf750700 1 --2- 172.21.15.73:0/2143239181 >> [v2:172.21.15.73:6824/47232,v1:172.21.15.73:6825/47232] conn(0x7faec407d320 0x7faec407f740 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.250+0000 7f6b727fc700 1 --2- 172.21.15.73:0/1291862154 >> [v2:172.21.15.115:6800/47200,v1:172.21.15.115:6801/47200] conn(0x7f6b60072e60 0x7f6b60075280 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:55.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.250+0000 7f6b72ffd700 1 --2- 172.21.15.73:0/1291862154 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f6b6006acc0 0x7f6b6006d180 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6b64009690 tx=0x7f6b64006c10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:55.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.250+0000 7f221d9d7700 1 -- 172.21.15.73:0/3798942100 shutdown_connections 2024-05-08T21:49:55.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.250+0000 7faedf750700 1 -- 172.21.15.73:0/2143239181 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7faec4075180 msgr2=0x7faec4077640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.250+0000 7faedf750700 1 --2- 172.21.15.73:0/2143239181 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7faec4075180 0x7faec4077640 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7faed0000f80 tx=0x7faed0009030 comp rx=0 tx=0).stop 2024-05-08T21:49:55.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.250+0000 7faedf750700 1 -- 172.21.15.73:0/2143239181 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faed814b820 msgr2=0x7faed80c5480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.250+0000 7faedf750700 1 --2- 172.21.15.73:0/2143239181 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faed814b820 0x7faed80c5480 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7faed80cc1c0 tx=0x7faec800c670 comp rx=0 tx=0).stop 2024-05-08T21:49:55.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.250+0000 7f221d9d7700 1 -- 172.21.15.73:0/3798942100 wait complete. 2024-05-08T21:49:55.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.250+0000 7faeddced700 1 -- 172.21.15.73:0/2143239181 reap_dead start 2024-05-08T21:49:55.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.251+0000 7f6b5b7fe700 1 -- 172.21.15.73:0/1291862154 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6b6c009410 con 0x7f6b7415bb00 2024-05-08T21:49:55.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.251+0000 7f6b5b7fe700 1 -- 172.21.15.73:0/1291862154 <== osd.4 v2:172.21.15.115:6800/47200 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f6b60075930 con 0x7f6b60072e60 2024-05-08T21:49:55.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.251+0000 7faedf750700 1 -- 172.21.15.73:0/2143239181 shutdown_connections 2024-05-08T21:49:55.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.251+0000 7faedf750700 1 -- 172.21.15.73:0/2143239181 >> 172.21.15.73:0/2143239181 conn(0x7faed80cb230 msgr2=0x7faed8070e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:55.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.252+0000 7faedf750700 1 -- 172.21.15.73:0/2143239181 shutdown_connections 2024-05-08T21:49:55.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.252+0000 7faedf750700 1 -- 172.21.15.73:0/2143239181 wait complete. 2024-05-08T21:49:55.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.252+0000 7f221d9d7700 1 Processor -- start 2024-05-08T21:49:55.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.252+0000 7f221d9d7700 1 -- start start 2024-05-08T21:49:55.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.253+0000 7f221d9d7700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f221806bd40 0x7f2218158d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.253+0000 7f221d9d7700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22180c6890 0x7f2218155140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.253+0000 7f221d9d7700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2218159990 0x7f22181f9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.253+0000 7f221d9d7700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2218157820 con 0x7f22180c6890 2024-05-08T21:49:55.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.253+0000 7f221d9d7700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2218156d60 con 0x7f221806bd40 2024-05-08T21:49:55.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.253+0000 7f221d9d7700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2218157390 con 0x7f2218159990 2024-05-08T21:49:55.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.253+0000 7f22177fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2218159990 0x7f22181f9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.253+0000 7f2216ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f221806bd40 0x7f2218158d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.253+0000 7f22177fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2218159990 0x7f22181f9710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.73:52660/0 (socket says 172.21.15.73:52660) 2024-05-08T21:49:55.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.253+0000 7f22177fe700 1 -- 172.21.15.73:0/2965870307 learned_addr learned my addr 172.21.15.73:0/2965870307 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:55.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.253+0000 7f220e7fc700 1 --2- 172.21.15.73:0/2965870307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22180c6890 0x7f2218155140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.254+0000 7f2216ffd700 1 -- 172.21.15.73:0/2965870307 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2218159990 msgr2=0x7f22181f9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.254+0000 7f2216ffd700 1 --2- 172.21.15.73:0/2965870307 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2218159990 0x7f22181f9710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.254+0000 7f2216ffd700 1 -- 172.21.15.73:0/2965870307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22180c6890 msgr2=0x7f2218155140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.254+0000 7f2216ffd700 1 --2- 172.21.15.73:0/2965870307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22180c6890 0x7f2218155140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.254+0000 7f2216ffd700 1 -- 172.21.15.73:0/2965870307 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2208009b30 con 0x7f221806bd40 2024-05-08T21:49:55.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.254+0000 7f220e7fc700 1 --2- 172.21.15.73:0/2965870307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22180c6890 0x7f2218155140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:49:55.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.254+0000 7f2216ffd700 1 --2- 172.21.15.73:0/2965870307 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f221806bd40 0x7f2218158d00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f22180c8400 tx=0x7f2208004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:55.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.254+0000 7f2214ff9700 1 -- 172.21.15.73:0/2965870307 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2208004240 con 0x7f221806bd40 2024-05-08T21:49:55.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.255+0000 7f221d9d7700 1 -- 172.21.15.73:0/2965870307 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2218154050 con 0x7f221806bd40 2024-05-08T21:49:55.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.254+0000 7f2214ff9700 1 -- 172.21.15.73:0/2965870307 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22080043a0 con 0x7f221806bd40 2024-05-08T21:49:55.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.255+0000 7f2214ff9700 1 -- 172.21.15.73:0/2965870307 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2208004730 con 0x7f221806bd40 2024-05-08T21:49:55.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.255+0000 7f221d9d7700 1 -- 172.21.15.73:0/2965870307 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2218152e60 con 0x7f221806bd40 2024-05-08T21:49:55.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.255+0000 7f949a2d7700 1 -- 172.21.15.73:0/987897721 --> [v2:172.21.15.73:6808/47228,v1:172.21.15.73:6809/47228] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f949415e830 con 0x7f9480072e60 2024-05-08T21:49:55.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.257+0000 7f9490ff9700 1 -- 172.21.15.73:0/987897721 <== osd.0 v2:172.21.15.73:6808/47228 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9488004220 con 0x7f9480072e60 2024-05-08T21:49:55.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.257+0000 7f2214ff9700 1 -- 172.21.15.73:0/2965870307 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2208019070 con 0x7f221806bd40 2024-05-08T21:49:55.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.257+0000 7f2214ff9700 1 --2- 172.21.15.73:0/2965870307 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f21f806acc0 0x7f21f806d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.258+0000 7f2214ff9700 1 -- 172.21.15.73:0/2965870307 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2208058d70 con 0x7f221806bd40 2024-05-08T21:49:55.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.262+0000 7fcbae82e700 1 -- 172.21.15.73:0/4270707465 --> [v2:172.21.15.73:6816/47229,v1:172.21.15.73:6817/47229] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcb88002d40 con 0x7fcb94072f80 2024-05-08T21:49:55.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.263+0000 7f220e7fc700 1 --2- 172.21.15.73:0/2965870307 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f21f806acc0 0x7f21f806d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.263+0000 7f220e7fc700 1 --2- 172.21.15.73:0/2965870307 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f21f806acc0 0x7f21f806d180 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2218159920 tx=0x7f2200006f90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:55.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.263+0000 7f04c7e7e700 1 -- 172.21.15.73:0/3961246327 --> [v2:172.21.15.115:6824/47211,v1:172.21.15.115:6825/47211] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f04a8005cb0 con 0x7f04a80015e0 2024-05-08T21:49:55.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.264+0000 7f949a2d7700 1 -- 172.21.15.73:0/987897721 >> [v2:172.21.15.73:6808/47228,v1:172.21.15.73:6809/47228] conn(0x7f9480072e60 msgr2=0x7f9480075280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.264+0000 7f949a2d7700 1 --2- 172.21.15.73:0/987897721 >> [v2:172.21.15.73:6808/47228,v1:172.21.15.73:6809/47228] conn(0x7f9480072e60 0x7f9480075280 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.264+0000 7f949a2d7700 1 -- 172.21.15.73:0/987897721 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f948006acc0 msgr2=0x7f948006d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.264+0000 7f949a2d7700 1 --2- 172.21.15.73:0/987897721 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f948006acc0 0x7f948006d180 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9484001380 tx=0x7f94840010f0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.264+0000 7f949a2d7700 1 -- 172.21.15.73:0/987897721 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f949413c340 msgr2=0x7f94941543b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.264+0000 7f949a2d7700 1 --2- 172.21.15.73:0/987897721 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f949413c340 0x7f94941543b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f948c00cba0 tx=0x7f948c00cf60 comp rx=0 tx=0).stop 2024-05-08T21:49:55.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.264+0000 7f9498874700 1 -- 172.21.15.73:0/987897721 reap_dead start 2024-05-08T21:49:55.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.264+0000 7f949a2d7700 1 -- 172.21.15.73:0/987897721 shutdown_connections 2024-05-08T21:49:55.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.264+0000 7f949a2d7700 1 -- 172.21.15.73:0/987897721 >> 172.21.15.73:0/987897721 conn(0x7f94940cb230 msgr2=0x7f949413f670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:55.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.264+0000 7f04b67fc700 1 -- 172.21.15.73:0/3961246327 <== osd.7 v2:172.21.15.115:6824/47211 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f04a8005cb0 con 0x7f04a80015e0 2024-05-08T21:49:55.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.264+0000 7fc7c487c700 1 -- 172.21.15.73:0/1385181904 --> [v2:172.21.15.115:6808/47201,v1:172.21.15.115:6809/47201] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc7c0159fb0 con 0x7fc7a0072f30 2024-05-08T21:49:55.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.264+0000 7f221d9d7700 1 --2- 172.21.15.73:0/2965870307 >> [v2:172.21.15.115:6816/47202,v1:172.21.15.115:6817/47202] conn(0x7f2218153ba0 0x7f221815a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.264+0000 7f221d9d7700 1 -- 172.21.15.73:0/2965870307 --> [v2:172.21.15.115:6816/47202,v1:172.21.15.115:6817/47202] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f22180c6e70 con 0x7f2218153ba0 2024-05-08T21:49:55.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.264+0000 7f04c7e7e700 1 -- 172.21.15.73:0/3961246327 >> [v2:172.21.15.115:6824/47211,v1:172.21.15.115:6825/47211] conn(0x7f04a80015e0 msgr2=0x7f04a8003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.264+0000 7f04c7e7e700 1 --2- 172.21.15.73:0/3961246327 >> [v2:172.21.15.115:6824/47211,v1:172.21.15.115:6825/47211] conn(0x7f04a80015e0 0x7f04a8003aa0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.265+0000 7fcba4ff9700 1 -- 172.21.15.73:0/4270707465 <== osd.2 v2:172.21.15.73:6816/47229 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fcb88002d40 con 0x7fcb94072f80 2024-05-08T21:49:55.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.265+0000 7f22177fe700 1 --2- 172.21.15.73:0/2965870307 >> [v2:172.21.15.115:6816/47202,v1:172.21.15.115:6817/47202] conn(0x7f2218153ba0 0x7f221815a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.265+0000 7f949a2d7700 1 -- 172.21.15.73:0/987897721 shutdown_connections 2024-05-08T21:49:55.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.265+0000 7f949a2d7700 1 -- 172.21.15.73:0/987897721 wait complete. 2024-05-08T21:49:55.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.265+0000 7f04c7e7e700 1 -- 172.21.15.73:0/3961246327 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f04a406ad60 msgr2=0x7f04a406d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.265+0000 7f04c7e7e700 1 --2- 172.21.15.73:0/3961246327 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f04a406ad60 0x7f04a406d220 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f04b0000c00 tx=0x7f04b0007a50 comp rx=0 tx=0).stop 2024-05-08T21:49:55.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.265+0000 7f04c7e7e700 1 -- 172.21.15.73:0/3961246327 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f04c00c53f0 msgr2=0x7f04c0071fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.265+0000 7f04c7e7e700 1 --2- 172.21.15.73:0/3961246327 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f04c00c53f0 0x7f04c0071fe0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f04b8015000 tx=0x7f04b8004ad0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.265+0000 7f04c641b700 1 -- 172.21.15.73:0/3961246327 reap_dead start 2024-05-08T21:49:55.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.265+0000 7f22177fe700 1 --2- 172.21.15.73:0/2965870307 >> [v2:172.21.15.115:6816/47202,v1:172.21.15.115:6817/47202] conn(0x7f2218153ba0 0x7f221815a1e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:55.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.266+0000 7fc7aeffd700 1 -- 172.21.15.73:0/1385181904 <== osd.5 v2:172.21.15.115:6808/47201 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc7b4004170 con 0x7fc7a0072f30 2024-05-08T21:49:55.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.266+0000 7f04c7e7e700 1 -- 172.21.15.73:0/3961246327 shutdown_connections 2024-05-08T21:49:55.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.266+0000 7f04c7e7e700 1 -- 172.21.15.73:0/3961246327 >> 172.21.15.73:0/3961246327 conn(0x7f04c00cb560 msgr2=0x7f04c00c6790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:55.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.266+0000 7f04c7e7e700 1 -- 172.21.15.73:0/3961246327 shutdown_connections 2024-05-08T21:49:55.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.266+0000 7f04c7e7e700 1 -- 172.21.15.73:0/3961246327 wait complete. 2024-05-08T21:49:55.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.266+0000 7f2214ff9700 1 -- 172.21.15.73:0/2965870307 <== osd.6 v2:172.21.15.115:6816/47202 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f22100095f0 con 0x7f2218153ba0 2024-05-08T21:49:55.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.267+0000 7fcbae82e700 1 -- 172.21.15.73:0/4270707465 >> [v2:172.21.15.73:6816/47229,v1:172.21.15.73:6817/47229] conn(0x7fcb94072f80 msgr2=0x7fcb940753a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.267+0000 7fcbae82e700 1 --2- 172.21.15.73:0/4270707465 >> [v2:172.21.15.73:6816/47229,v1:172.21.15.73:6817/47229] conn(0x7fcb94072f80 0x7fcb940753a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.267+0000 7fcbae82e700 1 -- 172.21.15.73:0/4270707465 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fcb9406ad60 msgr2=0x7fcb9406d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.267+0000 7fcbae82e700 1 --2- 172.21.15.73:0/4270707465 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fcb9406ad60 0x7fcb9406d220 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcba00097a0 tx=0x7fcba001a040 comp rx=0 tx=0).stop 2024-05-08T21:49:55.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.267+0000 7fcbae82e700 1 -- 172.21.15.73:0/4270707465 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcba814fe00 msgr2=0x7fcba8154910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.267+0000 7fcbae82e700 1 --2- 172.21.15.73:0/4270707465 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcba814fe00 0x7fcba8154910 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c00c450 tx=0x7fcb9c00c760 comp rx=0 tx=0).stop 2024-05-08T21:49:55.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.267+0000 7fcbacdcb700 1 -- 172.21.15.73:0/4270707465 reap_dead start 2024-05-08T21:49:55.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.267+0000 7fcbae82e700 1 -- 172.21.15.73:0/4270707465 shutdown_connections 2024-05-08T21:49:55.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.267+0000 7fcbae82e700 1 -- 172.21.15.73:0/4270707465 >> 172.21.15.73:0/4270707465 conn(0x7fcba80cb230 msgr2=0x7fcba80cb610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:55.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.267+0000 7fcbae82e700 1 -- 172.21.15.73:0/4270707465 shutdown_connections 2024-05-08T21:49:55.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.267+0000 7fcbae82e700 1 -- 172.21.15.73:0/4270707465 wait complete. 2024-05-08T21:49:55.290 INFO:teuthology.orchestra.run.smithi073.stdout:55834574854 2024-05-08T21:49:55.291 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-08T21:49:55.292 INFO:teuthology.orchestra.run.smithi073.stdout:64424509447 2024-05-08T21:49:55.292 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-08T21:49:55.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.273+0000 7fc7c487c700 1 -- 172.21.15.73:0/1385181904 >> [v2:172.21.15.115:6808/47201,v1:172.21.15.115:6809/47201] conn(0x7fc7a0072f30 msgr2=0x7fc7a0075350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.273+0000 7fc7c487c700 1 --2- 172.21.15.73:0/1385181904 >> [v2:172.21.15.115:6808/47201,v1:172.21.15.115:6809/47201] conn(0x7fc7a0072f30 0x7fc7a0075350 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.273+0000 7fc7c487c700 1 -- 172.21.15.73:0/1385181904 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fc7a006ad10 msgr2=0x7fc7a006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.273+0000 7fc7c487c700 1 --2- 172.21.15.73:0/1385181904 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fc7a006ad10 0x7fc7a006d1d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8007bf0 tx=0x7fc7b8007240 comp rx=0 tx=0).stop 2024-05-08T21:49:55.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.273+0000 7fc7c487c700 1 -- 172.21.15.73:0/1385181904 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7c0150010 msgr2=0x7fc7c014d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.273+0000 7fc7c487c700 1 --2- 172.21.15.73:0/1385181904 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7c0150010 0x7fc7c014d550 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc7b000b4a0 tx=0x7fc7b000b860 comp rx=0 tx=0).stop 2024-05-08T21:49:55.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.277+0000 7f6b792f5700 1 -- 172.21.15.73:0/1291862154 --> [v2:172.21.15.115:6800/47200,v1:172.21.15.115:6801/47200] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6b54002d40 con 0x7f6b60072e60 2024-05-08T21:49:55.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.277+0000 7fc7bed9d700 1 -- 172.21.15.73:0/1385181904 reap_dead start 2024-05-08T21:49:55.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.277+0000 7fc7c487c700 1 -- 172.21.15.73:0/1385181904 shutdown_connections 2024-05-08T21:49:55.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.277+0000 7fc7c487c700 1 -- 172.21.15.73:0/1385181904 >> 172.21.15.73:0/1385181904 conn(0x7fc7c00cb230 msgr2=0x7fc7c00c6330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:55.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.277+0000 7fc7c487c700 1 -- 172.21.15.73:0/1385181904 shutdown_connections 2024-05-08T21:49:55.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.277+0000 7fc7c487c700 1 -- 172.21.15.73:0/1385181904 wait complete. 2024-05-08T21:49:55.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.278+0000 7f6b5b7fe700 1 -- 172.21.15.73:0/1291862154 <== osd.4 v2:172.21.15.115:6800/47200 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6b54002d40 con 0x7f6b60072e60 2024-05-08T21:49:55.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.279+0000 7f6b792f5700 1 -- 172.21.15.73:0/1291862154 >> [v2:172.21.15.115:6800/47200,v1:172.21.15.115:6801/47200] conn(0x7f6b60072e60 msgr2=0x7f6b60075280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.279+0000 7f6b792f5700 1 --2- 172.21.15.73:0/1291862154 >> [v2:172.21.15.115:6800/47200,v1:172.21.15.115:6801/47200] conn(0x7f6b60072e60 0x7f6b60075280 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.279+0000 7f6b792f5700 1 -- 172.21.15.73:0/1291862154 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f6b6006acc0 msgr2=0x7f6b6006d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.279+0000 7f6b792f5700 1 --2- 172.21.15.73:0/1291862154 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f6b6006acc0 0x7f6b6006d180 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6b64009690 tx=0x7f6b64006c10 comp rx=0 tx=0).stop 2024-05-08T21:49:55.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.279+0000 7f6b792f5700 1 -- 172.21.15.73:0/1291862154 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6b7415bb00 msgr2=0x7f6b740ced70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.279+0000 7f6b792f5700 1 --2- 172.21.15.73:0/1291862154 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6b7415bb00 0x7f6b740ced70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6b74161eb0 tx=0x7f6b6c004ad0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.279+0000 7f6b737fe700 1 -- 172.21.15.73:0/1291862154 reap_dead start 2024-05-08T21:49:55.296 INFO:teuthology.orchestra.run.smithi073.stdout:64424509448 2024-05-08T21:49:55.296 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-08T21:49:55.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.285+0000 7f6b792f5700 1 -- 172.21.15.73:0/1291862154 shutdown_connections 2024-05-08T21:49:55.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.285+0000 7f6b792f5700 1 -- 172.21.15.73:0/1291862154 >> 172.21.15.73:0/1291862154 conn(0x7f6b7406be90 msgr2=0x7f6b7415a560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:55.297 INFO:teuthology.orchestra.run.smithi073.stdout:64424509447 2024-05-08T21:49:55.298 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-08T21:49:55.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.285+0000 7f6b792f5700 1 -- 172.21.15.73:0/1291862154 shutdown_connections 2024-05-08T21:49:55.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.285+0000 7f6b792f5700 1 -- 172.21.15.73:0/1291862154 wait complete. 2024-05-08T21:49:55.299 INFO:teuthology.orchestra.run.smithi073.stdout:64424509448 2024-05-08T21:49:55.300 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-08T21:49:55.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.296+0000 7f221d9d7700 1 -- 172.21.15.73:0/2965870307 --> [v2:172.21.15.115:6816/47202,v1:172.21.15.115:6817/47202] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f22181574d0 con 0x7f2218153ba0 2024-05-08T21:49:55.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.296+0000 7f2214ff9700 1 -- 172.21.15.73:0/2965870307 <== osd.6 v2:172.21.15.115:6816/47202 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2210009a30 con 0x7f2218153ba0 2024-05-08T21:49:55.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.297+0000 7f221d9d7700 1 -- 172.21.15.73:0/2965870307 >> [v2:172.21.15.115:6816/47202,v1:172.21.15.115:6817/47202] conn(0x7f2218153ba0 msgr2=0x7f221815a1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.297+0000 7f221d9d7700 1 --2- 172.21.15.73:0/2965870307 >> [v2:172.21.15.115:6816/47202,v1:172.21.15.115:6817/47202] conn(0x7f2218153ba0 0x7f221815a1e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.297+0000 7f221d9d7700 1 -- 172.21.15.73:0/2965870307 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f21f806acc0 msgr2=0x7f21f806d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.297+0000 7f221d9d7700 1 --2- 172.21.15.73:0/2965870307 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f21f806acc0 0x7f21f806d180 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2218159920 tx=0x7f2200006f90 comp rx=0 tx=0).stop 2024-05-08T21:49:55.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.297+0000 7f221d9d7700 1 -- 172.21.15.73:0/2965870307 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f221806bd40 msgr2=0x7f2218158d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.297+0000 7f221d9d7700 1 --2- 172.21.15.73:0/2965870307 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f221806bd40 0x7f2218158d00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f22180c8400 tx=0x7f2208004ad0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.297+0000 7f22177fe700 1 -- 172.21.15.73:0/2965870307 reap_dead start 2024-05-08T21:49:55.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.297+0000 7f221d9d7700 1 -- 172.21.15.73:0/2965870307 shutdown_connections 2024-05-08T21:49:55.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.297+0000 7f221d9d7700 1 -- 172.21.15.73:0/2965870307 >> 172.21.15.73:0/2965870307 conn(0x7f221806eb90 msgr2=0x7f2218141330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:55.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.297+0000 7f221d9d7700 1 -- 172.21.15.73:0/2965870307 shutdown_connections 2024-05-08T21:49:55.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.297+0000 7f221d9d7700 1 -- 172.21.15.73:0/2965870307 wait complete. 2024-05-08T21:49:55.303 INFO:teuthology.orchestra.run.smithi073.stdout:55834574855 2024-05-08T21:49:55.303 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-08T21:49:55.304 INFO:teuthology.orchestra.run.smithi073.stdout:64424509447 2024-05-08T21:49:55.304 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-08T21:49:55.309 INFO:teuthology.orchestra.run.smithi073.stdout:64424509448 2024-05-08T21:49:55.310 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-08T21:49:55.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.492+0000 7f8983e69700 1 Processor -- start 2024-05-08T21:49:55.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.492+0000 7f8983e69700 1 -- start start 2024-05-08T21:49:55.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.493+0000 7f8983e69700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f897c150b40 0x7f897c1571f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.494+0000 7f8983e69700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f897c156d60 con 0x7f897c0c65d0 2024-05-08T21:49:55.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.494+0000 7f8983e69700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f897c0722f0 con 0x7f897c071db0 2024-05-08T21:49:55.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.494+0000 7f8983e69700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f897c0c39c0 con 0x7f897c150b40 2024-05-08T21:49:55.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.494+0000 7f8982406700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f897c071db0 0x7f897c161260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.73:46978/0 (socket says 172.21.15.73:46978) 2024-05-08T21:49:55.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.494+0000 7f8982406700 1 -- 172.21.15.73:0/329961536 learned_addr learned my addr 172.21.15.73:0/329961536 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:49:55.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.494+0000 7f8981c05700 1 --2- 172.21.15.73:0/329961536 >> v2:172.21.15.73:3300/0 conn(0x7f897c150b40 0x7f897c1571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.495+0000 7f8980c03700 1 -- 172.21.15.73:0/329961536 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1258813106 0 0) 0x7f897c0722f0 con 0x7f897c071db0 2024-05-08T21:49:55.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.495+0000 7f8980c03700 1 -- 172.21.15.73:0/329961536 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89680057c0 con 0x7f897c071db0 2024-05-08T21:49:55.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.495+0000 7f8980c03700 1 -- 172.21.15.73:0/329961536 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1543465463 0 0) 0x7f897c156d60 con 0x7f897c0c65d0 2024-05-08T21:49:55.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.495+0000 7f8980c03700 1 -- 172.21.15.73:0/329961536 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f897c0722f0 con 0x7f897c0c65d0 2024-05-08T21:49:55.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.495+0000 7f8981c05700 1 -- 172.21.15.73:0/329961536 >> v1:172.21.15.115:6789/0 conn(0x7f897c071db0 legacy=0x7f897c161260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.495+0000 7f8981c05700 1 -- 172.21.15.73:0/329961536 >> v1:172.21.15.73:6789/0 conn(0x7f897c0c65d0 legacy=0x7f897c0cc390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.495+0000 7f8981c05700 1 -- 172.21.15.73:0/329961536 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f897c0c3ca0 con 0x7f897c150b40 2024-05-08T21:49:55.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.495+0000 7f8981c05700 1 --2- 172.21.15.73:0/329961536 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f897c150b40 0x7f897c1571f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f896c009840 tx=0x7f896c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dae88ff348e6a7ec server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:55.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.495+0000 7f8980c03700 1 -- 172.21.15.73:0/329961536 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f896c004230 con 0x7f897c150b40 2024-05-08T21:49:55.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.495+0000 7f8980c03700 1 -- 172.21.15.73:0/329961536 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f896c004390 con 0x7f897c150b40 2024-05-08T21:49:55.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.495+0000 7f8980c03700 1 -- 172.21.15.73:0/329961536 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f896c0036a0 con 0x7f897c150b40 2024-05-08T21:49:55.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.496+0000 7f8983e69700 1 -- 172.21.15.73:0/329961536 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f897c150b40 msgr2=0x7f897c1571f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.496+0000 7f8983e69700 1 --2- 172.21.15.73:0/329961536 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f897c150b40 0x7f897c1571f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f896c009840 tx=0x7f896c009b50 comp rx=0 tx=0).stop 2024-05-08T21:49:55.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.497+0000 7f8983e69700 1 -- 172.21.15.73:0/329961536 shutdown_connections 2024-05-08T21:49:55.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.497+0000 7f8983e69700 1 --2- 172.21.15.73:0/329961536 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f897c150b40 0x7f897c1571f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.497+0000 7f8983e69700 1 -- 172.21.15.73:0/329961536 >> 172.21.15.73:0/329961536 conn(0x7f897c066ab0 msgr2=0x7f897c06f550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:55.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.497+0000 7f8983e69700 1 -- 172.21.15.73:0/329961536 shutdown_connections 2024-05-08T21:49:55.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.497+0000 7f8983e69700 1 -- 172.21.15.73:0/329961536 wait complete. 2024-05-08T21:49:55.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.499+0000 7f8983e69700 1 Processor -- start 2024-05-08T21:49:55.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.499+0000 7f8983e69700 1 -- start start 2024-05-08T21:49:55.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.500+0000 7f8983e69700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f897c071db0 0x7f897c0c06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.500+0000 7f8983e69700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f897c0c65d0 0x7f897c1f6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.500+0000 7f8983e69700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f897c150b40 0x7f897c0cac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.500+0000 7f8983e69700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f897c0c0c00 con 0x7f897c150b40 2024-05-08T21:49:55.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.500+0000 7f8983e69700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f897c1488b0 con 0x7f897c0c65d0 2024-05-08T21:49:55.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.500+0000 7f8983e69700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f897c0c0e00 con 0x7f897c071db0 2024-05-08T21:49:55.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.500+0000 7f8982406700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f897c150b40 0x7f897c0cac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.500+0000 7f8982406700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f897c150b40 0x7f897c0cac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38958/0 (socket says 172.21.15.73:38958) 2024-05-08T21:49:55.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.500+0000 7f8982406700 1 -- 172.21.15.73:0/306603854 learned_addr learned my addr 172.21.15.73:0/306603854 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:55.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.500+0000 7f8981404700 1 --2- 172.21.15.73:0/306603854 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f897c0c65d0 0x7f897c1f6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.501+0000 7f3de13ea700 1 Processor -- start 2024-05-08T21:49:55.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.501+0000 7f8981c05700 1 --2- 172.21.15.73:0/306603854 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f897c071db0 0x7f897c0c06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.501+0000 7f8982406700 1 -- 172.21.15.73:0/306603854 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f897c071db0 msgr2=0x7f897c0c06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.501+0000 7f8982406700 1 --2- 172.21.15.73:0/306603854 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f897c071db0 0x7f897c0c06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.501+0000 7f8982406700 1 -- 172.21.15.73:0/306603854 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f897c0c65d0 msgr2=0x7f897c1f6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.501+0000 7f8982406700 1 --2- 172.21.15.73:0/306603854 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f897c0c65d0 0x7f897c1f6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.501+0000 7f8982406700 1 -- 172.21.15.73:0/306603854 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f896c0094a0 con 0x7f897c150b40 2024-05-08T21:49:55.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.501+0000 7f8981c05700 1 --2- 172.21.15.73:0/306603854 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f897c071db0 0x7f897c0c06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:49:55.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.501+0000 7f8982406700 1 --2- 172.21.15.73:0/306603854 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f897c150b40 0x7f897c0cac60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f897400cbd0 tx=0x7f897400cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:55.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.501+0000 7f3de13ea700 1 -- start start 2024-05-08T21:49:55.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.501+0000 7fb1ab49e700 1 Processor -- start 2024-05-08T21:49:55.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.501+0000 7fb1ab49e700 1 -- start start 2024-05-08T21:49:55.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.502+0000 7f89727fc700 1 -- 172.21.15.73:0/306603854 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897400aac0 con 0x7f897c150b40 2024-05-08T21:49:55.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.502+0000 7f89727fc700 1 -- 172.21.15.73:0/306603854 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f897400ac40 con 0x7f897c150b40 2024-05-08T21:49:55.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.502+0000 7f89727fc700 1 -- 172.21.15.73:0/306603854 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89740070d0 con 0x7f897c150b40 2024-05-08T21:49:55.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.502+0000 7f8983e69700 1 -- 172.21.15.73:0/306603854 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f897c0c10a0 con 0x7f897c150b40 2024-05-08T21:49:55.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.502+0000 7f8983e69700 1 -- 172.21.15.73:0/306603854 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f897c148540 con 0x7f897c150b40 2024-05-08T21:49:55.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.502+0000 7f3de13ea700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3ddc150440 0x7f3ddc0cacb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.502+0000 7f3de13ea700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3ddc15a080 0x7f3ddc0666c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.502+0000 7f3de13ea700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ddc06a9c0 con 0x7f3ddc06b9d0 2024-05-08T21:49:55.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.502+0000 7f3de13ea700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ddc0c34c0 con 0x7f3ddc15a080 2024-05-08T21:49:55.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.502+0000 7f3de13ea700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ddc0cb640 con 0x7f3ddc150440 2024-05-08T21:49:55.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.503+0000 7fb1ab49e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb1a40c5f90 0x7fb1a40c6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.503+0000 7fb1ab49e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1a415eba0 con 0x7fb1a41581f0 2024-05-08T21:49:55.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.503+0000 7fb1ab49e700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1a415f030 con 0x7fb1a41585d0 2024-05-08T21:49:55.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.503+0000 7fb1ab49e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a415e080 con 0x7fb1a40c5f90 2024-05-08T21:49:55.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.503+0000 7fb1a923a700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fb1a41581f0 0x7fb1a40c5190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:51820/0 (socket says 172.21.15.73:51820) 2024-05-08T21:49:55.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.503+0000 7fb1a923a700 1 -- 172.21.15.73:0/3838319553 learned_addr learned my addr 172.21.15.73:0/3838319553 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:49:55.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.503+0000 7f3ddb7fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f3ddc06b9d0 0x7f3ddc0c9ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.73:47006/0 (socket says 172.21.15.73:47006) 2024-05-08T21:49:55.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.503+0000 7f3ddb7fe700 1 -- 172.21.15.73:0/101033412 learned_addr learned my addr 172.21.15.73:0/101033412 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:49:55.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.503+0000 7fb1a9a3b700 1 --2- 172.21.15.73:0/3838319553 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb1a40c5f90 0x7fb1a40c6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.504+0000 7f3dda7fc700 1 --2- 172.21.15.73:0/101033412 >> v2:172.21.15.115:3300/0 conn(0x7f3ddc15a080 0x7f3ddc0666c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.504+0000 7f3dd9ffb700 1 -- 172.21.15.73:0/101033412 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1923789585 0 0) 0x7f3ddc06a9c0 con 0x7f3ddc06b9d0 2024-05-08T21:49:55.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.504+0000 7f3ddaffd700 1 --2- 172.21.15.73:0/101033412 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3ddc150440 0x7f3ddc0cacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.504+0000 7f3dd9ffb700 1 -- 172.21.15.73:0/101033412 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3dc40035b0 con 0x7f3ddc06b9d0 2024-05-08T21:49:55.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.504+0000 7fb1a9a3b700 1 -- 172.21.15.73:0/3838319553 >> v1:172.21.15.115:6789/0 conn(0x7fb1a41585d0 legacy=0x7fb1a4161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.504+0000 7fb1a9a3b700 1 -- 172.21.15.73:0/3838319553 >> v1:172.21.15.73:6789/0 conn(0x7fb1a41581f0 legacy=0x7fb1a40c5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.504+0000 7fb1a9a3b700 1 -- 172.21.15.73:0/3838319553 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a40c65b0 con 0x7fb1a40c5f90 2024-05-08T21:49:55.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.504+0000 7f3dd9ffb700 1 -- 172.21.15.73:0/101033412 <== mon.1 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2741867111 0 0) 0x7f3dc40035b0 con 0x7f3ddc06b9d0 2024-05-08T21:49:55.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.504+0000 7f3ddaffd700 1 -- 172.21.15.73:0/101033412 >> v2:172.21.15.115:3300/0 conn(0x7f3ddc15a080 msgr2=0x7f3ddc0666c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:55.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.504+0000 7f3ddaffd700 1 --2- 172.21.15.73:0/101033412 >> v2:172.21.15.115:3300/0 conn(0x7f3ddc15a080 0x7f3ddc0666c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.504+0000 7f3ddaffd700 1 -- 172.21.15.73:0/101033412 >> v1:172.21.15.115:6789/0 conn(0x7f3ddc06b9d0 legacy=0x7f3ddc0c9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.504+0000 7f3ddaffd700 1 -- 172.21.15.73:0/101033412 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ddc0cb380 con 0x7f3ddc150440 2024-05-08T21:49:55.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.504+0000 7fb1a9a3b700 1 --2- 172.21.15.73:0/3838319553 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb1a40c5f90 0x7fb1a40c6bb0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb19c009dc0 tx=0x7fb19c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7555efec649f2077 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:55.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.505+0000 7fb19bfff700 1 -- 172.21.15.73:0/3838319553 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19c00e070 con 0x7fb1a40c5f90 2024-05-08T21:49:55.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.505+0000 7fb19bfff700 1 -- 172.21.15.73:0/3838319553 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb19c00bbd0 con 0x7fb1a40c5f90 2024-05-08T21:49:55.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.505+0000 7fb19bfff700 1 -- 172.21.15.73:0/3838319553 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19c012430 con 0x7fb1a40c5f90 2024-05-08T21:49:55.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.505+0000 7f3ddaffd700 1 --2- 172.21.15.73:0/101033412 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3ddc150440 0x7f3ddc0cacb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc009840 tx=0x7f3dcc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22b96a526b01589e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:55.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.505+0000 7f3dd9ffb700 1 -- 172.21.15.73:0/101033412 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd40019f0 con 0x7f3ddc150440 2024-05-08T21:49:55.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.505+0000 7f3dd9ffb700 1 -- 172.21.15.73:0/101033412 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dcc004030 con 0x7f3ddc150440 2024-05-08T21:49:55.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.505+0000 7f3dd9ffb700 1 -- 172.21.15.73:0/101033412 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc0043c0 con 0x7f3ddc150440 2024-05-08T21:49:55.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.504+0000 7f89727fc700 1 -- 172.21.15.73:0/306603854 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8974007250 con 0x7f897c150b40 2024-05-08T21:49:55.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.504+0000 7f8983e69700 1 -- 172.21.15.73:0/306603854 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89640052f0 con 0x7f897c150b40 2024-05-08T21:49:55.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.505+0000 7f89727fc700 1 --2- 172.21.15.73:0/306603854 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f896006ad90 0x7f896006d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.505+0000 7f89727fc700 1 -- 172.21.15.73:0/306603854 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8974089270 con 0x7f897c150b40 2024-05-08T21:49:55.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.506+0000 7f8981c05700 1 --2- 172.21.15.73:0/306603854 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f896006ad90 0x7f896006d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.505+0000 7fb1ab49e700 1 -- 172.21.15.73:0/3838319553 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb1a40c5f90 msgr2=0x7fb1a40c6bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.505+0000 7fb1ab49e700 1 --2- 172.21.15.73:0/3838319553 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb1a40c5f90 0x7fb1a40c6bb0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb19c009dc0 tx=0x7fb19c00b330 comp rx=0 tx=0).stop 2024-05-08T21:49:55.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.506+0000 7fb1ab49e700 1 -- 172.21.15.73:0/3838319553 shutdown_connections 2024-05-08T21:49:55.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.506+0000 7fb1ab49e700 1 --2- 172.21.15.73:0/3838319553 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb1a40c5f90 0x7fb1a40c6bb0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.506+0000 7fb1ab49e700 1 -- 172.21.15.73:0/3838319553 >> 172.21.15.73:0/3838319553 conn(0x7fb1a40cb230 msgr2=0x7fb1a40cb610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:55.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.506+0000 7f8981c05700 1 --2- 172.21.15.73:0/306603854 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f896006ad90 0x7f896006d250 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f896c009840 tx=0x7f896c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:55.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.506+0000 7f3de13ea700 1 -- 172.21.15.73:0/101033412 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3ddc150440 msgr2=0x7f3ddc0cacb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.506+0000 7f3de13ea700 1 --2- 172.21.15.73:0/101033412 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3ddc150440 0x7f3ddc0cacb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc009840 tx=0x7f3dcc009b50 comp rx=0 tx=0).stop 2024-05-08T21:49:55.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.507+0000 7f3de13ea700 1 -- 172.21.15.73:0/101033412 shutdown_connections 2024-05-08T21:49:55.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.507+0000 7f3de13ea700 1 --2- 172.21.15.73:0/101033412 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3ddc150440 0x7f3ddc0cacb0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.507+0000 7f3de13ea700 1 --2- 172.21.15.73:0/101033412 >> v2:172.21.15.115:3300/0 conn(0x7f3ddc15a080 0x7f3ddc0666c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.507+0000 7f3de13ea700 1 -- 172.21.15.73:0/101033412 >> 172.21.15.73:0/101033412 conn(0x7f3ddc06eb90 msgr2=0x7f3ddc06ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:55.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.507+0000 7fb1ab49e700 1 -- 172.21.15.73:0/3838319553 shutdown_connections 2024-05-08T21:49:55.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.507+0000 7fb1ab49e700 1 -- 172.21.15.73:0/3838319553 wait complete. 2024-05-08T21:49:55.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.507+0000 7f3de13ea700 1 -- 172.21.15.73:0/101033412 shutdown_connections 2024-05-08T21:49:55.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.507+0000 7f3de13ea700 1 -- 172.21.15.73:0/101033412 wait complete. 2024-05-08T21:49:55.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.509+0000 7f3de13ea700 1 Processor -- start 2024-05-08T21:49:55.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.508+0000 7fb1ab49e700 1 Processor -- start 2024-05-08T21:49:55.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.509+0000 7fb1ab49e700 1 -- start start 2024-05-08T21:49:55.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.509+0000 7f3de13ea700 1 -- start start 2024-05-08T21:49:55.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.510+0000 7f3de13ea700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ddc06b9d0 0x7f3ddc0c7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.510+0000 7f3de13ea700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3ddc150440 0x7f3ddc152250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.510+0000 7f3de13ea700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ddc15a080 0x7f3ddc155ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.510+0000 7f3de13ea700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ddc1557d0 con 0x7f3ddc15a080 2024-05-08T21:49:55.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.510+0000 7f3de13ea700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ddc150bd0 con 0x7f3ddc06b9d0 2024-05-08T21:49:55.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.510+0000 7f3de13ea700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ddc150e70 con 0x7f3ddc150440 2024-05-08T21:49:55.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.510+0000 7fb1ab49e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb1a40c5f90 0x7fb1a42002b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.510+0000 7fb1ab49e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1a41581f0 0x7fb1a41612c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.510+0000 7fb1ab49e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1a41585d0 0x7fb1a415cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.510+0000 7fb1ab49e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a42007f0 con 0x7fb1a41581f0 2024-05-08T21:49:55.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.510+0000 7fb1ab49e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a41fd2a0 con 0x7fb1a41585d0 2024-05-08T21:49:55.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.510+0000 7fb1ab49e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a4154720 con 0x7fb1a40c5f90 2024-05-08T21:49:55.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.510+0000 7f4e3471f700 1 Processor -- start 2024-05-08T21:49:55.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.510+0000 7f3ddaffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ddc06b9d0 0x7f3ddc0c7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.510+0000 7f3ddaffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ddc06b9d0 0x7f3ddc0c7300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.73:53720/0 (socket says 172.21.15.73:53720) 2024-05-08T21:49:55.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.510+0000 7f3ddaffd700 1 -- 172.21.15.73:0/2680594386 learned_addr learned my addr 172.21.15.73:0/2680594386 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:55.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.510+0000 7f3dda7fc700 1 --2- 172.21.15.73:0/2680594386 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3ddc150440 0x7f3ddc152250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.511+0000 7fb1a923a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb1a40c5f90 0x7fb1a42002b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.511+0000 7fb1a8a39700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1a41581f0 0x7fb1a41612c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.511+0000 7fb1a8a39700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1a41581f0 0x7fb1a41612c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38960/0 (socket says 172.21.15.73:38960) 2024-05-08T21:49:55.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.511+0000 7fb1a8a39700 1 -- 172.21.15.73:0/3241926418 learned_addr learned my addr 172.21.15.73:0/3241926418 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:55.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.511+0000 7f3ddaffd700 1 -- 172.21.15.73:0/2680594386 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3ddc150440 msgr2=0x7f3ddc152250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.511+0000 7f3ddaffd700 1 --2- 172.21.15.73:0/2680594386 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3ddc150440 0x7f3ddc152250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.511+0000 7f3ddaffd700 1 -- 172.21.15.73:0/2680594386 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ddc15a080 msgr2=0x7f3ddc155ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.511+0000 7f3ddaffd700 1 --2- 172.21.15.73:0/2680594386 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ddc15a080 0x7f3ddc155ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.511+0000 7f3ddaffd700 1 -- 172.21.15.73:0/2680594386 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dcc0094a0 con 0x7f3ddc06b9d0 2024-05-08T21:49:55.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.511+0000 7f3ddaffd700 1 --2- 172.21.15.73:0/2680594386 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ddc06b9d0 0x7f3ddc0c7300 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc00a010 tx=0x7f3dcc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:55.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.511+0000 7f3dc37fe700 1 -- 172.21.15.73:0/2680594386 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc011630 con 0x7f3ddc06b9d0 2024-05-08T21:49:55.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.511+0000 7f3dc37fe700 1 -- 172.21.15.73:0/2680594386 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dcc01f070 con 0x7f3ddc06b9d0 2024-05-08T21:49:55.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.510+0000 7f4e3471f700 1 -- start start 2024-05-08T21:49:55.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.512+0000 7f4e3471f700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4e2c0caac0 0x7f4e2c06e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.512+0000 7f4e3471f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4e2c06e7b0 0x7f4e2c1617e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.512+0000 7f4e3471f700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e2c158780 con 0x7f4e2c1583a0 2024-05-08T21:49:55.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.512+0000 7f4e3471f700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e2c0caf30 con 0x7f4e2c0caac0 2024-05-08T21:49:55.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.512+0000 7f4e3471f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2c15e2c0 con 0x7f4e2c06e7b0 2024-05-08T21:49:55.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.511+0000 7f3de13ea700 1 -- 172.21.15.73:0/2680594386 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ddc151150 con 0x7f3ddc06b9d0 2024-05-08T21:49:55.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.511+0000 7f3de13ea700 1 -- 172.21.15.73:0/2680594386 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ddc1559b0 con 0x7f3ddc06b9d0 2024-05-08T21:49:55.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.513+0000 7f3dc37fe700 1 -- 172.21.15.73:0/2680594386 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc0119d0 con 0x7f3ddc06b9d0 2024-05-08T21:49:55.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.511+0000 7fb1a8a39700 1 -- 172.21.15.73:0/3241926418 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb1a40c5f90 msgr2=0x7fb1a42002b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.511+0000 7fb1a8a39700 1 --2- 172.21.15.73:0/3241926418 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb1a40c5f90 0x7fb1a42002b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.512+0000 7f4e32cbc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4e2c06e7b0 0x7f4e2c1617e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.513+0000 7f4e32cbc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4e2c06e7b0 0x7f4e2c1617e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.73:52722/0 (socket says 172.21.15.73:52722) 2024-05-08T21:49:55.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.513+0000 7f4e32cbc700 1 -- 172.21.15.73:0/1520527734 learned_addr learned my addr 172.21.15.73:0/1520527734 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:55.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.511+0000 7fb1a8a39700 1 -- 172.21.15.73:0/3241926418 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1a41585d0 msgr2=0x7fb1a415cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.511+0000 7fb1a8a39700 1 --2- 172.21.15.73:0/3241926418 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1a41585d0 0x7fb1a415cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.511+0000 7fb1a8a39700 1 -- 172.21.15.73:0/3241926418 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb19c009a70 con 0x7fb1a41581f0 2024-05-08T21:49:55.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.512+0000 7fb1a8a39700 1 --2- 172.21.15.73:0/3241926418 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1a41581f0 0x7fb1a41612c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb19400c420 tx=0x7fb19400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:55.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.513+0000 7f4e31cba700 1 --2- 172.21.15.73:0/1520527734 >> v2:172.21.15.73:3300/0 conn(0x7f4e2c0caac0 0x7f4e2c06e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.513+0000 7f4e32cbc700 1 -- 172.21.15.73:0/1520527734 >> v2:172.21.15.73:3300/0 conn(0x7f4e2c0caac0 msgr2=0x7f4e2c06e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:55.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.513+0000 7f4e32cbc700 1 --2- 172.21.15.73:0/1520527734 >> v2:172.21.15.73:3300/0 conn(0x7f4e2c0caac0 0x7f4e2c06e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.513+0000 7f4e32cbc700 1 -- 172.21.15.73:0/1520527734 >> v1:172.21.15.73:6789/0 conn(0x7f4e2c1583a0 legacy=0x7f4e2c0c9030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.513+0000 7f4e32cbc700 1 -- 172.21.15.73:0/1520527734 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e2c15e5a0 con 0x7f4e2c06e7b0 2024-05-08T21:49:55.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.514+0000 7f3de13ea700 1 -- 172.21.15.73:0/2680594386 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dbc0052f0 con 0x7f3ddc06b9d0 2024-05-08T21:49:55.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.515+0000 7f3dc37fe700 1 -- 172.21.15.73:0/2680594386 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3dcc011b30 con 0x7f3ddc06b9d0 2024-05-08T21:49:55.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.515+0000 7f3dc37fe700 1 --2- 172.21.15.73:0/2680594386 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f3dc806ace0 0x7f3dc806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.515+0000 7f3dc37fe700 1 -- 172.21.15.73:0/2680594386 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3dcc021070 con 0x7f3ddc06b9d0 2024-05-08T21:49:55.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.516+0000 7f3dda7fc700 1 --2- 172.21.15.73:0/2680594386 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f3dc806ace0 0x7f3dc806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.516+0000 7f3dda7fc700 1 --2- 172.21.15.73:0/2680594386 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f3dc806ace0 0x7f3dc806d1a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc14dae0 tx=0x7f3dd0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:55.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.514+0000 7fb199ffb700 1 -- 172.21.15.73:0/3241926418 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1940052d0 con 0x7fb1a41581f0 2024-05-08T21:49:55.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.514+0000 7fb199ffb700 1 -- 172.21.15.73:0/3241926418 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb194005430 con 0x7fb1a41581f0 2024-05-08T21:49:55.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.514+0000 7fb199ffb700 1 -- 172.21.15.73:0/3241926418 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb194003880 con 0x7fb1a41581f0 2024-05-08T21:49:55.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.514+0000 7fb1ab49e700 1 -- 172.21.15.73:0/3241926418 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1a41fc440 con 0x7fb1a41581f0 2024-05-08T21:49:55.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.515+0000 7fb1ab49e700 1 -- 172.21.15.73:0/3241926418 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1a41fca00 con 0x7fb1a41581f0 2024-05-08T21:49:55.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.514+0000 7f89727fc700 1 -- 172.21.15.73:0/306603854 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f8974018020 con 0x7f897c150b40 2024-05-08T21:49:55.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.514+0000 7f4e32cbc700 1 --2- 172.21.15.73:0/1520527734 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4e2c06e7b0 0x7f4e2c1617e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4e280098f0 tx=0x7f4e28009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e881d0bda35da07 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:55.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.514+0000 7fa916f5d700 1 Processor -- start 2024-05-08T21:49:55.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.514+0000 7fa916f5d700 1 -- start start 2024-05-08T21:49:55.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.515+0000 7fa916f5d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa9100cac40 0x7fa9100720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.515+0000 7fa916f5d700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa910072630 0x7fa91015a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.515+0000 7fa916f5d700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9100c9f90 con 0x7fa910153e20 2024-05-08T21:49:55.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.515+0000 7fa916f5d700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa910159c00 con 0x7fa910072630 2024-05-08T21:49:55.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.515+0000 7fa916f5d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9100ca250 con 0x7fa9100cac40 2024-05-08T21:49:55.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.516+0000 7fa9154fa700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa910072630 0x7fa91015a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.516+0000 7fa9154fa700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa910072630 0x7fa91015a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38992/0 (socket says 172.21.15.73:38992) 2024-05-08T21:49:55.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.516+0000 7fa9154fa700 1 -- 172.21.15.73:0/4083208528 learned_addr learned my addr 172.21.15.73:0/4083208528 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:55.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.516+0000 7fa9154fa700 1 -- 172.21.15.73:0/4083208528 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa9100cac40 msgr2=0x7fa9100720f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T21:49:55.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.516+0000 7fa9154fa700 1 --2- 172.21.15.73:0/4083208528 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa9100cac40 0x7fa9100720f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.516+0000 7fa9154fa700 1 -- 172.21.15.73:0/4083208528 >> v1:172.21.15.73:6789/0 conn(0x7fa910153e20 legacy=0x7fa91015dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:55.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.516+0000 7fa9154fa700 1 -- 172.21.15.73:0/4083208528 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9100cb7e0 con 0x7fa910072630 2024-05-08T21:49:55.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.517+0000 7fb1ab49e700 1 -- 172.21.15.73:0/3241926418 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1840052f0 con 0x7fb1a41581f0 2024-05-08T21:49:55.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.517+0000 7f4e314b9700 1 -- 172.21.15.73:0/1520527734 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2800b8a0 con 0x7f4e2c06e7b0 2024-05-08T21:49:55.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.517+0000 7f4e314b9700 1 -- 172.21.15.73:0/1520527734 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e2800ba00 con 0x7f4e2c06e7b0 2024-05-08T21:49:55.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.517+0000 7f4e314b9700 1 -- 172.21.15.73:0/1520527734 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2800bd90 con 0x7f4e2c06e7b0 2024-05-08T21:49:55.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.517+0000 7fa9154fa700 1 --2- 172.21.15.73:0/4083208528 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa910072630 0x7fa91015a100 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa908009e50 tx=0x7fa90800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=470ba0d57cab0db0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:55.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.517+0000 7fa90f7fe700 1 -- 172.21.15.73:0/4083208528 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa90800e070 con 0x7fa910072630 2024-05-08T21:49:55.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.517+0000 7fa90f7fe700 1 -- 172.21.15.73:0/4083208528 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa908003a20 con 0x7fa910072630 2024-05-08T21:49:55.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.517+0000 7fa90f7fe700 1 -- 172.21.15.73:0/4083208528 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa908003dd0 con 0x7fa910072630 2024-05-08T21:49:55.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.518+0000 7f4e3471f700 1 -- 172.21.15.73:0/1520527734 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4e2c06e7b0 msgr2=0x7f4e2c1617e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.518+0000 7f4e3471f700 1 --2- 172.21.15.73:0/1520527734 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4e2c06e7b0 0x7f4e2c1617e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4e280098f0 tx=0x7f4e28009c00 comp rx=0 tx=0).stop 2024-05-08T21:49:55.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.518+0000 7f4e3471f700 1 -- 172.21.15.73:0/1520527734 shutdown_connections 2024-05-08T21:49:55.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.518+0000 7f4e3471f700 1 --2- 172.21.15.73:0/1520527734 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4e2c06e7b0 0x7f4e2c1617e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.518+0000 7f4e3471f700 1 --2- 172.21.15.73:0/1520527734 >> v2:172.21.15.73:3300/0 conn(0x7f4e2c0caac0 0x7f4e2c06e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.518+0000 7f4e3471f700 1 -- 172.21.15.73:0/1520527734 >> 172.21.15.73:0/1520527734 conn(0x7f4e2c0cb230 msgr2=0x7f4e2c0cb610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:55.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.518+0000 7f4e3471f700 1 -- 172.21.15.73:0/1520527734 shutdown_connections 2024-05-08T21:49:55.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.518+0000 7fb199ffb700 1 -- 172.21.15.73:0/3241926418 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb1940039e0 con 0x7fb1a41581f0 2024-05-08T21:49:55.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.518+0000 7fa916f5d700 1 -- 172.21.15.73:0/4083208528 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa910072630 msgr2=0x7fa91015a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.518+0000 7fa916f5d700 1 --2- 172.21.15.73:0/4083208528 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa910072630 0x7fa91015a100 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa908009e50 tx=0x7fa90800b330 comp rx=0 tx=0).stop 2024-05-08T21:49:55.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.519+0000 7fb199ffb700 1 --2- 172.21.15.73:0/3241926418 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fb18806ad10 0x7fb18806d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.519+0000 7fb199ffb700 1 -- 172.21.15.73:0/3241926418 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb1940884f0 con 0x7fb1a41581f0 2024-05-08T21:49:55.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.518+0000 7f4e3471f700 1 -- 172.21.15.73:0/1520527734 wait complete. 2024-05-08T21:49:55.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.519+0000 7fb1a923a700 1 --2- 172.21.15.73:0/3241926418 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fb18806ad10 0x7fb18806d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.520+0000 7f4e3471f700 1 Processor -- start 2024-05-08T21:49:55.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.521+0000 7f3dc37fe700 1 -- 172.21.15.73:0/2680594386 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f3dcc055f30 con 0x7f3ddc06b9d0 2024-05-08T21:49:55.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.520+0000 7f4e3471f700 1 -- start start 2024-05-08T21:49:55.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.520+0000 7fa916f5d700 1 -- 172.21.15.73:0/4083208528 shutdown_connections 2024-05-08T21:49:55.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.520+0000 7fa916f5d700 1 --2- 172.21.15.73:0/4083208528 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa910072630 0x7fa91015a100 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.520+0000 7fa916f5d700 1 --2- 172.21.15.73:0/4083208528 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa9100cac40 0x7fa9100720f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.520+0000 7fa916f5d700 1 -- 172.21.15.73:0/4083208528 >> 172.21.15.73:0/4083208528 conn(0x7fa91006be90 msgr2=0x7fa91006c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:55.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.521+0000 7f4e3471f700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4e2c06e7b0 0x7f4e2c1466b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.521+0000 7f4e3471f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4e2c0caac0 0x7f4e2c135a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.521+0000 7f4e3471f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4e2c1583a0 0x7f4e2c15fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.521+0000 7f4e3471f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2c146bf0 con 0x7f4e2c1583a0 2024-05-08T21:49:55.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.521+0000 7f4e3471f700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2c15f860 con 0x7f4e2c06e7b0 2024-05-08T21:49:55.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.521+0000 7f4e3471f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2c141be0 con 0x7f4e2c0caac0 2024-05-08T21:49:55.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.521+0000 7f4e31cba700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4e2c0caac0 0x7f4e2c135a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.522+0000 7f4e31cba700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4e2c0caac0 0x7f4e2c135a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.73:52744/0 (socket says 172.21.15.73:52744) 2024-05-08T21:49:55.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.522+0000 7f4e31cba700 1 -- 172.21.15.73:0/840366357 learned_addr learned my addr 172.21.15.73:0/840366357 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:55.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.522+0000 7f4e324bb700 1 --2- 172.21.15.73:0/840366357 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4e2c06e7b0 0x7f4e2c1466b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.522+0000 7f4e31cba700 1 -- 172.21.15.73:0/840366357 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4e2c06e7b0 msgr2=0x7f4e2c1466b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.522+0000 7f4e31cba700 1 --2- 172.21.15.73:0/840366357 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4e2c06e7b0 0x7f4e2c1466b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.522+0000 7f4e31cba700 1 -- 172.21.15.73:0/840366357 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4e2c1583a0 msgr2=0x7f4e2c15fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.522+0000 7f4e31cba700 1 --2- 172.21.15.73:0/840366357 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4e2c1583a0 0x7f4e2c15fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.522+0000 7f4e31cba700 1 -- 172.21.15.73:0/840366357 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e28009550 con 0x7f4e2c0caac0 2024-05-08T21:49:55.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.522+0000 7f4e31cba700 1 --2- 172.21.15.73:0/840366357 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4e2c0caac0 0x7f4e2c135a00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c00e810 tx=0x7f4e1c00eb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:55.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.522+0000 7f4e22ffd700 1 -- 172.21.15.73:0/840366357 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e1c013610 con 0x7f4e2c0caac0 2024-05-08T21:49:55.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.522+0000 7f4e22ffd700 1 -- 172.21.15.73:0/840366357 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e1c013790 con 0x7f4e2c0caac0 2024-05-08T21:49:55.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.522+0000 7f4e22ffd700 1 -- 172.21.15.73:0/840366357 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e1c013b40 con 0x7f4e2c0caac0 2024-05-08T21:49:55.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.523+0000 7f4e3471f700 1 -- 172.21.15.73:0/840366357 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e2c146250 con 0x7f4e2c0caac0 2024-05-08T21:49:55.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.523+0000 7f4e3471f700 1 -- 172.21.15.73:0/840366357 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e2c15f210 con 0x7f4e2c0caac0 2024-05-08T21:49:55.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.525+0000 7fb1a923a700 1 --2- 172.21.15.73:0/3241926418 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fb18806ad10 0x7fb18806d1d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb1a0005910 tx=0x7fb1a0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:55.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.526+0000 7f4e22ffd700 1 -- 172.21.15.73:0/840366357 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4e1c013ca0 con 0x7f4e2c0caac0 2024-05-08T21:49:55.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.527+0000 7f4e3471f700 1 -- 172.21.15.73:0/840366357 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e2c15fa10 con 0x7f4e2c0caac0 2024-05-08T21:49:55.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.527+0000 7f4e22ffd700 1 --2- 172.21.15.73:0/840366357 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f4e1006ad10 0x7f4e1006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.527+0000 7f4e22ffd700 1 -- 172.21.15.73:0/840366357 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4e1c088dd0 con 0x7f4e2c0caac0 2024-05-08T21:49:55.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.529+0000 7fa916f5d700 1 -- 172.21.15.73:0/4083208528 shutdown_connections 2024-05-08T21:49:55.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.529+0000 7fb199ffb700 1 -- 172.21.15.73:0/3241926418 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fb1940537d0 con 0x7fb1a41581f0 2024-05-08T21:49:55.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.529+0000 7f4e324bb700 1 --2- 172.21.15.73:0/840366357 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f4e1006ad10 0x7f4e1006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.530+0000 7f4e324bb700 1 --2- 172.21.15.73:0/840366357 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f4e1006ad10 0x7f4e1006d1d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4e240012e0 tx=0x7f4e24009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:55.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.536+0000 7f4e22ffd700 1 -- 172.21.15.73:0/840366357 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f4e2c15fa10 con 0x7f4e2c0caac0 2024-05-08T21:49:55.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.530+0000 7fa916f5d700 1 -- 172.21.15.73:0/4083208528 wait complete. 2024-05-08T21:49:55.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.532+0000 7fa916f5d700 1 Processor -- start 2024-05-08T21:49:55.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.532+0000 7fa916f5d700 1 -- start start 2024-05-08T21:49:55.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.533+0000 7fa916f5d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa910072630 0x7fa9100c9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.533+0000 7fa916f5d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa9100cac40 0x7fa9100c7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.534+0000 7fa916f5d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa910153e20 0x7fa9100c7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.534+0000 7fa916f5d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9100c6be0 con 0x7fa910072630 2024-05-08T21:49:55.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.534+0000 7fa916f5d700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa910149680 con 0x7fa910153e20 2024-05-08T21:49:55.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.534+0000 7fa916f5d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9100c6e50 con 0x7fa9100cac40 2024-05-08T21:49:55.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.534+0000 7fa914cf9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa910072630 0x7fa9100c9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.534+0000 7fa914cf9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa910072630 0x7fa9100c9170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39022/0 (socket says 172.21.15.73:39022) 2024-05-08T21:49:55.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.534+0000 7fa914cf9700 1 -- 172.21.15.73:0/1537800625 learned_addr learned my addr 172.21.15.73:0/1537800625 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:55.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.535+0000 7fa914cf9700 1 -- 172.21.15.73:0/1537800625 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa9100cac40 msgr2=0x7fa9100c7930 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T21:49:55.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.535+0000 7fa914cf9700 1 --2- 172.21.15.73:0/1537800625 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa9100cac40 0x7fa9100c7930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.535+0000 7fa914cf9700 1 -- 172.21.15.73:0/1537800625 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa910153e20 msgr2=0x7fa9100c7e70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T21:49:55.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.535+0000 7fa914cf9700 1 --2- 172.21.15.73:0/1537800625 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa910153e20 0x7fa9100c7e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.535+0000 7fa914cf9700 1 -- 172.21.15.73:0/1537800625 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa908009b30 con 0x7fa910072630 2024-05-08T21:49:55.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.535+0000 7fa914cf9700 1 --2- 172.21.15.73:0/1537800625 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa910072630 0x7fa9100c9170 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa90000b470 tx=0x7fa90000b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:55.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.535+0000 7fa90d7fa700 1 -- 172.21.15.73:0/1537800625 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa900011830 con 0x7fa910072630 2024-05-08T21:49:55.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.535+0000 7fa90d7fa700 1 -- 172.21.15.73:0/1537800625 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9000119b0 con 0x7fa910072630 2024-05-08T21:49:55.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.535+0000 7fa90d7fa700 1 -- 172.21.15.73:0/1537800625 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa900011d60 con 0x7fa910072630 2024-05-08T21:49:55.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.536+0000 7fa916f5d700 1 -- 172.21.15.73:0/1537800625 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9100c7130 con 0x7fa910072630 2024-05-08T21:49:55.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.536+0000 7fa916f5d700 1 -- 172.21.15.73:0/1537800625 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9100c96b0 con 0x7fa910072630 2024-05-08T21:49:55.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.538+0000 7fa916f5d700 1 -- 172.21.15.73:0/1537800625 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8ec0052f0 con 0x7fa910072630 2024-05-08T21:49:55.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.540+0000 7fa90d7fa700 1 -- 172.21.15.73:0/1537800625 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa90001a400 con 0x7fa910072630 2024-05-08T21:49:55.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.541+0000 7fa90d7fa700 1 --2- 172.21.15.73:0/1537800625 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fa8f406ad60 0x7fa8f406d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.541+0000 7fa90d7fa700 1 -- 172.21.15.73:0/1537800625 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa900089990 con 0x7fa910072630 2024-05-08T21:49:55.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.548+0000 7fa90d7fa700 1 -- 172.21.15.73:0/1537800625 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fa900054ac0 con 0x7fa910072630 2024-05-08T21:49:55.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.549+0000 7fa90ffff700 1 --2- 172.21.15.73:0/1537800625 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fa8f406ad60 0x7fa8f406d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.550+0000 7fa90ffff700 1 --2- 172.21.15.73:0/1537800625 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fa8f406ad60 0x7fa8f406d220 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa9101583e0 tx=0x7fa904006c60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:55.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.576+0000 7fbe27226700 1 Processor -- start 2024-05-08T21:49:55.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.576+0000 7fbe27226700 1 -- start start 2024-05-08T21:49:55.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.577+0000 7fbe27226700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbe201581f0 0x7fbe200c5f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.577+0000 7fbe27226700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fbe201585d0 0x7fbe200c5190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.577+0000 7fbe27226700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe2015eba0 con 0x7fbe20161670 2024-05-08T21:49:55.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.577+0000 7fbe27226700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe2015e080 con 0x7fbe201581f0 2024-05-08T21:49:55.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.577+0000 7fbe27226700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe2015f030 con 0x7fbe201585d0 2024-05-08T21:49:55.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.577+0000 7fbe24fc2700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbe201581f0 0x7fbe200c5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.577+0000 7fbe24fc2700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbe201581f0 0x7fbe200c5f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39038/0 (socket says 172.21.15.73:39038) 2024-05-08T21:49:55.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.577+0000 7fbe24fc2700 1 -- 172.21.15.73:0/1203786713 learned_addr learned my addr 172.21.15.73:0/1203786713 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:55.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.578+0000 7fbe24fc2700 1 -- 172.21.15.73:0/1203786713 >> v2:172.21.15.115:3300/0 conn(0x7fbe201585d0 msgr2=0x7fbe200c5190 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T21:49:55.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.578+0000 7fbe24fc2700 1 --2- 172.21.15.73:0/1203786713 >> v2:172.21.15.115:3300/0 conn(0x7fbe201585d0 0x7fbe200c5190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.578+0000 7fbe24fc2700 1 -- 172.21.15.73:0/1203786713 >> v1:172.21.15.115:6789/0 conn(0x7fbe20161670 legacy=0x7fbe200c6bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T21:49:55.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.578+0000 7fbe24fc2700 1 -- 172.21.15.73:0/1203786713 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe200c56d0 con 0x7fbe201581f0 2024-05-08T21:49:55.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.578+0000 7fbe24fc2700 1 --2- 172.21.15.73:0/1203786713 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe201581f0 0x7fbe200c5f90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbe200c5d50 tx=0x7fbe1800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36f6031f46b6c148 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:55.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.579+0000 7fbe1f7fe700 1 -- 172.21.15.73:0/1203786713 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe1800e070 con 0x7fbe201581f0 2024-05-08T21:49:55.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.579+0000 7fbe1f7fe700 1 -- 172.21.15.73:0/1203786713 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe18003a20 con 0x7fbe201581f0 2024-05-08T21:49:55.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.579+0000 7fbe1f7fe700 1 -- 172.21.15.73:0/1203786713 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe18003dd0 con 0x7fbe201581f0 2024-05-08T21:49:55.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.580+0000 7f5b15cc8700 1 Processor -- start 2024-05-08T21:49:55.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.580+0000 7fbe27226700 1 -- 172.21.15.73:0/1203786713 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe201581f0 msgr2=0x7fbe200c5f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.580+0000 7fbe27226700 1 --2- 172.21.15.73:0/1203786713 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe201581f0 0x7fbe200c5f90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbe200c5d50 tx=0x7fbe1800b330 comp rx=0 tx=0).stop 2024-05-08T21:49:55.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.581+0000 7fbe27226700 1 -- 172.21.15.73:0/1203786713 shutdown_connections 2024-05-08T21:49:55.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.581+0000 7fbe27226700 1 --2- 172.21.15.73:0/1203786713 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe201581f0 0x7fbe200c5f90 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.581+0000 7fbe27226700 1 --2- 172.21.15.73:0/1203786713 >> v2:172.21.15.115:3300/0 conn(0x7fbe201585d0 0x7fbe200c5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.581+0000 7fbe27226700 1 -- 172.21.15.73:0/1203786713 >> 172.21.15.73:0/1203786713 conn(0x7fbe200cb230 msgr2=0x7fbe200cb610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:55.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.581+0000 7fbe27226700 1 -- 172.21.15.73:0/1203786713 shutdown_connections 2024-05-08T21:49:55.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.580+0000 7f5b15cc8700 1 -- start start 2024-05-08T21:49:55.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.581+0000 7f5b15cc8700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5b10159270 0x7f5b10070880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.581+0000 7f5b15cc8700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5b1006e270 0x7f5b1006e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.581+0000 7f5b15cc8700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b10156ca0 con 0x7f5b1014fe00 2024-05-08T21:49:55.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.581+0000 7f5b15cc8700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b101596c0 con 0x7f5b1006e270 2024-05-08T21:49:55.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.581+0000 7f5b15cc8700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b1015a1a0 con 0x7f5b10159270 2024-05-08T21:49:55.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.581+0000 7fbe27226700 1 -- 172.21.15.73:0/1203786713 wait complete. 2024-05-08T21:49:55.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.582+0000 7f5b0ffff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5b1006e270 0x7f5b1006e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.582+0000 7f5b0ffff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5b1006e270 0x7f5b1006e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39040/0 (socket says 172.21.15.73:39040) 2024-05-08T21:49:55.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.582+0000 7f5b0ffff700 1 -- 172.21.15.73:0/1930338888 learned_addr learned my addr 172.21.15.73:0/1930338888 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:55.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.583+0000 7fbe27226700 1 Processor -- start 2024-05-08T21:49:55.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.583+0000 7f5b0ffff700 1 -- 172.21.15.73:0/1930338888 >> v2:172.21.15.115:3300/0 conn(0x7f5b10159270 msgr2=0x7f5b10070880 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T21:49:55.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.583+0000 7f5b0ffff700 1 --2- 172.21.15.73:0/1930338888 >> v2:172.21.15.115:3300/0 conn(0x7f5b10159270 0x7f5b10070880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.583+0000 7f5b0ffff700 1 -- 172.21.15.73:0/1930338888 >> v1:172.21.15.115:6789/0 conn(0x7f5b1014fe00 legacy=0x7f5b10156590 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T21:49:55.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.583+0000 7f5b0ffff700 1 -- 172.21.15.73:0/1930338888 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b10159900 con 0x7f5b1006e270 2024-05-08T21:49:55.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.583+0000 7f5b0ffff700 1 --2- 172.21.15.73:0/1930338888 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b1006e270 0x7f5b1006e6c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5b100c7d00 tx=0x7f5b0000d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2f30203944a2ada server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:55.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.583+0000 7fbe27226700 1 -- start start 2024-05-08T21:49:55.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.584+0000 7fbe27226700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe201581f0 0x7fbe20160dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.584+0000 7fbe27226700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe201585d0 0x7fbe2013fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.584+0000 7fbe27226700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe20161670 0x7fbe20140400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.584+0000 7fbe27226700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2015cc90 con 0x7fbe201585d0 2024-05-08T21:49:55.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.584+0000 7fbe27226700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe201613e0 con 0x7fbe201581f0 2024-05-08T21:49:55.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.584+0000 7fbe27226700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe200ca520 con 0x7fbe20161670 2024-05-08T21:49:55.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.584+0000 7fbe1ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe201585d0 0x7fbe2013fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.584+0000 7fbe1ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe201585d0 0x7fbe2013fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39044/0 (socket says 172.21.15.73:39044) 2024-05-08T21:49:55.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.585+0000 7fbe1ffff700 1 -- 172.21.15.73:0/708706314 learned_addr learned my addr 172.21.15.73:0/708706314 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:55.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.585+0000 7fbe1ffff700 1 -- 172.21.15.73:0/708706314 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe20161670 msgr2=0x7fbe20140400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.585+0000 7fbe1ffff700 1 --2- 172.21.15.73:0/708706314 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe20161670 0x7fbe20140400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.585+0000 7fbe1ffff700 1 -- 172.21.15.73:0/708706314 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe201581f0 msgr2=0x7fbe20160dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.585+0000 7fbe1ffff700 1 --2- 172.21.15.73:0/708706314 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe201581f0 0x7fbe20160dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.585+0000 7fbe1ffff700 1 -- 172.21.15.73:0/708706314 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe18009b30 con 0x7fbe201585d0 2024-05-08T21:49:55.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.585+0000 7fbe1ffff700 1 --2- 172.21.15.73:0/708706314 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe201585d0 0x7fbe2013fec0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbe1400b550 tx=0x7fbe1400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:55.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.586+0000 7f5b0e7fc700 1 -- 172.21.15.73:0/1930338888 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b00010070 con 0x7f5b1006e270 2024-05-08T21:49:55.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.586+0000 7f5b0e7fc700 1 -- 172.21.15.73:0/1930338888 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b0000da40 con 0x7f5b1006e270 2024-05-08T21:49:55.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.586+0000 7f5b0e7fc700 1 -- 172.21.15.73:0/1930338888 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0000ddd0 con 0x7f5b1006e270 2024-05-08T21:49:55.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.586+0000 7fbe1d7fa700 1 -- 172.21.15.73:0/708706314 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe14011830 con 0x7fbe201585d0 2024-05-08T21:49:55.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.586+0000 7fbe1d7fa700 1 -- 172.21.15.73:0/708706314 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe140119b0 con 0x7fbe201585d0 2024-05-08T21:49:55.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.586+0000 7fbe1d7fa700 1 -- 172.21.15.73:0/708706314 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe14011d60 con 0x7fbe201585d0 2024-05-08T21:49:55.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.587+0000 7f5b15cc8700 1 -- 172.21.15.73:0/1930338888 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b1006e270 msgr2=0x7f5b1006e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.587+0000 7f5b15cc8700 1 --2- 172.21.15.73:0/1930338888 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b1006e270 0x7f5b1006e6c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5b100c7d00 tx=0x7f5b0000d330 comp rx=0 tx=0).stop 2024-05-08T21:49:55.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.587+0000 7fbe27226700 1 -- 172.21.15.73:0/708706314 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe200ca800 con 0x7fbe201585d0 2024-05-08T21:49:55.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.587+0000 7fbe27226700 1 -- 172.21.15.73:0/708706314 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe200cadc0 con 0x7fbe201585d0 2024-05-08T21:49:55.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.589+0000 7fbe27226700 1 -- 172.21.15.73:0/708706314 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe000052f0 con 0x7fbe201585d0 2024-05-08T21:49:55.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.589+0000 7f5b15cc8700 1 -- 172.21.15.73:0/1930338888 shutdown_connections 2024-05-08T21:49:55.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.589+0000 7f5b15cc8700 1 --2- 172.21.15.73:0/1930338888 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b1006e270 0x7f5b1006e6c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.589+0000 7f5b15cc8700 1 --2- 172.21.15.73:0/1930338888 >> v2:172.21.15.115:3300/0 conn(0x7f5b10159270 0x7f5b10070880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.589+0000 7f5b15cc8700 1 -- 172.21.15.73:0/1930338888 >> 172.21.15.73:0/1930338888 conn(0x7f5b100cb230 msgr2=0x7f5b100cb610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:55.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.590+0000 7f5b15cc8700 1 -- 172.21.15.73:0/1930338888 shutdown_connections 2024-05-08T21:49:55.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.590+0000 7fbe1d7fa700 1 -- 172.21.15.73:0/708706314 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbe1401a400 con 0x7fbe201585d0 2024-05-08T21:49:55.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.590+0000 7fbe1d7fa700 1 --2- 172.21.15.73:0/708706314 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fbe0806aef0 0x7fbe0806d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.590+0000 7fbe1d7fa700 1 -- 172.21.15.73:0/708706314 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbe140893a0 con 0x7fbe201585d0 2024-05-08T21:49:55.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.590+0000 7f5b15cc8700 1 -- 172.21.15.73:0/1930338888 wait complete. 2024-05-08T21:49:55.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.591+0000 7f5b15cc8700 1 Processor -- start 2024-05-08T21:49:55.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.592+0000 7f5b15cc8700 1 -- start start 2024-05-08T21:49:55.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.593+0000 7f5b15cc8700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b1006e270 0x7f5b10200110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.593+0000 7f5b15cc8700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b1014fe00 0x7f5b10154150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.593+0000 7f5b15cc8700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b10200650 0x7f5b10154690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.593+0000 7f5b15cc8700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1014aab0 con 0x7f5b1014fe00 2024-05-08T21:49:55.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.593+0000 7f5b15cc8700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b101fa3f0 con 0x7f5b1006e270 2024-05-08T21:49:55.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.593+0000 7f5b15cc8700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b10200ae0 con 0x7f5b10200650 2024-05-08T21:49:55.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.594+0000 7f5b0effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b1014fe00 0x7f5b10154150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.594+0000 7f5b0effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b1014fe00 0x7f5b10154150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39048/0 (socket says 172.21.15.73:39048) 2024-05-08T21:49:55.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.594+0000 7f5b0effd700 1 -- 172.21.15.73:0/313588866 learned_addr learned my addr 172.21.15.73:0/313588866 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:55.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.594+0000 7f5b0effd700 1 -- 172.21.15.73:0/313588866 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b10200650 msgr2=0x7f5b10154690 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T21:49:55.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.594+0000 7f5b0effd700 1 --2- 172.21.15.73:0/313588866 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b10200650 0x7f5b10154690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.594+0000 7f5b0effd700 1 -- 172.21.15.73:0/313588866 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b1006e270 msgr2=0x7f5b10200110 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T21:49:55.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.594+0000 7f5b0effd700 1 --2- 172.21.15.73:0/313588866 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b1006e270 0x7f5b10200110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.594+0000 7f5b0effd700 1 -- 172.21.15.73:0/313588866 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b000085d0 con 0x7f5b1014fe00 2024-05-08T21:49:55.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.595+0000 7f5b0effd700 1 --2- 172.21.15.73:0/313588866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b1014fe00 0x7f5b10154150 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5b0400b4d0 tx=0x7f5b0400b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:55.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.596+0000 7fbe24fc2700 1 --2- 172.21.15.73:0/708706314 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fbe0806aef0 0x7fbe0806d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.597+0000 7fbe24fc2700 1 --2- 172.21.15.73:0/708706314 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fbe0806aef0 0x7fbe0806d3b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbe18009fd0 tx=0x7fbe18010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:55.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.599+0000 7f5afffff700 1 -- 172.21.15.73:0/313588866 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b04011830 con 0x7f5b1014fe00 2024-05-08T21:49:55.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.599+0000 7f5afffff700 1 -- 172.21.15.73:0/313588866 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b04011990 con 0x7f5b1014fe00 2024-05-08T21:49:55.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.599+0000 7f5afffff700 1 -- 172.21.15.73:0/313588866 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b04011d20 con 0x7f5b1014fe00 2024-05-08T21:49:55.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.599+0000 7fbe1d7fa700 1 -- 172.21.15.73:0/708706314 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fbe14054560 con 0x7fbe201585d0 2024-05-08T21:49:55.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.599+0000 7f5b15cc8700 1 -- 172.21.15.73:0/313588866 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b1014acc0 con 0x7f5b1014fe00 2024-05-08T21:49:55.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.599+0000 7f5b15cc8700 1 -- 172.21.15.73:0/313588866 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b100c5060 con 0x7f5b1014fe00 2024-05-08T21:49:55.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.602+0000 7f5afffff700 1 -- 172.21.15.73:0/313588866 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5b0401a400 con 0x7f5b1014fe00 2024-05-08T21:49:55.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.603+0000 7f5b15cc8700 1 -- 172.21.15.73:0/313588866 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5aec0052f0 con 0x7f5b1014fe00 2024-05-08T21:49:55.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.603+0000 7f5afffff700 1 --2- 172.21.15.73:0/313588866 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f5af406ad60 0x7f5af406d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.603+0000 7f5afffff700 1 -- 172.21.15.73:0/313588866 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5b04089310 con 0x7f5b1014fe00 2024-05-08T21:49:55.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.604+0000 7f5b0f7fe700 1 --2- 172.21.15.73:0/313588866 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f5af406ad60 0x7f5af406d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.604+0000 7f5b0f7fe700 1 --2- 172.21.15.73:0/313588866 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f5af406ad60 0x7f5af406d220 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5b0800abb0 tx=0x7f5b08009250 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:55.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.613+0000 7f5afffff700 1 -- 172.21.15.73:0/313588866 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f5b04054440 con 0x7f5b1014fe00 2024-05-08T21:49:55.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.631+0000 7f0ba9189700 1 Processor -- start 2024-05-08T21:49:55.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.631+0000 7f0ba9189700 1 -- start start 2024-05-08T21:49:55.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.633+0000 7f0ba9189700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0ba40c47f0 0x7f0ba41669b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.633+0000 7f0ba9189700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0ba40c5190 0x7f0ba416a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.633+0000 7f0ba9189700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ba4169f20 con 0x7f0ba4072ab0 2024-05-08T21:49:55.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.633+0000 7f0ba9189700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ba40c7380 con 0x7f0ba40c47f0 2024-05-08T21:49:55.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.633+0000 7f0ba9189700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ba40c7660 con 0x7f0ba40c5190 2024-05-08T21:49:55.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.634+0000 7f0ba359e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0ba40c5190 0x7f0ba416a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.634+0000 7f0ba359e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0ba40c5190 0x7f0ba416a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.73:53794/0 (socket says 172.21.15.73:53794) 2024-05-08T21:49:55.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.634+0000 7f0ba359e700 1 -- 172.21.15.73:0/3443248243 learned_addr learned my addr 172.21.15.73:0/3443248243 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:55.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.634+0000 7f0ba2d9d700 1 --2- 172.21.15.73:0/3443248243 >> v2:172.21.15.73:3300/0 conn(0x7f0ba40c47f0 0x7f0ba41669b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.638+0000 7f0ba2d9d700 1 -- 172.21.15.73:0/3443248243 >> v2:172.21.15.115:3300/0 conn(0x7f0ba40c5190 msgr2=0x7f0ba416a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:55.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.638+0000 7f0ba2d9d700 1 --2- 172.21.15.73:0/3443248243 >> v2:172.21.15.115:3300/0 conn(0x7f0ba40c5190 0x7f0ba416a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.638+0000 7f0ba2d9d700 1 -- 172.21.15.73:0/3443248243 >> v1:172.21.15.115:6789/0 conn(0x7f0ba4072ab0 legacy=0x7f0ba40c6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:55.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.638+0000 7f0ba2d9d700 1 -- 172.21.15.73:0/3443248243 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ba40c7940 con 0x7f0ba40c47f0 2024-05-08T21:49:55.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.639+0000 7f0ba2d9d700 1 --2- 172.21.15.73:0/3443248243 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ba40c47f0 0x7f0ba41669b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0ba40c5600 tx=0x7f0b9400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40d02672bfd8fdad server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:55.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.639+0000 7f0ba1d9b700 1 -- 172.21.15.73:0/3443248243 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b9400e070 con 0x7f0ba40c47f0 2024-05-08T21:49:55.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.639+0000 7f0ba1d9b700 1 -- 172.21.15.73:0/3443248243 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b9400bb90 con 0x7f0ba40c47f0 2024-05-08T21:49:55.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.639+0000 7f0ba1d9b700 1 -- 172.21.15.73:0/3443248243 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b94004030 con 0x7f0ba40c47f0 2024-05-08T21:49:55.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.640+0000 7f0ba9189700 1 -- 172.21.15.73:0/3443248243 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ba40c47f0 msgr2=0x7f0ba41669b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.640+0000 7f0ba9189700 1 --2- 172.21.15.73:0/3443248243 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ba40c47f0 0x7f0ba41669b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0ba40c5600 tx=0x7f0b9400b330 comp rx=0 tx=0).stop 2024-05-08T21:49:55.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.641+0000 7f0ba9189700 1 -- 172.21.15.73:0/3443248243 shutdown_connections 2024-05-08T21:49:55.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.641+0000 7f0ba9189700 1 --2- 172.21.15.73:0/3443248243 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ba40c47f0 0x7f0ba41669b0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.641+0000 7f0ba9189700 1 --2- 172.21.15.73:0/3443248243 >> v2:172.21.15.115:3300/0 conn(0x7f0ba40c5190 0x7f0ba416a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.641+0000 7f0ba9189700 1 -- 172.21.15.73:0/3443248243 >> 172.21.15.73:0/3443248243 conn(0x7f0ba40cb230 msgr2=0x7f0ba40cb610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:55.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.641+0000 7f0ba9189700 1 -- 172.21.15.73:0/3443248243 shutdown_connections 2024-05-08T21:49:55.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.641+0000 7f0ba9189700 1 -- 172.21.15.73:0/3443248243 wait complete. 2024-05-08T21:49:55.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.643+0000 7f0ba9189700 1 Processor -- start 2024-05-08T21:49:55.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.644+0000 7f0ba9189700 1 -- start start 2024-05-08T21:49:55.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.645+0000 7f0ba9189700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ba40c47f0 0x7f0ba416caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.645+0000 7f0ba9189700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ba40c5190 0x7f0ba40ca2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.645+0000 7f0ba9189700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ba4167b10 0x7f0ba415be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.645+0000 7f0ba9189700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba41f84b0 con 0x7f0ba40c5190 2024-05-08T21:49:55.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.645+0000 7f0ba9189700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba416d150 con 0x7f0ba40c47f0 2024-05-08T21:49:55.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.645+0000 7f0ba9189700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba41f9d50 con 0x7f0ba4167b10 2024-05-08T21:49:55.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.646+0000 7f0ba2d9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ba40c47f0 0x7f0ba416caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.646+0000 7f0ba2d9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ba40c47f0 0x7f0ba416caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.73:53806/0 (socket says 172.21.15.73:53806) 2024-05-08T21:49:55.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.646+0000 7f0ba2d9d700 1 -- 172.21.15.73:0/9995441 learned_addr learned my addr 172.21.15.73:0/9995441 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:55.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.646+0000 7f0ba359e700 1 --2- 172.21.15.73:0/9995441 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ba4167b10 0x7f0ba415be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.646+0000 7f0ba259c700 1 --2- 172.21.15.73:0/9995441 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ba40c5190 0x7f0ba40ca2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.647+0000 7f0ba259c700 1 -- 172.21.15.73:0/9995441 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ba4167b10 msgr2=0x7f0ba415be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.647+0000 7f0ba259c700 1 --2- 172.21.15.73:0/9995441 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ba4167b10 0x7f0ba415be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.647+0000 7f0ba259c700 1 -- 172.21.15.73:0/9995441 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ba40c47f0 msgr2=0x7f0ba416caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.647+0000 7f0ba259c700 1 --2- 172.21.15.73:0/9995441 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ba40c47f0 0x7f0ba416caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.647+0000 7f0ba259c700 1 -- 172.21.15.73:0/9995441 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b94009a70 con 0x7f0ba40c5190 2024-05-08T21:49:55.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.647+0000 7f0ba259c700 1 --2- 172.21.15.73:0/9995441 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ba40c5190 0x7f0ba40ca2f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0b9800c400 tx=0x7f0b9800c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:55.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.648+0000 7f0b937fe700 1 -- 172.21.15.73:0/9995441 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b98011790 con 0x7f0ba40c5190 2024-05-08T21:49:55.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.648+0000 7f0b937fe700 1 -- 172.21.15.73:0/9995441 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b980118f0 con 0x7f0ba40c5190 2024-05-08T21:49:55.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.648+0000 7f0b937fe700 1 -- 172.21.15.73:0/9995441 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b98011ca0 con 0x7f0ba40c5190 2024-05-08T21:49:55.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.648+0000 7f0ba9189700 1 -- 172.21.15.73:0/9995441 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ba41fa030 con 0x7f0ba40c5190 2024-05-08T21:49:55.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.649+0000 7f0ba9189700 1 -- 172.21.15.73:0/9995441 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ba41f9a50 con 0x7f0ba40c5190 2024-05-08T21:49:55.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.654+0000 7f0b937fe700 1 -- 172.21.15.73:0/9995441 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0b9801c460 con 0x7f0ba40c5190 2024-05-08T21:49:55.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.654+0000 7f0b937fe700 1 --2- 172.21.15.73:0/9995441 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f0b8806ad60 0x7f0b8806d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:55.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.654+0000 7f0b937fe700 1 -- 172.21.15.73:0/9995441 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0b98088f70 con 0x7f0ba40c5190 2024-05-08T21:49:55.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.655+0000 7f0ba2d9d700 1 --2- 172.21.15.73:0/9995441 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f0b8806ad60 0x7f0b8806d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:55.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.656+0000 7f0ba2d9d700 1 --2- 172.21.15.73:0/9995441 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f0b8806ad60 0x7f0b8806d220 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0b9400b020 tx=0x7f0b94011000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:55.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.656+0000 7f0ba9189700 1 -- 172.21.15.73:0/9995441 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b800052f0 con 0x7f0ba40c5190 2024-05-08T21:49:55.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.667+0000 7f0b937fe700 1 -- 172.21.15.73:0/9995441 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f0b98054130 con 0x7f0ba40c5190 2024-05-08T21:49:55.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.937+0000 7f3de13ea700 1 -- 172.21.15.73:0/2680594386 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3dbc0055a0 con 0x7f3ddc06b9d0 2024-05-08T21:49:55.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.937+0000 7f8983e69700 1 -- 172.21.15.73:0/306603854 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f89640055a0 con 0x7f897c150b40 2024-05-08T21:49:55.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.938+0000 7f89727fc700 1 -- 172.21.15.73:0/306603854 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f89740543a0 con 0x7f897c150b40 2024-05-08T21:49:55.939 INFO:teuthology.orchestra.run.smithi073.stdout:64424509447 2024-05-08T21:49:55.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.938+0000 7f3dc37fe700 1 -- 172.21.15.73:0/2680594386 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3dcc059550 con 0x7f3ddc06b9d0 2024-05-08T21:49:55.942 INFO:teuthology.orchestra.run.smithi073.stdout:64424509446 2024-05-08T21:49:55.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.942+0000 7f3de13ea700 1 -- 172.21.15.73:0/2680594386 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f3dc806ace0 msgr2=0x7f3dc806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.942+0000 7f3de13ea700 1 --2- 172.21.15.73:0/2680594386 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f3dc806ace0 0x7f3dc806d1a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc14dae0 tx=0x7f3dd0008040 comp rx=0 tx=0).stop 2024-05-08T21:49:55.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.942+0000 7f3de13ea700 1 -- 172.21.15.73:0/2680594386 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ddc06b9d0 msgr2=0x7f3ddc0c7300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.942+0000 7f3de13ea700 1 --2- 172.21.15.73:0/2680594386 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ddc06b9d0 0x7f3ddc0c7300 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc00a010 tx=0x7f3dcc004750 comp rx=0 tx=0).stop 2024-05-08T21:49:55.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.942+0000 7f8983e69700 1 -- 172.21.15.73:0/306603854 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f896006ad90 msgr2=0x7f896006d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.942+0000 7f8983e69700 1 --2- 172.21.15.73:0/306603854 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f896006ad90 0x7f896006d250 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f896c009840 tx=0x7f896c008030 comp rx=0 tx=0).stop 2024-05-08T21:49:55.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.942+0000 7f8983e69700 1 -- 172.21.15.73:0/306603854 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f897c150b40 msgr2=0x7f897c0cac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.942+0000 7f8983e69700 1 --2- 172.21.15.73:0/306603854 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f897c150b40 0x7f897c0cac60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f897400cbd0 tx=0x7f897400cee0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.942+0000 7f8983e69700 1 -- 172.21.15.73:0/306603854 shutdown_connections 2024-05-08T21:49:55.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.942+0000 7f8983e69700 1 --2- 172.21.15.73:0/306603854 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f896006ad90 0x7f896006d250 secure :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f896c009840 tx=0x7f896c008030 comp rx=0 tx=0).stop 2024-05-08T21:49:55.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.942+0000 7f8983e69700 1 --2- 172.21.15.73:0/306603854 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f897c150b40 0x7f897c0cac60 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.942+0000 7f8983e69700 1 --2- 172.21.15.73:0/306603854 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f897c071db0 0x7f897c0c06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.942+0000 7f8983e69700 1 --2- 172.21.15.73:0/306603854 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f897c0c65d0 0x7f897c1f6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.942+0000 7f8983e69700 1 -- 172.21.15.73:0/306603854 >> 172.21.15.73:0/306603854 conn(0x7f897c066ab0 msgr2=0x7f897c14e330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:55.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.943+0000 7f8983e69700 1 -- 172.21.15.73:0/306603854 shutdown_connections 2024-05-08T21:49:55.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.943+0000 7f3de13ea700 1 -- 172.21.15.73:0/2680594386 shutdown_connections 2024-05-08T21:49:55.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.943+0000 7f3de13ea700 1 --2- 172.21.15.73:0/2680594386 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f3dc806ace0 0x7f3dc806d1a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.943+0000 7f3de13ea700 1 --2- 172.21.15.73:0/2680594386 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ddc15a080 0x7f3ddc155ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.943+0000 7f3de13ea700 1 --2- 172.21.15.73:0/2680594386 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ddc06b9d0 0x7f3ddc0c7300 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.943+0000 7f3de13ea700 1 --2- 172.21.15.73:0/2680594386 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3ddc150440 0x7f3ddc152250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.943+0000 7f3de13ea700 1 -- 172.21.15.73:0/2680594386 >> 172.21.15.73:0/2680594386 conn(0x7f3ddc06eb90 msgr2=0x7f3ddc06ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:55.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.943+0000 7f3de13ea700 1 -- 172.21.15.73:0/2680594386 shutdown_connections 2024-05-08T21:49:55.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.943+0000 7f3de13ea700 1 -- 172.21.15.73:0/2680594386 wait complete. 2024-05-08T21:49:55.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.948+0000 7f8983e69700 1 -- 172.21.15.73:0/306603854 wait complete. 2024-05-08T21:49:55.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.949+0000 7fb1ab49e700 1 -- 172.21.15.73:0/3241926418 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb184005870 con 0x7fb1a41581f0 2024-05-08T21:49:55.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.956+0000 7fa916f5d700 1 -- 172.21.15.73:0/1537800625 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fa8ec005870 con 0x7fa910072630 2024-05-08T21:49:55.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.957+0000 7f4e3471f700 1 -- 172.21.15.73:0/840366357 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4e2c15fa10 con 0x7f4e2c0caac0 2024-05-08T21:49:55.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.957+0000 7fa90d7fa700 1 -- 172.21.15.73:0/1537800625 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa900015090 con 0x7fa910072630 2024-05-08T21:49:55.959 INFO:teuthology.orchestra.run.smithi073.stdout:64424509447 2024-05-08T21:49:55.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.957+0000 7fb199ffb700 1 -- 172.21.15.73:0/3241926418 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb194056df0 con 0x7fb1a41581f0 2024-05-08T21:49:55.960 INFO:teuthology.orchestra.run.smithi073.stdout:55834574853 2024-05-08T21:49:55.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.959+0000 7f4e22ffd700 1 -- 172.21.15.73:0/840366357 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4e2c15fa10 con 0x7f4e2c0caac0 2024-05-08T21:49:55.961 INFO:teuthology.orchestra.run.smithi073.stdout:64424509446 2024-05-08T21:49:55.961 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.0 2024-05-08T21:49:55.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.961+0000 7fa916f5d700 1 -- 172.21.15.73:0/1537800625 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fa8f406ad60 msgr2=0x7fa8f406d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.961+0000 7fa916f5d700 1 --2- 172.21.15.73:0/1537800625 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fa8f406ad60 0x7fa8f406d220 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa9101583e0 tx=0x7fa904006c60 comp rx=0 tx=0).stop 2024-05-08T21:49:55.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.961+0000 7fa916f5d700 1 -- 172.21.15.73:0/1537800625 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa910072630 msgr2=0x7fa9100c9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.961+0000 7fa916f5d700 1 --2- 172.21.15.73:0/1537800625 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa910072630 0x7fa9100c9170 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa90000b470 tx=0x7fa90000b830 comp rx=0 tx=0).stop 2024-05-08T21:49:55.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.961+0000 7fa916f5d700 1 -- 172.21.15.73:0/1537800625 shutdown_connections 2024-05-08T21:49:55.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.961+0000 7fa916f5d700 1 --2- 172.21.15.73:0/1537800625 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fa8f406ad60 0x7fa8f406d220 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.961+0000 7fa916f5d700 1 --2- 172.21.15.73:0/1537800625 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa910153e20 0x7fa9100c7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.961+0000 7fa916f5d700 1 --2- 172.21.15.73:0/1537800625 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa910072630 0x7fa9100c9170 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.961+0000 7fa916f5d700 1 --2- 172.21.15.73:0/1537800625 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa9100cac40 0x7fa9100c7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.961+0000 7fa916f5d700 1 -- 172.21.15.73:0/1537800625 >> 172.21.15.73:0/1537800625 conn(0x7fa91006be90 msgr2=0x7fa9100cf980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:55.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.962+0000 7fa916f5d700 1 -- 172.21.15.73:0/1537800625 shutdown_connections 2024-05-08T21:49:55.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.962+0000 7fb1ab49e700 1 -- 172.21.15.73:0/3241926418 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fb18806ad10 msgr2=0x7fb18806d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.962+0000 7fb1ab49e700 1 --2- 172.21.15.73:0/3241926418 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fb18806ad10 0x7fb18806d1d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb1a0005910 tx=0x7fb1a0009040 comp rx=0 tx=0).stop 2024-05-08T21:49:55.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.962+0000 7fb1ab49e700 1 -- 172.21.15.73:0/3241926418 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1a41581f0 msgr2=0x7fb1a41612c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.962+0000 7fb1ab49e700 1 --2- 172.21.15.73:0/3241926418 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1a41581f0 0x7fb1a41612c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb19400c420 tx=0x7fb19400c7e0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.962+0000 7fa916f5d700 1 -- 172.21.15.73:0/1537800625 wait complete. 2024-05-08T21:49:55.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.962+0000 7fb1ab49e700 1 -- 172.21.15.73:0/3241926418 shutdown_connections 2024-05-08T21:49:55.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.962+0000 7fb1ab49e700 1 --2- 172.21.15.73:0/3241926418 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fb18806ad10 0x7fb18806d1d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.962+0000 7fb1ab49e700 1 --2- 172.21.15.73:0/3241926418 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1a41585d0 0x7fb1a415cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.962+0000 7fb1ab49e700 1 --2- 172.21.15.73:0/3241926418 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb1a40c5f90 0x7fb1a42002b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.962+0000 7fb1ab49e700 1 --2- 172.21.15.73:0/3241926418 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1a41581f0 0x7fb1a41612c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.962+0000 7fb1ab49e700 1 -- 172.21.15.73:0/3241926418 >> 172.21.15.73:0/3241926418 conn(0x7fb1a40cb230 msgr2=0x7fb1a40c8650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:55.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.962+0000 7fb1ab49e700 1 -- 172.21.15.73:0/3241926418 shutdown_connections 2024-05-08T21:49:55.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.962+0000 7fb1ab49e700 1 -- 172.21.15.73:0/3241926418 wait complete. 2024-05-08T21:49:55.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.966+0000 7f4e3471f700 1 -- 172.21.15.73:0/840366357 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f4e1006ad10 msgr2=0x7f4e1006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.966+0000 7f4e3471f700 1 --2- 172.21.15.73:0/840366357 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f4e1006ad10 0x7f4e1006d1d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4e240012e0 tx=0x7f4e24009040 comp rx=0 tx=0).stop 2024-05-08T21:49:55.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.966+0000 7f4e3471f700 1 -- 172.21.15.73:0/840366357 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4e2c0caac0 msgr2=0x7f4e2c135a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:55.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.966+0000 7f4e3471f700 1 --2- 172.21.15.73:0/840366357 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4e2c0caac0 0x7f4e2c135a00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c00e810 tx=0x7f4e1c00eb20 comp rx=0 tx=0).stop 2024-05-08T21:49:55.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.966+0000 7f4e3471f700 1 -- 172.21.15.73:0/840366357 shutdown_connections 2024-05-08T21:49:55.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.966+0000 7f4e3471f700 1 --2- 172.21.15.73:0/840366357 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f4e1006ad10 0x7f4e1006d1d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.966+0000 7f4e3471f700 1 --2- 172.21.15.73:0/840366357 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4e2c1583a0 0x7f4e2c15fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.966+0000 7f4e3471f700 1 --2- 172.21.15.73:0/840366357 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4e2c06e7b0 0x7f4e2c1466b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.966+0000 7f4e3471f700 1 --2- 172.21.15.73:0/840366357 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4e2c0caac0 0x7f4e2c135a00 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:55.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.966+0000 7f4e3471f700 1 -- 172.21.15.73:0/840366357 >> 172.21.15.73:0/840366357 conn(0x7f4e2c0cb230 msgr2=0x7f4e2c0c3ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:55.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.966+0000 7f4e3471f700 1 -- 172.21.15.73:0/840366357 shutdown_connections 2024-05-08T21:49:55.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:55.966+0000 7f4e3471f700 1 -- 172.21.15.73:0/840366357 wait complete. 2024-05-08T21:49:55.972 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.2 2024-05-08T21:49:55.983 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.7 2024-05-08T21:49:55.984 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.1 2024-05-08T21:49:55.985 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.3 2024-05-08T21:49:56.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:56.007+0000 7fbe27226700 1 -- 172.21.15.73:0/708706314 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fbe000055a0 con 0x7fbe201585d0 2024-05-08T21:49:56.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:56.007+0000 7fbe1d7fa700 1 -- 172.21.15.73:0/708706314 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbe14057b80 con 0x7fbe201585d0 2024-05-08T21:49:56.008 INFO:teuthology.orchestra.run.smithi073.stdout:64424509446 2024-05-08T21:49:56.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:56.010+0000 7fbe27226700 1 -- 172.21.15.73:0/708706314 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fbe0806aef0 msgr2=0x7fbe0806d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:56.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:56.010+0000 7fbe27226700 1 --2- 172.21.15.73:0/708706314 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fbe0806aef0 0x7fbe0806d3b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbe18009fd0 tx=0x7fbe18010000 comp rx=0 tx=0).stop 2024-05-08T21:49:56.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:56.010+0000 7fbe27226700 1 -- 172.21.15.73:0/708706314 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe201585d0 msgr2=0x7fbe2013fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:56.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:56.010+0000 7fbe27226700 1 --2- 172.21.15.73:0/708706314 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe201585d0 0x7fbe2013fec0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbe1400b550 tx=0x7fbe1400b910 comp rx=0 tx=0).stop 2024-05-08T21:49:56.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:56.011+0000 7fbe27226700 1 -- 172.21.15.73:0/708706314 shutdown_connections 2024-05-08T21:49:56.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:56.011+0000 7fbe27226700 1 --2- 172.21.15.73:0/708706314 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fbe0806aef0 0x7fbe0806d3b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:56.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:56.011+0000 7fbe27226700 1 --2- 172.21.15.73:0/708706314 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe20161670 0x7fbe20140400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:56.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:56.011+0000 7fbe27226700 1 --2- 172.21.15.73:0/708706314 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe201581f0 0x7fbe20160dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:56.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:56.011+0000 7fbe27226700 1 --2- 172.21.15.73:0/708706314 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe201585d0 0x7fbe2013fec0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:56.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:56.011+0000 7fbe27226700 1 -- 172.21.15.73:0/708706314 >> 172.21.15.73:0/708706314 conn(0x7fbe200cb230 msgr2=0x7fbe20070d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:56.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:56.011+0000 7fbe27226700 1 -- 172.21.15.73:0/708706314 shutdown_connections 2024-05-08T21:49:56.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:56.011+0000 7fbe27226700 1 -- 172.21.15.73:0/708706314 wait complete. 2024-05-08T21:49:56.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:56.021+0000 7f5b15cc8700 1 -- 172.21.15.73:0/313588866 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f5aec0055a0 con 0x7f5b1014fe00 2024-05-08T21:49:56.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:56.022+0000 7f5afffff700 1 -- 172.21.15.73:0/313588866 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5b04057a60 con 0x7f5b1014fe00 2024-05-08T21:49:56.023 INFO:teuthology.orchestra.run.smithi073.stdout:55834574855 2024-05-08T21:49:56.025 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.4 2024-05-08T21:49:56.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:56.024+0000 7f5b15cc8700 1 -- 172.21.15.73:0/313588866 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f5af406ad60 msgr2=0x7f5af406d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:56.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:56.024+0000 7f5b15cc8700 1 --2- 172.21.15.73:0/313588866 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f5af406ad60 0x7f5af406d220 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5b0800abb0 tx=0x7f5b08009250 comp rx=0 tx=0).stop 2024-05-08T21:49:56.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:56.024+0000 7f5b15cc8700 1 -- 172.21.15.73:0/313588866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b1014fe00 msgr2=0x7f5b10154150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:56.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:56.024+0000 7f5b15cc8700 1 --2- 172.21.15.73:0/313588866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b1014fe00 0x7f5b10154150 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5b0400b4d0 tx=0x7f5b0400b890 comp rx=0 tx=0).stop 2024-05-08T21:49:56.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:56.024+0000 7f5b15cc8700 1 -- 172.21.15.73:0/313588866 shutdown_connections 2024-05-08T21:49:56.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:56.024+0000 7f5b15cc8700 1 --2- 172.21.15.73:0/313588866 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f5af406ad60 0x7f5af406d220 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:56.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:56.024+0000 7f5b15cc8700 1 --2- 172.21.15.73:0/313588866 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b10200650 0x7f5b10154690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:56.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:56.024+0000 7f5b15cc8700 1 --2- 172.21.15.73:0/313588866 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b1006e270 0x7f5b10200110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:56.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:56.024+0000 7f5b15cc8700 1 --2- 172.21.15.73:0/313588866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b1014fe00 0x7f5b10154150 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:56.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:56.024+0000 7f5b15cc8700 1 -- 172.21.15.73:0/313588866 >> 172.21.15.73:0/313588866 conn(0x7f5b100cb230 msgr2=0x7f5b1014c330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:56.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:56.024+0000 7f5b15cc8700 1 -- 172.21.15.73:0/313588866 shutdown_connections 2024-05-08T21:49:56.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:56.024+0000 7f5b15cc8700 1 -- 172.21.15.73:0/313588866 wait complete. 2024-05-08T21:49:56.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:56.024+0000 7f0ba9189700 1 -- 172.21.15.73:0/9995441 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f0b800055a0 con 0x7f0ba40c5190 2024-05-08T21:49:56.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:56.024+0000 7f0b937fe700 1 -- 172.21.15.73:0/9995441 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0b98057750 con 0x7f0ba40c5190 2024-05-08T21:49:56.027 INFO:teuthology.orchestra.run.smithi073.stdout:64424509448 2024-05-08T21:49:56.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:56.026+0000 7f0ba9189700 1 -- 172.21.15.73:0/9995441 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f0b8806ad60 msgr2=0x7f0b8806d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:56.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:56.026+0000 7f0ba9189700 1 --2- 172.21.15.73:0/9995441 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f0b8806ad60 0x7f0b8806d220 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0b9400b020 tx=0x7f0b94011000 comp rx=0 tx=0).stop 2024-05-08T21:49:56.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:56.026+0000 7f0ba9189700 1 -- 172.21.15.73:0/9995441 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ba40c5190 msgr2=0x7f0ba40ca2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:56.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:56.026+0000 7f0ba9189700 1 --2- 172.21.15.73:0/9995441 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ba40c5190 0x7f0ba40ca2f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0b9800c400 tx=0x7f0b9800c710 comp rx=0 tx=0).stop 2024-05-08T21:49:56.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:56.027+0000 7f0ba9189700 1 -- 172.21.15.73:0/9995441 shutdown_connections 2024-05-08T21:49:56.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:56.027+0000 7f0ba9189700 1 --2- 172.21.15.73:0/9995441 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f0b8806ad60 0x7f0b8806d220 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:56.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:56.027+0000 7f0ba9189700 1 --2- 172.21.15.73:0/9995441 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ba4167b10 0x7f0ba415be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:56.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:56.027+0000 7f0ba9189700 1 --2- 172.21.15.73:0/9995441 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ba40c47f0 0x7f0ba416caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:56.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:56.027+0000 7f0ba9189700 1 --2- 172.21.15.73:0/9995441 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ba40c5190 0x7f0ba40ca2f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:56.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:56.027+0000 7f0ba9189700 1 -- 172.21.15.73:0/9995441 >> 172.21.15.73:0/9995441 conn(0x7f0ba40cb230 msgr2=0x7f0ba40c3bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:56.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:56.027+0000 7f0ba9189700 1 -- 172.21.15.73:0/9995441 shutdown_connections 2024-05-08T21:49:56.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:56.027+0000 7f0ba9189700 1 -- 172.21.15.73:0/9995441 wait complete. 2024-05-08T21:49:56.038 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.5 2024-05-08T21:49:56.038 DEBUG:teuthology.parallel:result is None 2024-05-08T21:49:56.040 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.6 2024-05-08T21:49:56.040 DEBUG:teuthology.parallel:result is None 2024-05-08T21:49:56.962 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-08T21:49:56.973 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-08T21:49:56.984 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-08T21:49:56.984 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-08T21:49:56.986 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-08T21:49:57.026 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-08T21:49:57.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.150+0000 7fab2168e700 1 Processor -- start 2024-05-08T21:49:57.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.150+0000 7fab2168e700 1 -- start start 2024-05-08T21:49:57.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.151+0000 7fab2168e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab1c0ca480 0x7fab1c0ca860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:57.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.151+0000 7fab2168e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fab1c0c24a0 0x7fab1c161fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:57.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.151+0000 7fab2168e700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab1c06a9c0 con 0x7fab1c15e760 2024-05-08T21:49:57.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.151+0000 7fab2168e700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab1c0c7f80 con 0x7fab1c0c24a0 2024-05-08T21:49:57.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.151+0000 7fab2168e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab1c0cb6d0 con 0x7fab1c0ca480 2024-05-08T21:49:57.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.151+0000 7fab1b7fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fab1c15e760 0x7fab1c0c6c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.73:47040/0 (socket says 172.21.15.73:47040) 2024-05-08T21:49:57.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.151+0000 7fab1b7fe700 1 -- 172.21.15.73:0/946073704 learned_addr learned my addr 172.21.15.73:0/946073704 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:49:57.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.151+0000 7fab19ffb700 1 -- 172.21.15.73:0/946073704 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1233115018 0 0) 0x7fab1c06a9c0 con 0x7fab1c15e760 2024-05-08T21:49:57.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.151+0000 7fab19ffb700 1 -- 172.21.15.73:0/946073704 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab040035b0 con 0x7fab1c15e760 2024-05-08T21:49:57.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.152+0000 7fab19ffb700 1 -- 172.21.15.73:0/946073704 <== mon.1 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2142024663 0 0) 0x7fab040035b0 con 0x7fab1c15e760 2024-05-08T21:49:57.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.152+0000 7fab19ffb700 1 -- 172.21.15.73:0/946073704 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab1c0ca480 msgr2=0x7fab1c0ca860 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T21:49:57.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.152+0000 7fab19ffb700 1 --2- 172.21.15.73:0/946073704 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab1c0ca480 0x7fab1c0ca860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:57.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.152+0000 7fab19ffb700 1 -- 172.21.15.73:0/946073704 >> v2:172.21.15.115:3300/0 conn(0x7fab1c0c24a0 msgr2=0x7fab1c161fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T21:49:57.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.152+0000 7fab19ffb700 1 --2- 172.21.15.73:0/946073704 >> v2:172.21.15.115:3300/0 conn(0x7fab1c0c24a0 0x7fab1c161fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:57.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.152+0000 7fab19ffb700 1 -- 172.21.15.73:0/946073704 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab1c15e2d0 con 0x7fab1c15e760 2024-05-08T21:49:57.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.152+0000 7fab19ffb700 1 -- 172.21.15.73:0/946073704 <== mon.1 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 953298616 0 0) 0x7fab140019f0 con 0x7fab1c15e760 2024-05-08T21:49:57.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.152+0000 7fab19ffb700 1 -- 172.21.15.73:0/946073704 >> v1:172.21.15.115:6789/0 conn(0x7fab1c15e760 legacy=0x7fab1c0c6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:57.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.152+0000 7fab19ffb700 1 --2- 172.21.15.73:0/946073704 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab04003a00 0x7fab04003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:57.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.152+0000 7fab19ffb700 1 --2- 172.21.15.73:0/946073704 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab04004850 0x7fab04004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:57.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.152+0000 7fab19ffb700 1 --2- 172.21.15.73:0/946073704 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab04005260 0x7fab0400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:57.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.152+0000 7fab19ffb700 1 -- 172.21.15.73:0/946073704 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab1c0c7f80 con 0x7fab04005260 2024-05-08T21:49:57.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.152+0000 7fab19ffb700 1 -- 172.21.15.73:0/946073704 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab1c0cb6d0 con 0x7fab04004850 2024-05-08T21:49:57.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.152+0000 7fab19ffb700 1 -- 172.21.15.73:0/946073704 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab0400c210 con 0x7fab04003a00 2024-05-08T21:49:57.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.152+0000 7fab1b7fe700 1 --2- 172.21.15.73:0/946073704 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab04005260 0x7fab0400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:57.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.152+0000 7fab1b7fe700 1 -- 172.21.15.73:0/946073704 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab04003a00 msgr2=0x7fab04003e20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T21:49:57.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.152+0000 7fab1b7fe700 1 --2- 172.21.15.73:0/946073704 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab04003a00 0x7fab04003e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:57.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.152+0000 7fab1b7fe700 1 -- 172.21.15.73:0/946073704 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab04004850 msgr2=0x7fab04004cd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T21:49:57.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.152+0000 7fab1b7fe700 1 --2- 172.21.15.73:0/946073704 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab04004850 0x7fab04004cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:57.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.152+0000 7fab1b7fe700 1 -- 172.21.15.73:0/946073704 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab1c15e2d0 con 0x7fab04005260 2024-05-08T21:49:57.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.152+0000 7fab1b7fe700 1 --2- 172.21.15.73:0/946073704 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab04005260 0x7fab0400ba10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fab1400a960 tx=0x7fab04005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60520f65559acd3d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:57.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.153+0000 7fab19ffb700 1 -- 172.21.15.73:0/946073704 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab14012600 con 0x7fab04005260 2024-05-08T21:49:57.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.153+0000 7fab19ffb700 1 -- 172.21.15.73:0/946073704 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab14012760 con 0x7fab04005260 2024-05-08T21:49:57.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.153+0000 7fab19ffb700 1 -- 172.21.15.73:0/946073704 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab14012af0 con 0x7fab04005260 2024-05-08T21:49:57.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.153+0000 7fab2168e700 1 -- 172.21.15.73:0/946073704 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab04005260 msgr2=0x7fab0400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:57.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.153+0000 7fab2168e700 1 --2- 172.21.15.73:0/946073704 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab04005260 0x7fab0400ba10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fab1400a960 tx=0x7fab04005880 comp rx=0 tx=0).stop 2024-05-08T21:49:57.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.153+0000 7fab1b7fe700 1 -- 172.21.15.73:0/946073704 reap_dead start 2024-05-08T21:49:57.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.154+0000 7fab2168e700 1 -- 172.21.15.73:0/946073704 shutdown_connections 2024-05-08T21:49:57.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.154+0000 7fab2168e700 1 -- 172.21.15.73:0/946073704 >> 172.21.15.73:0/946073704 conn(0x7fab1c06eb90 msgr2=0x7fab1c06ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:57.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.154+0000 7fab2168e700 1 -- 172.21.15.73:0/946073704 shutdown_connections 2024-05-08T21:49:57.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.154+0000 7fab2168e700 1 -- 172.21.15.73:0/946073704 wait complete. 2024-05-08T21:49:57.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.156+0000 7fab2168e700 1 Processor -- start 2024-05-08T21:49:57.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.156+0000 7fab2168e700 1 -- start start 2024-05-08T21:49:57.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.157+0000 7fab2168e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab04005260 0x7fab1c1539d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:57.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.157+0000 7fab2168e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab1c15d530 0x7fab1c15d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:57.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.157+0000 7fab2168e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab1c15a030 0x7fab1c15a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:57.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.157+0000 7fab2168e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab1c0c9e30 con 0x7fab04005260 2024-05-08T21:49:57.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.157+0000 7fab2168e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab1c152c90 con 0x7fab1c15a030 2024-05-08T21:49:57.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.157+0000 7fab2168e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab1c144920 con 0x7fab1c15d530 2024-05-08T21:49:57.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.158+0000 7fab1affd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab04005260 0x7fab1c1539d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:57.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.158+0000 7fab1b7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab1c15a030 0x7fab1c15a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:57.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.158+0000 7fab1affd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab04005260 0x7fab1c1539d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39078/0 (socket says 172.21.15.73:39078) 2024-05-08T21:49:57.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.158+0000 7fab1affd700 1 -- 172.21.15.73:0/1330387492 learned_addr learned my addr 172.21.15.73:0/1330387492 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:57.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.158+0000 7fab1b7fe700 1 -- 172.21.15.73:0/1330387492 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab1c15d530 msgr2=0x7fab1c15d990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T21:49:57.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.158+0000 7fab1b7fe700 1 --2- 172.21.15.73:0/1330387492 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab1c15d530 0x7fab1c15d990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:57.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.158+0000 7fab1b7fe700 1 -- 172.21.15.73:0/1330387492 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab04005260 msgr2=0x7fab1c1539d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:57.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.158+0000 7fab1b7fe700 1 --2- 172.21.15.73:0/1330387492 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab04005260 0x7fab1c1539d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:57.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.158+0000 7fab1b7fe700 1 -- 172.21.15.73:0/1330387492 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab1c152660 con 0x7fab1c15a030 2024-05-08T21:49:57.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.158+0000 7fab1affd700 1 --2- 172.21.15.73:0/1330387492 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab04005260 0x7fab1c1539d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:49:57.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.159+0000 7fab1b7fe700 1 --2- 172.21.15.73:0/1330387492 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab1c15a030 0x7fab1c15a4b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fab14014000 tx=0x7fab14001cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:57.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.159+0000 7fab037fe700 1 -- 172.21.15.73:0/1330387492 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1401e600 con 0x7fab1c15a030 2024-05-08T21:49:57.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.159+0000 7fab037fe700 1 -- 172.21.15.73:0/1330387492 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab1401e760 con 0x7fab1c15a030 2024-05-08T21:49:57.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.159+0000 7fab037fe700 1 -- 172.21.15.73:0/1330387492 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1401ead0 con 0x7fab1c15a030 2024-05-08T21:49:57.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.159+0000 7fab2168e700 1 -- 172.21.15.73:0/1330387492 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab1c15a9f0 con 0x7fab1c15a030 2024-05-08T21:49:57.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.159+0000 7fab2168e700 1 -- 172.21.15.73:0/1330387492 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab1c15b300 con 0x7fab1c15a030 2024-05-08T21:49:57.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.161+0000 7fab2168e700 1 -- 172.21.15.73:0/1330387492 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab1c152dd0 con 0x7fab1c15a030 2024-05-08T21:49:57.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.162+0000 7fab037fe700 1 -- 172.21.15.73:0/1330387492 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fab14019030 con 0x7fab1c15a030 2024-05-08T21:49:57.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.162+0000 7fedb3b63700 1 Processor -- start 2024-05-08T21:49:57.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.162+0000 7fab037fe700 1 --2- 172.21.15.73:0/1330387492 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fab0806acc0 0x7fab0806d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:57.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.163+0000 7fab037fe700 1 -- 172.21.15.73:0/1330387492 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fab1408b650 con 0x7fab1c15a030 2024-05-08T21:49:57.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.162+0000 7fedb3b63700 1 -- start start 2024-05-08T21:49:57.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.163+0000 7fedb3b63700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fedac0caac0 0x7fedac06e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:57.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.163+0000 7fedb3b63700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fedac06e7b0 0x7fedac1617e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:57.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.163+0000 7fedb3b63700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedac158780 con 0x7fedac1583a0 2024-05-08T21:49:57.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.163+0000 7fedb3b63700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedac0caf30 con 0x7fedac0caac0 2024-05-08T21:49:57.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.163+0000 7fedb3b63700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedac15e2c0 con 0x7fedac06e7b0 2024-05-08T21:49:57.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.164+0000 7fedb10fe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fedac0caac0 0x7fedac06e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:57.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.164+0000 7fedb10fe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fedac0caac0 0x7fedac06e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39082/0 (socket says 172.21.15.73:39082) 2024-05-08T21:49:57.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.164+0000 7fedb10fe700 1 -- 172.21.15.73:0/3951273290 learned_addr learned my addr 172.21.15.73:0/3951273290 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:57.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.164+0000 7fedb2100700 1 --2- 172.21.15.73:0/3951273290 >> v2:172.21.15.115:3300/0 conn(0x7fedac06e7b0 0x7fedac1617e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:57.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.164+0000 7fab1affd700 1 --2- 172.21.15.73:0/1330387492 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fab0806acc0 0x7fab0806d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:57.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.165+0000 7ff812b6c700 1 Processor -- start 2024-05-08T21:49:57.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.165+0000 7ff812b6c700 1 -- start start 2024-05-08T21:49:57.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.164+0000 7fedb10fe700 1 -- 172.21.15.73:0/3951273290 >> v2:172.21.15.115:3300/0 conn(0x7fedac06e7b0 msgr2=0x7fedac1617e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:57.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.164+0000 7fedb10fe700 1 --2- 172.21.15.73:0/3951273290 >> v2:172.21.15.115:3300/0 conn(0x7fedac06e7b0 0x7fedac1617e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:57.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.164+0000 7fedb10fe700 1 -- 172.21.15.73:0/3951273290 >> v1:172.21.15.115:6789/0 conn(0x7fedac1583a0 legacy=0x7fedac0c9030 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T21:49:57.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.164+0000 7fedb10fe700 1 -- 172.21.15.73:0/3951273290 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedac15e5a0 con 0x7fedac0caac0 2024-05-08T21:49:57.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.164+0000 7fedb10fe700 1 --2- 172.21.15.73:0/3951273290 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fedac0caac0 0x7fedac06e270 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7feda80098f0 tx=0x7feda8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=114a73a118b122ed server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:57.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.164+0000 7fedb08fd700 1 -- 172.21.15.73:0/3951273290 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda8004230 con 0x7fedac0caac0 2024-05-08T21:49:57.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.165+0000 7fedb08fd700 1 -- 172.21.15.73:0/3951273290 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feda8004390 con 0x7fedac0caac0 2024-05-08T21:49:57.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.165+0000 7fedb08fd700 1 -- 172.21.15.73:0/3951273290 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda80036a0 con 0x7fedac0caac0 2024-05-08T21:49:57.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.165+0000 7fedb3b63700 1 -- 172.21.15.73:0/3951273290 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fedac0caac0 msgr2=0x7fedac06e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:57.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.165+0000 7fedb3b63700 1 --2- 172.21.15.73:0/3951273290 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fedac0caac0 0x7fedac06e270 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7feda80098f0 tx=0x7feda8009c00 comp rx=0 tx=0).stop 2024-05-08T21:49:57.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.166+0000 7fedb3b63700 1 -- 172.21.15.73:0/3951273290 shutdown_connections 2024-05-08T21:49:57.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.166+0000 7fedb3b63700 1 --2- 172.21.15.73:0/3951273290 >> v2:172.21.15.115:3300/0 conn(0x7fedac06e7b0 0x7fedac1617e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:57.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.166+0000 7fedb3b63700 1 --2- 172.21.15.73:0/3951273290 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fedac0caac0 0x7fedac06e270 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:57.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.166+0000 7fedb3b63700 1 -- 172.21.15.73:0/3951273290 >> 172.21.15.73:0/3951273290 conn(0x7fedac0cb230 msgr2=0x7fedac0cb610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:57.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.166+0000 7fedb3b63700 1 -- 172.21.15.73:0/3951273290 shutdown_connections 2024-05-08T21:49:57.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.166+0000 7ff812b6c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff80c150cc0 0x7ff80c0c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:57.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.166+0000 7ff812b6c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff80c0c5c30 0x7ff80c1569b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:57.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.166+0000 7ff812b6c700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff80c0c6d10 0x7ff80c0c7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:57.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.166+0000 7ff812b6c700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff80c156ef0 con 0x7ff80c0c6d10 2024-05-08T21:49:57.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.166+0000 7ff812b6c700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff80c0c6b00 con 0x7ff80c150cc0 2024-05-08T21:49:57.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.166+0000 7ff812b6c700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff80c1510a0 con 0x7ff80c0c5c30 2024-05-08T21:49:57.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.166+0000 7ff811109700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff80c0c6d10 0x7ff80c0c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:57.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.166+0000 7ff811109700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff80c0c6d10 0x7ff80c0c7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39098/0 (socket says 172.21.15.73:39098) 2024-05-08T21:49:57.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.166+0000 7ff811109700 1 -- 172.21.15.73:0/4000915924 learned_addr learned my addr 172.21.15.73:0/4000915924 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:57.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.166+0000 7ff810908700 1 --2- 172.21.15.73:0/4000915924 >> v2:172.21.15.115:3300/0 conn(0x7ff80c150cc0 0x7ff80c0c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:57.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.166+0000 7fab037fe700 1 -- 172.21.15.73:0/1330387492 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fab140568a0 con 0x7fab1c15a030 2024-05-08T21:49:57.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.167+0000 7ff811109700 1 -- 172.21.15.73:0/4000915924 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff80c0c5c30 msgr2=0x7ff80c1569b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T21:49:57.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.167+0000 7ff811109700 1 --2- 172.21.15.73:0/4000915924 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff80c0c5c30 0x7ff80c1569b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:57.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.167+0000 7ff811109700 1 -- 172.21.15.73:0/4000915924 >> v2:172.21.15.115:3300/0 conn(0x7ff80c150cc0 msgr2=0x7ff80c0c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:57.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.167+0000 7ff811109700 1 --2- 172.21.15.73:0/4000915924 >> v2:172.21.15.115:3300/0 conn(0x7ff80c150cc0 0x7ff80c0c4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:57.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.167+0000 7ff811109700 1 -- 172.21.15.73:0/4000915924 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff80c0c6860 con 0x7ff80c0c6d10 2024-05-08T21:49:57.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.167+0000 7ff810908700 1 --2- 172.21.15.73:0/4000915924 >> v2:172.21.15.115:3300/0 conn(0x7ff80c150cc0 0x7ff80c0c4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:49:57.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.167+0000 7ff811109700 1 --2- 172.21.15.73:0/4000915924 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff80c0c6d10 0x7ff80c0c7250 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff80c070b20 tx=0x7ff80400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=499cb3f0f761a8c5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:57.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.167+0000 7fedb3b63700 1 -- 172.21.15.73:0/3951273290 wait complete. 2024-05-08T21:49:57.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.167+0000 7ff80b7fe700 1 -- 172.21.15.73:0/4000915924 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80400e070 con 0x7ff80c0c6d10 2024-05-08T21:49:57.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.167+0000 7ff80b7fe700 1 -- 172.21.15.73:0/4000915924 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff80400b910 con 0x7ff80c0c6d10 2024-05-08T21:49:57.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.167+0000 7ff80b7fe700 1 -- 172.21.15.73:0/4000915924 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80400bcc0 con 0x7ff80c0c6d10 2024-05-08T21:49:57.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.169+0000 7fedb3b63700 1 Processor -- start 2024-05-08T21:49:57.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.169+0000 7fedb3b63700 1 -- start start 2024-05-08T21:49:57.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.170+0000 7fab1affd700 1 --2- 172.21.15.73:0/1330387492 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fab0806acc0 0x7fab0806d180 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fab0c009d00 tx=0x7fab0c0090e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:57.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.170+0000 7fedb3b63700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fedac06e7b0 0x7fedac131a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:57.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.170+0000 7fedb3b63700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fedac0caac0 0x7fedac130aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:57.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.170+0000 7fedb3b63700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fedac1583a0 0x7fedac130fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:57.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.170+0000 7fedb3b63700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedac15de70 con 0x7fedac1583a0 2024-05-08T21:49:57.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.170+0000 7fedb3b63700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedac0c4860 con 0x7fedac06e7b0 2024-05-08T21:49:57.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.170+0000 7fedb3b63700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedac15cbe0 con 0x7fedac0caac0 2024-05-08T21:49:57.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.171+0000 7fedb2100700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fedac1583a0 0x7fedac130fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:57.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.171+0000 7fedb2100700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fedac1583a0 0x7fedac130fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39104/0 (socket says 172.21.15.73:39104) 2024-05-08T21:49:57.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.171+0000 7fedb2100700 1 -- 172.21.15.73:0/223903090 learned_addr learned my addr 172.21.15.73:0/223903090 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:57.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.171+0000 7fedb18ff700 1 --2- 172.21.15.73:0/223903090 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fedac06e7b0 0x7fedac131a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:57.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.171+0000 7fedb10fe700 1 --2- 172.21.15.73:0/223903090 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fedac0caac0 0x7fedac130aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:57.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.171+0000 7fedb10fe700 1 -- 172.21.15.73:0/223903090 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fedac06e7b0 msgr2=0x7fedac131a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:57.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.171+0000 7fedb10fe700 1 --2- 172.21.15.73:0/223903090 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fedac06e7b0 0x7fedac131a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:57.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.171+0000 7fedb10fe700 1 -- 172.21.15.73:0/223903090 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fedac1583a0 msgr2=0x7fedac130fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:57.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.171+0000 7fedb10fe700 1 --2- 172.21.15.73:0/223903090 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fedac1583a0 0x7fedac130fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:57.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.171+0000 7fedb10fe700 1 -- 172.21.15.73:0/223903090 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda8009550 con 0x7fedac0caac0 2024-05-08T21:49:57.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.171+0000 7fedb10fe700 1 --2- 172.21.15.73:0/223903090 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fedac0caac0 0x7fedac130aa0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7feda8015000 tx=0x7feda8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:57.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.171+0000 7feda27fc700 1 -- 172.21.15.73:0/223903090 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda80045f0 con 0x7fedac0caac0 2024-05-08T21:49:57.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.171+0000 7feda27fc700 1 -- 172.21.15.73:0/223903090 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feda8011630 con 0x7fedac0caac0 2024-05-08T21:49:57.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.171+0000 7fedb3b63700 1 -- 172.21.15.73:0/223903090 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedac1414b0 con 0x7fedac0caac0 2024-05-08T21:49:57.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.171+0000 7feda27fc700 1 -- 172.21.15.73:0/223903090 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda8003ea0 con 0x7fedac0caac0 2024-05-08T21:49:57.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.172+0000 7fedb3b63700 1 -- 172.21.15.73:0/223903090 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedac130330 con 0x7fedac0caac0 2024-05-08T21:49:57.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.174+0000 7fedb3b63700 1 -- 172.21.15.73:0/223903090 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedac146cf0 con 0x7fedac0caac0 2024-05-08T21:49:57.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.174+0000 7ff812b6c700 1 -- 172.21.15.73:0/4000915924 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff80c0c6d10 msgr2=0x7ff80c0c7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:57.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.174+0000 7ff812b6c700 1 --2- 172.21.15.73:0/4000915924 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff80c0c6d10 0x7ff80c0c7250 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff80c070b20 tx=0x7ff80400b330 comp rx=0 tx=0).stop 2024-05-08T21:49:57.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.174+0000 7feda27fc700 1 -- 172.21.15.73:0/223903090 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7feda8022070 con 0x7fedac0caac0 2024-05-08T21:49:57.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.175+0000 7feda27fc700 1 --2- 172.21.15.73:0/223903090 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fed9006ac90 0x7fed9006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:57.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.175+0000 7feda27fc700 1 -- 172.21.15.73:0/223903090 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feda808ad60 con 0x7fedac0caac0 2024-05-08T21:49:57.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.176+0000 7ff812b6c700 1 -- 172.21.15.73:0/4000915924 shutdown_connections 2024-05-08T21:49:57.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.176+0000 7ff812b6c700 1 --2- 172.21.15.73:0/4000915924 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff80c0c6d10 0x7ff80c0c7250 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:57.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.176+0000 7ff812b6c700 1 --2- 172.21.15.73:0/4000915924 >> v2:172.21.15.115:3300/0 conn(0x7ff80c150cc0 0x7ff80c0c4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:57.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.176+0000 7ff812b6c700 1 --2- 172.21.15.73:0/4000915924 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff80c0c5c30 0x7ff80c1569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:57.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.176+0000 7ff812b6c700 1 -- 172.21.15.73:0/4000915924 >> 172.21.15.73:0/4000915924 conn(0x7ff80c0cb230 msgr2=0x7ff80c0cb610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:57.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.178+0000 7ff812b6c700 1 -- 172.21.15.73:0/4000915924 shutdown_connections 2024-05-08T21:49:57.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.178+0000 7ff812b6c700 1 -- 172.21.15.73:0/4000915924 wait complete. 2024-05-08T21:49:57.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.180+0000 7ff812b6c700 1 Processor -- start 2024-05-08T21:49:57.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.181+0000 7feda27fc700 1 -- 172.21.15.73:0/223903090 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7feda8055e10 con 0x7fedac0caac0 2024-05-08T21:49:57.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.180+0000 7ff812b6c700 1 -- start start 2024-05-08T21:49:57.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.181+0000 7ff812b6c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff80c0c5c30 0x7ff80c071fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:57.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.181+0000 7ff812b6c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff80c0c6d10 0x7ff80c155820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:57.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.181+0000 7ff812b6c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff80c150cc0 0x7ff80c155d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:57.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.181+0000 7ff812b6c700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff80c1535a0 con 0x7ff80c0c5c30 2024-05-08T21:49:57.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.181+0000 7ff812b6c700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff80c13e0e0 con 0x7ff80c150cc0 2024-05-08T21:49:57.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.181+0000 7ff812b6c700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff80c1544a0 con 0x7ff80c0c6d10 2024-05-08T21:49:57.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.181+0000 7ff80bfff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff80c0c6d10 0x7ff80c155820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:57.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.182+0000 7fedb18ff700 1 --2- 172.21.15.73:0/223903090 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fed9006ac90 0x7fed9006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:57.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.182+0000 7fedb18ff700 1 --2- 172.21.15.73:0/223903090 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fed9006ac90 0x7fed9006d150 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fed9c009960 tx=0x7fed9c0090e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:57.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.181+0000 7ff80bfff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff80c0c6d10 0x7ff80c155820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.73:52836/0 (socket says 172.21.15.73:52836) 2024-05-08T21:49:57.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.181+0000 7ff810908700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff80c0c5c30 0x7ff80c071fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:57.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.181+0000 7ff80bfff700 1 -- 172.21.15.73:0/1063389325 learned_addr learned my addr 172.21.15.73:0/1063389325 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:57.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.181+0000 7ff811109700 1 --2- 172.21.15.73:0/1063389325 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff80c150cc0 0x7ff80c155d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:57.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.182+0000 7ff811109700 1 -- 172.21.15.73:0/1063389325 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff80c0c6d10 msgr2=0x7ff80c155820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:57.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.182+0000 7ff811109700 1 --2- 172.21.15.73:0/1063389325 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff80c0c6d10 0x7ff80c155820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:57.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.182+0000 7ff811109700 1 -- 172.21.15.73:0/1063389325 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff80c0c5c30 msgr2=0x7ff80c071fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:57.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.182+0000 7ff811109700 1 --2- 172.21.15.73:0/1063389325 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff80c0c5c30 0x7ff80c071fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:57.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.182+0000 7ff811109700 1 -- 172.21.15.73:0/1063389325 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8000094a0 con 0x7ff80c150cc0 2024-05-08T21:49:57.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.184+0000 7f58d2d8a700 1 Processor -- start 2024-05-08T21:49:57.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.185+0000 7f58d2d8a700 1 -- start start 2024-05-08T21:49:57.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.185+0000 7f58d2d8a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f58cc06b560 0x7f58cc15ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:57.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.185+0000 7f58d2d8a700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58cc161f70 con 0x7f58cc158050 2024-05-08T21:49:57.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.185+0000 7f58d2d8a700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58cc15ef40 con 0x7f58cc158430 2024-05-08T21:49:57.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.185+0000 7f58d2d8a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58cc0c6940 con 0x7f58cc06b560 2024-05-08T21:49:57.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.186+0000 7f58d0b26700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f58cc158050 0x7f58cc0c74a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:51842/0 (socket says 172.21.15.73:51842) 2024-05-08T21:49:57.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.186+0000 7f58d0b26700 1 -- 172.21.15.73:0/4100456836 learned_addr learned my addr 172.21.15.73:0/4100456836 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:49:57.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.186+0000 7f58d1327700 1 --2- 172.21.15.73:0/4100456836 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f58cc06b560 0x7f58cc15ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:57.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.186+0000 7f58cb7fe700 1 -- 172.21.15.73:0/4100456836 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4064032426 0 0) 0x7f58cc161f70 con 0x7f58cc158050 2024-05-08T21:49:57.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.186+0000 7f58cb7fe700 1 -- 172.21.15.73:0/4100456836 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58bc0035b0 con 0x7f58cc158050 2024-05-08T21:49:57.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.186+0000 7f58cb7fe700 1 -- 172.21.15.73:0/4100456836 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1912338816 0 0) 0x7f58bc0035b0 con 0x7f58cc158050 2024-05-08T21:49:57.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.186+0000 7f58cb7fe700 1 -- 172.21.15.73:0/4100456836 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f58cc06b560 msgr2=0x7f58cc15ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:57.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.186+0000 7f58cb7fe700 1 --2- 172.21.15.73:0/4100456836 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f58cc06b560 0x7f58cc15ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:57.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.186+0000 7f58cb7fe700 1 -- 172.21.15.73:0/4100456836 >> v1:172.21.15.115:6789/0 conn(0x7f58cc158430 legacy=0x7f58cc0cc3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:57.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.186+0000 7f58cb7fe700 1 -- 172.21.15.73:0/4100456836 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58cc0c6680 con 0x7f58cc158050 2024-05-08T21:49:57.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.186+0000 7f58cb7fe700 1 -- 172.21.15.73:0/4100456836 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 953298616 0 0) 0x7f58c0001670 con 0x7f58cc158050 2024-05-08T21:49:57.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.186+0000 7f58cb7fe700 1 -- 172.21.15.73:0/4100456836 >> v1:172.21.15.73:6789/0 conn(0x7f58cc158050 legacy=0x7f58cc0c74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:57.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.186+0000 7f58cb7fe700 1 --2- 172.21.15.73:0/4100456836 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58bc003a30 0x7f58bc003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:57.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.186+0000 7f58cb7fe700 1 --2- 172.21.15.73:0/4100456836 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f58bc004850 0x7f58bc004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:57.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.186+0000 7f58cb7fe700 1 --2- 172.21.15.73:0/4100456836 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58bc005210 0x7f58bc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:57.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.186+0000 7f58cb7fe700 1 -- 172.21.15.73:0/4100456836 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58cc0c6940 con 0x7f58bc005210 2024-05-08T21:49:57.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.186+0000 7f58cb7fe700 1 -- 172.21.15.73:0/4100456836 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58bc00c060 con 0x7f58bc003a30 2024-05-08T21:49:57.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.186+0000 7f58cb7fe700 1 -- 172.21.15.73:0/4100456836 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58bc00c220 con 0x7f58bc004850 2024-05-08T21:49:57.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.186+0000 7f58cbfff700 1 --2- 172.21.15.73:0/4100456836 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f58bc004850 0x7f58bc004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:57.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.186+0000 7f58d1327700 1 --2- 172.21.15.73:0/4100456836 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58bc005210 0x7f58bc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:57.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.186+0000 7f58d0b26700 1 --2- 172.21.15.73:0/4100456836 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58bc003a30 0x7f58bc003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:57.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.187+0000 7f58cbfff700 1 -- 172.21.15.73:0/4100456836 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58bc003a30 msgr2=0x7f58bc003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:57.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.187+0000 7f58cbfff700 1 --2- 172.21.15.73:0/4100456836 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58bc003a30 0x7f58bc003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:57.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.187+0000 7f58cbfff700 1 -- 172.21.15.73:0/4100456836 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58bc005210 msgr2=0x7f58bc00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:57.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.187+0000 7f58cbfff700 1 --2- 172.21.15.73:0/4100456836 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58bc005210 0x7f58bc00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:57.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.187+0000 7f58cbfff700 1 -- 172.21.15.73:0/4100456836 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58bc0035b0 con 0x7f58bc004850 2024-05-08T21:49:57.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.187+0000 7f58cbfff700 1 --2- 172.21.15.73:0/4100456836 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f58bc004850 0x7f58bc004cd0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f58b8001800 tx=0x7f58bc005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97d54ea28ae849c2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:57.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.187+0000 7f58cb7fe700 1 -- 172.21.15.73:0/4100456836 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b80012f0 con 0x7f58bc004850 2024-05-08T21:49:57.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.187+0000 7f58cb7fe700 1 -- 172.21.15.73:0/4100456836 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b80052f0 con 0x7f58bc004850 2024-05-08T21:49:57.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.187+0000 7f58cb7fe700 1 -- 172.21.15.73:0/4100456836 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b8006860 con 0x7f58bc004850 2024-05-08T21:49:57.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.188+0000 7f58d2d8a700 1 -- 172.21.15.73:0/4100456836 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f58bc004850 msgr2=0x7f58bc004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:57.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.188+0000 7f58d2d8a700 1 --2- 172.21.15.73:0/4100456836 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f58bc004850 0x7f58bc004cd0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f58b8001800 tx=0x7f58bc005880 comp rx=0 tx=0).stop 2024-05-08T21:49:57.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.188+0000 7f58d1327700 1 -- 172.21.15.73:0/4100456836 reap_dead start 2024-05-08T21:49:57.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.188+0000 7f58d2d8a700 1 -- 172.21.15.73:0/4100456836 shutdown_connections 2024-05-08T21:49:57.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.188+0000 7f58d2d8a700 1 -- 172.21.15.73:0/4100456836 >> 172.21.15.73:0/4100456836 conn(0x7f58cc066ab0 msgr2=0x7f58cc06f550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:57.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.188+0000 7f58d2d8a700 1 -- 172.21.15.73:0/4100456836 shutdown_connections 2024-05-08T21:49:57.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.188+0000 7f58d2d8a700 1 -- 172.21.15.73:0/4100456836 wait complete. 2024-05-08T21:49:57.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.189+0000 7f58d2d8a700 1 Processor -- start 2024-05-08T21:49:57.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.189+0000 7f58d2d8a700 1 -- start start 2024-05-08T21:49:57.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.190+0000 7f58d2d8a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58bc004850 0x7f58cc1f46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:57.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.190+0000 7f58d2d8a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58cc1520f0 0x7f58cc0caf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:57.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.190+0000 7f58d2d8a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f58cc15d4c0 0x7f58cc1f3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:57.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.190+0000 7f58d2d8a700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58cc0ca220 con 0x7f58bc004850 2024-05-08T21:49:57.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.190+0000 7f58d2d8a700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58cc152ad0 con 0x7f58cc1520f0 2024-05-08T21:49:57.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.190+0000 7f58d2d8a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58cc1f3cf0 con 0x7f58cc15d4c0 2024-05-08T21:49:57.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.190+0000 7f58d0b26700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58bc004850 0x7f58cc1f46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:57.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.190+0000 7f58d0b26700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58bc004850 0x7f58cc1f46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39138/0 (socket says 172.21.15.73:39138) 2024-05-08T21:49:57.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.190+0000 7f58d0b26700 1 -- 172.21.15.73:0/861029234 learned_addr learned my addr 172.21.15.73:0/861029234 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:57.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.190+0000 7f58d1327700 1 --2- 172.21.15.73:0/861029234 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f58cc15d4c0 0x7f58cc1f3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:57.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.191+0000 7f58d0b26700 1 -- 172.21.15.73:0/861029234 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f58cc15d4c0 msgr2=0x7f58cc1f3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:57.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.191+0000 7f58d0b26700 1 --2- 172.21.15.73:0/861029234 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f58cc15d4c0 0x7f58cc1f3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:57.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.191+0000 7f58d0b26700 1 -- 172.21.15.73:0/861029234 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58cc1520f0 msgr2=0x7f58cc0caf50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T21:49:57.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.191+0000 7f58d0b26700 1 --2- 172.21.15.73:0/861029234 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58cc1520f0 0x7f58cc0caf50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:57.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.191+0000 7f58d0b26700 1 -- 172.21.15.73:0/861029234 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58cc1f3fd0 con 0x7f58bc004850 2024-05-08T21:49:57.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.191+0000 7f58d0b26700 1 --2- 172.21.15.73:0/861029234 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58bc004850 0x7f58cc1f46b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f58c0007fd0 tx=0x7f58c0007570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:57.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.191+0000 7f58c97fa700 1 -- 172.21.15.73:0/861029234 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c0012560 con 0x7f58bc004850 2024-05-08T21:49:57.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.191+0000 7f58c97fa700 1 -- 172.21.15.73:0/861029234 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58c00126c0 con 0x7f58bc004850 2024-05-08T21:49:57.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.191+0000 7f58c97fa700 1 -- 172.21.15.73:0/861029234 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c0012a50 con 0x7f58bc004850 2024-05-08T21:49:57.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.192+0000 7f58d2d8a700 1 -- 172.21.15.73:0/861029234 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58cc0ca470 con 0x7f58bc004850 2024-05-08T21:49:57.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.192+0000 7f58d2d8a700 1 -- 172.21.15.73:0/861029234 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58cc0caa30 con 0x7f58bc004850 2024-05-08T21:49:57.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.192+0000 7f58d2d8a700 1 -- 172.21.15.73:0/861029234 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58cc068b80 con 0x7f58bc004850 2024-05-08T21:49:57.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.193+0000 7ff811109700 1 --2- 172.21.15.73:0/1063389325 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff80c150cc0 0x7ff80c155d60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff804015000 tx=0x7ff804004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:57.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.193+0000 7ff8097fa700 1 -- 172.21.15.73:0/1063389325 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8040092e0 con 0x7ff80c150cc0 2024-05-08T21:49:57.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.193+0000 7ff8097fa700 1 -- 172.21.15.73:0/1063389325 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff804004250 con 0x7ff80c150cc0 2024-05-08T21:49:57.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.193+0000 7ff8097fa700 1 -- 172.21.15.73:0/1063389325 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff804004600 con 0x7ff80c150cc0 2024-05-08T21:49:57.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.193+0000 7ff812b6c700 1 -- 172.21.15.73:0/1063389325 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff804009b30 con 0x7ff80c150cc0 2024-05-08T21:49:57.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.193+0000 7ff812b6c700 1 -- 172.21.15.73:0/1063389325 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff80c154a60 con 0x7ff80c150cc0 2024-05-08T21:49:57.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.196+0000 7ff812b6c700 1 -- 172.21.15.73:0/1063389325 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7ec0052f0 con 0x7ff80c150cc0 2024-05-08T21:49:57.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.194+0000 7f58c97fa700 1 -- 172.21.15.73:0/861029234 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f58c0012bb0 con 0x7f58bc004850 2024-05-08T21:49:57.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.194+0000 7f58c97fa700 1 --2- 172.21.15.73:0/861029234 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f58b006ac90 0x7f58b006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:57.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.195+0000 7f58c97fa700 1 -- 172.21.15.73:0/861029234 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f58c00892e0 con 0x7f58bc004850 2024-05-08T21:49:57.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.196+0000 7f58cbfff700 1 --2- 172.21.15.73:0/861029234 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f58b006ac90 0x7f58b006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:57.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.197+0000 7f58cbfff700 1 --2- 172.21.15.73:0/861029234 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f58b006ac90 0x7f58b006d150 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f58cc1f6710 tx=0x7f58b8009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:57.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.198+0000 7ff8097fa700 1 -- 172.21.15.73:0/1063389325 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff804004760 con 0x7ff80c150cc0 2024-05-08T21:49:57.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.198+0000 7ff8097fa700 1 --2- 172.21.15.73:0/1063389325 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7ff7f006ace0 0x7ff7f006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:57.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.198+0000 7ff8097fa700 1 -- 172.21.15.73:0/1063389325 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff80408a5b0 con 0x7ff80c150cc0 2024-05-08T21:49:57.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.199+0000 7ff810908700 1 --2- 172.21.15.73:0/1063389325 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7ff7f006ace0 0x7ff7f006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:57.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.199+0000 7f9d52714700 1 Processor -- start 2024-05-08T21:49:57.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.200+0000 7f58c97fa700 1 -- 172.21.15.73:0/861029234 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f58c0054420 con 0x7f58bc004850 2024-05-08T21:49:57.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.200+0000 7ff810908700 1 --2- 172.21.15.73:0/1063389325 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7ff7f006ace0 0x7ff7f006d1a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff800009cd0 tx=0x7ff800009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:57.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.200+0000 7f9d52714700 1 -- start start 2024-05-08T21:49:57.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.201+0000 7f9d52714700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d4c0cd550 0x7f9d4c0cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:57.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.201+0000 7f9d52714700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9d4c0c7fc0 0x7f9d4c161650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:57.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.201+0000 7f9d52714700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d4c06f1d0 con 0x7f9d4c06d820 2024-05-08T21:49:57.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.201+0000 7f9d52714700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d4c0cde70 con 0x7f9d4c0c7fc0 2024-05-08T21:49:57.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.201+0000 7f9d52714700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4c06bb70 con 0x7f9d4c0cd550 2024-05-08T21:49:57.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.201+0000 7f9d4b7fe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9d4c0c7fc0 0x7f9d4c161650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:57.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.201+0000 7f9d4b7fe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9d4c0c7fc0 0x7f9d4c161650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39146/0 (socket says 172.21.15.73:39146) 2024-05-08T21:49:57.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.201+0000 7f9d4b7fe700 1 -- 172.21.15.73:0/3545840270 learned_addr learned my addr 172.21.15.73:0/3545840270 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:57.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.201+0000 7f9d4bfff700 1 --2- 172.21.15.73:0/3545840270 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d4c0cd550 0x7f9d4c0cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:57.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.201+0000 7f9d4b7fe700 1 -- 172.21.15.73:0/3545840270 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d4c0cd550 msgr2=0x7f9d4c0cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:57.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.201+0000 7f9d4b7fe700 1 --2- 172.21.15.73:0/3545840270 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d4c0cd550 0x7f9d4c0cd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:57.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.201+0000 7f9d4b7fe700 1 -- 172.21.15.73:0/3545840270 >> v1:172.21.15.115:6789/0 conn(0x7f9d4c06d820 legacy=0x7f9d4c0ca050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:57.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.201+0000 7f9d4b7fe700 1 -- 172.21.15.73:0/3545840270 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d4c15ee60 con 0x7f9d4c0c7fc0 2024-05-08T21:49:57.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.202+0000 7f9d4b7fe700 1 --2- 172.21.15.73:0/3545840270 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d4c0c7fc0 0x7f9d4c161650 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9d400098f0 tx=0x7f9d40009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57b96d4c3e891e32 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:57.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.202+0000 7f9d4affd700 1 -- 172.21.15.73:0/3545840270 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d40011830 con 0x7f9d4c0c7fc0 2024-05-08T21:49:57.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.202+0000 7f9d4affd700 1 -- 172.21.15.73:0/3545840270 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d40011990 con 0x7f9d4c0c7fc0 2024-05-08T21:49:57.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.202+0000 7f9d4affd700 1 -- 172.21.15.73:0/3545840270 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d40011d20 con 0x7f9d4c0c7fc0 2024-05-08T21:49:57.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.203+0000 7f9d52714700 1 -- 172.21.15.73:0/3545840270 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d4c0c7fc0 msgr2=0x7f9d4c161650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:57.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.203+0000 7f9d52714700 1 --2- 172.21.15.73:0/3545840270 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d4c0c7fc0 0x7f9d4c161650 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9d400098f0 tx=0x7f9d40009c00 comp rx=0 tx=0).stop 2024-05-08T21:49:57.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.203+0000 7ff8097fa700 1 -- 172.21.15.73:0/1063389325 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7ff804055900 con 0x7ff80c150cc0 2024-05-08T21:49:57.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.203+0000 7f9d52714700 1 -- 172.21.15.73:0/3545840270 shutdown_connections 2024-05-08T21:49:57.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.203+0000 7f9d52714700 1 --2- 172.21.15.73:0/3545840270 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d4c0cd550 0x7f9d4c0cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:57.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.203+0000 7f9d52714700 1 --2- 172.21.15.73:0/3545840270 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d4c0c7fc0 0x7f9d4c161650 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:57.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.203+0000 7f9d52714700 1 -- 172.21.15.73:0/3545840270 >> 172.21.15.73:0/3545840270 conn(0x7f9d4c06aff0 msgr2=0x7f9d4c0666c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:57.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.203+0000 7f9d52714700 1 -- 172.21.15.73:0/3545840270 shutdown_connections 2024-05-08T21:49:57.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.203+0000 7f9d52714700 1 -- 172.21.15.73:0/3545840270 wait complete. 2024-05-08T21:49:57.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.205+0000 7f9d52714700 1 Processor -- start 2024-05-08T21:49:57.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.205+0000 7f9d52714700 1 -- start start 2024-05-08T21:49:57.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.206+0000 7f9d52714700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d4c06d820 0x7f9d4c1615b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:57.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.206+0000 7f9d52714700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d4c0c7fc0 0x7f9d4c15fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:57.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.206+0000 7f9d52714700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d4c0cd550 0x7f9d4c159bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:57.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.206+0000 7f9d52714700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4c147ca0 con 0x7f9d4c06d820 2024-05-08T21:49:57.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.206+0000 7f9d52714700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4c159730 con 0x7f9d4c0c7fc0 2024-05-08T21:49:57.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.206+0000 7f9d52714700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4c158b20 con 0x7f9d4c0cd550 2024-05-08T21:49:57.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.207+0000 7f9d4b7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d4c0c7fc0 0x7f9d4c15fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:57.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.207+0000 7f9d50cb1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d4c0cd550 0x7f9d4c159bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:57.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.207+0000 7f9d4b7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d4c0c7fc0 0x7f9d4c15fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.73:53896/0 (socket says 172.21.15.73:53896) 2024-05-08T21:49:57.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.207+0000 7f9d4b7fe700 1 -- 172.21.15.73:0/1380944352 learned_addr learned my addr 172.21.15.73:0/1380944352 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:57.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.207+0000 7f9d4b7fe700 1 -- 172.21.15.73:0/1380944352 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d4c0cd550 msgr2=0x7f9d4c159bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:57.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.207+0000 7f9d4b7fe700 1 --2- 172.21.15.73:0/1380944352 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d4c0cd550 0x7f9d4c159bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:57.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.207+0000 7f9d4b7fe700 1 -- 172.21.15.73:0/1380944352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d4c06d820 msgr2=0x7f9d4c1615b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:57.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.207+0000 7f9d4b7fe700 1 --2- 172.21.15.73:0/1380944352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d4c06d820 0x7f9d4c1615b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:57.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.207+0000 7f9d4b7fe700 1 -- 172.21.15.73:0/1380944352 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d40009550 con 0x7f9d4c0c7fc0 2024-05-08T21:49:57.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.207+0000 7f9d50cb1700 1 --2- 172.21.15.73:0/1380944352 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d4c0cd550 0x7f9d4c159bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:49:57.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.207+0000 7f9d4b7fe700 1 --2- 172.21.15.73:0/1380944352 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d4c0c7fc0 0x7f9d4c15fbb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9d40009c40 tx=0x7f9d40004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:57.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.212+0000 7f9d48ff9700 1 -- 172.21.15.73:0/1380944352 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d40004510 con 0x7f9d4c0c7fc0 2024-05-08T21:49:57.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.213+0000 7f9d48ff9700 1 -- 172.21.15.73:0/1380944352 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d400036a0 con 0x7f9d4c0c7fc0 2024-05-08T21:49:57.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.213+0000 7f9d48ff9700 1 -- 172.21.15.73:0/1380944352 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d40003a50 con 0x7f9d4c0c7fc0 2024-05-08T21:49:57.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.213+0000 7f9d52714700 1 -- 172.21.15.73:0/1380944352 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d4c158e00 con 0x7f9d4c0c7fc0 2024-05-08T21:49:57.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.213+0000 7f9d52714700 1 -- 172.21.15.73:0/1380944352 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d4c1593c0 con 0x7f9d4c0c7fc0 2024-05-08T21:49:57.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.216+0000 7f9d52714700 1 -- 172.21.15.73:0/1380944352 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d4c159580 con 0x7f9d4c0c7fc0 2024-05-08T21:49:57.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.216+0000 7f9d48ff9700 1 -- 172.21.15.73:0/1380944352 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9d40003bb0 con 0x7f9d4c0c7fc0 2024-05-08T21:49:57.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.217+0000 7f9d48ff9700 1 --2- 172.21.15.73:0/1380944352 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f9d3806ad90 0x7f9d3806d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:57.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.217+0000 7f9d48ff9700 1 -- 172.21.15.73:0/1380944352 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9d4008a750 con 0x7f9d4c0c7fc0 2024-05-08T21:49:57.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.217+0000 7f9d4bfff700 1 --2- 172.21.15.73:0/1380944352 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f9d3806ad90 0x7f9d3806d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:57.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.218+0000 7f9d4bfff700 1 --2- 172.21.15.73:0/1380944352 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f9d3806ad90 0x7f9d3806d250 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c006b20 tx=0x7f9d3c006ab0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:57.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.221+0000 7f9d48ff9700 1 -- 172.21.15.73:0/1380944352 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f9d40055a40 con 0x7f9d4c0c7fc0 2024-05-08T21:49:57.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.248+0000 7f6570486700 1 Processor -- start 2024-05-08T21:49:57.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.249+0000 7f6570486700 1 -- start start 2024-05-08T21:49:57.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.250+0000 7f6570486700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6568153d20 0x7f65680c8020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:57.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.250+0000 7f656e222700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6568153d20 0x7f65680c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:57.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.251+0000 7f6570486700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6568159fc0 con 0x7f65680c64f0 2024-05-08T21:49:57.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.251+0000 7f6570486700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6568072670 con 0x7f6568159b70 2024-05-08T21:49:57.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.251+0000 7f6570486700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6568072910 con 0x7f6568153d20 2024-05-08T21:49:57.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.251+0000 7f656da21700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f65680c64f0 0x7f65680719b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:51848/0 (socket says 172.21.15.73:51848) 2024-05-08T21:49:57.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.251+0000 7f656e222700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6568153d20 0x7f65680c8020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39154/0 (socket says 172.21.15.73:39154) 2024-05-08T21:49:57.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.251+0000 7f656da21700 1 -- 172.21.15.73:0/2124879277 learned_addr learned my addr 172.21.15.73:0/2124879277 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:49:57.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.251+0000 7f656e222700 1 -- 172.21.15.73:0/2124879277 >> v1:172.21.15.115:6789/0 conn(0x7f6568159b70 legacy=0x7f65681644f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:57.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.251+0000 7f656e222700 1 -- 172.21.15.73:0/2124879277 >> v1:172.21.15.73:6789/0 conn(0x7f65680c64f0 legacy=0x7f65680719b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:57.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.251+0000 7f656e222700 1 -- 172.21.15.73:0/2124879277 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65680c7820 con 0x7f6568153d20 2024-05-08T21:49:57.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.251+0000 7f656e222700 1 --2- 172.21.15.73:0/2124879277 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6568153d20 0x7f65680c8020 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6564009840 tx=0x7f6564009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aeee86aa9ff6437 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:57.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.252+0000 7f656d220700 1 -- 172.21.15.73:0/2124879277 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6564004230 con 0x7f6568153d20 2024-05-08T21:49:57.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.252+0000 7f656d220700 1 -- 172.21.15.73:0/2124879277 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6564004390 con 0x7f6568153d20 2024-05-08T21:49:57.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.252+0000 7f656d220700 1 -- 172.21.15.73:0/2124879277 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65640036a0 con 0x7f6568153d20 2024-05-08T21:49:57.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.253+0000 7f6570486700 1 -- 172.21.15.73:0/2124879277 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6568153d20 msgr2=0x7f65680c8020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:57.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.253+0000 7f6570486700 1 --2- 172.21.15.73:0/2124879277 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6568153d20 0x7f65680c8020 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6564009840 tx=0x7f6564009b50 comp rx=0 tx=0).stop 2024-05-08T21:49:57.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.253+0000 7f6570486700 1 -- 172.21.15.73:0/2124879277 shutdown_connections 2024-05-08T21:49:57.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.253+0000 7f6570486700 1 --2- 172.21.15.73:0/2124879277 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6568153d20 0x7f65680c8020 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:57.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.253+0000 7f6570486700 1 -- 172.21.15.73:0/2124879277 >> 172.21.15.73:0/2124879277 conn(0x7f6568066ab0 msgr2=0x7f656806f550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:57.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.253+0000 7f6570486700 1 -- 172.21.15.73:0/2124879277 shutdown_connections 2024-05-08T21:49:57.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.253+0000 7f6570486700 1 -- 172.21.15.73:0/2124879277 wait complete. 2024-05-08T21:49:57.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.255+0000 7f6570486700 1 Processor -- start 2024-05-08T21:49:57.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.255+0000 7f6570486700 1 -- start start 2024-05-08T21:49:57.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.256+0000 7f6570486700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f65680c64f0 0x7f6568157e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:57.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.256+0000 7f6570486700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6568153d20 0x7f6568156260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:57.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.256+0000 7f6570486700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6568159b70 0x7f65680c2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:57.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.256+0000 7f6570486700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65681559e0 con 0x7f6568153d20 2024-05-08T21:49:57.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.256+0000 7f6570486700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65680c7030 con 0x7f6568159b70 2024-05-08T21:49:57.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.256+0000 7f6570486700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65681f4010 con 0x7f65680c64f0 2024-05-08T21:49:57.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.256+0000 7f656da21700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6568153d20 0x7f6568156260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:57.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.256+0000 7f656da21700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6568153d20 0x7f6568156260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39158/0 (socket says 172.21.15.73:39158) 2024-05-08T21:49:57.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.256+0000 7f656da21700 1 -- 172.21.15.73:0/2458138096 learned_addr learned my addr 172.21.15.73:0/2458138096 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:57.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.257+0000 7f656e222700 1 --2- 172.21.15.73:0/2458138096 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f65680c64f0 0x7f6568157e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:57.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.257+0000 7f656da21700 1 -- 172.21.15.73:0/2458138096 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f65680c64f0 msgr2=0x7f6568157e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:57.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.257+0000 7f656da21700 1 --2- 172.21.15.73:0/2458138096 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f65680c64f0 0x7f6568157e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:57.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.257+0000 7f656da21700 1 -- 172.21.15.73:0/2458138096 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6568159b70 msgr2=0x7f65680c2fb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T21:49:57.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.257+0000 7f656da21700 1 --2- 172.21.15.73:0/2458138096 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6568159b70 0x7f65680c2fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:57.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.257+0000 7f656da21700 1 -- 172.21.15.73:0/2458138096 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65640094a0 con 0x7f6568153d20 2024-05-08T21:49:57.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.257+0000 7f656da21700 1 --2- 172.21.15.73:0/2458138096 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6568153d20 0x7f6568156260 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f655800c500 tx=0x7f655800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:57.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.257+0000 7f655effd700 1 -- 172.21.15.73:0/2458138096 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6558005d70 con 0x7f6568153d20 2024-05-08T21:49:57.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.257+0000 7f655effd700 1 -- 172.21.15.73:0/2458138096 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65580070d0 con 0x7f6568153d20 2024-05-08T21:49:57.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.257+0000 7f655effd700 1 -- 172.21.15.73:0/2458138096 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6558007480 con 0x7f6568153d20 2024-05-08T21:49:57.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.257+0000 7f6570486700 1 -- 172.21.15.73:0/2458138096 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6568155400 con 0x7f6568153d20 2024-05-08T21:49:57.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.257+0000 7f6570486700 1 -- 172.21.15.73:0/2458138096 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65681f42b0 con 0x7f6568153d20 2024-05-08T21:49:57.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.259+0000 7f6570486700 1 -- 172.21.15.73:0/2458138096 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6568068b80 con 0x7f6568153d20 2024-05-08T21:49:57.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.260+0000 7f655effd700 1 -- 172.21.15.73:0/2458138096 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f65580075e0 con 0x7f6568153d20 2024-05-08T21:49:57.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.261+0000 7f655effd700 1 --2- 172.21.15.73:0/2458138096 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f654c06ace0 0x7f654c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:57.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.261+0000 7f655effd700 1 -- 172.21.15.73:0/2458138096 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6558057bd0 con 0x7f6568153d20 2024-05-08T21:49:57.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.261+0000 7f656e222700 1 --2- 172.21.15.73:0/2458138096 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f654c06ace0 0x7f654c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:57.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.262+0000 7f656e222700 1 --2- 172.21.15.73:0/2458138096 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f654c06ace0 0x7f654c06d1a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6564009b90 tx=0x7f6564008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:57.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.270+0000 7f655effd700 1 -- 172.21.15.73:0/2458138096 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f655808d060 con 0x7f6568153d20 2024-05-08T21:49:57.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.418+0000 7ff812b6c700 1 -- 172.21.15.73:0/1063389325 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff7ec005870 con 0x7ff80c150cc0 2024-05-08T21:49:57.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.419+0000 7ff8097fa700 1 -- 172.21.15.73:0/1063389325 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff804058f20 con 0x7ff80c150cc0 2024-05-08T21:49:57.420 INFO:teuthology.orchestra.run.smithi073.stdout:64424509447 2024-05-08T21:49:57.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.420+0000 7fedb3b63700 1 -- 172.21.15.73:0/223903090 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fedac158780 con 0x7fedac0caac0 2024-05-08T21:49:57.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.421+0000 7feda27fc700 1 -- 172.21.15.73:0/223903090 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fedac158780 con 0x7fedac0caac0 2024-05-08T21:49:57.423 INFO:teuthology.orchestra.run.smithi073.stdout:64424509448 2024-05-08T21:49:57.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.422+0000 7ff812b6c700 1 -- 172.21.15.73:0/1063389325 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7ff7f006ace0 msgr2=0x7ff7f006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:57.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.422+0000 7ff812b6c700 1 --2- 172.21.15.73:0/1063389325 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7ff7f006ace0 0x7ff7f006d1a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff800009cd0 tx=0x7ff800009210 comp rx=0 tx=0).stop 2024-05-08T21:49:57.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.422+0000 7ff812b6c700 1 -- 172.21.15.73:0/1063389325 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff80c150cc0 msgr2=0x7ff80c155d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:57.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.422+0000 7ff812b6c700 1 --2- 172.21.15.73:0/1063389325 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff80c150cc0 0x7ff80c155d60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff804015000 tx=0x7ff804004ad0 comp rx=0 tx=0).stop 2024-05-08T21:49:57.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.422+0000 7ff812b6c700 1 -- 172.21.15.73:0/1063389325 shutdown_connections 2024-05-08T21:49:57.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.422+0000 7ff812b6c700 1 --2- 172.21.15.73:0/1063389325 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7ff7f006ace0 0x7ff7f006d1a0 secure :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff800009cd0 tx=0x7ff800009210 comp rx=0 tx=0).stop 2024-05-08T21:49:57.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.422+0000 7ff812b6c700 1 --2- 172.21.15.73:0/1063389325 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff80c150cc0 0x7ff80c155d60 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:57.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.422+0000 7ff812b6c700 1 --2- 172.21.15.73:0/1063389325 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff80c0c5c30 0x7ff80c071fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:57.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.422+0000 7ff812b6c700 1 --2- 172.21.15.73:0/1063389325 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff80c0c6d10 0x7ff80c155820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:57.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.422+0000 7ff812b6c700 1 -- 172.21.15.73:0/1063389325 >> 172.21.15.73:0/1063389325 conn(0x7ff80c0cb230 msgr2=0x7ff80c071230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:57.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.423+0000 7ff812b6c700 1 -- 172.21.15.73:0/1063389325 shutdown_connections 2024-05-08T21:49:57.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.423+0000 7ff812b6c700 1 -- 172.21.15.73:0/1063389325 wait complete. 2024-05-08T21:49:57.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.423+0000 7fedb3b63700 1 -- 172.21.15.73:0/223903090 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fed9006ac90 msgr2=0x7fed9006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:57.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.423+0000 7fedb3b63700 1 --2- 172.21.15.73:0/223903090 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fed9006ac90 0x7fed9006d150 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fed9c009960 tx=0x7fed9c0090e0 comp rx=0 tx=0).stop 2024-05-08T21:49:57.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.423+0000 7fedb3b63700 1 -- 172.21.15.73:0/223903090 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fedac0caac0 msgr2=0x7fedac130aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:57.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.423+0000 7fedb3b63700 1 --2- 172.21.15.73:0/223903090 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fedac0caac0 0x7fedac130aa0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7feda8015000 tx=0x7feda8004750 comp rx=0 tx=0).stop 2024-05-08T21:49:57.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.423+0000 7fedb3b63700 1 -- 172.21.15.73:0/223903090 shutdown_connections 2024-05-08T21:49:57.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.423+0000 7fedb3b63700 1 --2- 172.21.15.73:0/223903090 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fed9006ac90 0x7fed9006d150 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:57.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.423+0000 7fedb3b63700 1 --2- 172.21.15.73:0/223903090 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fedac1583a0 0x7fedac130fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:57.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.423+0000 7fedb3b63700 1 --2- 172.21.15.73:0/223903090 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fedac06e7b0 0x7fedac131a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:57.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.423+0000 7fedb3b63700 1 --2- 172.21.15.73:0/223903090 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fedac0caac0 0x7fedac130aa0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:57.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.423+0000 7fedb3b63700 1 -- 172.21.15.73:0/223903090 >> 172.21.15.73:0/223903090 conn(0x7fedac0cb230 msgr2=0x7fedac147a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:57.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.423+0000 7fedb3b63700 1 -- 172.21.15.73:0/223903090 shutdown_connections 2024-05-08T21:49:57.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.423+0000 7fedb3b63700 1 -- 172.21.15.73:0/223903090 wait complete. 2024-05-08T21:49:57.438 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.2 2024-05-08T21:49:57.438 DEBUG:teuthology.parallel:result is None 2024-05-08T21:49:57.439 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.3 2024-05-08T21:49:57.439 DEBUG:teuthology.parallel:result is None 2024-05-08T21:49:57.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.520+0000 7fab2168e700 1 -- 172.21.15.73:0/1330387492 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fab1c152dd0 con 0x7fab1c15a030 2024-05-08T21:49:57.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.520+0000 7fab037fe700 1 -- 172.21.15.73:0/1330387492 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fab1c152dd0 con 0x7fab1c15a030 2024-05-08T21:49:57.521 INFO:teuthology.orchestra.run.smithi073.stdout:64424509447 2024-05-08T21:49:57.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.520+0000 7f58d2d8a700 1 -- 172.21.15.73:0/861029234 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f58cc06f660 con 0x7f58bc004850 2024-05-08T21:49:57.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.521+0000 7f58c97fa700 1 -- 172.21.15.73:0/861029234 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f58c0057a40 con 0x7f58bc004850 2024-05-08T21:49:57.522 INFO:teuthology.orchestra.run.smithi073.stdout:64424509448 2024-05-08T21:49:57.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.523+0000 7f58d2d8a700 1 -- 172.21.15.73:0/861029234 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f58b006ac90 msgr2=0x7f58b006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:57.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.523+0000 7f58d2d8a700 1 --2- 172.21.15.73:0/861029234 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f58b006ac90 0x7f58b006d150 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f58cc1f6710 tx=0x7f58b8009030 comp rx=0 tx=0).stop 2024-05-08T21:49:57.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.523+0000 7f58d2d8a700 1 -- 172.21.15.73:0/861029234 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58bc004850 msgr2=0x7f58cc1f46b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:57.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.523+0000 7f58d2d8a700 1 --2- 172.21.15.73:0/861029234 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58bc004850 0x7f58cc1f46b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f58c0007fd0 tx=0x7f58c0007570 comp rx=0 tx=0).stop 2024-05-08T21:49:57.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.523+0000 7f58d2d8a700 1 -- 172.21.15.73:0/861029234 shutdown_connections 2024-05-08T21:49:57.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.523+0000 7f58d2d8a700 1 --2- 172.21.15.73:0/861029234 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f58b006ac90 0x7f58b006d150 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:57.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.523+0000 7f58d2d8a700 1 --2- 172.21.15.73:0/861029234 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f58cc15d4c0 0x7f58cc1f3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:57.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.523+0000 7f58d2d8a700 1 --2- 172.21.15.73:0/861029234 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58bc004850 0x7f58cc1f46b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:57.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.523+0000 7f58d2d8a700 1 --2- 172.21.15.73:0/861029234 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58cc1520f0 0x7f58cc0caf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:57.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.523+0000 7f58d2d8a700 1 -- 172.21.15.73:0/861029234 >> 172.21.15.73:0/861029234 conn(0x7f58cc066ab0 msgr2=0x7f58cc15c6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:57.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.523+0000 7f58d2d8a700 1 -- 172.21.15.73:0/861029234 shutdown_connections 2024-05-08T21:49:57.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.523+0000 7f58d2d8a700 1 -- 172.21.15.73:0/861029234 wait complete. 2024-05-08T21:49:57.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.524+0000 7fab2168e700 1 -- 172.21.15.73:0/1330387492 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fab0806acc0 msgr2=0x7fab0806d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:57.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.524+0000 7fab2168e700 1 --2- 172.21.15.73:0/1330387492 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fab0806acc0 0x7fab0806d180 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fab0c009d00 tx=0x7fab0c0090e0 comp rx=0 tx=0).stop 2024-05-08T21:49:57.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.524+0000 7fab2168e700 1 -- 172.21.15.73:0/1330387492 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab1c15a030 msgr2=0x7fab1c15a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:57.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.524+0000 7fab2168e700 1 --2- 172.21.15.73:0/1330387492 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab1c15a030 0x7fab1c15a4b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fab14014000 tx=0x7fab14001cb0 comp rx=0 tx=0).stop 2024-05-08T21:49:57.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.524+0000 7fab2168e700 1 -- 172.21.15.73:0/1330387492 shutdown_connections 2024-05-08T21:49:57.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.524+0000 7fab2168e700 1 --2- 172.21.15.73:0/1330387492 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fab0806acc0 0x7fab0806d180 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:57.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.524+0000 7fab2168e700 1 --2- 172.21.15.73:0/1330387492 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab1c15a030 0x7fab1c15a4b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:57.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.524+0000 7fab2168e700 1 --2- 172.21.15.73:0/1330387492 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab04005260 0x7fab1c1539d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:57.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.524+0000 7fab2168e700 1 --2- 172.21.15.73:0/1330387492 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab1c15d530 0x7fab1c15d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:57.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.524+0000 7fab2168e700 1 -- 172.21.15.73:0/1330387492 >> 172.21.15.73:0/1330387492 conn(0x7fab1c06eb90 msgr2=0x7fab1c15fdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:57.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.524+0000 7fab2168e700 1 -- 172.21.15.73:0/1330387492 shutdown_connections 2024-05-08T21:49:57.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.524+0000 7fab2168e700 1 -- 172.21.15.73:0/1330387492 wait complete. 2024-05-08T21:49:57.537 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.7 2024-05-08T21:49:57.537 DEBUG:teuthology.parallel:result is None 2024-05-08T21:49:57.544 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.0 2024-05-08T21:49:57.544 DEBUG:teuthology.parallel:result is None 2024-05-08T21:49:57.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.568+0000 7f9d52714700 1 -- 172.21.15.73:0/1380944352 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9d4c068b80 con 0x7f9d4c0c7fc0 2024-05-08T21:49:57.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.568+0000 7f9d48ff9700 1 -- 172.21.15.73:0/1380944352 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9d40003e60 con 0x7f9d4c0c7fc0 2024-05-08T21:49:57.569 INFO:teuthology.orchestra.run.smithi073.stdout:55834574854 2024-05-08T21:49:57.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.570+0000 7f9d52714700 1 -- 172.21.15.73:0/1380944352 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f9d3806ad90 msgr2=0x7f9d3806d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:57.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.570+0000 7f9d52714700 1 --2- 172.21.15.73:0/1380944352 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f9d3806ad90 0x7f9d3806d250 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c006b20 tx=0x7f9d3c006ab0 comp rx=0 tx=0).stop 2024-05-08T21:49:57.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.570+0000 7f9d52714700 1 -- 172.21.15.73:0/1380944352 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d4c0c7fc0 msgr2=0x7f9d4c15fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:57.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.570+0000 7f9d52714700 1 --2- 172.21.15.73:0/1380944352 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d4c0c7fc0 0x7f9d4c15fbb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9d40009c40 tx=0x7f9d40004750 comp rx=0 tx=0).stop 2024-05-08T21:49:57.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.570+0000 7f9d52714700 1 -- 172.21.15.73:0/1380944352 shutdown_connections 2024-05-08T21:49:57.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.570+0000 7f9d52714700 1 --2- 172.21.15.73:0/1380944352 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f9d3806ad90 0x7f9d3806d250 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:57.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.570+0000 7f9d52714700 1 --2- 172.21.15.73:0/1380944352 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d4c0cd550 0x7f9d4c159bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:57.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.571+0000 7f9d52714700 1 --2- 172.21.15.73:0/1380944352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d4c06d820 0x7f9d4c1615b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:57.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.571+0000 7f9d52714700 1 --2- 172.21.15.73:0/1380944352 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d4c0c7fc0 0x7f9d4c15fbb0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:57.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.571+0000 7f9d52714700 1 -- 172.21.15.73:0/1380944352 >> 172.21.15.73:0/1380944352 conn(0x7f9d4c06aff0 msgr2=0x7f9d4c157cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:57.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.571+0000 7f9d52714700 1 -- 172.21.15.73:0/1380944352 shutdown_connections 2024-05-08T21:49:57.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.571+0000 7f9d52714700 1 -- 172.21.15.73:0/1380944352 wait complete. 2024-05-08T21:49:57.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.574+0000 7f6570486700 1 -- 172.21.15.73:0/2458138096 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f65680c6080 con 0x7f6568153d20 2024-05-08T21:49:57.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.574+0000 7f655effd700 1 -- 172.21.15.73:0/2458138096 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f655808d020 con 0x7f6568153d20 2024-05-08T21:49:57.575 INFO:teuthology.orchestra.run.smithi073.stdout:64424509447 2024-05-08T21:49:57.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.576+0000 7f6570486700 1 -- 172.21.15.73:0/2458138096 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f654c06ace0 msgr2=0x7f654c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:57.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.576+0000 7f6570486700 1 --2- 172.21.15.73:0/2458138096 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f654c06ace0 0x7f654c06d1a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6564009b90 tx=0x7f6564008030 comp rx=0 tx=0).stop 2024-05-08T21:49:57.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.576+0000 7f6570486700 1 -- 172.21.15.73:0/2458138096 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6568153d20 msgr2=0x7f6568156260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:57.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.576+0000 7f6570486700 1 --2- 172.21.15.73:0/2458138096 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6568153d20 0x7f6568156260 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f655800c500 tx=0x7f655800c8c0 comp rx=0 tx=0).stop 2024-05-08T21:49:57.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.576+0000 7f6570486700 1 -- 172.21.15.73:0/2458138096 shutdown_connections 2024-05-08T21:49:57.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.576+0000 7f6570486700 1 --2- 172.21.15.73:0/2458138096 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f654c06ace0 0x7f654c06d1a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:57.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.576+0000 7f6570486700 1 --2- 172.21.15.73:0/2458138096 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6568159b70 0x7f65680c2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:57.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.576+0000 7f6570486700 1 --2- 172.21.15.73:0/2458138096 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f65680c64f0 0x7f6568157e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:57.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.576+0000 7f6570486700 1 --2- 172.21.15.73:0/2458138096 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6568153d20 0x7f6568156260 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:57.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.576+0000 7f6570486700 1 -- 172.21.15.73:0/2458138096 >> 172.21.15.73:0/2458138096 conn(0x7f6568066ab0 msgr2=0x7f6568151370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:57.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.576+0000 7f6570486700 1 -- 172.21.15.73:0/2458138096 shutdown_connections 2024-05-08T21:49:57.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.576+0000 7f6570486700 1 -- 172.21.15.73:0/2458138096 wait complete. 2024-05-08T21:49:57.585 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2024-05-08T21:49:57.585 DEBUG:teuthology.parallel:result is None 2024-05-08T21:49:57.590 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.4 2024-05-08T21:49:57.590 DEBUG:teuthology.parallel:result is None 2024-05-08T21:49:57.590 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-08T21:49:57.590 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T21:49:57.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.751+0000 7fecfa59d700 1 Processor -- start 2024-05-08T21:49:57.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.751+0000 7fecfa59d700 1 -- start start 2024-05-08T21:49:57.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.752+0000 7fecfa59d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fecf40c9990 0x7fecf4072710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:57.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.752+0000 7fecfa59d700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fecf415b5e0 0x7fecf415b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:57.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.752+0000 7fecfa59d700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecf4141600 con 0x7fecf4141220 2024-05-08T21:49:57.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.752+0000 7fecfa59d700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecf4073030 con 0x7fecf415b5e0 2024-05-08T21:49:57.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.752+0000 7fecfa59d700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecf415b1b0 con 0x7fecf40c9990 2024-05-08T21:49:57.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.752+0000 7fecf8b3a700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fecf415b5e0 0x7fecf415b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:57.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.752+0000 7fecf3fff700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fecf4141220 0x7fecf40c5c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:51852/0 (socket says 172.21.15.73:51852) 2024-05-08T21:49:57.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.752+0000 7fecf8b3a700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fecf415b5e0 0x7fecf415b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39172/0 (socket says 172.21.15.73:39172) 2024-05-08T21:49:57.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.752+0000 7fecf3fff700 1 -- 172.21.15.73:0/3759485649 learned_addr learned my addr 172.21.15.73:0/3759485649 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:49:57.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.752+0000 7fecf37fe700 1 --2- 172.21.15.73:0/3759485649 >> v2:172.21.15.115:3300/0 conn(0x7fecf40c9990 0x7fecf4072710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:57.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.753+0000 7fecf8b3a700 1 -- 172.21.15.73:0/3759485649 >> v2:172.21.15.115:3300/0 conn(0x7fecf40c9990 msgr2=0x7fecf4072710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:57.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.753+0000 7fecf8b3a700 1 --2- 172.21.15.73:0/3759485649 >> v2:172.21.15.115:3300/0 conn(0x7fecf40c9990 0x7fecf4072710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:57.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.753+0000 7fecf8b3a700 1 -- 172.21.15.73:0/3759485649 >> v1:172.21.15.73:6789/0 conn(0x7fecf4141220 legacy=0x7fecf40c5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:57.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.753+0000 7fecf8b3a700 1 -- 172.21.15.73:0/3759485649 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf4072d50 con 0x7fecf415b5e0 2024-05-08T21:49:57.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.753+0000 7fecf8b3a700 1 --2- 172.21.15.73:0/3759485649 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecf415b5e0 0x7fecf415b9f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fecf4071a80 tx=0x7fecec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b96c5f2a0e0ef32 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:57.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.753+0000 7fecf2ffd700 1 -- 172.21.15.73:0/3759485649 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecec00e070 con 0x7fecf415b5e0 2024-05-08T21:49:57.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.753+0000 7fecf2ffd700 1 -- 172.21.15.73:0/3759485649 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecec00bb20 con 0x7fecf415b5e0 2024-05-08T21:49:57.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.753+0000 7fecf2ffd700 1 -- 172.21.15.73:0/3759485649 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecec012430 con 0x7fecf415b5e0 2024-05-08T21:49:57.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.753+0000 7fecfa59d700 1 -- 172.21.15.73:0/3759485649 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecf415b5e0 msgr2=0x7fecf415b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:57.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.753+0000 7fecfa59d700 1 --2- 172.21.15.73:0/3759485649 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecf415b5e0 0x7fecf415b9f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fecf4071a80 tx=0x7fecec00b330 comp rx=0 tx=0).stop 2024-05-08T21:49:57.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.754+0000 7fecfa59d700 1 -- 172.21.15.73:0/3759485649 shutdown_connections 2024-05-08T21:49:57.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.754+0000 7fecfa59d700 1 --2- 172.21.15.73:0/3759485649 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecf415b5e0 0x7fecf415b9f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:57.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.754+0000 7fecfa59d700 1 --2- 172.21.15.73:0/3759485649 >> v2:172.21.15.115:3300/0 conn(0x7fecf40c9990 0x7fecf4072710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:57.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.754+0000 7fecfa59d700 1 -- 172.21.15.73:0/3759485649 >> 172.21.15.73:0/3759485649 conn(0x7fecf4066d70 msgr2=0x7fecf40cc500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:57.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.754+0000 7fecfa59d700 1 -- 172.21.15.73:0/3759485649 shutdown_connections 2024-05-08T21:49:57.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.754+0000 7fecfa59d700 1 -- 172.21.15.73:0/3759485649 wait complete. 2024-05-08T21:49:57.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.755+0000 7fecfa59d700 1 Processor -- start 2024-05-08T21:49:57.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.755+0000 7fecfa59d700 1 -- start start 2024-05-08T21:49:57.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.756+0000 7fecfa59d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecf40c9990 0x7fecf41ed7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:57.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.756+0000 7fecfa59d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fecf4141220 0x7fecf415a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:57.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.756+0000 7fecfa59d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecf415b5e0 0x7fecf4139530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:57.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.756+0000 7fecfa59d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf41ee740 con 0x7fecf40c9990 2024-05-08T21:49:57.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.756+0000 7fecfa59d700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf4156110 con 0x7fecf415b5e0 2024-05-08T21:49:57.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.756+0000 7fecfa59d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecf41edea0 con 0x7fecf4141220 2024-05-08T21:49:57.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.756+0000 7fecf3fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecf40c9990 0x7fecf41ed7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:57.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.756+0000 7fecf3fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecf40c9990 0x7fecf41ed7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39188/0 (socket says 172.21.15.73:39188) 2024-05-08T21:49:57.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.756+0000 7fecf3fff700 1 -- 172.21.15.73:0/118983521 learned_addr learned my addr 172.21.15.73:0/118983521 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:57.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.756+0000 7fecf8b3a700 1 --2- 172.21.15.73:0/118983521 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecf415b5e0 0x7fecf4139530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:57.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.756+0000 7fecf37fe700 1 --2- 172.21.15.73:0/118983521 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fecf4141220 0x7fecf415a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:57.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.756+0000 7fecf3fff700 1 -- 172.21.15.73:0/118983521 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fecf4141220 msgr2=0x7fecf415a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:57.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.756+0000 7fecf3fff700 1 --2- 172.21.15.73:0/118983521 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fecf4141220 0x7fecf415a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:57.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.756+0000 7fecf3fff700 1 -- 172.21.15.73:0/118983521 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecf415b5e0 msgr2=0x7fecf4139530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:57.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.756+0000 7fecf3fff700 1 --2- 172.21.15.73:0/118983521 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecf415b5e0 0x7fecf4139530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:57.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.756+0000 7fecf3fff700 1 -- 172.21.15.73:0/118983521 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecec009a70 con 0x7fecf40c9990 2024-05-08T21:49:57.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.756+0000 7fecf3fff700 1 --2- 172.21.15.73:0/118983521 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecf40c9990 0x7fecf41ed7a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fece800c520 tx=0x7fece800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:57.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.756+0000 7fecf0ff9700 1 -- 172.21.15.73:0/118983521 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece8005d70 con 0x7fecf40c9990 2024-05-08T21:49:57.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.756+0000 7fecf0ff9700 1 -- 172.21.15.73:0/118983521 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fece80070d0 con 0x7fecf40c9990 2024-05-08T21:49:57.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.756+0000 7fecfa59d700 1 -- 172.21.15.73:0/118983521 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecf41ee180 con 0x7fecf40c9990 2024-05-08T21:49:57.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.756+0000 7fecf0ff9700 1 -- 172.21.15.73:0/118983521 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece8007440 con 0x7fecf40c9990 2024-05-08T21:49:57.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.756+0000 7fecfa59d700 1 -- 172.21.15.73:0/118983521 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecf4138d30 con 0x7fecf40c9990 2024-05-08T21:49:57.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.757+0000 7fecfa59d700 1 -- 172.21.15.73:0/118983521 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecf4158790 con 0x7fecf40c9990 2024-05-08T21:49:57.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.758+0000 7fecf0ff9700 1 -- 172.21.15.73:0/118983521 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fece80075a0 con 0x7fecf40c9990 2024-05-08T21:49:57.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.758+0000 7fecf0ff9700 1 --2- 172.21.15.73:0/118983521 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fece006ac90 0x7fece006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:57.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.758+0000 7fecf0ff9700 1 -- 172.21.15.73:0/118983521 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fece8088660 con 0x7fecf40c9990 2024-05-08T21:49:57.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.758+0000 7fecf37fe700 1 --2- 172.21.15.73:0/118983521 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fece006ac90 0x7fece006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:57.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.759+0000 7fecf37fe700 1 --2- 172.21.15.73:0/118983521 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fece006ac90 0x7fece006d150 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fecf40cc410 tx=0x7fece4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:57.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.763+0000 7fecf0ff9700 1 -- 172.21.15.73:0/118983521 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fecf4158790 con 0x7fecf40c9990 2024-05-08T21:49:57.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.957+0000 7fecfa59d700 1 -- 172.21.15.73:0/118983521 --> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fecf406b210 con 0x7fece006ac90 2024-05-08T21:49:57.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.964+0000 7fecf0ff9700 1 -- 172.21.15.73:0/118983521 <== mgr.4104 v2:172.21.15.73:6832/46949 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264527 (secure 0 0 0) 0x7fece40117b0 con 0x7fece006ac90 2024-05-08T21:49:57.968 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:49:57.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.967+0000 7fecfa59d700 1 -- 172.21.15.73:0/118983521 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fece006ac90 msgr2=0x7fece006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:57.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.967+0000 7fecfa59d700 1 --2- 172.21.15.73:0/118983521 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fece006ac90 0x7fece006d150 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fecf40cc410 tx=0x7fece4008040 comp rx=0 tx=0).stop 2024-05-08T21:49:57.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.967+0000 7fecfa59d700 1 -- 172.21.15.73:0/118983521 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecf40c9990 msgr2=0x7fecf41ed7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:57.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.967+0000 7fecfa59d700 1 --2- 172.21.15.73:0/118983521 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecf40c9990 0x7fecf41ed7a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fece800c520 tx=0x7fece800c830 comp rx=0 tx=0).stop 2024-05-08T21:49:57.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.967+0000 7fecfa59d700 1 -- 172.21.15.73:0/118983521 shutdown_connections 2024-05-08T21:49:57.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.967+0000 7fecfa59d700 1 --2- 172.21.15.73:0/118983521 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fece006ac90 0x7fece006d150 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:57.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.967+0000 7fecfa59d700 1 --2- 172.21.15.73:0/118983521 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecf415b5e0 0x7fecf4139530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:57.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.967+0000 7fecfa59d700 1 --2- 172.21.15.73:0/118983521 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecf40c9990 0x7fecf41ed7a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:57.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.967+0000 7fecfa59d700 1 --2- 172.21.15.73:0/118983521 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fecf4141220 0x7fecf415a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:57.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.967+0000 7fecfa59d700 1 -- 172.21.15.73:0/118983521 >> 172.21.15.73:0/118983521 conn(0x7fecf4066d70 msgr2=0x7fecf4151c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:57.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.967+0000 7fecfa59d700 1 -- 172.21.15.73:0/118983521 shutdown_connections 2024-05-08T21:49:57.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:57.967+0000 7fecfa59d700 1 -- 172.21.15.73:0/118983521 wait complete. 2024-05-08T21:49:57.972 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-05-08T21:49:57.980 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-05-08T21:49:57.958527+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218984,"kb_used_data":2856,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755736,"statfs":{"total":773094113280,"available":772869873664,"internally_reserved":0,"allocated":2924544,"data_stored":1770172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007979"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.928360+0000","last_change":"2024-05-08T21:49:43.775912+0000","last_active":"2024-05-08T21:49:44.928360+0000","last_peered":"2024-05-08T21:49:44.928360+0000","last_clean":"2024-05-08T21:49:44.928360+0000","last_became_active":"2024-05-08T21:49:43.775657+0000","last_became_peered":"2024-05-08T21:49:43.775657+0000","last_unstale":"2024-05-08T21:49:44.928360+0000","last_undegraded":"2024-05-08T21:49:44.928360+0000","last_fullsized":"2024-05-08T21:49:44.928360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:10:07.209965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755108+0000","last_change":"2024-05-08T21:49:43.766984+0000","last_active":"2024-05-08T21:49:44.755108+0000","last_peered":"2024-05-08T21:49:44.755108+0000","last_clean":"2024-05-08T21:49:44.755108+0000","last_became_active":"2024-05-08T21:49:43.765995+0000","last_became_peered":"2024-05-08T21:49:43.765995+0000","last_unstale":"2024-05-08T21:49:44.755108+0000","last_undegraded":"2024-05-08T21:49:44.755108+0000","last_fullsized":"2024-05-08T21:49:44.755108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:21:41.238890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.926947+0000","last_change":"2024-05-08T21:49:43.766107+0000","last_active":"2024-05-08T21:49:44.926947+0000","last_peered":"2024-05-08T21:49:44.926947+0000","last_clean":"2024-05-08T21:49:44.926947+0000","last_became_active":"2024-05-08T21:49:43.765874+0000","last_became_peered":"2024-05-08T21:49:43.765874+0000","last_unstale":"2024-05-08T21:49:44.926947+0000","last_undegraded":"2024-05-08T21:49:44.926947+0000","last_fullsized":"2024-05-08T21:49:44.926947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:06:50.769169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757017+0000","last_change":"2024-05-08T21:49:43.766355+0000","last_active":"2024-05-08T21:49:44.757017+0000","last_peered":"2024-05-08T21:49:44.757017+0000","last_clean":"2024-05-08T21:49:44.757017+0000","last_became_active":"2024-05-08T21:49:43.765507+0000","last_became_peered":"2024-05-08T21:49:43.765507+0000","last_unstale":"2024-05-08T21:49:44.757017+0000","last_undegraded":"2024-05-08T21:49:44.757017+0000","last_fullsized":"2024-05-08T21:49:44.757017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:09:09.676078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927361+0000","last_change":"2024-05-08T21:49:43.770346+0000","last_active":"2024-05-08T21:49:44.927361+0000","last_peered":"2024-05-08T21:49:44.927361+0000","last_clean":"2024-05-08T21:49:44.927361+0000","last_became_active":"2024-05-08T21:49:43.770067+0000","last_became_peered":"2024-05-08T21:49:43.770067+0000","last_unstale":"2024-05-08T21:49:44.927361+0000","last_undegraded":"2024-05-08T21:49:44.927361+0000","last_fullsized":"2024-05-08T21:49:44.927361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:04:14.416894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756907+0000","last_change":"2024-05-08T21:49:43.771390+0000","last_active":"2024-05-08T21:49:44.756907+0000","last_peered":"2024-05-08T21:49:44.756907+0000","last_clean":"2024-05-08T21:49:44.756907+0000","last_became_active":"2024-05-08T21:49:43.770893+0000","last_became_peered":"2024-05-08T21:49:43.770893+0000","last_unstale":"2024-05-08T21:49:44.756907+0000","last_undegraded":"2024-05-08T21:49:44.756907+0000","last_fullsized":"2024-05-08T21:49:44.756907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:28.979468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927055+0000","last_change":"2024-05-08T21:49:43.769981+0000","last_active":"2024-05-08T21:49:44.927055+0000","last_peered":"2024-05-08T21:49:44.927055+0000","last_clean":"2024-05-08T21:49:44.927055+0000","last_became_active":"2024-05-08T21:49:43.769667+0000","last_became_peered":"2024-05-08T21:49:43.769667+0000","last_unstale":"2024-05-08T21:49:44.927055+0000","last_undegraded":"2024-05-08T21:49:44.927055+0000","last_fullsized":"2024-05-08T21:49:44.927055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:12:00.381761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927368+0000","last_change":"2024-05-08T21:49:43.771078+0000","last_active":"2024-05-08T21:49:44.927368+0000","last_peered":"2024-05-08T21:49:44.927368+0000","last_clean":"2024-05-08T21:49:44.927368+0000","last_became_active":"2024-05-08T21:49:43.770912+0000","last_became_peered":"2024-05-08T21:49:43.770912+0000","last_unstale":"2024-05-08T21:49:44.927368+0000","last_undegraded":"2024-05-08T21:49:44.927368+0000","last_fullsized":"2024-05-08T21:49:44.927368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:12:00.381761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.928368+0000","last_change":"2024-05-08T21:49:43.775880+0000","last_active":"2024-05-08T21:49:44.928368+0000","last_peered":"2024-05-08T21:49:44.928368+0000","last_clean":"2024-05-08T21:49:44.928368+0000","last_became_active":"2024-05-08T21:49:43.775404+0000","last_became_peered":"2024-05-08T21:49:43.775404+0000","last_unstale":"2024-05-08T21:49:44.928368+0000","last_undegraded":"2024-05-08T21:49:44.928368+0000","last_fullsized":"2024-05-08T21:49:44.928368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:23:24.559669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756369+0000","last_change":"2024-05-08T21:49:43.772784+0000","last_active":"2024-05-08T21:49:44.756369+0000","last_peered":"2024-05-08T21:49:44.756369+0000","last_clean":"2024-05-08T21:49:44.756369+0000","last_became_active":"2024-05-08T21:49:43.772505+0000","last_became_peered":"2024-05-08T21:49:43.772505+0000","last_unstale":"2024-05-08T21:49:44.756369+0000","last_undegraded":"2024-05-08T21:49:44.756369+0000","last_fullsized":"2024-05-08T21:49:44.756369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:19:28.925404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756079+0000","last_change":"2024-05-08T21:49:43.771781+0000","last_active":"2024-05-08T21:49:44.756079+0000","last_peered":"2024-05-08T21:49:44.756079+0000","last_clean":"2024-05-08T21:49:44.756079+0000","last_became_active":"2024-05-08T21:49:43.771457+0000","last_became_peered":"2024-05-08T21:49:43.771457+0000","last_unstale":"2024-05-08T21:49:44.756079+0000","last_undegraded":"2024-05-08T21:49:44.756079+0000","last_fullsized":"2024-05-08T21:49:44.756079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:43.798909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927611+0000","last_change":"2024-05-08T21:49:43.764249+0000","last_active":"2024-05-08T21:49:44.927611+0000","last_peered":"2024-05-08T21:49:44.927611+0000","last_clean":"2024-05-08T21:49:44.927611+0000","last_became_active":"2024-05-08T21:49:43.763986+0000","last_became_peered":"2024-05-08T21:49:43.763986+0000","last_unstale":"2024-05-08T21:49:44.927611+0000","last_undegraded":"2024-05-08T21:49:44.927611+0000","last_fullsized":"2024-05-08T21:49:44.927611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:33:13.833915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927054+0000","last_change":"2024-05-08T21:49:43.761127+0000","last_active":"2024-05-08T21:49:44.927054+0000","last_peered":"2024-05-08T21:49:44.927054+0000","last_clean":"2024-05-08T21:49:44.927054+0000","last_became_active":"2024-05-08T21:49:43.760874+0000","last_became_peered":"2024-05-08T21:49:43.760874+0000","last_unstale":"2024-05-08T21:49:44.927054+0000","last_undegraded":"2024-05-08T21:49:44.927054+0000","last_fullsized":"2024-05-08T21:49:44.927054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:17:34.570817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.926846+0000","last_change":"2024-05-08T21:49:43.765829+0000","last_active":"2024-05-08T21:49:44.926846+0000","last_peered":"2024-05-08T21:49:44.926846+0000","last_clean":"2024-05-08T21:49:44.926846+0000","last_became_active":"2024-05-08T21:49:43.765566+0000","last_became_peered":"2024-05-08T21:49:43.765566+0000","last_unstale":"2024-05-08T21:49:44.926846+0000","last_undegraded":"2024-05-08T21:49:44.926846+0000","last_fullsized":"2024-05-08T21:49:44.926846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:39.954320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.754916+0000","last_change":"2024-05-08T21:49:43.765080+0000","last_active":"2024-05-08T21:49:44.754916+0000","last_peered":"2024-05-08T21:49:44.754916+0000","last_clean":"2024-05-08T21:49:44.754916+0000","last_became_active":"2024-05-08T21:49:43.764810+0000","last_became_peered":"2024-05-08T21:49:43.764810+0000","last_unstale":"2024-05-08T21:49:44.754916+0000","last_undegraded":"2024-05-08T21:49:44.754916+0000","last_fullsized":"2024-05-08T21:49:44.754916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:24:11.223913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756634+0000","last_change":"2024-05-08T21:49:43.766717+0000","last_active":"2024-05-08T21:49:44.756634+0000","last_peered":"2024-05-08T21:49:44.756634+0000","last_clean":"2024-05-08T21:49:44.756634+0000","last_became_active":"2024-05-08T21:49:43.766427+0000","last_became_peered":"2024-05-08T21:49:43.766427+0000","last_unstale":"2024-05-08T21:49:44.756634+0000","last_undegraded":"2024-05-08T21:49:44.756634+0000","last_fullsized":"2024-05-08T21:49:44.756634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:49:22.833820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757256+0000","last_change":"2024-05-08T21:49:43.776929+0000","last_active":"2024-05-08T21:49:44.757256+0000","last_peered":"2024-05-08T21:49:44.757256+0000","last_clean":"2024-05-08T21:49:44.757256+0000","last_became_active":"2024-05-08T21:49:43.776509+0000","last_became_peered":"2024-05-08T21:49:43.776509+0000","last_unstale":"2024-05-08T21:49:44.757256+0000","last_undegraded":"2024-05-08T21:49:44.757256+0000","last_fullsized":"2024-05-08T21:49:44.757256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:26.199459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.926679+0000","last_change":"2024-05-08T21:49:43.762646+0000","last_active":"2024-05-08T21:49:44.926679+0000","last_peered":"2024-05-08T21:49:44.926679+0000","last_clean":"2024-05-08T21:49:44.926679+0000","last_became_active":"2024-05-08T21:49:43.762237+0000","last_became_peered":"2024-05-08T21:49:43.762237+0000","last_unstale":"2024-05-08T21:49:44.926679+0000","last_undegraded":"2024-05-08T21:49:44.926679+0000","last_fullsized":"2024-05-08T21:49:44.926679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:46:08.821947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927249+0000","last_change":"2024-05-08T21:49:43.774729+0000","last_active":"2024-05-08T21:49:44.927249+0000","last_peered":"2024-05-08T21:49:44.927249+0000","last_clean":"2024-05-08T21:49:44.927249+0000","last_became_active":"2024-05-08T21:49:43.774450+0000","last_became_peered":"2024-05-08T21:49:43.774450+0000","last_unstale":"2024-05-08T21:49:44.927249+0000","last_undegraded":"2024-05-08T21:49:44.927249+0000","last_fullsized":"2024-05-08T21:49:44.927249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:25.661350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:48.760475+0000","last_change":"2024-05-08T21:49:43.219461+0000","last_active":"2024-05-08T21:49:48.760475+0000","last_peered":"2024-05-08T21:49:48.760475+0000","last_clean":"2024-05-08T21:49:48.760475+0000","last_became_active":"2024-05-08T21:49:43.219161+0000","last_became_peered":"2024-05-08T21:49:43.219161+0000","last_unstale":"2024-05-08T21:49:48.760475+0000","last_undegraded":"2024-05-08T21:49:48.760475+0000","last_fullsized":"2024-05-08T21:49:48.760475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:02:45.778415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927036+0000","last_change":"2024-05-08T21:49:43.764252+0000","last_active":"2024-05-08T21:49:44.927036+0000","last_peered":"2024-05-08T21:49:44.927036+0000","last_clean":"2024-05-08T21:49:44.927036+0000","last_became_active":"2024-05-08T21:49:43.764045+0000","last_became_peered":"2024-05-08T21:49:43.764045+0000","last_unstale":"2024-05-08T21:49:44.927036+0000","last_undegraded":"2024-05-08T21:49:44.927036+0000","last_fullsized":"2024-05-08T21:49:44.927036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:43.798909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927120+0000","last_change":"2024-05-08T21:49:43.221599+0000","last_active":"2024-05-08T21:49:44.927120+0000","last_peered":"2024-05-08T21:49:44.927120+0000","last_clean":"2024-05-08T21:49:44.927120+0000","last_became_active":"2024-05-08T21:49:43.221309+0000","last_became_peered":"2024-05-08T21:49:43.221309+0000","last_unstale":"2024-05-08T21:49:44.927120+0000","last_undegraded":"2024-05-08T21:49:44.927120+0000","last_fullsized":"2024-05-08T21:49:44.927120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:17.379362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927796+0000","last_change":"2024-05-08T21:49:43.771523+0000","last_active":"2024-05-08T21:49:44.927796+0000","last_peered":"2024-05-08T21:49:44.927796+0000","last_clean":"2024-05-08T21:49:44.927796+0000","last_became_active":"2024-05-08T21:49:43.771295+0000","last_became_peered":"2024-05-08T21:49:43.771295+0000","last_unstale":"2024-05-08T21:49:44.927796+0000","last_undegraded":"2024-05-08T21:49:44.927796+0000","last_fullsized":"2024-05-08T21:49:44.927796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:53:14.774835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:48.755678+0000","last_change":"2024-05-08T21:49:43.226637+0000","last_active":"2024-05-08T21:49:48.755678+0000","last_peered":"2024-05-08T21:49:48.755678+0000","last_clean":"2024-05-08T21:49:48.755678+0000","last_became_active":"2024-05-08T21:49:43.226284+0000","last_became_peered":"2024-05-08T21:49:43.226284+0000","last_unstale":"2024-05-08T21:49:48.755678+0000","last_undegraded":"2024-05-08T21:49:48.755678+0000","last_fullsized":"2024-05-08T21:49:48.755678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:01.844011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756849+0000","last_change":"2024-05-08T21:49:43.766694+0000","last_active":"2024-05-08T21:49:44.756849+0000","last_peered":"2024-05-08T21:49:44.756849+0000","last_clean":"2024-05-08T21:49:44.756849+0000","last_became_active":"2024-05-08T21:49:43.766079+0000","last_became_peered":"2024-05-08T21:49:43.766079+0000","last_unstale":"2024-05-08T21:49:44.756849+0000","last_undegraded":"2024-05-08T21:49:44.756849+0000","last_fullsized":"2024-05-08T21:49:44.756849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:01:16.682080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:48.755619+0000","last_change":"2024-05-08T21:49:43.230152+0000","last_active":"2024-05-08T21:49:48.755619+0000","last_peered":"2024-05-08T21:49:48.755619+0000","last_clean":"2024-05-08T21:49:48.755619+0000","last_became_active":"2024-05-08T21:49:43.229891+0000","last_became_peered":"2024-05-08T21:49:43.229891+0000","last_unstale":"2024-05-08T21:49:48.755619+0000","last_undegraded":"2024-05-08T21:49:48.755619+0000","last_fullsized":"2024-05-08T21:49:48.755619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:33:12.827218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757018+0000","last_change":"2024-05-08T21:49:43.771097+0000","last_active":"2024-05-08T21:49:44.757018+0000","last_peered":"2024-05-08T21:49:44.757018+0000","last_clean":"2024-05-08T21:49:44.757018+0000","last_became_active":"2024-05-08T21:49:43.770727+0000","last_became_peered":"2024-05-08T21:49:43.770727+0000","last_unstale":"2024-05-08T21:49:44.757018+0000","last_undegraded":"2024-05-08T21:49:44.757018+0000","last_fullsized":"2024-05-08T21:49:44.757018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:24:02.741766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927211+0000","last_change":"2024-05-08T21:49:43.220418+0000","last_active":"2024-05-08T21:49:44.927211+0000","last_peered":"2024-05-08T21:49:44.927211+0000","last_clean":"2024-05-08T21:49:44.927211+0000","last_became_active":"2024-05-08T21:49:43.220090+0000","last_became_peered":"2024-05-08T21:49:43.220090+0000","last_unstale":"2024-05-08T21:49:44.927211+0000","last_undegraded":"2024-05-08T21:49:44.927211+0000","last_fullsized":"2024-05-08T21:49:44.927211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:33:28.074468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927692+0000","last_change":"2024-05-08T21:49:43.762664+0000","last_active":"2024-05-08T21:49:44.927692+0000","last_peered":"2024-05-08T21:49:44.927692+0000","last_clean":"2024-05-08T21:49:44.927692+0000","last_became_active":"2024-05-08T21:49:43.762351+0000","last_became_peered":"2024-05-08T21:49:43.762351+0000","last_unstale":"2024-05-08T21:49:44.927692+0000","last_undegraded":"2024-05-08T21:49:44.927692+0000","last_fullsized":"2024-05-08T21:49:44.927692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:53.330614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756121+0000","last_change":"2024-05-08T21:49:43.220518+0000","last_active":"2024-05-08T21:49:44.756121+0000","last_peered":"2024-05-08T21:49:44.756121+0000","last_clean":"2024-05-08T21:49:44.756121+0000","last_became_active":"2024-05-08T21:49:43.218473+0000","last_became_peered":"2024-05-08T21:49:43.218473+0000","last_unstale":"2024-05-08T21:49:44.756121+0000","last_undegraded":"2024-05-08T21:49:44.756121+0000","last_fullsized":"2024-05-08T21:49:44.756121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:10.497167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927324+0000","last_change":"2024-05-08T21:49:43.770935+0000","last_active":"2024-05-08T21:49:44.927324+0000","last_peered":"2024-05-08T21:49:44.927324+0000","last_clean":"2024-05-08T21:49:44.927324+0000","last_became_active":"2024-05-08T21:49:43.770677+0000","last_became_peered":"2024-05-08T21:49:43.770677+0000","last_unstale":"2024-05-08T21:49:44.927324+0000","last_undegraded":"2024-05-08T21:49:44.927324+0000","last_fullsized":"2024-05-08T21:49:44.927324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:04:14.416894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.752777+0000","last_change":"2024-05-08T21:49:43.221027+0000","last_active":"2024-05-08T21:49:43.752777+0000","last_peered":"2024-05-08T21:49:43.752777+0000","last_clean":"2024-05-08T21:49:43.752777+0000","last_became_active":"2024-05-08T21:49:43.220780+0000","last_became_peered":"2024-05-08T21:49:43.220780+0000","last_unstale":"2024-05-08T21:49:43.752777+0000","last_undegraded":"2024-05-08T21:49:43.752777+0000","last_fullsized":"2024-05-08T21:49:43.752777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:20:34.123736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927461+0000","last_change":"2024-05-08T21:49:43.766815+0000","last_active":"2024-05-08T21:49:44.927461+0000","last_peered":"2024-05-08T21:49:44.927461+0000","last_clean":"2024-05-08T21:49:44.927461+0000","last_became_active":"2024-05-08T21:49:43.766568+0000","last_became_peered":"2024-05-08T21:49:43.766568+0000","last_unstale":"2024-05-08T21:49:44.927461+0000","last_undegraded":"2024-05-08T21:49:44.927461+0000","last_fullsized":"2024-05-08T21:49:44.927461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:41:45.602022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756625+0000","last_change":"2024-05-08T21:49:43.225299+0000","last_active":"2024-05-08T21:49:44.756625+0000","last_peered":"2024-05-08T21:49:44.756625+0000","last_clean":"2024-05-08T21:49:44.756625+0000","last_became_active":"2024-05-08T21:49:43.225057+0000","last_became_peered":"2024-05-08T21:49:43.225057+0000","last_unstale":"2024-05-08T21:49:44.756625+0000","last_undegraded":"2024-05-08T21:49:44.756625+0000","last_fullsized":"2024-05-08T21:49:44.756625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:38:43.069159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755021+0000","last_change":"2024-05-08T21:49:43.757361+0000","last_active":"2024-05-08T21:49:44.755021+0000","last_peered":"2024-05-08T21:49:44.755021+0000","last_clean":"2024-05-08T21:49:44.755021+0000","last_became_active":"2024-05-08T21:49:43.757092+0000","last_became_peered":"2024-05-08T21:49:43.757092+0000","last_unstale":"2024-05-08T21:49:44.755021+0000","last_undegraded":"2024-05-08T21:49:44.755021+0000","last_fullsized":"2024-05-08T21:49:44.755021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:24:02.741766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.756381+0000","last_change":"2024-05-08T21:49:43.229405+0000","last_active":"2024-05-08T21:49:43.756381+0000","last_peered":"2024-05-08T21:49:43.756381+0000","last_clean":"2024-05-08T21:49:43.756381+0000","last_became_active":"2024-05-08T21:49:43.229105+0000","last_became_peered":"2024-05-08T21:49:43.229105+0000","last_unstale":"2024-05-08T21:49:43.756381+0000","last_undegraded":"2024-05-08T21:49:43.756381+0000","last_fullsized":"2024-05-08T21:49:43.756381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:18:58.164159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757172+0000","last_change":"2024-05-08T21:49:43.773243+0000","last_active":"2024-05-08T21:49:44.757172+0000","last_peered":"2024-05-08T21:49:44.757172+0000","last_clean":"2024-05-08T21:49:44.757172+0000","last_became_active":"2024-05-08T21:49:43.772944+0000","last_became_peered":"2024-05-08T21:49:43.772944+0000","last_unstale":"2024-05-08T21:49:44.757172+0000","last_undegraded":"2024-05-08T21:49:44.757172+0000","last_fullsized":"2024-05-08T21:49:44.757172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:21:41.238890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757107+0000","last_change":"2024-05-08T21:49:43.224999+0000","last_active":"2024-05-08T21:49:44.757107+0000","last_peered":"2024-05-08T21:49:44.757107+0000","last_clean":"2024-05-08T21:49:44.757107+0000","last_became_active":"2024-05-08T21:49:43.223476+0000","last_became_peered":"2024-05-08T21:49:43.223476+0000","last_unstale":"2024-05-08T21:49:44.757107+0000","last_undegraded":"2024-05-08T21:49:44.757107+0000","last_fullsized":"2024-05-08T21:49:44.757107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:09:12.983430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927734+0000","last_change":"2024-05-08T21:49:43.771526+0000","last_active":"2024-05-08T21:49:44.927734+0000","last_peered":"2024-05-08T21:49:44.927734+0000","last_clean":"2024-05-08T21:49:44.927734+0000","last_became_active":"2024-05-08T21:49:43.771279+0000","last_became_peered":"2024-05-08T21:49:43.771279+0000","last_unstale":"2024-05-08T21:49:44.927734+0000","last_undegraded":"2024-05-08T21:49:44.927734+0000","last_fullsized":"2024-05-08T21:49:44.927734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:41:45.602022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:48.757392+0000","last_change":"2024-05-08T21:49:43.224378+0000","last_active":"2024-05-08T21:49:48.757392+0000","last_peered":"2024-05-08T21:49:48.757392+0000","last_clean":"2024-05-08T21:49:48.757392+0000","last_became_active":"2024-05-08T21:49:43.224164+0000","last_became_peered":"2024-05-08T21:49:43.224164+0000","last_unstale":"2024-05-08T21:49:48.757392+0000","last_undegraded":"2024-05-08T21:49:48.757392+0000","last_fullsized":"2024-05-08T21:49:48.757392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:06:10.276907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927552+0000","last_change":"2024-05-08T21:49:43.772948+0000","last_active":"2024-05-08T21:49:44.927552+0000","last_peered":"2024-05-08T21:49:44.927552+0000","last_clean":"2024-05-08T21:49:44.927552+0000","last_became_active":"2024-05-08T21:49:43.772685+0000","last_became_peered":"2024-05-08T21:49:43.772685+0000","last_unstale":"2024-05-08T21:49:44.927552+0000","last_undegraded":"2024-05-08T21:49:44.927552+0000","last_fullsized":"2024-05-08T21:49:44.927552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:02.850708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:48.760794+0000","last_change":"2024-05-08T21:49:43.222308+0000","last_active":"2024-05-08T21:49:48.760794+0000","last_peered":"2024-05-08T21:49:48.760794+0000","last_clean":"2024-05-08T21:49:48.760794+0000","last_became_active":"2024-05-08T21:49:43.221844+0000","last_became_peered":"2024-05-08T21:49:43.221844+0000","last_unstale":"2024-05-08T21:49:48.760794+0000","last_undegraded":"2024-05-08T21:49:48.760794+0000","last_fullsized":"2024-05-08T21:49:48.760794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:17.379362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927374+0000","last_change":"2024-05-08T21:49:43.773923+0000","last_active":"2024-05-08T21:49:44.927374+0000","last_peered":"2024-05-08T21:49:44.927374+0000","last_clean":"2024-05-08T21:49:44.927374+0000","last_became_active":"2024-05-08T21:49:43.772037+0000","last_became_peered":"2024-05-08T21:49:43.772037+0000","last_unstale":"2024-05-08T21:49:44.927374+0000","last_undegraded":"2024-05-08T21:49:44.927374+0000","last_fullsized":"2024-05-08T21:49:44.927374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:52:32.629407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:48.757374+0000","last_change":"2024-05-08T21:49:43.219473+0000","last_active":"2024-05-08T21:49:48.757374+0000","last_peered":"2024-05-08T21:49:48.757374+0000","last_clean":"2024-05-08T21:49:48.757374+0000","last_became_active":"2024-05-08T21:49:43.219186+0000","last_became_peered":"2024-05-08T21:49:43.219186+0000","last_unstale":"2024-05-08T21:49:48.757374+0000","last_undegraded":"2024-05-08T21:49:48.757374+0000","last_fullsized":"2024-05-08T21:49:48.757374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:20:34.123736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.926751+0000","last_change":"2024-05-08T21:49:43.775135+0000","last_active":"2024-05-08T21:49:44.926751+0000","last_peered":"2024-05-08T21:49:44.926751+0000","last_clean":"2024-05-08T21:49:44.926751+0000","last_became_active":"2024-05-08T21:49:43.774919+0000","last_became_peered":"2024-05-08T21:49:43.774919+0000","last_unstale":"2024-05-08T21:49:44.926751+0000","last_undegraded":"2024-05-08T21:49:44.926751+0000","last_fullsized":"2024-05-08T21:49:44.926751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:01:00.614249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757128+0000","last_change":"2024-05-08T21:49:43.227386+0000","last_active":"2024-05-08T21:49:44.757128+0000","last_peered":"2024-05-08T21:49:44.757128+0000","last_clean":"2024-05-08T21:49:44.757128+0000","last_became_active":"2024-05-08T21:49:43.227065+0000","last_became_peered":"2024-05-08T21:49:43.227065+0000","last_unstale":"2024-05-08T21:49:44.757128+0000","last_undegraded":"2024-05-08T21:49:44.757128+0000","last_fullsized":"2024-05-08T21:49:44.757128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:43:48.019170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927424+0000","last_change":"2024-05-08T21:49:43.770509+0000","last_active":"2024-05-08T21:49:44.927424+0000","last_peered":"2024-05-08T21:49:44.927424+0000","last_clean":"2024-05-08T21:49:44.927424+0000","last_became_active":"2024-05-08T21:49:43.770180+0000","last_became_peered":"2024-05-08T21:49:43.770180+0000","last_unstale":"2024-05-08T21:49:44.927424+0000","last_undegraded":"2024-05-08T21:49:44.927424+0000","last_fullsized":"2024-05-08T21:49:44.927424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:00:38.941899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.756153+0000","last_change":"2024-05-08T21:49:43.220942+0000","last_active":"2024-05-08T21:49:43.756153+0000","last_peered":"2024-05-08T21:49:43.756153+0000","last_clean":"2024-05-08T21:49:43.756153+0000","last_became_active":"2024-05-08T21:49:43.220641+0000","last_became_peered":"2024-05-08T21:49:43.220641+0000","last_unstale":"2024-05-08T21:49:43.756153+0000","last_undegraded":"2024-05-08T21:49:43.756153+0000","last_fullsized":"2024-05-08T21:49:43.756153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:52.323917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755763+0000","last_change":"2024-05-08T21:49:43.766269+0000","last_active":"2024-05-08T21:49:44.755763+0000","last_peered":"2024-05-08T21:49:44.755763+0000","last_clean":"2024-05-08T21:49:44.755763+0000","last_became_active":"2024-05-08T21:49:43.765945+0000","last_became_peered":"2024-05-08T21:49:43.765945+0000","last_unstale":"2024-05-08T21:49:44.755763+0000","last_undegraded":"2024-05-08T21:49:44.755763+0000","last_fullsized":"2024-05-08T21:49:44.755763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:17:34.570817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:48.763472+0000","last_change":"2024-05-08T21:49:43.208328+0000","last_active":"2024-05-08T21:49:48.763472+0000","last_peered":"2024-05-08T21:49:48.763472+0000","last_clean":"2024-05-08T21:49:48.763472+0000","last_became_active":"2024-05-08T21:49:43.208013+0000","last_became_peered":"2024-05-08T21:49:43.208013+0000","last_unstale":"2024-05-08T21:49:48.763472+0000","last_undegraded":"2024-05-08T21:49:48.763472+0000","last_fullsized":"2024-05-08T21:49:48.763472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:10.497167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.928099+0000","last_change":"2024-05-08T21:49:43.774210+0000","last_active":"2024-05-08T21:49:44.928099+0000","last_peered":"2024-05-08T21:49:44.928099+0000","last_clean":"2024-05-08T21:49:44.928099+0000","last_became_active":"2024-05-08T21:49:43.773933+0000","last_became_peered":"2024-05-08T21:49:43.773933+0000","last_unstale":"2024-05-08T21:49:44.928099+0000","last_undegraded":"2024-05-08T21:49:44.928099+0000","last_fullsized":"2024-05-08T21:49:44.928099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:10:25.398535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927899+0000","last_change":"2024-05-08T21:49:43.217456+0000","last_active":"2024-05-08T21:49:44.927899+0000","last_peered":"2024-05-08T21:49:44.927899+0000","last_clean":"2024-05-08T21:49:44.927899+0000","last_became_active":"2024-05-08T21:49:43.216822+0000","last_became_peered":"2024-05-08T21:49:43.216822+0000","last_unstale":"2024-05-08T21:49:44.927899+0000","last_undegraded":"2024-05-08T21:49:44.927899+0000","last_fullsized":"2024-05-08T21:49:44.927899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:41:35.881003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927764+0000","last_change":"2024-05-08T21:49:43.770066+0000","last_active":"2024-05-08T21:49:44.927764+0000","last_peered":"2024-05-08T21:49:44.927764+0000","last_clean":"2024-05-08T21:49:44.927764+0000","last_became_active":"2024-05-08T21:49:43.769762+0000","last_became_peered":"2024-05-08T21:49:43.769762+0000","last_unstale":"2024-05-08T21:49:44.927764+0000","last_undegraded":"2024-05-08T21:49:44.927764+0000","last_fullsized":"2024-05-08T21:49:44.927764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:40:20.301747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755188+0000","last_change":"2024-05-08T21:49:43.215293+0000","last_active":"2024-05-08T21:49:44.755188+0000","last_peered":"2024-05-08T21:49:44.755188+0000","last_clean":"2024-05-08T21:49:44.755188+0000","last_became_active":"2024-05-08T21:49:43.215048+0000","last_became_peered":"2024-05-08T21:49:43.215048+0000","last_unstale":"2024-05-08T21:49:44.755188+0000","last_undegraded":"2024-05-08T21:49:44.755188+0000","last_fullsized":"2024-05-08T21:49:44.755188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:43:48.019170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757129+0000","last_change":"2024-05-08T21:49:43.770326+0000","last_active":"2024-05-08T21:49:44.757129+0000","last_peered":"2024-05-08T21:49:44.757129+0000","last_clean":"2024-05-08T21:49:44.757129+0000","last_became_active":"2024-05-08T21:49:43.770029+0000","last_became_peered":"2024-05-08T21:49:43.770029+0000","last_unstale":"2024-05-08T21:49:44.757129+0000","last_undegraded":"2024-05-08T21:49:44.757129+0000","last_fullsized":"2024-05-08T21:49:44.757129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:33:33.642847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757017+0000","last_change":"2024-05-08T21:49:43.227710+0000","last_active":"2024-05-08T21:49:44.757017+0000","last_peered":"2024-05-08T21:49:44.757017+0000","last_clean":"2024-05-08T21:49:44.757017+0000","last_became_active":"2024-05-08T21:49:43.227430+0000","last_became_peered":"2024-05-08T21:49:43.227430+0000","last_unstale":"2024-05-08T21:49:44.757017+0000","last_undegraded":"2024-05-08T21:49:44.757017+0000","last_fullsized":"2024-05-08T21:49:44.757017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:05:58.875400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.928131+0000","last_change":"2024-05-08T21:49:43.768588+0000","last_active":"2024-05-08T21:49:44.928131+0000","last_peered":"2024-05-08T21:49:44.928131+0000","last_clean":"2024-05-08T21:49:44.928131+0000","last_became_active":"2024-05-08T21:49:43.768307+0000","last_became_peered":"2024-05-08T21:49:43.768307+0000","last_unstale":"2024-05-08T21:49:44.928131+0000","last_undegraded":"2024-05-08T21:49:44.928131+0000","last_fullsized":"2024-05-08T21:49:44.928131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:04.968184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.754953+0000","last_change":"2024-05-08T21:49:43.758618+0000","last_active":"2024-05-08T21:49:44.754953+0000","last_peered":"2024-05-08T21:49:44.754953+0000","last_clean":"2024-05-08T21:49:44.754953+0000","last_became_active":"2024-05-08T21:49:43.758367+0000","last_became_peered":"2024-05-08T21:49:43.758367+0000","last_unstale":"2024-05-08T21:49:44.754953+0000","last_undegraded":"2024-05-08T21:49:44.754953+0000","last_fullsized":"2024-05-08T21:49:44.754953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:30:06.569971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.751866+0000","last_change":"2024-05-08T21:49:43.217410+0000","last_active":"2024-05-08T21:49:43.751866+0000","last_peered":"2024-05-08T21:49:43.751866+0000","last_clean":"2024-05-08T21:49:43.751866+0000","last_became_active":"2024-05-08T21:49:43.217133+0000","last_became_peered":"2024-05-08T21:49:43.217133+0000","last_unstale":"2024-05-08T21:49:43.751866+0000","last_undegraded":"2024-05-08T21:49:43.751866+0000","last_fullsized":"2024-05-08T21:49:43.751866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:17.379362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.926897+0000","last_change":"2024-05-08T21:49:43.771651+0000","last_active":"2024-05-08T21:49:44.926897+0000","last_peered":"2024-05-08T21:49:44.926897+0000","last_clean":"2024-05-08T21:49:44.926897+0000","last_became_active":"2024-05-08T21:49:43.771451+0000","last_became_peered":"2024-05-08T21:49:43.771451+0000","last_unstale":"2024-05-08T21:49:44.926897+0000","last_undegraded":"2024-05-08T21:49:44.926897+0000","last_fullsized":"2024-05-08T21:49:44.926897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:00:38.941899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756759+0000","last_change":"2024-05-08T21:49:43.224929+0000","last_active":"2024-05-08T21:49:44.756759+0000","last_peered":"2024-05-08T21:49:44.756759+0000","last_clean":"2024-05-08T21:49:44.756759+0000","last_became_active":"2024-05-08T21:49:43.223469+0000","last_became_peered":"2024-05-08T21:49:43.223469+0000","last_unstale":"2024-05-08T21:49:44.756759+0000","last_undegraded":"2024-05-08T21:49:44.756759+0000","last_fullsized":"2024-05-08T21:49:44.756759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:27.504127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":164,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.756621+0000","last_change":"2024-05-08T21:49:38.626519+0000","last_active":"2024-05-08T21:49:43.756621+0000","last_peered":"2024-05-08T21:49:43.756621+0000","last_clean":"2024-05-08T21:49:43.756621+0000","last_became_active":"2024-05-08T21:49:38.626159+0000","last_became_peered":"2024-05-08T21:49:38.626159+0000","last_unstale":"2024-05-08T21:49:43.756621+0000","last_undegraded":"2024-05-08T21:49:43.756621+0000","last_fullsized":"2024-05-08T21:49:43.756621+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:36.031649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:36.031649+0000","last_clean_scrub_stamp":"2024-05-08T21:49:36.031649+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:12:04.846500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.926994+0000","last_change":"2024-05-08T21:49:43.770966+0000","last_active":"2024-05-08T21:49:44.926994+0000","last_peered":"2024-05-08T21:49:44.926994+0000","last_clean":"2024-05-08T21:49:44.926994+0000","last_became_active":"2024-05-08T21:49:43.770711+0000","last_became_peered":"2024-05-08T21:49:43.770711+0000","last_unstale":"2024-05-08T21:49:44.926994+0000","last_undegraded":"2024-05-08T21:49:44.926994+0000","last_fullsized":"2024-05-08T21:49:44.926994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:17:34.570817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.756729+0000","last_change":"2024-05-08T21:49:43.221086+0000","last_active":"2024-05-08T21:49:43.756729+0000","last_peered":"2024-05-08T21:49:43.756729+0000","last_clean":"2024-05-08T21:49:43.756729+0000","last_became_active":"2024-05-08T21:49:43.220539+0000","last_became_peered":"2024-05-08T21:49:43.220539+0000","last_unstale":"2024-05-08T21:49:43.756729+0000","last_undegraded":"2024-05-08T21:49:43.756729+0000","last_fullsized":"2024-05-08T21:49:43.756729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:52.323917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.765742+0000","last_change":"2024-05-08T21:49:43.222410+0000","last_active":"2024-05-08T21:49:43.765742+0000","last_peered":"2024-05-08T21:49:43.765742+0000","last_clean":"2024-05-08T21:49:43.765742+0000","last_became_active":"2024-05-08T21:49:43.222131+0000","last_became_peered":"2024-05-08T21:49:43.222131+0000","last_unstale":"2024-05-08T21:49:43.765742+0000","last_undegraded":"2024-05-08T21:49:43.765742+0000","last_fullsized":"2024-05-08T21:49:43.765742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:18:58.164159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755021+0000","last_change":"2024-05-08T21:49:43.758424+0000","last_active":"2024-05-08T21:49:44.755021+0000","last_peered":"2024-05-08T21:49:44.755021+0000","last_clean":"2024-05-08T21:49:44.755021+0000","last_became_active":"2024-05-08T21:49:43.758140+0000","last_became_peered":"2024-05-08T21:49:43.758140+0000","last_unstale":"2024-05-08T21:49:44.755021+0000","last_undegraded":"2024-05-08T21:49:44.755021+0000","last_fullsized":"2024-05-08T21:49:44.755021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:10.795540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:46.015958+0000","last_change":"2024-05-08T21:49:43.218241+0000","last_active":"2024-05-08T21:49:46.015958+0000","last_peered":"2024-05-08T21:49:46.015958+0000","last_clean":"2024-05-08T21:49:46.015958+0000","last_became_active":"2024-05-08T21:49:43.217780+0000","last_became_peered":"2024-05-08T21:49:43.217780+0000","last_unstale":"2024-05-08T21:49:46.015958+0000","last_undegraded":"2024-05-08T21:49:46.015958+0000","last_fullsized":"2024-05-08T21:49:46.015958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:27.504127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927830+0000","last_change":"2024-05-08T21:49:43.770491+0000","last_active":"2024-05-08T21:49:44.927830+0000","last_peered":"2024-05-08T21:49:44.927830+0000","last_clean":"2024-05-08T21:49:44.927830+0000","last_became_active":"2024-05-08T21:49:43.770221+0000","last_became_peered":"2024-05-08T21:49:43.770221+0000","last_unstale":"2024-05-08T21:49:44.927830+0000","last_undegraded":"2024-05-08T21:49:44.927830+0000","last_fullsized":"2024-05-08T21:49:44.927830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:25.661350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:48.755985+0000","last_change":"2024-05-08T21:49:43.221345+0000","last_active":"2024-05-08T21:49:48.755985+0000","last_peered":"2024-05-08T21:49:48.755985+0000","last_clean":"2024-05-08T21:49:48.755985+0000","last_became_active":"2024-05-08T21:49:43.220953+0000","last_became_peered":"2024-05-08T21:49:43.220953+0000","last_unstale":"2024-05-08T21:49:48.755985+0000","last_undegraded":"2024-05-08T21:49:48.755985+0000","last_fullsized":"2024-05-08T21:49:48.755985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:33:28.074468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927636+0000","last_change":"2024-05-08T21:49:43.765001+0000","last_active":"2024-05-08T21:49:44.927636+0000","last_peered":"2024-05-08T21:49:44.927636+0000","last_clean":"2024-05-08T21:49:44.927636+0000","last_became_active":"2024-05-08T21:49:43.764740+0000","last_became_peered":"2024-05-08T21:49:43.764740+0000","last_unstale":"2024-05-08T21:49:44.927636+0000","last_undegraded":"2024-05-08T21:49:44.927636+0000","last_fullsized":"2024-05-08T21:49:44.927636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:18:58.836430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.756521+0000","last_change":"2024-05-08T21:49:43.221251+0000","last_active":"2024-05-08T21:49:43.756521+0000","last_peered":"2024-05-08T21:49:43.756521+0000","last_clean":"2024-05-08T21:49:43.756521+0000","last_became_active":"2024-05-08T21:49:43.220839+0000","last_became_peered":"2024-05-08T21:49:43.220839+0000","last_unstale":"2024-05-08T21:49:43.756521+0000","last_undegraded":"2024-05-08T21:49:43.756521+0000","last_fullsized":"2024-05-08T21:49:43.756521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:10.497167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927485+0000","last_change":"2024-05-08T21:49:43.762511+0000","last_active":"2024-05-08T21:49:44.927485+0000","last_peered":"2024-05-08T21:49:44.927485+0000","last_clean":"2024-05-08T21:49:44.927485+0000","last_became_active":"2024-05-08T21:49:43.762170+0000","last_became_peered":"2024-05-08T21:49:43.762170+0000","last_unstale":"2024-05-08T21:49:44.927485+0000","last_undegraded":"2024-05-08T21:49:44.927485+0000","last_fullsized":"2024-05-08T21:49:44.927485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:11.503864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.754925+0000","last_change":"2024-05-08T21:49:43.215361+0000","last_active":"2024-05-08T21:49:44.754925+0000","last_peered":"2024-05-08T21:49:44.754925+0000","last_clean":"2024-05-08T21:49:44.754925+0000","last_became_active":"2024-05-08T21:49:43.215162+0000","last_became_peered":"2024-05-08T21:49:43.215162+0000","last_unstale":"2024-05-08T21:49:44.754925+0000","last_undegraded":"2024-05-08T21:49:44.754925+0000","last_fullsized":"2024-05-08T21:49:44.754925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:05:58.875400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927416+0000","last_change":"2024-05-08T21:49:43.757512+0000","last_active":"2024-05-08T21:49:44.927416+0000","last_peered":"2024-05-08T21:49:44.927416+0000","last_clean":"2024-05-08T21:49:44.927416+0000","last_became_active":"2024-05-08T21:49:43.757233+0000","last_became_peered":"2024-05-08T21:49:43.757233+0000","last_unstale":"2024-05-08T21:49:44.927416+0000","last_undegraded":"2024-05-08T21:49:44.927416+0000","last_fullsized":"2024-05-08T21:49:44.927416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:53:14.774835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755100+0000","last_change":"2024-05-08T21:49:43.217935+0000","last_active":"2024-05-08T21:49:44.755100+0000","last_peered":"2024-05-08T21:49:44.755100+0000","last_clean":"2024-05-08T21:49:44.755100+0000","last_became_active":"2024-05-08T21:49:43.217595+0000","last_became_peered":"2024-05-08T21:49:43.217595+0000","last_unstale":"2024-05-08T21:49:44.755100+0000","last_undegraded":"2024-05-08T21:49:44.755100+0000","last_fullsized":"2024-05-08T21:49:44.755100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:38:43.069159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927301+0000","last_change":"2024-05-08T21:49:43.766816+0000","last_active":"2024-05-08T21:49:44.927301+0000","last_peered":"2024-05-08T21:49:44.927301+0000","last_clean":"2024-05-08T21:49:44.927301+0000","last_became_active":"2024-05-08T21:49:43.766596+0000","last_became_peered":"2024-05-08T21:49:43.766596+0000","last_unstale":"2024-05-08T21:49:44.927301+0000","last_undegraded":"2024-05-08T21:49:44.927301+0000","last_fullsized":"2024-05-08T21:49:44.927301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:01:00.614249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:48.756361+0000","last_change":"2024-05-08T21:49:43.224243+0000","last_active":"2024-05-08T21:49:48.756361+0000","last_peered":"2024-05-08T21:49:48.756361+0000","last_clean":"2024-05-08T21:49:48.756361+0000","last_became_active":"2024-05-08T21:49:43.223974+0000","last_became_peered":"2024-05-08T21:49:43.223974+0000","last_unstale":"2024-05-08T21:49:48.756361+0000","last_undegraded":"2024-05-08T21:49:48.756361+0000","last_fullsized":"2024-05-08T21:49:48.756361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:03.961487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755912+0000","last_change":"2024-05-08T21:49:43.764377+0000","last_active":"2024-05-08T21:49:44.755912+0000","last_peered":"2024-05-08T21:49:44.755912+0000","last_clean":"2024-05-08T21:49:44.755912+0000","last_became_active":"2024-05-08T21:49:43.764075+0000","last_became_peered":"2024-05-08T21:49:43.764075+0000","last_unstale":"2024-05-08T21:49:44.755912+0000","last_undegraded":"2024-05-08T21:49:44.755912+0000","last_fullsized":"2024-05-08T21:49:44.755912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:41:45.602022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.752001+0000","last_change":"2024-05-08T21:49:43.229414+0000","last_active":"2024-05-08T21:49:43.752001+0000","last_peered":"2024-05-08T21:49:43.752001+0000","last_clean":"2024-05-08T21:49:43.752001+0000","last_became_active":"2024-05-08T21:49:43.229121+0000","last_became_peered":"2024-05-08T21:49:43.229121+0000","last_unstale":"2024-05-08T21:49:43.752001+0000","last_undegraded":"2024-05-08T21:49:43.752001+0000","last_fullsized":"2024-05-08T21:49:43.752001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:33:28.074468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927480+0000","last_change":"2024-05-08T21:49:43.774111+0000","last_active":"2024-05-08T21:49:44.927480+0000","last_peered":"2024-05-08T21:49:44.927480+0000","last_clean":"2024-05-08T21:49:44.927480+0000","last_became_active":"2024-05-08T21:49:43.772528+0000","last_became_peered":"2024-05-08T21:49:43.772528+0000","last_unstale":"2024-05-08T21:49:44.927480+0000","last_undegraded":"2024-05-08T21:49:44.927480+0000","last_fullsized":"2024-05-08T21:49:44.927480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:28.983476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:46.015933+0000","last_change":"2024-05-08T21:49:43.208581+0000","last_active":"2024-05-08T21:49:46.015933+0000","last_peered":"2024-05-08T21:49:46.015933+0000","last_clean":"2024-05-08T21:49:46.015933+0000","last_became_active":"2024-05-08T21:49:43.208326+0000","last_became_peered":"2024-05-08T21:49:43.208326+0000","last_unstale":"2024-05-08T21:49:46.015933+0000","last_undegraded":"2024-05-08T21:49:46.015933+0000","last_fullsized":"2024-05-08T21:49:46.015933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:13:35.461791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756911+0000","last_change":"2024-05-08T21:49:43.766519+0000","last_active":"2024-05-08T21:49:44.756911+0000","last_peered":"2024-05-08T21:49:44.756911+0000","last_clean":"2024-05-08T21:49:44.756911+0000","last_became_active":"2024-05-08T21:49:43.765789+0000","last_became_peered":"2024-05-08T21:49:43.765789+0000","last_unstale":"2024-05-08T21:49:44.756911+0000","last_undegraded":"2024-05-08T21:49:44.756911+0000","last_fullsized":"2024-05-08T21:49:44.756911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:23.674986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:48.757658+0000","last_change":"2024-05-08T21:49:43.218079+0000","last_active":"2024-05-08T21:49:48.757658+0000","last_peered":"2024-05-08T21:49:48.757658+0000","last_clean":"2024-05-08T21:49:48.757658+0000","last_became_active":"2024-05-08T21:49:43.217814+0000","last_became_peered":"2024-05-08T21:49:43.217814+0000","last_unstale":"2024-05-08T21:49:48.757658+0000","last_undegraded":"2024-05-08T21:49:48.757658+0000","last_fullsized":"2024-05-08T21:49:48.757658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:18:58.164159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.928456+0000","last_change":"2024-05-08T21:49:43.775713+0000","last_active":"2024-05-08T21:49:44.928456+0000","last_peered":"2024-05-08T21:49:44.928456+0000","last_clean":"2024-05-08T21:49:44.928456+0000","last_became_active":"2024-05-08T21:49:43.775361+0000","last_became_peered":"2024-05-08T21:49:43.775361+0000","last_unstale":"2024-05-08T21:49:44.928456+0000","last_undegraded":"2024-05-08T21:49:44.928456+0000","last_fullsized":"2024-05-08T21:49:44.928456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:48:24.482146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755727+0000","last_change":"2024-05-08T21:49:43.767129+0000","last_active":"2024-05-08T21:49:44.755727+0000","last_peered":"2024-05-08T21:49:44.755727+0000","last_clean":"2024-05-08T21:49:44.755727+0000","last_became_active":"2024-05-08T21:49:43.766789+0000","last_became_peered":"2024-05-08T21:49:43.766789+0000","last_unstale":"2024-05-08T21:49:44.755727+0000","last_undegraded":"2024-05-08T21:49:44.755727+0000","last_fullsized":"2024-05-08T21:49:44.755727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:39.954320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927246+0000","last_change":"2024-05-08T21:49:43.766157+0000","last_active":"2024-05-08T21:49:44.927246+0000","last_peered":"2024-05-08T21:49:44.927246+0000","last_clean":"2024-05-08T21:49:44.927246+0000","last_became_active":"2024-05-08T21:49:43.765843+0000","last_became_peered":"2024-05-08T21:49:43.765843+0000","last_unstale":"2024-05-08T21:49:44.927246+0000","last_undegraded":"2024-05-08T21:49:44.927246+0000","last_fullsized":"2024-05-08T21:49:44.927246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:04.968184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757080+0000","last_change":"2024-05-08T21:49:43.768929+0000","last_active":"2024-05-08T21:49:44.757080+0000","last_peered":"2024-05-08T21:49:44.757080+0000","last_clean":"2024-05-08T21:49:44.757080+0000","last_became_active":"2024-05-08T21:49:43.767606+0000","last_became_peered":"2024-05-08T21:49:43.767606+0000","last_unstale":"2024-05-08T21:49:44.757080+0000","last_undegraded":"2024-05-08T21:49:44.757080+0000","last_fullsized":"2024-05-08T21:49:44.757080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:13:06.426154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927158+0000","last_change":"2024-05-08T21:49:43.774673+0000","last_active":"2024-05-08T21:49:44.927158+0000","last_peered":"2024-05-08T21:49:44.927158+0000","last_clean":"2024-05-08T21:49:44.927158+0000","last_became_active":"2024-05-08T21:49:43.774406+0000","last_became_peered":"2024-05-08T21:49:43.774406+0000","last_unstale":"2024-05-08T21:49:44.927158+0000","last_undegraded":"2024-05-08T21:49:44.927158+0000","last_fullsized":"2024-05-08T21:49:44.927158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:43.798909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927659+0000","last_change":"2024-05-08T21:49:43.764222+0000","last_active":"2024-05-08T21:49:44.927659+0000","last_peered":"2024-05-08T21:49:44.927659+0000","last_clean":"2024-05-08T21:49:44.927659+0000","last_became_active":"2024-05-08T21:49:43.763937+0000","last_became_peered":"2024-05-08T21:49:43.763937+0000","last_unstale":"2024-05-08T21:49:44.927659+0000","last_undegraded":"2024-05-08T21:49:44.927659+0000","last_fullsized":"2024-05-08T21:49:44.927659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:04:14.416894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755114+0000","last_change":"2024-05-08T21:49:43.757318+0000","last_active":"2024-05-08T21:49:44.755114+0000","last_peered":"2024-05-08T21:49:44.755114+0000","last_clean":"2024-05-08T21:49:44.755114+0000","last_became_active":"2024-05-08T21:49:43.757083+0000","last_became_peered":"2024-05-08T21:49:43.757083+0000","last_unstale":"2024-05-08T21:49:44.755114+0000","last_undegraded":"2024-05-08T21:49:44.755114+0000","last_fullsized":"2024-05-08T21:49:44.755114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:47.551474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756302+0000","last_change":"2024-05-08T21:49:43.773491+0000","last_active":"2024-05-08T21:49:44.756302+0000","last_peered":"2024-05-08T21:49:44.756302+0000","last_clean":"2024-05-08T21:49:44.756302+0000","last_became_active":"2024-05-08T21:49:43.773203+0000","last_became_peered":"2024-05-08T21:49:43.773203+0000","last_unstale":"2024-05-08T21:49:44.756302+0000","last_undegraded":"2024-05-08T21:49:44.756302+0000","last_fullsized":"2024-05-08T21:49:44.756302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:53:14.774835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927776+0000","last_change":"2024-05-08T21:49:43.761926+0000","last_active":"2024-05-08T21:49:44.927776+0000","last_peered":"2024-05-08T21:49:44.927776+0000","last_clean":"2024-05-08T21:49:44.927776+0000","last_became_active":"2024-05-08T21:49:43.761645+0000","last_became_peered":"2024-05-08T21:49:43.761645+0000","last_unstale":"2024-05-08T21:49:44.927776+0000","last_undegraded":"2024-05-08T21:49:44.927776+0000","last_fullsized":"2024-05-08T21:49:44.927776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:10:07.209965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756761+0000","last_change":"2024-05-08T21:49:43.768942+0000","last_active":"2024-05-08T21:49:44.756761+0000","last_peered":"2024-05-08T21:49:44.756761+0000","last_clean":"2024-05-08T21:49:44.756761+0000","last_became_active":"2024-05-08T21:49:43.768673+0000","last_became_peered":"2024-05-08T21:49:43.768673+0000","last_unstale":"2024-05-08T21:49:44.756761+0000","last_undegraded":"2024-05-08T21:49:44.756761+0000","last_fullsized":"2024-05-08T21:49:44.756761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:15:41.869107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927592+0000","last_change":"2024-05-08T21:49:43.766452+0000","last_active":"2024-05-08T21:49:44.927592+0000","last_peered":"2024-05-08T21:49:44.927592+0000","last_clean":"2024-05-08T21:49:44.927592+0000","last_became_active":"2024-05-08T21:49:43.765723+0000","last_became_peered":"2024-05-08T21:49:43.765723+0000","last_unstale":"2024-05-08T21:49:44.927592+0000","last_undegraded":"2024-05-08T21:49:44.927592+0000","last_fullsized":"2024-05-08T21:49:44.927592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:19:28.925404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756863+0000","last_change":"2024-05-08T21:49:43.775098+0000","last_active":"2024-05-08T21:49:44.756863+0000","last_peered":"2024-05-08T21:49:44.756863+0000","last_clean":"2024-05-08T21:49:44.756863+0000","last_became_active":"2024-05-08T21:49:43.774808+0000","last_became_peered":"2024-05-08T21:49:43.774808+0000","last_unstale":"2024-05-08T21:49:44.756863+0000","last_undegraded":"2024-05-08T21:49:44.756863+0000","last_fullsized":"2024-05-08T21:49:44.756863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:51:15.152611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927076+0000","last_change":"2024-05-08T21:49:43.775129+0000","last_active":"2024-05-08T21:49:44.927076+0000","last_peered":"2024-05-08T21:49:44.927076+0000","last_clean":"2024-05-08T21:49:44.927076+0000","last_became_active":"2024-05-08T21:49:43.774881+0000","last_became_peered":"2024-05-08T21:49:43.774881+0000","last_unstale":"2024-05-08T21:49:44.927076+0000","last_undegraded":"2024-05-08T21:49:44.927076+0000","last_fullsized":"2024-05-08T21:49:44.927076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:19:28.925404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756057+0000","last_change":"2024-05-08T21:49:43.764163+0000","last_active":"2024-05-08T21:49:44.756057+0000","last_peered":"2024-05-08T21:49:44.756057+0000","last_clean":"2024-05-08T21:49:44.756057+0000","last_became_active":"2024-05-08T21:49:43.763907+0000","last_became_peered":"2024-05-08T21:49:43.763907+0000","last_unstale":"2024-05-08T21:49:44.756057+0000","last_undegraded":"2024-05-08T21:49:44.756057+0000","last_fullsized":"2024-05-08T21:49:44.756057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:01:00.614249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":806912,"data_stored":664039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]}]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":221184,"data_stored":74653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3440000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.5359999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.329}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.371}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":212992,"data_stored":73179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":217088,"data_stored":73249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.0419999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6880000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0489999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5449999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.202}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.2249999999999996}]}]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":815104,"data_stored":664095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":208896,"data_stored":73089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]}]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":221184,"data_stored":74653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":221184,"data_stored":73215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T21:49:57.984 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T21:49:58.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.142+0000 7f2a8c5d0700 1 Processor -- start 2024-05-08T21:49:58.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.142+0000 7f2a8c5d0700 1 -- start start 2024-05-08T21:49:58.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.143+0000 7f2a8c5d0700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2a840c44e0 0x7f2a8415a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:58.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.143+0000 7f2a8c5d0700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2a840c7f50 0x7f2a8415a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:58.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.143+0000 7f2a8c5d0700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a8406fd20 con 0x7f2a84157550 2024-05-08T21:49:58.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.143+0000 7f2a8c5d0700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a8406cf10 con 0x7f2a840c44e0 2024-05-08T21:49:58.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.143+0000 7f2a8c5d0700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a8406d730 con 0x7f2a840c7f50 2024-05-08T21:49:58.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.143+0000 7f2a8a36c700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f2a84157550 0x7f2a840cd4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:51866/0 (socket says 172.21.15.73:51866) 2024-05-08T21:49:58.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.143+0000 7f2a8a36c700 1 -- 172.21.15.73:0/820879470 learned_addr learned my addr 172.21.15.73:0/820879470 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:49:58.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.143+0000 7f2a8936a700 1 -- 172.21.15.73:0/820879470 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3058368847 0 0) 0x7f2a8406fd20 con 0x7f2a84157550 2024-05-08T21:49:58.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.143+0000 7f2a8936a700 1 -- 172.21.15.73:0/820879470 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a700035b0 con 0x7f2a84157550 2024-05-08T21:49:58.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.143+0000 7f2a89b6b700 1 --2- 172.21.15.73:0/820879470 >> v2:172.21.15.115:3300/0 conn(0x7f2a840c44e0 0x7f2a8415a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:58.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.143+0000 7f2a8ab6d700 1 --2- 172.21.15.73:0/820879470 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2a840c7f50 0x7f2a8415a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:58.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.143+0000 7f2a8936a700 1 -- 172.21.15.73:0/820879470 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3940109828 0 0) 0x7f2a700035b0 con 0x7f2a84157550 2024-05-08T21:49:58.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.143+0000 7f2a8936a700 1 -- 172.21.15.73:0/820879470 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2a840c7f50 msgr2=0x7f2a8415a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:58.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.143+0000 7f2a8936a700 1 --2- 172.21.15.73:0/820879470 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2a840c7f50 0x7f2a8415a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:58.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.143+0000 7f2a8936a700 1 -- 172.21.15.73:0/820879470 >> v2:172.21.15.115:3300/0 conn(0x7f2a840c44e0 msgr2=0x7f2a8415a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:58.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.143+0000 7f2a8936a700 1 --2- 172.21.15.73:0/820879470 >> v2:172.21.15.115:3300/0 conn(0x7f2a840c44e0 0x7f2a8415a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:58.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.143+0000 7f2a8936a700 1 -- 172.21.15.73:0/820879470 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a84157930 con 0x7f2a84157550 2024-05-08T21:49:58.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.143+0000 7f2a8936a700 1 -- 172.21.15.73:0/820879470 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 953298616 0 0) 0x7f2a80001670 con 0x7f2a84157550 2024-05-08T21:49:58.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.143+0000 7f2a8936a700 1 -- 172.21.15.73:0/820879470 >> v1:172.21.15.73:6789/0 conn(0x7f2a84157550 legacy=0x7f2a840cd4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:58.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.143+0000 7f2a8936a700 1 --2- 172.21.15.73:0/820879470 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2a840c7f50 0x7f2a70003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:58.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.143+0000 7f2a8936a700 1 --2- 172.21.15.73:0/820879470 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a70003f80 0x7f2a70004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:58.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.143+0000 7f2a8936a700 1 --2- 172.21.15.73:0/820879470 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a70004d90 0x7f2a70005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:58.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.143+0000 7f2a8936a700 1 -- 172.21.15.73:0/820879470 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a8406cf10 con 0x7f2a70004d90 2024-05-08T21:49:58.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.144+0000 7f2a8936a700 1 -- 172.21.15.73:0/820879470 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7000ba10 con 0x7f2a70003f80 2024-05-08T21:49:58.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.144+0000 7f2a8936a700 1 -- 172.21.15.73:0/820879470 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7000bb50 con 0x7f2a840c7f50 2024-05-08T21:49:58.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.144+0000 7f2a8ab6d700 1 --2- 172.21.15.73:0/820879470 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a70004d90 0x7f2a70005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:58.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.144+0000 7f2a89b6b700 1 --2- 172.21.15.73:0/820879470 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a70003f80 0x7f2a70004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:58.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.144+0000 7f2a8a36c700 1 --2- 172.21.15.73:0/820879470 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2a840c7f50 0x7f2a70003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:58.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.144+0000 7f2a8ab6d700 1 -- 172.21.15.73:0/820879470 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2a840c7f50 msgr2=0x7f2a70003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:58.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.144+0000 7f2a8ab6d700 1 --2- 172.21.15.73:0/820879470 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2a840c7f50 0x7f2a70003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:58.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.144+0000 7f2a8ab6d700 1 -- 172.21.15.73:0/820879470 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a70003f80 msgr2=0x7f2a70004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:58.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.144+0000 7f2a8ab6d700 1 --2- 172.21.15.73:0/820879470 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a70003f80 0x7f2a70004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:58.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.144+0000 7f2a8ab6d700 1 -- 172.21.15.73:0/820879470 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a700035b0 con 0x7f2a70004d90 2024-05-08T21:49:58.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.144+0000 7f2a8ab6d700 1 --2- 172.21.15.73:0/820879470 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a70004d90 0x7f2a70005210 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c009f90 tx=0x7f2a70005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=636738170d8ba9db server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:58.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.144+0000 7f2a8936a700 1 -- 172.21.15.73:0/820879470 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c00eb70 con 0x7f2a70004d90 2024-05-08T21:49:58.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.144+0000 7f2a8936a700 1 -- 172.21.15.73:0/820879470 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a7c00f040 con 0x7f2a70004d90 2024-05-08T21:49:58.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.144+0000 7f2a8936a700 1 -- 172.21.15.73:0/820879470 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c014480 con 0x7f2a70004d90 2024-05-08T21:49:58.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.145+0000 7f2a8c5d0700 1 -- 172.21.15.73:0/820879470 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a70004d90 msgr2=0x7f2a70005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:58.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.145+0000 7f2a8c5d0700 1 --2- 172.21.15.73:0/820879470 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a70004d90 0x7f2a70005210 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c009f90 tx=0x7f2a70005880 comp rx=0 tx=0).stop 2024-05-08T21:49:58.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.145+0000 7f2a8ab6d700 1 -- 172.21.15.73:0/820879470 reap_dead start 2024-05-08T21:49:58.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.145+0000 7f2a8c5d0700 1 -- 172.21.15.73:0/820879470 shutdown_connections 2024-05-08T21:49:58.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.145+0000 7f2a8c5d0700 1 -- 172.21.15.73:0/820879470 >> 172.21.15.73:0/820879470 conn(0x7f2a8406ae10 msgr2=0x7f2a840666c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:58.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.145+0000 7f2a8c5d0700 1 -- 172.21.15.73:0/820879470 shutdown_connections 2024-05-08T21:49:58.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.145+0000 7f2a8c5d0700 1 -- 172.21.15.73:0/820879470 wait complete. 2024-05-08T21:49:58.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.146+0000 7f2a8c5d0700 1 Processor -- start 2024-05-08T21:49:58.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.146+0000 7f2a8c5d0700 1 -- start start 2024-05-08T21:49:58.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.147+0000 7f2a8c5d0700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a70004d90 0x7f2a840b2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:58.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.147+0000 7f2a8c5d0700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2a841f0f80 0x7f2a840c6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:58.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.147+0000 7f2a8c5d0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a841553d0 0x7f2a84152ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:58.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.147+0000 7f2a8c5d0700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a840c79e0 con 0x7f2a841553d0 2024-05-08T21:49:58.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.147+0000 7f2a8c5d0700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a841e6cc0 con 0x7f2a70004d90 2024-05-08T21:49:58.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.147+0000 7f2a8c5d0700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a8406ca20 con 0x7f2a841f0f80 2024-05-08T21:49:58.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.147+0000 7f2a8ab6d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a841553d0 0x7f2a84152ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:58.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.147+0000 7f2a8ab6d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a841553d0 0x7f2a84152ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39196/0 (socket says 172.21.15.73:39196) 2024-05-08T21:49:58.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.147+0000 7f2a8ab6d700 1 -- 172.21.15.73:0/216851985 learned_addr learned my addr 172.21.15.73:0/216851985 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:58.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.147+0000 7f2a8a36c700 1 --2- 172.21.15.73:0/216851985 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a70004d90 0x7f2a840b2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:58.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.147+0000 7f2a89b6b700 1 --2- 172.21.15.73:0/216851985 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2a841f0f80 0x7f2a840c6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:58.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.147+0000 7f2a8ab6d700 1 -- 172.21.15.73:0/216851985 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2a841f0f80 msgr2=0x7f2a840c6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:58.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.147+0000 7f2a8ab6d700 1 --2- 172.21.15.73:0/216851985 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2a841f0f80 0x7f2a840c6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:58.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.147+0000 7f2a8ab6d700 1 -- 172.21.15.73:0/216851985 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a70004d90 msgr2=0x7f2a840b2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:58.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.147+0000 7f2a8ab6d700 1 --2- 172.21.15.73:0/216851985 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a70004d90 0x7f2a840b2280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:58.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.147+0000 7f2a8ab6d700 1 -- 172.21.15.73:0/216851985 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a8406cc70 con 0x7f2a841553d0 2024-05-08T21:49:58.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.147+0000 7f2a8ab6d700 1 --2- 172.21.15.73:0/216851985 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a841553d0 0x7f2a84152ec0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c016000 tx=0x7f2a7c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:58.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.147+0000 7f2a7affd700 1 -- 172.21.15.73:0/216851985 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c007000 con 0x7f2a841553d0 2024-05-08T21:49:58.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.147+0000 7f2a7affd700 1 -- 172.21.15.73:0/216851985 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a7c014c90 con 0x7f2a841553d0 2024-05-08T21:49:58.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.147+0000 7f2a7affd700 1 -- 172.21.15.73:0/216851985 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c003a20 con 0x7f2a841553d0 2024-05-08T21:49:58.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.147+0000 7f2a8c5d0700 1 -- 172.21.15.73:0/216851985 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a840c7700 con 0x7f2a841553d0 2024-05-08T21:49:58.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.147+0000 7f2a8c5d0700 1 -- 172.21.15.73:0/216851985 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a840b27c0 con 0x7f2a841553d0 2024-05-08T21:49:58.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.148+0000 7f2a8c5d0700 1 -- 172.21.15.73:0/216851985 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a841e67b0 con 0x7f2a841553d0 2024-05-08T21:49:58.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.149+0000 7f2a7affd700 1 -- 172.21.15.73:0/216851985 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2a7c023070 con 0x7f2a841553d0 2024-05-08T21:49:58.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.149+0000 7f2a7affd700 1 --2- 172.21.15.73:0/216851985 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f2a6806ac90 0x7f2a6806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:58.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.149+0000 7f2a7affd700 1 -- 172.21.15.73:0/216851985 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2a7c08a330 con 0x7f2a841553d0 2024-05-08T21:49:58.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.149+0000 7f2a8a36c700 1 --2- 172.21.15.73:0/216851985 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f2a6806ac90 0x7f2a6806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:58.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.149+0000 7f2a8a36c700 1 --2- 172.21.15.73:0/216851985 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f2a6806ac90 0x7f2a6806d150 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2a800015d0 tx=0x7f2a80007980 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:58.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.154+0000 7f2a7affd700 1 -- 172.21.15.73:0/216851985 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f2a841e67b0 con 0x7f2a841553d0 2024-05-08T21:49:58.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.347+0000 7f2a8c5d0700 1 -- 172.21.15.73:0/216851985 --> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2a840b2110 con 0x7f2a6806ac90 2024-05-08T21:49:58.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.354+0000 7f2a7affd700 1 -- 172.21.15.73:0/216851985 <== mgr.4104 v2:172.21.15.73:6832/46949 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264527 (secure 0 0 0) 0x7f2a840b2110 con 0x7f2a6806ac90 2024-05-08T21:49:58.358 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:49:58.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.357+0000 7f2a8c5d0700 1 -- 172.21.15.73:0/216851985 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f2a6806ac90 msgr2=0x7f2a6806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:58.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.357+0000 7f2a8c5d0700 1 --2- 172.21.15.73:0/216851985 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f2a6806ac90 0x7f2a6806d150 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2a800015d0 tx=0x7f2a80007980 comp rx=0 tx=0).stop 2024-05-08T21:49:58.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.357+0000 7f2a8c5d0700 1 -- 172.21.15.73:0/216851985 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a841553d0 msgr2=0x7f2a84152ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:58.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.357+0000 7f2a8c5d0700 1 --2- 172.21.15.73:0/216851985 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a841553d0 0x7f2a84152ec0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c016000 tx=0x7f2a7c009750 comp rx=0 tx=0).stop 2024-05-08T21:49:58.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.357+0000 7f2a8c5d0700 1 -- 172.21.15.73:0/216851985 shutdown_connections 2024-05-08T21:49:58.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.357+0000 7f2a8c5d0700 1 --2- 172.21.15.73:0/216851985 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f2a6806ac90 0x7f2a6806d150 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:58.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.357+0000 7f2a8c5d0700 1 --2- 172.21.15.73:0/216851985 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a841553d0 0x7f2a84152ec0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:58.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.357+0000 7f2a8c5d0700 1 --2- 172.21.15.73:0/216851985 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a70004d90 0x7f2a840b2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:58.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.357+0000 7f2a8c5d0700 1 --2- 172.21.15.73:0/216851985 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2a841f0f80 0x7f2a840c6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:58.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.357+0000 7f2a8c5d0700 1 -- 172.21.15.73:0/216851985 >> 172.21.15.73:0/216851985 conn(0x7f2a8406ae10 msgr2=0x7f2a84156750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:58.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.357+0000 7f2a8c5d0700 1 -- 172.21.15.73:0/216851985 shutdown_connections 2024-05-08T21:49:58.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.357+0000 7f2a8c5d0700 1 -- 172.21.15.73:0/216851985 wait complete. 2024-05-08T21:49:58.361 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-05-08T21:49:58.370 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-05-08T21:49:57.958527+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218984,"kb_used_data":2856,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755736,"statfs":{"total":773094113280,"available":772869873664,"internally_reserved":0,"allocated":2924544,"data_stored":1770172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007979"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.928360+0000","last_change":"2024-05-08T21:49:43.775912+0000","last_active":"2024-05-08T21:49:44.928360+0000","last_peered":"2024-05-08T21:49:44.928360+0000","last_clean":"2024-05-08T21:49:44.928360+0000","last_became_active":"2024-05-08T21:49:43.775657+0000","last_became_peered":"2024-05-08T21:49:43.775657+0000","last_unstale":"2024-05-08T21:49:44.928360+0000","last_undegraded":"2024-05-08T21:49:44.928360+0000","last_fullsized":"2024-05-08T21:49:44.928360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:10:07.209965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755108+0000","last_change":"2024-05-08T21:49:43.766984+0000","last_active":"2024-05-08T21:49:44.755108+0000","last_peered":"2024-05-08T21:49:44.755108+0000","last_clean":"2024-05-08T21:49:44.755108+0000","last_became_active":"2024-05-08T21:49:43.765995+0000","last_became_peered":"2024-05-08T21:49:43.765995+0000","last_unstale":"2024-05-08T21:49:44.755108+0000","last_undegraded":"2024-05-08T21:49:44.755108+0000","last_fullsized":"2024-05-08T21:49:44.755108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:21:41.238890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.926947+0000","last_change":"2024-05-08T21:49:43.766107+0000","last_active":"2024-05-08T21:49:44.926947+0000","last_peered":"2024-05-08T21:49:44.926947+0000","last_clean":"2024-05-08T21:49:44.926947+0000","last_became_active":"2024-05-08T21:49:43.765874+0000","last_became_peered":"2024-05-08T21:49:43.765874+0000","last_unstale":"2024-05-08T21:49:44.926947+0000","last_undegraded":"2024-05-08T21:49:44.926947+0000","last_fullsized":"2024-05-08T21:49:44.926947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:06:50.769169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757017+0000","last_change":"2024-05-08T21:49:43.766355+0000","last_active":"2024-05-08T21:49:44.757017+0000","last_peered":"2024-05-08T21:49:44.757017+0000","last_clean":"2024-05-08T21:49:44.757017+0000","last_became_active":"2024-05-08T21:49:43.765507+0000","last_became_peered":"2024-05-08T21:49:43.765507+0000","last_unstale":"2024-05-08T21:49:44.757017+0000","last_undegraded":"2024-05-08T21:49:44.757017+0000","last_fullsized":"2024-05-08T21:49:44.757017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:09:09.676078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927361+0000","last_change":"2024-05-08T21:49:43.770346+0000","last_active":"2024-05-08T21:49:44.927361+0000","last_peered":"2024-05-08T21:49:44.927361+0000","last_clean":"2024-05-08T21:49:44.927361+0000","last_became_active":"2024-05-08T21:49:43.770067+0000","last_became_peered":"2024-05-08T21:49:43.770067+0000","last_unstale":"2024-05-08T21:49:44.927361+0000","last_undegraded":"2024-05-08T21:49:44.927361+0000","last_fullsized":"2024-05-08T21:49:44.927361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:04:14.416894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756907+0000","last_change":"2024-05-08T21:49:43.771390+0000","last_active":"2024-05-08T21:49:44.756907+0000","last_peered":"2024-05-08T21:49:44.756907+0000","last_clean":"2024-05-08T21:49:44.756907+0000","last_became_active":"2024-05-08T21:49:43.770893+0000","last_became_peered":"2024-05-08T21:49:43.770893+0000","last_unstale":"2024-05-08T21:49:44.756907+0000","last_undegraded":"2024-05-08T21:49:44.756907+0000","last_fullsized":"2024-05-08T21:49:44.756907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:28.979468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927055+0000","last_change":"2024-05-08T21:49:43.769981+0000","last_active":"2024-05-08T21:49:44.927055+0000","last_peered":"2024-05-08T21:49:44.927055+0000","last_clean":"2024-05-08T21:49:44.927055+0000","last_became_active":"2024-05-08T21:49:43.769667+0000","last_became_peered":"2024-05-08T21:49:43.769667+0000","last_unstale":"2024-05-08T21:49:44.927055+0000","last_undegraded":"2024-05-08T21:49:44.927055+0000","last_fullsized":"2024-05-08T21:49:44.927055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:12:00.381761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927368+0000","last_change":"2024-05-08T21:49:43.771078+0000","last_active":"2024-05-08T21:49:44.927368+0000","last_peered":"2024-05-08T21:49:44.927368+0000","last_clean":"2024-05-08T21:49:44.927368+0000","last_became_active":"2024-05-08T21:49:43.770912+0000","last_became_peered":"2024-05-08T21:49:43.770912+0000","last_unstale":"2024-05-08T21:49:44.927368+0000","last_undegraded":"2024-05-08T21:49:44.927368+0000","last_fullsized":"2024-05-08T21:49:44.927368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:12:00.381761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.928368+0000","last_change":"2024-05-08T21:49:43.775880+0000","last_active":"2024-05-08T21:49:44.928368+0000","last_peered":"2024-05-08T21:49:44.928368+0000","last_clean":"2024-05-08T21:49:44.928368+0000","last_became_active":"2024-05-08T21:49:43.775404+0000","last_became_peered":"2024-05-08T21:49:43.775404+0000","last_unstale":"2024-05-08T21:49:44.928368+0000","last_undegraded":"2024-05-08T21:49:44.928368+0000","last_fullsized":"2024-05-08T21:49:44.928368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:23:24.559669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756369+0000","last_change":"2024-05-08T21:49:43.772784+0000","last_active":"2024-05-08T21:49:44.756369+0000","last_peered":"2024-05-08T21:49:44.756369+0000","last_clean":"2024-05-08T21:49:44.756369+0000","last_became_active":"2024-05-08T21:49:43.772505+0000","last_became_peered":"2024-05-08T21:49:43.772505+0000","last_unstale":"2024-05-08T21:49:44.756369+0000","last_undegraded":"2024-05-08T21:49:44.756369+0000","last_fullsized":"2024-05-08T21:49:44.756369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:19:28.925404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756079+0000","last_change":"2024-05-08T21:49:43.771781+0000","last_active":"2024-05-08T21:49:44.756079+0000","last_peered":"2024-05-08T21:49:44.756079+0000","last_clean":"2024-05-08T21:49:44.756079+0000","last_became_active":"2024-05-08T21:49:43.771457+0000","last_became_peered":"2024-05-08T21:49:43.771457+0000","last_unstale":"2024-05-08T21:49:44.756079+0000","last_undegraded":"2024-05-08T21:49:44.756079+0000","last_fullsized":"2024-05-08T21:49:44.756079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:43.798909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927611+0000","last_change":"2024-05-08T21:49:43.764249+0000","last_active":"2024-05-08T21:49:44.927611+0000","last_peered":"2024-05-08T21:49:44.927611+0000","last_clean":"2024-05-08T21:49:44.927611+0000","last_became_active":"2024-05-08T21:49:43.763986+0000","last_became_peered":"2024-05-08T21:49:43.763986+0000","last_unstale":"2024-05-08T21:49:44.927611+0000","last_undegraded":"2024-05-08T21:49:44.927611+0000","last_fullsized":"2024-05-08T21:49:44.927611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:33:13.833915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927054+0000","last_change":"2024-05-08T21:49:43.761127+0000","last_active":"2024-05-08T21:49:44.927054+0000","last_peered":"2024-05-08T21:49:44.927054+0000","last_clean":"2024-05-08T21:49:44.927054+0000","last_became_active":"2024-05-08T21:49:43.760874+0000","last_became_peered":"2024-05-08T21:49:43.760874+0000","last_unstale":"2024-05-08T21:49:44.927054+0000","last_undegraded":"2024-05-08T21:49:44.927054+0000","last_fullsized":"2024-05-08T21:49:44.927054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:17:34.570817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.926846+0000","last_change":"2024-05-08T21:49:43.765829+0000","last_active":"2024-05-08T21:49:44.926846+0000","last_peered":"2024-05-08T21:49:44.926846+0000","last_clean":"2024-05-08T21:49:44.926846+0000","last_became_active":"2024-05-08T21:49:43.765566+0000","last_became_peered":"2024-05-08T21:49:43.765566+0000","last_unstale":"2024-05-08T21:49:44.926846+0000","last_undegraded":"2024-05-08T21:49:44.926846+0000","last_fullsized":"2024-05-08T21:49:44.926846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:39.954320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.754916+0000","last_change":"2024-05-08T21:49:43.765080+0000","last_active":"2024-05-08T21:49:44.754916+0000","last_peered":"2024-05-08T21:49:44.754916+0000","last_clean":"2024-05-08T21:49:44.754916+0000","last_became_active":"2024-05-08T21:49:43.764810+0000","last_became_peered":"2024-05-08T21:49:43.764810+0000","last_unstale":"2024-05-08T21:49:44.754916+0000","last_undegraded":"2024-05-08T21:49:44.754916+0000","last_fullsized":"2024-05-08T21:49:44.754916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:24:11.223913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756634+0000","last_change":"2024-05-08T21:49:43.766717+0000","last_active":"2024-05-08T21:49:44.756634+0000","last_peered":"2024-05-08T21:49:44.756634+0000","last_clean":"2024-05-08T21:49:44.756634+0000","last_became_active":"2024-05-08T21:49:43.766427+0000","last_became_peered":"2024-05-08T21:49:43.766427+0000","last_unstale":"2024-05-08T21:49:44.756634+0000","last_undegraded":"2024-05-08T21:49:44.756634+0000","last_fullsized":"2024-05-08T21:49:44.756634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:49:22.833820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757256+0000","last_change":"2024-05-08T21:49:43.776929+0000","last_active":"2024-05-08T21:49:44.757256+0000","last_peered":"2024-05-08T21:49:44.757256+0000","last_clean":"2024-05-08T21:49:44.757256+0000","last_became_active":"2024-05-08T21:49:43.776509+0000","last_became_peered":"2024-05-08T21:49:43.776509+0000","last_unstale":"2024-05-08T21:49:44.757256+0000","last_undegraded":"2024-05-08T21:49:44.757256+0000","last_fullsized":"2024-05-08T21:49:44.757256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:26.199459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.926679+0000","last_change":"2024-05-08T21:49:43.762646+0000","last_active":"2024-05-08T21:49:44.926679+0000","last_peered":"2024-05-08T21:49:44.926679+0000","last_clean":"2024-05-08T21:49:44.926679+0000","last_became_active":"2024-05-08T21:49:43.762237+0000","last_became_peered":"2024-05-08T21:49:43.762237+0000","last_unstale":"2024-05-08T21:49:44.926679+0000","last_undegraded":"2024-05-08T21:49:44.926679+0000","last_fullsized":"2024-05-08T21:49:44.926679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:46:08.821947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927249+0000","last_change":"2024-05-08T21:49:43.774729+0000","last_active":"2024-05-08T21:49:44.927249+0000","last_peered":"2024-05-08T21:49:44.927249+0000","last_clean":"2024-05-08T21:49:44.927249+0000","last_became_active":"2024-05-08T21:49:43.774450+0000","last_became_peered":"2024-05-08T21:49:43.774450+0000","last_unstale":"2024-05-08T21:49:44.927249+0000","last_undegraded":"2024-05-08T21:49:44.927249+0000","last_fullsized":"2024-05-08T21:49:44.927249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:25.661350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:48.760475+0000","last_change":"2024-05-08T21:49:43.219461+0000","last_active":"2024-05-08T21:49:48.760475+0000","last_peered":"2024-05-08T21:49:48.760475+0000","last_clean":"2024-05-08T21:49:48.760475+0000","last_became_active":"2024-05-08T21:49:43.219161+0000","last_became_peered":"2024-05-08T21:49:43.219161+0000","last_unstale":"2024-05-08T21:49:48.760475+0000","last_undegraded":"2024-05-08T21:49:48.760475+0000","last_fullsized":"2024-05-08T21:49:48.760475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:02:45.778415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927036+0000","last_change":"2024-05-08T21:49:43.764252+0000","last_active":"2024-05-08T21:49:44.927036+0000","last_peered":"2024-05-08T21:49:44.927036+0000","last_clean":"2024-05-08T21:49:44.927036+0000","last_became_active":"2024-05-08T21:49:43.764045+0000","last_became_peered":"2024-05-08T21:49:43.764045+0000","last_unstale":"2024-05-08T21:49:44.927036+0000","last_undegraded":"2024-05-08T21:49:44.927036+0000","last_fullsized":"2024-05-08T21:49:44.927036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:43.798909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927120+0000","last_change":"2024-05-08T21:49:43.221599+0000","last_active":"2024-05-08T21:49:44.927120+0000","last_peered":"2024-05-08T21:49:44.927120+0000","last_clean":"2024-05-08T21:49:44.927120+0000","last_became_active":"2024-05-08T21:49:43.221309+0000","last_became_peered":"2024-05-08T21:49:43.221309+0000","last_unstale":"2024-05-08T21:49:44.927120+0000","last_undegraded":"2024-05-08T21:49:44.927120+0000","last_fullsized":"2024-05-08T21:49:44.927120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:17.379362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927796+0000","last_change":"2024-05-08T21:49:43.771523+0000","last_active":"2024-05-08T21:49:44.927796+0000","last_peered":"2024-05-08T21:49:44.927796+0000","last_clean":"2024-05-08T21:49:44.927796+0000","last_became_active":"2024-05-08T21:49:43.771295+0000","last_became_peered":"2024-05-08T21:49:43.771295+0000","last_unstale":"2024-05-08T21:49:44.927796+0000","last_undegraded":"2024-05-08T21:49:44.927796+0000","last_fullsized":"2024-05-08T21:49:44.927796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:53:14.774835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:48.755678+0000","last_change":"2024-05-08T21:49:43.226637+0000","last_active":"2024-05-08T21:49:48.755678+0000","last_peered":"2024-05-08T21:49:48.755678+0000","last_clean":"2024-05-08T21:49:48.755678+0000","last_became_active":"2024-05-08T21:49:43.226284+0000","last_became_peered":"2024-05-08T21:49:43.226284+0000","last_unstale":"2024-05-08T21:49:48.755678+0000","last_undegraded":"2024-05-08T21:49:48.755678+0000","last_fullsized":"2024-05-08T21:49:48.755678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:01.844011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756849+0000","last_change":"2024-05-08T21:49:43.766694+0000","last_active":"2024-05-08T21:49:44.756849+0000","last_peered":"2024-05-08T21:49:44.756849+0000","last_clean":"2024-05-08T21:49:44.756849+0000","last_became_active":"2024-05-08T21:49:43.766079+0000","last_became_peered":"2024-05-08T21:49:43.766079+0000","last_unstale":"2024-05-08T21:49:44.756849+0000","last_undegraded":"2024-05-08T21:49:44.756849+0000","last_fullsized":"2024-05-08T21:49:44.756849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:01:16.682080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:48.755619+0000","last_change":"2024-05-08T21:49:43.230152+0000","last_active":"2024-05-08T21:49:48.755619+0000","last_peered":"2024-05-08T21:49:48.755619+0000","last_clean":"2024-05-08T21:49:48.755619+0000","last_became_active":"2024-05-08T21:49:43.229891+0000","last_became_peered":"2024-05-08T21:49:43.229891+0000","last_unstale":"2024-05-08T21:49:48.755619+0000","last_undegraded":"2024-05-08T21:49:48.755619+0000","last_fullsized":"2024-05-08T21:49:48.755619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:33:12.827218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757018+0000","last_change":"2024-05-08T21:49:43.771097+0000","last_active":"2024-05-08T21:49:44.757018+0000","last_peered":"2024-05-08T21:49:44.757018+0000","last_clean":"2024-05-08T21:49:44.757018+0000","last_became_active":"2024-05-08T21:49:43.770727+0000","last_became_peered":"2024-05-08T21:49:43.770727+0000","last_unstale":"2024-05-08T21:49:44.757018+0000","last_undegraded":"2024-05-08T21:49:44.757018+0000","last_fullsized":"2024-05-08T21:49:44.757018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:24:02.741766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927211+0000","last_change":"2024-05-08T21:49:43.220418+0000","last_active":"2024-05-08T21:49:44.927211+0000","last_peered":"2024-05-08T21:49:44.927211+0000","last_clean":"2024-05-08T21:49:44.927211+0000","last_became_active":"2024-05-08T21:49:43.220090+0000","last_became_peered":"2024-05-08T21:49:43.220090+0000","last_unstale":"2024-05-08T21:49:44.927211+0000","last_undegraded":"2024-05-08T21:49:44.927211+0000","last_fullsized":"2024-05-08T21:49:44.927211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:33:28.074468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927692+0000","last_change":"2024-05-08T21:49:43.762664+0000","last_active":"2024-05-08T21:49:44.927692+0000","last_peered":"2024-05-08T21:49:44.927692+0000","last_clean":"2024-05-08T21:49:44.927692+0000","last_became_active":"2024-05-08T21:49:43.762351+0000","last_became_peered":"2024-05-08T21:49:43.762351+0000","last_unstale":"2024-05-08T21:49:44.927692+0000","last_undegraded":"2024-05-08T21:49:44.927692+0000","last_fullsized":"2024-05-08T21:49:44.927692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:53.330614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756121+0000","last_change":"2024-05-08T21:49:43.220518+0000","last_active":"2024-05-08T21:49:44.756121+0000","last_peered":"2024-05-08T21:49:44.756121+0000","last_clean":"2024-05-08T21:49:44.756121+0000","last_became_active":"2024-05-08T21:49:43.218473+0000","last_became_peered":"2024-05-08T21:49:43.218473+0000","last_unstale":"2024-05-08T21:49:44.756121+0000","last_undegraded":"2024-05-08T21:49:44.756121+0000","last_fullsized":"2024-05-08T21:49:44.756121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:10.497167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927324+0000","last_change":"2024-05-08T21:49:43.770935+0000","last_active":"2024-05-08T21:49:44.927324+0000","last_peered":"2024-05-08T21:49:44.927324+0000","last_clean":"2024-05-08T21:49:44.927324+0000","last_became_active":"2024-05-08T21:49:43.770677+0000","last_became_peered":"2024-05-08T21:49:43.770677+0000","last_unstale":"2024-05-08T21:49:44.927324+0000","last_undegraded":"2024-05-08T21:49:44.927324+0000","last_fullsized":"2024-05-08T21:49:44.927324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:04:14.416894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.752777+0000","last_change":"2024-05-08T21:49:43.221027+0000","last_active":"2024-05-08T21:49:43.752777+0000","last_peered":"2024-05-08T21:49:43.752777+0000","last_clean":"2024-05-08T21:49:43.752777+0000","last_became_active":"2024-05-08T21:49:43.220780+0000","last_became_peered":"2024-05-08T21:49:43.220780+0000","last_unstale":"2024-05-08T21:49:43.752777+0000","last_undegraded":"2024-05-08T21:49:43.752777+0000","last_fullsized":"2024-05-08T21:49:43.752777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:20:34.123736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927461+0000","last_change":"2024-05-08T21:49:43.766815+0000","last_active":"2024-05-08T21:49:44.927461+0000","last_peered":"2024-05-08T21:49:44.927461+0000","last_clean":"2024-05-08T21:49:44.927461+0000","last_became_active":"2024-05-08T21:49:43.766568+0000","last_became_peered":"2024-05-08T21:49:43.766568+0000","last_unstale":"2024-05-08T21:49:44.927461+0000","last_undegraded":"2024-05-08T21:49:44.927461+0000","last_fullsized":"2024-05-08T21:49:44.927461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:41:45.602022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756625+0000","last_change":"2024-05-08T21:49:43.225299+0000","last_active":"2024-05-08T21:49:44.756625+0000","last_peered":"2024-05-08T21:49:44.756625+0000","last_clean":"2024-05-08T21:49:44.756625+0000","last_became_active":"2024-05-08T21:49:43.225057+0000","last_became_peered":"2024-05-08T21:49:43.225057+0000","last_unstale":"2024-05-08T21:49:44.756625+0000","last_undegraded":"2024-05-08T21:49:44.756625+0000","last_fullsized":"2024-05-08T21:49:44.756625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:38:43.069159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755021+0000","last_change":"2024-05-08T21:49:43.757361+0000","last_active":"2024-05-08T21:49:44.755021+0000","last_peered":"2024-05-08T21:49:44.755021+0000","last_clean":"2024-05-08T21:49:44.755021+0000","last_became_active":"2024-05-08T21:49:43.757092+0000","last_became_peered":"2024-05-08T21:49:43.757092+0000","last_unstale":"2024-05-08T21:49:44.755021+0000","last_undegraded":"2024-05-08T21:49:44.755021+0000","last_fullsized":"2024-05-08T21:49:44.755021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:24:02.741766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.756381+0000","last_change":"2024-05-08T21:49:43.229405+0000","last_active":"2024-05-08T21:49:43.756381+0000","last_peered":"2024-05-08T21:49:43.756381+0000","last_clean":"2024-05-08T21:49:43.756381+0000","last_became_active":"2024-05-08T21:49:43.229105+0000","last_became_peered":"2024-05-08T21:49:43.229105+0000","last_unstale":"2024-05-08T21:49:43.756381+0000","last_undegraded":"2024-05-08T21:49:43.756381+0000","last_fullsized":"2024-05-08T21:49:43.756381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:18:58.164159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757172+0000","last_change":"2024-05-08T21:49:43.773243+0000","last_active":"2024-05-08T21:49:44.757172+0000","last_peered":"2024-05-08T21:49:44.757172+0000","last_clean":"2024-05-08T21:49:44.757172+0000","last_became_active":"2024-05-08T21:49:43.772944+0000","last_became_peered":"2024-05-08T21:49:43.772944+0000","last_unstale":"2024-05-08T21:49:44.757172+0000","last_undegraded":"2024-05-08T21:49:44.757172+0000","last_fullsized":"2024-05-08T21:49:44.757172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:21:41.238890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757107+0000","last_change":"2024-05-08T21:49:43.224999+0000","last_active":"2024-05-08T21:49:44.757107+0000","last_peered":"2024-05-08T21:49:44.757107+0000","last_clean":"2024-05-08T21:49:44.757107+0000","last_became_active":"2024-05-08T21:49:43.223476+0000","last_became_peered":"2024-05-08T21:49:43.223476+0000","last_unstale":"2024-05-08T21:49:44.757107+0000","last_undegraded":"2024-05-08T21:49:44.757107+0000","last_fullsized":"2024-05-08T21:49:44.757107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:09:12.983430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927734+0000","last_change":"2024-05-08T21:49:43.771526+0000","last_active":"2024-05-08T21:49:44.927734+0000","last_peered":"2024-05-08T21:49:44.927734+0000","last_clean":"2024-05-08T21:49:44.927734+0000","last_became_active":"2024-05-08T21:49:43.771279+0000","last_became_peered":"2024-05-08T21:49:43.771279+0000","last_unstale":"2024-05-08T21:49:44.927734+0000","last_undegraded":"2024-05-08T21:49:44.927734+0000","last_fullsized":"2024-05-08T21:49:44.927734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:41:45.602022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:48.757392+0000","last_change":"2024-05-08T21:49:43.224378+0000","last_active":"2024-05-08T21:49:48.757392+0000","last_peered":"2024-05-08T21:49:48.757392+0000","last_clean":"2024-05-08T21:49:48.757392+0000","last_became_active":"2024-05-08T21:49:43.224164+0000","last_became_peered":"2024-05-08T21:49:43.224164+0000","last_unstale":"2024-05-08T21:49:48.757392+0000","last_undegraded":"2024-05-08T21:49:48.757392+0000","last_fullsized":"2024-05-08T21:49:48.757392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:06:10.276907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927552+0000","last_change":"2024-05-08T21:49:43.772948+0000","last_active":"2024-05-08T21:49:44.927552+0000","last_peered":"2024-05-08T21:49:44.927552+0000","last_clean":"2024-05-08T21:49:44.927552+0000","last_became_active":"2024-05-08T21:49:43.772685+0000","last_became_peered":"2024-05-08T21:49:43.772685+0000","last_unstale":"2024-05-08T21:49:44.927552+0000","last_undegraded":"2024-05-08T21:49:44.927552+0000","last_fullsized":"2024-05-08T21:49:44.927552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:02.850708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:48.760794+0000","last_change":"2024-05-08T21:49:43.222308+0000","last_active":"2024-05-08T21:49:48.760794+0000","last_peered":"2024-05-08T21:49:48.760794+0000","last_clean":"2024-05-08T21:49:48.760794+0000","last_became_active":"2024-05-08T21:49:43.221844+0000","last_became_peered":"2024-05-08T21:49:43.221844+0000","last_unstale":"2024-05-08T21:49:48.760794+0000","last_undegraded":"2024-05-08T21:49:48.760794+0000","last_fullsized":"2024-05-08T21:49:48.760794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:17.379362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927374+0000","last_change":"2024-05-08T21:49:43.773923+0000","last_active":"2024-05-08T21:49:44.927374+0000","last_peered":"2024-05-08T21:49:44.927374+0000","last_clean":"2024-05-08T21:49:44.927374+0000","last_became_active":"2024-05-08T21:49:43.772037+0000","last_became_peered":"2024-05-08T21:49:43.772037+0000","last_unstale":"2024-05-08T21:49:44.927374+0000","last_undegraded":"2024-05-08T21:49:44.927374+0000","last_fullsized":"2024-05-08T21:49:44.927374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:52:32.629407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:48.757374+0000","last_change":"2024-05-08T21:49:43.219473+0000","last_active":"2024-05-08T21:49:48.757374+0000","last_peered":"2024-05-08T21:49:48.757374+0000","last_clean":"2024-05-08T21:49:48.757374+0000","last_became_active":"2024-05-08T21:49:43.219186+0000","last_became_peered":"2024-05-08T21:49:43.219186+0000","last_unstale":"2024-05-08T21:49:48.757374+0000","last_undegraded":"2024-05-08T21:49:48.757374+0000","last_fullsized":"2024-05-08T21:49:48.757374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:20:34.123736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.926751+0000","last_change":"2024-05-08T21:49:43.775135+0000","last_active":"2024-05-08T21:49:44.926751+0000","last_peered":"2024-05-08T21:49:44.926751+0000","last_clean":"2024-05-08T21:49:44.926751+0000","last_became_active":"2024-05-08T21:49:43.774919+0000","last_became_peered":"2024-05-08T21:49:43.774919+0000","last_unstale":"2024-05-08T21:49:44.926751+0000","last_undegraded":"2024-05-08T21:49:44.926751+0000","last_fullsized":"2024-05-08T21:49:44.926751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:01:00.614249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757128+0000","last_change":"2024-05-08T21:49:43.227386+0000","last_active":"2024-05-08T21:49:44.757128+0000","last_peered":"2024-05-08T21:49:44.757128+0000","last_clean":"2024-05-08T21:49:44.757128+0000","last_became_active":"2024-05-08T21:49:43.227065+0000","last_became_peered":"2024-05-08T21:49:43.227065+0000","last_unstale":"2024-05-08T21:49:44.757128+0000","last_undegraded":"2024-05-08T21:49:44.757128+0000","last_fullsized":"2024-05-08T21:49:44.757128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:43:48.019170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927424+0000","last_change":"2024-05-08T21:49:43.770509+0000","last_active":"2024-05-08T21:49:44.927424+0000","last_peered":"2024-05-08T21:49:44.927424+0000","last_clean":"2024-05-08T21:49:44.927424+0000","last_became_active":"2024-05-08T21:49:43.770180+0000","last_became_peered":"2024-05-08T21:49:43.770180+0000","last_unstale":"2024-05-08T21:49:44.927424+0000","last_undegraded":"2024-05-08T21:49:44.927424+0000","last_fullsized":"2024-05-08T21:49:44.927424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:00:38.941899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.756153+0000","last_change":"2024-05-08T21:49:43.220942+0000","last_active":"2024-05-08T21:49:43.756153+0000","last_peered":"2024-05-08T21:49:43.756153+0000","last_clean":"2024-05-08T21:49:43.756153+0000","last_became_active":"2024-05-08T21:49:43.220641+0000","last_became_peered":"2024-05-08T21:49:43.220641+0000","last_unstale":"2024-05-08T21:49:43.756153+0000","last_undegraded":"2024-05-08T21:49:43.756153+0000","last_fullsized":"2024-05-08T21:49:43.756153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:52.323917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755763+0000","last_change":"2024-05-08T21:49:43.766269+0000","last_active":"2024-05-08T21:49:44.755763+0000","last_peered":"2024-05-08T21:49:44.755763+0000","last_clean":"2024-05-08T21:49:44.755763+0000","last_became_active":"2024-05-08T21:49:43.765945+0000","last_became_peered":"2024-05-08T21:49:43.765945+0000","last_unstale":"2024-05-08T21:49:44.755763+0000","last_undegraded":"2024-05-08T21:49:44.755763+0000","last_fullsized":"2024-05-08T21:49:44.755763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:17:34.570817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:48.763472+0000","last_change":"2024-05-08T21:49:43.208328+0000","last_active":"2024-05-08T21:49:48.763472+0000","last_peered":"2024-05-08T21:49:48.763472+0000","last_clean":"2024-05-08T21:49:48.763472+0000","last_became_active":"2024-05-08T21:49:43.208013+0000","last_became_peered":"2024-05-08T21:49:43.208013+0000","last_unstale":"2024-05-08T21:49:48.763472+0000","last_undegraded":"2024-05-08T21:49:48.763472+0000","last_fullsized":"2024-05-08T21:49:48.763472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:10.497167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.928099+0000","last_change":"2024-05-08T21:49:43.774210+0000","last_active":"2024-05-08T21:49:44.928099+0000","last_peered":"2024-05-08T21:49:44.928099+0000","last_clean":"2024-05-08T21:49:44.928099+0000","last_became_active":"2024-05-08T21:49:43.773933+0000","last_became_peered":"2024-05-08T21:49:43.773933+0000","last_unstale":"2024-05-08T21:49:44.928099+0000","last_undegraded":"2024-05-08T21:49:44.928099+0000","last_fullsized":"2024-05-08T21:49:44.928099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:10:25.398535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927899+0000","last_change":"2024-05-08T21:49:43.217456+0000","last_active":"2024-05-08T21:49:44.927899+0000","last_peered":"2024-05-08T21:49:44.927899+0000","last_clean":"2024-05-08T21:49:44.927899+0000","last_became_active":"2024-05-08T21:49:43.216822+0000","last_became_peered":"2024-05-08T21:49:43.216822+0000","last_unstale":"2024-05-08T21:49:44.927899+0000","last_undegraded":"2024-05-08T21:49:44.927899+0000","last_fullsized":"2024-05-08T21:49:44.927899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:41:35.881003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927764+0000","last_change":"2024-05-08T21:49:43.770066+0000","last_active":"2024-05-08T21:49:44.927764+0000","last_peered":"2024-05-08T21:49:44.927764+0000","last_clean":"2024-05-08T21:49:44.927764+0000","last_became_active":"2024-05-08T21:49:43.769762+0000","last_became_peered":"2024-05-08T21:49:43.769762+0000","last_unstale":"2024-05-08T21:49:44.927764+0000","last_undegraded":"2024-05-08T21:49:44.927764+0000","last_fullsized":"2024-05-08T21:49:44.927764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:40:20.301747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755188+0000","last_change":"2024-05-08T21:49:43.215293+0000","last_active":"2024-05-08T21:49:44.755188+0000","last_peered":"2024-05-08T21:49:44.755188+0000","last_clean":"2024-05-08T21:49:44.755188+0000","last_became_active":"2024-05-08T21:49:43.215048+0000","last_became_peered":"2024-05-08T21:49:43.215048+0000","last_unstale":"2024-05-08T21:49:44.755188+0000","last_undegraded":"2024-05-08T21:49:44.755188+0000","last_fullsized":"2024-05-08T21:49:44.755188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:43:48.019170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757129+0000","last_change":"2024-05-08T21:49:43.770326+0000","last_active":"2024-05-08T21:49:44.757129+0000","last_peered":"2024-05-08T21:49:44.757129+0000","last_clean":"2024-05-08T21:49:44.757129+0000","last_became_active":"2024-05-08T21:49:43.770029+0000","last_became_peered":"2024-05-08T21:49:43.770029+0000","last_unstale":"2024-05-08T21:49:44.757129+0000","last_undegraded":"2024-05-08T21:49:44.757129+0000","last_fullsized":"2024-05-08T21:49:44.757129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:33:33.642847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757017+0000","last_change":"2024-05-08T21:49:43.227710+0000","last_active":"2024-05-08T21:49:44.757017+0000","last_peered":"2024-05-08T21:49:44.757017+0000","last_clean":"2024-05-08T21:49:44.757017+0000","last_became_active":"2024-05-08T21:49:43.227430+0000","last_became_peered":"2024-05-08T21:49:43.227430+0000","last_unstale":"2024-05-08T21:49:44.757017+0000","last_undegraded":"2024-05-08T21:49:44.757017+0000","last_fullsized":"2024-05-08T21:49:44.757017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:05:58.875400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.928131+0000","last_change":"2024-05-08T21:49:43.768588+0000","last_active":"2024-05-08T21:49:44.928131+0000","last_peered":"2024-05-08T21:49:44.928131+0000","last_clean":"2024-05-08T21:49:44.928131+0000","last_became_active":"2024-05-08T21:49:43.768307+0000","last_became_peered":"2024-05-08T21:49:43.768307+0000","last_unstale":"2024-05-08T21:49:44.928131+0000","last_undegraded":"2024-05-08T21:49:44.928131+0000","last_fullsized":"2024-05-08T21:49:44.928131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:04.968184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.754953+0000","last_change":"2024-05-08T21:49:43.758618+0000","last_active":"2024-05-08T21:49:44.754953+0000","last_peered":"2024-05-08T21:49:44.754953+0000","last_clean":"2024-05-08T21:49:44.754953+0000","last_became_active":"2024-05-08T21:49:43.758367+0000","last_became_peered":"2024-05-08T21:49:43.758367+0000","last_unstale":"2024-05-08T21:49:44.754953+0000","last_undegraded":"2024-05-08T21:49:44.754953+0000","last_fullsized":"2024-05-08T21:49:44.754953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:30:06.569971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.751866+0000","last_change":"2024-05-08T21:49:43.217410+0000","last_active":"2024-05-08T21:49:43.751866+0000","last_peered":"2024-05-08T21:49:43.751866+0000","last_clean":"2024-05-08T21:49:43.751866+0000","last_became_active":"2024-05-08T21:49:43.217133+0000","last_became_peered":"2024-05-08T21:49:43.217133+0000","last_unstale":"2024-05-08T21:49:43.751866+0000","last_undegraded":"2024-05-08T21:49:43.751866+0000","last_fullsized":"2024-05-08T21:49:43.751866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:17.379362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.926897+0000","last_change":"2024-05-08T21:49:43.771651+0000","last_active":"2024-05-08T21:49:44.926897+0000","last_peered":"2024-05-08T21:49:44.926897+0000","last_clean":"2024-05-08T21:49:44.926897+0000","last_became_active":"2024-05-08T21:49:43.771451+0000","last_became_peered":"2024-05-08T21:49:43.771451+0000","last_unstale":"2024-05-08T21:49:44.926897+0000","last_undegraded":"2024-05-08T21:49:44.926897+0000","last_fullsized":"2024-05-08T21:49:44.926897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:00:38.941899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756759+0000","last_change":"2024-05-08T21:49:43.224929+0000","last_active":"2024-05-08T21:49:44.756759+0000","last_peered":"2024-05-08T21:49:44.756759+0000","last_clean":"2024-05-08T21:49:44.756759+0000","last_became_active":"2024-05-08T21:49:43.223469+0000","last_became_peered":"2024-05-08T21:49:43.223469+0000","last_unstale":"2024-05-08T21:49:44.756759+0000","last_undegraded":"2024-05-08T21:49:44.756759+0000","last_fullsized":"2024-05-08T21:49:44.756759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:27.504127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":164,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.756621+0000","last_change":"2024-05-08T21:49:38.626519+0000","last_active":"2024-05-08T21:49:43.756621+0000","last_peered":"2024-05-08T21:49:43.756621+0000","last_clean":"2024-05-08T21:49:43.756621+0000","last_became_active":"2024-05-08T21:49:38.626159+0000","last_became_peered":"2024-05-08T21:49:38.626159+0000","last_unstale":"2024-05-08T21:49:43.756621+0000","last_undegraded":"2024-05-08T21:49:43.756621+0000","last_fullsized":"2024-05-08T21:49:43.756621+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:36.031649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:36.031649+0000","last_clean_scrub_stamp":"2024-05-08T21:49:36.031649+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:12:04.846500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.926994+0000","last_change":"2024-05-08T21:49:43.770966+0000","last_active":"2024-05-08T21:49:44.926994+0000","last_peered":"2024-05-08T21:49:44.926994+0000","last_clean":"2024-05-08T21:49:44.926994+0000","last_became_active":"2024-05-08T21:49:43.770711+0000","last_became_peered":"2024-05-08T21:49:43.770711+0000","last_unstale":"2024-05-08T21:49:44.926994+0000","last_undegraded":"2024-05-08T21:49:44.926994+0000","last_fullsized":"2024-05-08T21:49:44.926994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:17:34.570817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.756729+0000","last_change":"2024-05-08T21:49:43.221086+0000","last_active":"2024-05-08T21:49:43.756729+0000","last_peered":"2024-05-08T21:49:43.756729+0000","last_clean":"2024-05-08T21:49:43.756729+0000","last_became_active":"2024-05-08T21:49:43.220539+0000","last_became_peered":"2024-05-08T21:49:43.220539+0000","last_unstale":"2024-05-08T21:49:43.756729+0000","last_undegraded":"2024-05-08T21:49:43.756729+0000","last_fullsized":"2024-05-08T21:49:43.756729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:52.323917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.765742+0000","last_change":"2024-05-08T21:49:43.222410+0000","last_active":"2024-05-08T21:49:43.765742+0000","last_peered":"2024-05-08T21:49:43.765742+0000","last_clean":"2024-05-08T21:49:43.765742+0000","last_became_active":"2024-05-08T21:49:43.222131+0000","last_became_peered":"2024-05-08T21:49:43.222131+0000","last_unstale":"2024-05-08T21:49:43.765742+0000","last_undegraded":"2024-05-08T21:49:43.765742+0000","last_fullsized":"2024-05-08T21:49:43.765742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:18:58.164159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755021+0000","last_change":"2024-05-08T21:49:43.758424+0000","last_active":"2024-05-08T21:49:44.755021+0000","last_peered":"2024-05-08T21:49:44.755021+0000","last_clean":"2024-05-08T21:49:44.755021+0000","last_became_active":"2024-05-08T21:49:43.758140+0000","last_became_peered":"2024-05-08T21:49:43.758140+0000","last_unstale":"2024-05-08T21:49:44.755021+0000","last_undegraded":"2024-05-08T21:49:44.755021+0000","last_fullsized":"2024-05-08T21:49:44.755021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:10.795540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:46.015958+0000","last_change":"2024-05-08T21:49:43.218241+0000","last_active":"2024-05-08T21:49:46.015958+0000","last_peered":"2024-05-08T21:49:46.015958+0000","last_clean":"2024-05-08T21:49:46.015958+0000","last_became_active":"2024-05-08T21:49:43.217780+0000","last_became_peered":"2024-05-08T21:49:43.217780+0000","last_unstale":"2024-05-08T21:49:46.015958+0000","last_undegraded":"2024-05-08T21:49:46.015958+0000","last_fullsized":"2024-05-08T21:49:46.015958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:27.504127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927830+0000","last_change":"2024-05-08T21:49:43.770491+0000","last_active":"2024-05-08T21:49:44.927830+0000","last_peered":"2024-05-08T21:49:44.927830+0000","last_clean":"2024-05-08T21:49:44.927830+0000","last_became_active":"2024-05-08T21:49:43.770221+0000","last_became_peered":"2024-05-08T21:49:43.770221+0000","last_unstale":"2024-05-08T21:49:44.927830+0000","last_undegraded":"2024-05-08T21:49:44.927830+0000","last_fullsized":"2024-05-08T21:49:44.927830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:25.661350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:48.755985+0000","last_change":"2024-05-08T21:49:43.221345+0000","last_active":"2024-05-08T21:49:48.755985+0000","last_peered":"2024-05-08T21:49:48.755985+0000","last_clean":"2024-05-08T21:49:48.755985+0000","last_became_active":"2024-05-08T21:49:43.220953+0000","last_became_peered":"2024-05-08T21:49:43.220953+0000","last_unstale":"2024-05-08T21:49:48.755985+0000","last_undegraded":"2024-05-08T21:49:48.755985+0000","last_fullsized":"2024-05-08T21:49:48.755985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:33:28.074468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927636+0000","last_change":"2024-05-08T21:49:43.765001+0000","last_active":"2024-05-08T21:49:44.927636+0000","last_peered":"2024-05-08T21:49:44.927636+0000","last_clean":"2024-05-08T21:49:44.927636+0000","last_became_active":"2024-05-08T21:49:43.764740+0000","last_became_peered":"2024-05-08T21:49:43.764740+0000","last_unstale":"2024-05-08T21:49:44.927636+0000","last_undegraded":"2024-05-08T21:49:44.927636+0000","last_fullsized":"2024-05-08T21:49:44.927636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:18:58.836430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.756521+0000","last_change":"2024-05-08T21:49:43.221251+0000","last_active":"2024-05-08T21:49:43.756521+0000","last_peered":"2024-05-08T21:49:43.756521+0000","last_clean":"2024-05-08T21:49:43.756521+0000","last_became_active":"2024-05-08T21:49:43.220839+0000","last_became_peered":"2024-05-08T21:49:43.220839+0000","last_unstale":"2024-05-08T21:49:43.756521+0000","last_undegraded":"2024-05-08T21:49:43.756521+0000","last_fullsized":"2024-05-08T21:49:43.756521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:10.497167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927485+0000","last_change":"2024-05-08T21:49:43.762511+0000","last_active":"2024-05-08T21:49:44.927485+0000","last_peered":"2024-05-08T21:49:44.927485+0000","last_clean":"2024-05-08T21:49:44.927485+0000","last_became_active":"2024-05-08T21:49:43.762170+0000","last_became_peered":"2024-05-08T21:49:43.762170+0000","last_unstale":"2024-05-08T21:49:44.927485+0000","last_undegraded":"2024-05-08T21:49:44.927485+0000","last_fullsized":"2024-05-08T21:49:44.927485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:11.503864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.754925+0000","last_change":"2024-05-08T21:49:43.215361+0000","last_active":"2024-05-08T21:49:44.754925+0000","last_peered":"2024-05-08T21:49:44.754925+0000","last_clean":"2024-05-08T21:49:44.754925+0000","last_became_active":"2024-05-08T21:49:43.215162+0000","last_became_peered":"2024-05-08T21:49:43.215162+0000","last_unstale":"2024-05-08T21:49:44.754925+0000","last_undegraded":"2024-05-08T21:49:44.754925+0000","last_fullsized":"2024-05-08T21:49:44.754925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:05:58.875400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927416+0000","last_change":"2024-05-08T21:49:43.757512+0000","last_active":"2024-05-08T21:49:44.927416+0000","last_peered":"2024-05-08T21:49:44.927416+0000","last_clean":"2024-05-08T21:49:44.927416+0000","last_became_active":"2024-05-08T21:49:43.757233+0000","last_became_peered":"2024-05-08T21:49:43.757233+0000","last_unstale":"2024-05-08T21:49:44.927416+0000","last_undegraded":"2024-05-08T21:49:44.927416+0000","last_fullsized":"2024-05-08T21:49:44.927416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:53:14.774835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755100+0000","last_change":"2024-05-08T21:49:43.217935+0000","last_active":"2024-05-08T21:49:44.755100+0000","last_peered":"2024-05-08T21:49:44.755100+0000","last_clean":"2024-05-08T21:49:44.755100+0000","last_became_active":"2024-05-08T21:49:43.217595+0000","last_became_peered":"2024-05-08T21:49:43.217595+0000","last_unstale":"2024-05-08T21:49:44.755100+0000","last_undegraded":"2024-05-08T21:49:44.755100+0000","last_fullsized":"2024-05-08T21:49:44.755100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:38:43.069159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927301+0000","last_change":"2024-05-08T21:49:43.766816+0000","last_active":"2024-05-08T21:49:44.927301+0000","last_peered":"2024-05-08T21:49:44.927301+0000","last_clean":"2024-05-08T21:49:44.927301+0000","last_became_active":"2024-05-08T21:49:43.766596+0000","last_became_peered":"2024-05-08T21:49:43.766596+0000","last_unstale":"2024-05-08T21:49:44.927301+0000","last_undegraded":"2024-05-08T21:49:44.927301+0000","last_fullsized":"2024-05-08T21:49:44.927301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:01:00.614249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:48.756361+0000","last_change":"2024-05-08T21:49:43.224243+0000","last_active":"2024-05-08T21:49:48.756361+0000","last_peered":"2024-05-08T21:49:48.756361+0000","last_clean":"2024-05-08T21:49:48.756361+0000","last_became_active":"2024-05-08T21:49:43.223974+0000","last_became_peered":"2024-05-08T21:49:43.223974+0000","last_unstale":"2024-05-08T21:49:48.756361+0000","last_undegraded":"2024-05-08T21:49:48.756361+0000","last_fullsized":"2024-05-08T21:49:48.756361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:03.961487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755912+0000","last_change":"2024-05-08T21:49:43.764377+0000","last_active":"2024-05-08T21:49:44.755912+0000","last_peered":"2024-05-08T21:49:44.755912+0000","last_clean":"2024-05-08T21:49:44.755912+0000","last_became_active":"2024-05-08T21:49:43.764075+0000","last_became_peered":"2024-05-08T21:49:43.764075+0000","last_unstale":"2024-05-08T21:49:44.755912+0000","last_undegraded":"2024-05-08T21:49:44.755912+0000","last_fullsized":"2024-05-08T21:49:44.755912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:41:45.602022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.752001+0000","last_change":"2024-05-08T21:49:43.229414+0000","last_active":"2024-05-08T21:49:43.752001+0000","last_peered":"2024-05-08T21:49:43.752001+0000","last_clean":"2024-05-08T21:49:43.752001+0000","last_became_active":"2024-05-08T21:49:43.229121+0000","last_became_peered":"2024-05-08T21:49:43.229121+0000","last_unstale":"2024-05-08T21:49:43.752001+0000","last_undegraded":"2024-05-08T21:49:43.752001+0000","last_fullsized":"2024-05-08T21:49:43.752001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:33:28.074468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927480+0000","last_change":"2024-05-08T21:49:43.774111+0000","last_active":"2024-05-08T21:49:44.927480+0000","last_peered":"2024-05-08T21:49:44.927480+0000","last_clean":"2024-05-08T21:49:44.927480+0000","last_became_active":"2024-05-08T21:49:43.772528+0000","last_became_peered":"2024-05-08T21:49:43.772528+0000","last_unstale":"2024-05-08T21:49:44.927480+0000","last_undegraded":"2024-05-08T21:49:44.927480+0000","last_fullsized":"2024-05-08T21:49:44.927480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:28.983476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:46.015933+0000","last_change":"2024-05-08T21:49:43.208581+0000","last_active":"2024-05-08T21:49:46.015933+0000","last_peered":"2024-05-08T21:49:46.015933+0000","last_clean":"2024-05-08T21:49:46.015933+0000","last_became_active":"2024-05-08T21:49:43.208326+0000","last_became_peered":"2024-05-08T21:49:43.208326+0000","last_unstale":"2024-05-08T21:49:46.015933+0000","last_undegraded":"2024-05-08T21:49:46.015933+0000","last_fullsized":"2024-05-08T21:49:46.015933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:13:35.461791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756911+0000","last_change":"2024-05-08T21:49:43.766519+0000","last_active":"2024-05-08T21:49:44.756911+0000","last_peered":"2024-05-08T21:49:44.756911+0000","last_clean":"2024-05-08T21:49:44.756911+0000","last_became_active":"2024-05-08T21:49:43.765789+0000","last_became_peered":"2024-05-08T21:49:43.765789+0000","last_unstale":"2024-05-08T21:49:44.756911+0000","last_undegraded":"2024-05-08T21:49:44.756911+0000","last_fullsized":"2024-05-08T21:49:44.756911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:23.674986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:48.757658+0000","last_change":"2024-05-08T21:49:43.218079+0000","last_active":"2024-05-08T21:49:48.757658+0000","last_peered":"2024-05-08T21:49:48.757658+0000","last_clean":"2024-05-08T21:49:48.757658+0000","last_became_active":"2024-05-08T21:49:43.217814+0000","last_became_peered":"2024-05-08T21:49:43.217814+0000","last_unstale":"2024-05-08T21:49:48.757658+0000","last_undegraded":"2024-05-08T21:49:48.757658+0000","last_fullsized":"2024-05-08T21:49:48.757658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:18:58.164159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.928456+0000","last_change":"2024-05-08T21:49:43.775713+0000","last_active":"2024-05-08T21:49:44.928456+0000","last_peered":"2024-05-08T21:49:44.928456+0000","last_clean":"2024-05-08T21:49:44.928456+0000","last_became_active":"2024-05-08T21:49:43.775361+0000","last_became_peered":"2024-05-08T21:49:43.775361+0000","last_unstale":"2024-05-08T21:49:44.928456+0000","last_undegraded":"2024-05-08T21:49:44.928456+0000","last_fullsized":"2024-05-08T21:49:44.928456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:48:24.482146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755727+0000","last_change":"2024-05-08T21:49:43.767129+0000","last_active":"2024-05-08T21:49:44.755727+0000","last_peered":"2024-05-08T21:49:44.755727+0000","last_clean":"2024-05-08T21:49:44.755727+0000","last_became_active":"2024-05-08T21:49:43.766789+0000","last_became_peered":"2024-05-08T21:49:43.766789+0000","last_unstale":"2024-05-08T21:49:44.755727+0000","last_undegraded":"2024-05-08T21:49:44.755727+0000","last_fullsized":"2024-05-08T21:49:44.755727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:39.954320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927246+0000","last_change":"2024-05-08T21:49:43.766157+0000","last_active":"2024-05-08T21:49:44.927246+0000","last_peered":"2024-05-08T21:49:44.927246+0000","last_clean":"2024-05-08T21:49:44.927246+0000","last_became_active":"2024-05-08T21:49:43.765843+0000","last_became_peered":"2024-05-08T21:49:43.765843+0000","last_unstale":"2024-05-08T21:49:44.927246+0000","last_undegraded":"2024-05-08T21:49:44.927246+0000","last_fullsized":"2024-05-08T21:49:44.927246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:04.968184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757080+0000","last_change":"2024-05-08T21:49:43.768929+0000","last_active":"2024-05-08T21:49:44.757080+0000","last_peered":"2024-05-08T21:49:44.757080+0000","last_clean":"2024-05-08T21:49:44.757080+0000","last_became_active":"2024-05-08T21:49:43.767606+0000","last_became_peered":"2024-05-08T21:49:43.767606+0000","last_unstale":"2024-05-08T21:49:44.757080+0000","last_undegraded":"2024-05-08T21:49:44.757080+0000","last_fullsized":"2024-05-08T21:49:44.757080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:13:06.426154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927158+0000","last_change":"2024-05-08T21:49:43.774673+0000","last_active":"2024-05-08T21:49:44.927158+0000","last_peered":"2024-05-08T21:49:44.927158+0000","last_clean":"2024-05-08T21:49:44.927158+0000","last_became_active":"2024-05-08T21:49:43.774406+0000","last_became_peered":"2024-05-08T21:49:43.774406+0000","last_unstale":"2024-05-08T21:49:44.927158+0000","last_undegraded":"2024-05-08T21:49:44.927158+0000","last_fullsized":"2024-05-08T21:49:44.927158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:43.798909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927659+0000","last_change":"2024-05-08T21:49:43.764222+0000","last_active":"2024-05-08T21:49:44.927659+0000","last_peered":"2024-05-08T21:49:44.927659+0000","last_clean":"2024-05-08T21:49:44.927659+0000","last_became_active":"2024-05-08T21:49:43.763937+0000","last_became_peered":"2024-05-08T21:49:43.763937+0000","last_unstale":"2024-05-08T21:49:44.927659+0000","last_undegraded":"2024-05-08T21:49:44.927659+0000","last_fullsized":"2024-05-08T21:49:44.927659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:04:14.416894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755114+0000","last_change":"2024-05-08T21:49:43.757318+0000","last_active":"2024-05-08T21:49:44.755114+0000","last_peered":"2024-05-08T21:49:44.755114+0000","last_clean":"2024-05-08T21:49:44.755114+0000","last_became_active":"2024-05-08T21:49:43.757083+0000","last_became_peered":"2024-05-08T21:49:43.757083+0000","last_unstale":"2024-05-08T21:49:44.755114+0000","last_undegraded":"2024-05-08T21:49:44.755114+0000","last_fullsized":"2024-05-08T21:49:44.755114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:47.551474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756302+0000","last_change":"2024-05-08T21:49:43.773491+0000","last_active":"2024-05-08T21:49:44.756302+0000","last_peered":"2024-05-08T21:49:44.756302+0000","last_clean":"2024-05-08T21:49:44.756302+0000","last_became_active":"2024-05-08T21:49:43.773203+0000","last_became_peered":"2024-05-08T21:49:43.773203+0000","last_unstale":"2024-05-08T21:49:44.756302+0000","last_undegraded":"2024-05-08T21:49:44.756302+0000","last_fullsized":"2024-05-08T21:49:44.756302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:53:14.774835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927776+0000","last_change":"2024-05-08T21:49:43.761926+0000","last_active":"2024-05-08T21:49:44.927776+0000","last_peered":"2024-05-08T21:49:44.927776+0000","last_clean":"2024-05-08T21:49:44.927776+0000","last_became_active":"2024-05-08T21:49:43.761645+0000","last_became_peered":"2024-05-08T21:49:43.761645+0000","last_unstale":"2024-05-08T21:49:44.927776+0000","last_undegraded":"2024-05-08T21:49:44.927776+0000","last_fullsized":"2024-05-08T21:49:44.927776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:10:07.209965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756761+0000","last_change":"2024-05-08T21:49:43.768942+0000","last_active":"2024-05-08T21:49:44.756761+0000","last_peered":"2024-05-08T21:49:44.756761+0000","last_clean":"2024-05-08T21:49:44.756761+0000","last_became_active":"2024-05-08T21:49:43.768673+0000","last_became_peered":"2024-05-08T21:49:43.768673+0000","last_unstale":"2024-05-08T21:49:44.756761+0000","last_undegraded":"2024-05-08T21:49:44.756761+0000","last_fullsized":"2024-05-08T21:49:44.756761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:15:41.869107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927592+0000","last_change":"2024-05-08T21:49:43.766452+0000","last_active":"2024-05-08T21:49:44.927592+0000","last_peered":"2024-05-08T21:49:44.927592+0000","last_clean":"2024-05-08T21:49:44.927592+0000","last_became_active":"2024-05-08T21:49:43.765723+0000","last_became_peered":"2024-05-08T21:49:43.765723+0000","last_unstale":"2024-05-08T21:49:44.927592+0000","last_undegraded":"2024-05-08T21:49:44.927592+0000","last_fullsized":"2024-05-08T21:49:44.927592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:19:28.925404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756863+0000","last_change":"2024-05-08T21:49:43.775098+0000","last_active":"2024-05-08T21:49:44.756863+0000","last_peered":"2024-05-08T21:49:44.756863+0000","last_clean":"2024-05-08T21:49:44.756863+0000","last_became_active":"2024-05-08T21:49:43.774808+0000","last_became_peered":"2024-05-08T21:49:43.774808+0000","last_unstale":"2024-05-08T21:49:44.756863+0000","last_undegraded":"2024-05-08T21:49:44.756863+0000","last_fullsized":"2024-05-08T21:49:44.756863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:51:15.152611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927076+0000","last_change":"2024-05-08T21:49:43.775129+0000","last_active":"2024-05-08T21:49:44.927076+0000","last_peered":"2024-05-08T21:49:44.927076+0000","last_clean":"2024-05-08T21:49:44.927076+0000","last_became_active":"2024-05-08T21:49:43.774881+0000","last_became_peered":"2024-05-08T21:49:43.774881+0000","last_unstale":"2024-05-08T21:49:44.927076+0000","last_undegraded":"2024-05-08T21:49:44.927076+0000","last_fullsized":"2024-05-08T21:49:44.927076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:19:28.925404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756057+0000","last_change":"2024-05-08T21:49:43.764163+0000","last_active":"2024-05-08T21:49:44.756057+0000","last_peered":"2024-05-08T21:49:44.756057+0000","last_clean":"2024-05-08T21:49:44.756057+0000","last_became_active":"2024-05-08T21:49:43.763907+0000","last_became_peered":"2024-05-08T21:49:43.763907+0000","last_unstale":"2024-05-08T21:49:44.756057+0000","last_undegraded":"2024-05-08T21:49:44.756057+0000","last_fullsized":"2024-05-08T21:49:44.756057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:01:00.614249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":806912,"data_stored":664039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]}]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":221184,"data_stored":74653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3440000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.5359999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.329}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.371}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":212992,"data_stored":73179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":217088,"data_stored":73249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.0419999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6880000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0489999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5449999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.202}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.2249999999999996}]}]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":815104,"data_stored":664095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":208896,"data_stored":73089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]}]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":221184,"data_stored":74653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":221184,"data_stored":73215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T21:49:58.374 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-08T21:49:58.374 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-08T21:49:58.374 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-05-08T21:49:58.374 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-08T21:49:58.397 INFO:tasks.ceph.mds.e.smithi073.stderr:2024-05-08T21:49:58.395+0000 7f58d5b3c700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-08T21:49:58.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.516+0000 7f21f664c700 1 Processor -- start 2024-05-08T21:49:58.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.516+0000 7f21f664c700 1 -- start start 2024-05-08T21:49:58.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.516+0000 7f21f664c700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f21f0072260 0x7f21f0159d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:58.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.516+0000 7f21f664c700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21f015dfc0 con 0x7f21f0072980 2024-05-08T21:49:58.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.516+0000 7f21f664c700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21f015d3b0 con 0x7f21f0072d60 2024-05-08T21:49:58.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.516+0000 7f21f664c700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21f0070120 con 0x7f21f0072260 2024-05-08T21:49:58.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.516+0000 7f21ef7fe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f21f0072260 0x7f21f0159d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:58.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.517+0000 7f21effff700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f21f0072980 0x7f21f006f970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:39200/0 (socket says 172.21.15.73:39200) 2024-05-08T21:49:58.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.517+0000 7f21effff700 1 -- 172.21.15.73:0/3077039445 learned_addr learned my addr 172.21.15.73:0/3077039445 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:49:58.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.517+0000 7f21ef7fe700 1 -- 172.21.15.73:0/3077039445 >> v1:172.21.15.115:6789/0 conn(0x7f21f0072d60 legacy=0x7f21f0153860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:58.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.517+0000 7f21ef7fe700 1 -- 172.21.15.73:0/3077039445 >> v1:172.21.15.73:6789/0 conn(0x7f21f0072980 legacy=0x7f21f006f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:58.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.517+0000 7f21ef7fe700 1 -- 172.21.15.73:0/3077039445 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f015d690 con 0x7f21f0072260 2024-05-08T21:49:58.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.517+0000 7f21ef7fe700 1 --2- 172.21.15.73:0/3077039445 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21f0072260 0x7f21f0159d90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f21e4009870 tx=0x7f21e4009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f488b153a244c99a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:58.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.517+0000 7f21eeffd700 1 -- 172.21.15.73:0/3077039445 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e4004230 con 0x7f21f0072260 2024-05-08T21:49:58.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.517+0000 7f21eeffd700 1 -- 172.21.15.73:0/3077039445 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21e4004390 con 0x7f21f0072260 2024-05-08T21:49:58.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.517+0000 7f21eeffd700 1 -- 172.21.15.73:0/3077039445 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e40036a0 con 0x7f21f0072260 2024-05-08T21:49:58.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.518+0000 7f21f664c700 1 -- 172.21.15.73:0/3077039445 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21f0072260 msgr2=0x7f21f0159d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:58.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.518+0000 7f21f664c700 1 --2- 172.21.15.73:0/3077039445 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21f0072260 0x7f21f0159d90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f21e4009870 tx=0x7f21e4009b80 comp rx=0 tx=0).stop 2024-05-08T21:49:58.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.518+0000 7f21f664c700 1 -- 172.21.15.73:0/3077039445 shutdown_connections 2024-05-08T21:49:58.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.518+0000 7f21f664c700 1 --2- 172.21.15.73:0/3077039445 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21f0072260 0x7f21f0159d90 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:58.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.518+0000 7f21f664c700 1 -- 172.21.15.73:0/3077039445 >> 172.21.15.73:0/3077039445 conn(0x7f21f0066cf0 msgr2=0x7f21f006bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:58.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.518+0000 7f21f664c700 1 -- 172.21.15.73:0/3077039445 shutdown_connections 2024-05-08T21:49:58.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.518+0000 7f21f664c700 1 -- 172.21.15.73:0/3077039445 wait complete. 2024-05-08T21:49:58.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.519+0000 7f21f664c700 1 Processor -- start 2024-05-08T21:49:58.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.519+0000 7f21f664c700 1 -- start start 2024-05-08T21:49:58.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.520+0000 7f21f664c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f21f0072260 0x7f21f0146070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:58.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.520+0000 7f21f664c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21f0072980 0x7f21f014edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:58.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.520+0000 7f21f664c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21f0072d60 0x7f21f014f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:58.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.520+0000 7f21f664c700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f01ef990 con 0x7f21f0072d60 2024-05-08T21:49:58.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.520+0000 7f21f664c700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f00ca3c0 con 0x7f21f0072980 2024-05-08T21:49:58.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.520+0000 7f21f664c700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21f00ca6a0 con 0x7f21f0072260 2024-05-08T21:49:58.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.520+0000 7f21f4be9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21f0072d60 0x7f21f014f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:58.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.520+0000 7f21f4be9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21f0072d60 0x7f21f014f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38508/0 (socket says 172.21.15.73:38508) 2024-05-08T21:49:58.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.520+0000 7f21f4be9700 1 -- 172.21.15.73:0/4202226008 learned_addr learned my addr 172.21.15.73:0/4202226008 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:58.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.520+0000 7f21ef7fe700 1 --2- 172.21.15.73:0/4202226008 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21f0072980 0x7f21f014edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:58.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.520+0000 7f21effff700 1 --2- 172.21.15.73:0/4202226008 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f21f0072260 0x7f21f0146070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:58.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.520+0000 7f21f4be9700 1 -- 172.21.15.73:0/4202226008 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f21f0072260 msgr2=0x7f21f0146070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:58.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.520+0000 7f21f4be9700 1 --2- 172.21.15.73:0/4202226008 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f21f0072260 0x7f21f0146070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:58.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.520+0000 7f21f4be9700 1 -- 172.21.15.73:0/4202226008 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21f0072980 msgr2=0x7f21f014edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:58.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.520+0000 7f21f4be9700 1 --2- 172.21.15.73:0/4202226008 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21f0072980 0x7f21f014edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:58.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.520+0000 7f21f4be9700 1 -- 172.21.15.73:0/4202226008 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e40094a0 con 0x7f21f0072d60 2024-05-08T21:49:58.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.520+0000 7f21effff700 1 --2- 172.21.15.73:0/4202226008 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f21f0072260 0x7f21f0146070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:49:58.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.520+0000 7f21f4be9700 1 --2- 172.21.15.73:0/4202226008 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21f0072d60 0x7f21f014f300 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f21e800be60 tx=0x7f21e8009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:58.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.520+0000 7f21ecff9700 1 -- 172.21.15.73:0/4202226008 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e800cd10 con 0x7f21f0072d60 2024-05-08T21:49:58.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.520+0000 7f21ecff9700 1 -- 172.21.15.73:0/4202226008 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21e8014440 con 0x7f21f0072d60 2024-05-08T21:49:58.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.520+0000 7f21f664c700 1 -- 172.21.15.73:0/4202226008 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21f00ca980 con 0x7f21f0072d60 2024-05-08T21:49:58.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.520+0000 7f21ecff9700 1 -- 172.21.15.73:0/4202226008 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e80147f0 con 0x7f21f0072d60 2024-05-08T21:49:58.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.520+0000 7f21f664c700 1 -- 172.21.15.73:0/4202226008 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21f01465b0 con 0x7f21f0072d60 2024-05-08T21:49:58.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.521+0000 7f21f664c700 1 -- 172.21.15.73:0/4202226008 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21f01efb60 con 0x7f21f0072d60 2024-05-08T21:49:58.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.522+0000 7f21ecff9700 1 -- 172.21.15.73:0/4202226008 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f21e8014950 con 0x7f21f0072d60 2024-05-08T21:49:58.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.522+0000 7f21ecff9700 1 --2- 172.21.15.73:0/4202226008 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f21dc06ac90 0x7f21dc06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:58.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.522+0000 7f21ecff9700 1 -- 172.21.15.73:0/4202226008 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f21e80891d0 con 0x7f21f0072d60 2024-05-08T21:49:58.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.522+0000 7f21effff700 1 --2- 172.21.15.73:0/4202226008 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f21dc06ac90 0x7f21dc06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:58.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.522+0000 7f21effff700 1 --2- 172.21.15.73:0/4202226008 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f21dc06ac90 0x7f21dc06d150 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f21e0007fd0 tx=0x7f21e0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:58.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.526+0000 7f21ecff9700 1 -- 172.21.15.73:0/4202226008 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f21f01efb60 con 0x7f21f0072d60 2024-05-08T21:49:58.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.769+0000 7f21f664c700 1 -- 172.21.15.73:0/4202226008 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f21f0068b80 con 0x7f21f0072d60 2024-05-08T21:49:58.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.770+0000 7f21ecff9700 1 -- 172.21.15.73:0/4202226008 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f21e8054470 con 0x7f21f0072d60 2024-05-08T21:49:58.771 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:49:58.771 INFO:teuthology.orchestra.run.smithi073.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-08T21:49:58.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.772+0000 7f21f664c700 1 -- 172.21.15.73:0/4202226008 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f21dc06ac90 msgr2=0x7f21dc06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:58.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.772+0000 7f21f664c700 1 --2- 172.21.15.73:0/4202226008 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f21dc06ac90 0x7f21dc06d150 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f21e0007fd0 tx=0x7f21e0009040 comp rx=0 tx=0).stop 2024-05-08T21:49:58.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.772+0000 7f21f664c700 1 -- 172.21.15.73:0/4202226008 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21f0072d60 msgr2=0x7f21f014f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:58.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.772+0000 7f21f664c700 1 --2- 172.21.15.73:0/4202226008 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21f0072d60 0x7f21f014f300 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f21e800be60 tx=0x7f21e8009f30 comp rx=0 tx=0).stop 2024-05-08T21:49:58.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.772+0000 7f21f664c700 1 -- 172.21.15.73:0/4202226008 shutdown_connections 2024-05-08T21:49:58.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.772+0000 7f21f664c700 1 --2- 172.21.15.73:0/4202226008 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f21dc06ac90 0x7f21dc06d150 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:58.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.772+0000 7f21f664c700 1 --2- 172.21.15.73:0/4202226008 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21f0072d60 0x7f21f014f300 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:58.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.772+0000 7f21f664c700 1 --2- 172.21.15.73:0/4202226008 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f21f0072260 0x7f21f0146070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:58.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.772+0000 7f21f664c700 1 --2- 172.21.15.73:0/4202226008 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21f0072980 0x7f21f014edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:58.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.772+0000 7f21f664c700 1 -- 172.21.15.73:0/4202226008 >> 172.21.15.73:0/4202226008 conn(0x7f21f0066cf0 msgr2=0x7f21f006bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:58.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.772+0000 7f21f664c700 1 -- 172.21.15.73:0/4202226008 shutdown_connections 2024-05-08T21:49:58.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.772+0000 7f21f664c700 1 -- 172.21.15.73:0/4202226008 wait complete. 2024-05-08T21:49:58.785 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-05-08T21:49:58.785 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T21:49:58.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.905+0000 7f6ceb49e700 1 Processor -- start 2024-05-08T21:49:58.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.905+0000 7f6ceb49e700 1 -- start start 2024-05-08T21:49:58.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.906+0000 7f6ceb49e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6ce40c7fe0 0x7f6ce40c6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:58.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.906+0000 7f6ceb49e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6ce40c7a90 0x7f6ce40c5b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:58.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.906+0000 7f6ceb49e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ce40c4020 con 0x7f6ce4150df0 2024-05-08T21:49:58.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.906+0000 7f6ceb49e700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ce40c5770 con 0x7f6ce40c7a90 2024-05-08T21:49:58.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.906+0000 7f6ceb49e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce41511d0 con 0x7f6ce40c7fe0 2024-05-08T21:49:58.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.906+0000 7f6ce923a700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f6ce4150df0 0x7f6ce40c8e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:39206/0 (socket says 172.21.15.73:39206) 2024-05-08T21:49:58.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.906+0000 7f6ce923a700 1 -- 172.21.15.73:0/2808497238 learned_addr learned my addr 172.21.15.73:0/2808497238 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:49:58.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.907+0000 7f6ce9a3b700 1 --2- 172.21.15.73:0/2808497238 >> v2:172.21.15.115:3300/0 conn(0x7f6ce40c7a90 0x7f6ce40c5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:58.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.907+0000 7f6ce8a39700 1 --2- 172.21.15.73:0/2808497238 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6ce40c7fe0 0x7f6ce40c6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:58.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.907+0000 7f6cdbfff700 1 -- 172.21.15.73:0/2808497238 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 381263296 0 0) 0x7f6ce40c4020 con 0x7f6ce4150df0 2024-05-08T21:49:58.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.907+0000 7f6cdbfff700 1 -- 172.21.15.73:0/2808497238 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6cd00035b0 con 0x7f6ce4150df0 2024-05-08T21:49:58.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.907+0000 7f6ce9a3b700 1 -- 172.21.15.73:0/2808497238 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6ce40c7fe0 msgr2=0x7f6ce40c6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:58.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.907+0000 7f6cdbfff700 1 -- 172.21.15.73:0/2808497238 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 202544157 0 0) 0x7f6cd00035b0 con 0x7f6ce4150df0 2024-05-08T21:49:58.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.907+0000 7f6ce9a3b700 1 --2- 172.21.15.73:0/2808497238 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6ce40c7fe0 0x7f6ce40c6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:58.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.907+0000 7f6ce9a3b700 1 -- 172.21.15.73:0/2808497238 >> v1:172.21.15.73:6789/0 conn(0x7f6ce4150df0 legacy=0x7f6ce40c8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:58.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.907+0000 7f6ce9a3b700 1 -- 172.21.15.73:0/2808497238 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce40c3d40 con 0x7f6ce40c7a90 2024-05-08T21:49:58.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.907+0000 7f6ce9a3b700 1 --2- 172.21.15.73:0/2808497238 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ce40c7a90 0x7f6ce40c5b90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc009d90 tx=0x7f6cdc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba562025ef5b894f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:58.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.907+0000 7f6cdbfff700 1 -- 172.21.15.73:0/2808497238 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd4001670 con 0x7f6ce40c7a90 2024-05-08T21:49:58.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.907+0000 7f6cdbfff700 1 -- 172.21.15.73:0/2808497238 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cdc003a20 con 0x7f6ce40c7a90 2024-05-08T21:49:58.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.907+0000 7f6cdbfff700 1 -- 172.21.15.73:0/2808497238 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cdc003d90 con 0x7f6ce40c7a90 2024-05-08T21:49:58.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.908+0000 7f6ceb49e700 1 -- 172.21.15.73:0/2808497238 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ce40c7a90 msgr2=0x7f6ce40c5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:58.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.908+0000 7f6ceb49e700 1 --2- 172.21.15.73:0/2808497238 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ce40c7a90 0x7f6ce40c5b90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc009d90 tx=0x7f6cdc00b330 comp rx=0 tx=0).stop 2024-05-08T21:49:58.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.908+0000 7f6ceb49e700 1 -- 172.21.15.73:0/2808497238 shutdown_connections 2024-05-08T21:49:58.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.908+0000 7f6ceb49e700 1 --2- 172.21.15.73:0/2808497238 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ce40c7a90 0x7f6ce40c5b90 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:58.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.908+0000 7f6ceb49e700 1 --2- 172.21.15.73:0/2808497238 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6ce40c7fe0 0x7f6ce40c6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:58.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.908+0000 7f6ceb49e700 1 -- 172.21.15.73:0/2808497238 >> 172.21.15.73:0/2808497238 conn(0x7f6ce40cc420 msgr2=0x7f6ce40cc800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:58.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.908+0000 7f6ceb49e700 1 -- 172.21.15.73:0/2808497238 shutdown_connections 2024-05-08T21:49:58.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.908+0000 7f6ceb49e700 1 -- 172.21.15.73:0/2808497238 wait complete. 2024-05-08T21:49:58.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.909+0000 7f6ceb49e700 1 Processor -- start 2024-05-08T21:49:58.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.909+0000 7f6ceb49e700 1 -- start start 2024-05-08T21:49:58.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.910+0000 7f6ceb49e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6ce40c7a90 0x7f6ce4140e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:58.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.910+0000 7f6ceb49e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ce40c7fe0 0x7f6ce41f2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:58.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.910+0000 7f6ceb49e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ce4150df0 0x7f6ce4145f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:58.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.910+0000 7f6ceb49e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce414c0b0 con 0x7f6ce4150df0 2024-05-08T21:49:58.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.910+0000 7f6ceb49e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce406c010 con 0x7f6ce40c7fe0 2024-05-08T21:49:58.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.910+0000 7f6ceb49e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce406bce0 con 0x7f6ce40c7a90 2024-05-08T21:49:58.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.910+0000 7f6ce9a3b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ce4150df0 0x7f6ce4145f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:58.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.910+0000 7f6ce9a3b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ce4150df0 0x7f6ce4145f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38516/0 (socket says 172.21.15.73:38516) 2024-05-08T21:49:58.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.910+0000 7f6ce9a3b700 1 -- 172.21.15.73:0/2391467132 learned_addr learned my addr 172.21.15.73:0/2391467132 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:58.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.910+0000 7f6ce923a700 1 --2- 172.21.15.73:0/2391467132 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6ce40c7a90 0x7f6ce4140e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:58.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.910+0000 7f6ce8a39700 1 --2- 172.21.15.73:0/2391467132 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ce40c7fe0 0x7f6ce41f2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:58.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.910+0000 7f6ce9a3b700 1 -- 172.21.15.73:0/2391467132 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6ce40c7a90 msgr2=0x7f6ce4140e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:58.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.910+0000 7f6ce9a3b700 1 --2- 172.21.15.73:0/2391467132 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6ce40c7a90 0x7f6ce4140e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:58.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.910+0000 7f6ce9a3b700 1 -- 172.21.15.73:0/2391467132 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ce40c7fe0 msgr2=0x7f6ce41f2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:58.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.910+0000 7f6ce9a3b700 1 --2- 172.21.15.73:0/2391467132 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ce40c7fe0 0x7f6ce41f2fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:58.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.910+0000 7f6ce9a3b700 1 -- 172.21.15.73:0/2391467132 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cdc009a70 con 0x7f6ce4150df0 2024-05-08T21:49:58.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.910+0000 7f6ce9a3b700 1 --2- 172.21.15.73:0/2391467132 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ce4150df0 0x7f6ce4145f20 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6ce4072da0 tx=0x7f6cdc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:58.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.910+0000 7f6cd9ffb700 1 -- 172.21.15.73:0/2391467132 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cdc01e070 con 0x7f6ce4150df0 2024-05-08T21:49:58.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.910+0000 7f6cd9ffb700 1 -- 172.21.15.73:0/2391467132 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cdc009410 con 0x7f6ce4150df0 2024-05-08T21:49:58.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.910+0000 7f6ceb49e700 1 -- 172.21.15.73:0/2391467132 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ce4140500 con 0x7f6ce4150df0 2024-05-08T21:49:58.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.910+0000 7f6cd9ffb700 1 -- 172.21.15.73:0/2391467132 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cdc0047f0 con 0x7f6ce4150df0 2024-05-08T21:49:58.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.911+0000 7f6ceb49e700 1 -- 172.21.15.73:0/2391467132 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ce414baf0 con 0x7f6ce4150df0 2024-05-08T21:49:58.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.911+0000 7f6ceb49e700 1 -- 172.21.15.73:0/2391467132 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ce414ae70 con 0x7f6ce4150df0 2024-05-08T21:49:58.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.913+0000 7f6cd9ffb700 1 -- 172.21.15.73:0/2391467132 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6cdc011460 con 0x7f6ce4150df0 2024-05-08T21:49:58.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.913+0000 7f6cd9ffb700 1 --2- 172.21.15.73:0/2391467132 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f6cc806acc0 0x7f6cc806d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:58.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.914+0000 7f6cd9ffb700 1 -- 172.21.15.73:0/2391467132 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6cdc08b0c0 con 0x7f6ce4150df0 2024-05-08T21:49:58.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.914+0000 7f6ce923a700 1 --2- 172.21.15.73:0/2391467132 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f6cc806acc0 0x7f6cc806d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:58.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.914+0000 7f6ce923a700 1 --2- 172.21.15.73:0/2391467132 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f6cc806acc0 0x7f6cc806d180 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6cd4001eb0 tx=0x7f6cd4001e40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:58.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:58.917+0000 7f6cd9ffb700 1 -- 172.21.15.73:0/2391467132 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f6cdc056290 con 0x7f6ce4150df0 2024-05-08T21:49:59.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.115+0000 7f6ceb49e700 1 -- 172.21.15.73:0/2391467132 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ce406c180 con 0x7f6ce4150df0 2024-05-08T21:49:59.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.116+0000 7f6cd9ffb700 1 -- 172.21.15.73:0/2391467132 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16037 (secure 0 0 0) 0x7f6cdc0598b0 con 0x7f6ce4150df0 2024-05-08T21:49:59.118 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:49:59.118 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":21,"fsid":"143164b7-c9c7-4737-a494-7dafa5a3320c","created":"2024-05-08T21:49:26.221909+0000","modified":"2024-05-08T21:49:44.748794+0000","last_up_change":"2024-05-08T21:49:37.118386+0000","last_in_change":"2024-05-08T21:49:28.836944+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T21:49:35.998578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T21:49:42.171760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T21:49:42.576293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6b7439c1-daaa-44af-8333-a455f9e9dc67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":47228},{"type":"v1","addr":"172.21.15.73:6809","nonce":47228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":47228},{"type":"v1","addr":"172.21.15.73:6811","nonce":47228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":47228},{"type":"v1","addr":"172.21.15.73:6815","nonce":47228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":47228},{"type":"v1","addr":"172.21.15.73:6813","nonce":47228}]},"public_addr":"172.21.15.73:6809/47228","cluster_addr":"172.21.15.73:6811/47228","heartbeat_back_addr":"172.21.15.73:6815/47228","heartbeat_front_addr":"172.21.15.73:6813/47228","state":["exists","up"]},{"osd":1,"uuid":"fb67886a-d7f7-45ac-832f-36c871c8a208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":47227},{"type":"v1","addr":"172.21.15.73:6801","nonce":47227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":47227},{"type":"v1","addr":"172.21.15.73:6803","nonce":47227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":47227},{"type":"v1","addr":"172.21.15.73:6807","nonce":47227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":47227},{"type":"v1","addr":"172.21.15.73:6805","nonce":47227}]},"public_addr":"172.21.15.73:6801/47227","cluster_addr":"172.21.15.73:6803/47227","heartbeat_back_addr":"172.21.15.73:6807/47227","heartbeat_front_addr":"172.21.15.73:6805/47227","state":["exists","up"]},{"osd":2,"uuid":"a5cd6e98-6621-473a-bfb8-5c648abbb563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":47229},{"type":"v1","addr":"172.21.15.73:6817","nonce":47229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":47229},{"type":"v1","addr":"172.21.15.73:6819","nonce":47229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":47229},{"type":"v1","addr":"172.21.15.73:6823","nonce":47229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":47229},{"type":"v1","addr":"172.21.15.73:6821","nonce":47229}]},"public_addr":"172.21.15.73:6817/47229","cluster_addr":"172.21.15.73:6819/47229","heartbeat_back_addr":"172.21.15.73:6823/47229","heartbeat_front_addr":"172.21.15.73:6821/47229","state":["exists","up"]},{"osd":3,"uuid":"36927c20-4241-4f3b-91b5-a6a6f27598e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":47232},{"type":"v1","addr":"172.21.15.73:6825","nonce":47232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":47232},{"type":"v1","addr":"172.21.15.73:6827","nonce":47232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":47232},{"type":"v1","addr":"172.21.15.73:6831","nonce":47232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":47232},{"type":"v1","addr":"172.21.15.73:6829","nonce":47232}]},"public_addr":"172.21.15.73:6825/47232","cluster_addr":"172.21.15.73:6827/47232","heartbeat_back_addr":"172.21.15.73:6831/47232","heartbeat_front_addr":"172.21.15.73:6829/47232","state":["exists","up"]},{"osd":4,"uuid":"4ebe0a18-8216-4815-878a-39c39a6cd3fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":47200},{"type":"v1","addr":"172.21.15.115:6801","nonce":47200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":47200},{"type":"v1","addr":"172.21.15.115:6803","nonce":47200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":47200},{"type":"v1","addr":"172.21.15.115:6807","nonce":47200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":47200},{"type":"v1","addr":"172.21.15.115:6805","nonce":47200}]},"public_addr":"172.21.15.115:6801/47200","cluster_addr":"172.21.15.115:6803/47200","heartbeat_back_addr":"172.21.15.115:6807/47200","heartbeat_front_addr":"172.21.15.115:6805/47200","state":["exists","up"]},{"osd":5,"uuid":"957f0ac1-5f26-4f02-8c05-488e6b67ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":47201},{"type":"v1","addr":"172.21.15.115:6809","nonce":47201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":47201},{"type":"v1","addr":"172.21.15.115:6811","nonce":47201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":47201},{"type":"v1","addr":"172.21.15.115:6815","nonce":47201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":47201},{"type":"v1","addr":"172.21.15.115:6813","nonce":47201}]},"public_addr":"172.21.15.115:6809/47201","cluster_addr":"172.21.15.115:6811/47201","heartbeat_back_addr":"172.21.15.115:6815/47201","heartbeat_front_addr":"172.21.15.115:6813/47201","state":["exists","up"]},{"osd":6,"uuid":"f5a6768f-ba7f-4f66-b335-0c303b158e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":47202},{"type":"v1","addr":"172.21.15.115:6817","nonce":47202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":47202},{"type":"v1","addr":"172.21.15.115:6819","nonce":47202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":47202},{"type":"v1","addr":"172.21.15.115:6823","nonce":47202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":47202},{"type":"v1","addr":"172.21.15.115:6821","nonce":47202}]},"public_addr":"172.21.15.115:6817/47202","cluster_addr":"172.21.15.115:6819/47202","heartbeat_back_addr":"172.21.15.115:6823/47202","heartbeat_front_addr":"172.21.15.115:6821/47202","state":["exists","up"]},{"osd":7,"uuid":"f4187743-f9e6-42e6-aca9-0604a58db1ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":47211},{"type":"v1","addr":"172.21.15.115:6825","nonce":47211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":47211},{"type":"v1","addr":"172.21.15.115:6827","nonce":47211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":47211},{"type":"v1","addr":"172.21.15.115:6831","nonce":47211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":47211},{"type":"v1","addr":"172.21.15.115:6829","nonce":47211}]},"public_addr":"172.21.15.115:6825/47211","cluster_addr":"172.21.15.115:6827/47211","heartbeat_back_addr":"172.21.15.115:6831/47211","heartbeat_front_addr":"172.21.15.115:6829/47211","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:33.996335+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:33.687451+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:34.072549+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:33.997588+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:34.047260+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:34.876272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:33.965472+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:34.038637+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T21:49:59.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.119+0000 7f6ceb49e700 1 -- 172.21.15.73:0/2391467132 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f6cc806acc0 msgr2=0x7f6cc806d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:59.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.119+0000 7f6ceb49e700 1 --2- 172.21.15.73:0/2391467132 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f6cc806acc0 0x7f6cc806d180 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6cd4001eb0 tx=0x7f6cd4001e40 comp rx=0 tx=0).stop 2024-05-08T21:49:59.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.119+0000 7f6ceb49e700 1 -- 172.21.15.73:0/2391467132 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ce4150df0 msgr2=0x7f6ce4145f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:59.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.119+0000 7f6ceb49e700 1 --2- 172.21.15.73:0/2391467132 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ce4150df0 0x7f6ce4145f20 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6ce4072da0 tx=0x7f6cdc004ad0 comp rx=0 tx=0).stop 2024-05-08T21:49:59.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.119+0000 7f6ceb49e700 1 -- 172.21.15.73:0/2391467132 shutdown_connections 2024-05-08T21:49:59.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.119+0000 7f6ceb49e700 1 --2- 172.21.15.73:0/2391467132 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f6cc806acc0 0x7f6cc806d180 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:59.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.119+0000 7f6ceb49e700 1 --2- 172.21.15.73:0/2391467132 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ce4150df0 0x7f6ce4145f20 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:59.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.119+0000 7f6ceb49e700 1 --2- 172.21.15.73:0/2391467132 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6ce40c7a90 0x7f6ce4140e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:59.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.119+0000 7f6ceb49e700 1 --2- 172.21.15.73:0/2391467132 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ce40c7fe0 0x7f6ce41f2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:59.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.119+0000 7f6ceb49e700 1 -- 172.21.15.73:0/2391467132 >> 172.21.15.73:0/2391467132 conn(0x7f6ce40cc420 msgr2=0x7f6ce40c8e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:59.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.119+0000 7f6ceb49e700 1 -- 172.21.15.73:0/2391467132 shutdown_connections 2024-05-08T21:49:59.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.119+0000 7f6ceb49e700 1 -- 172.21.15.73:0/2391467132 wait complete. 2024-05-08T21:49:59.132 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T21:49:35.998578+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T21:49:42.171760+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T21:49:42.576293+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T21:49:59.132 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T21:49:59.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.257+0000 7fd8f590d700 1 Processor -- start 2024-05-08T21:49:59.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.257+0000 7fd8f590d700 1 -- start start 2024-05-08T21:49:59.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.258+0000 7fd8f590d700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd8f0072880 0x7fd8f00cc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:59.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.258+0000 7fd8f590d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd8f0072c60 0x7fd8f006aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:59.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.258+0000 7fd8f590d700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8f00c9da0 con 0x7fd8f015d1e0 2024-05-08T21:49:59.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.258+0000 7fd8f590d700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8f00c8d60 con 0x7fd8f0072880 2024-05-08T21:49:59.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.258+0000 7fd8f590d700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8f00ccbf0 con 0x7fd8f0072c60 2024-05-08T21:49:59.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.258+0000 7fd8eeffd700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd8f0072880 0x7fd8f00cc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:59.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.258+0000 7fd8ef7fe700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fd8f015d1e0 0x7fd8f0153990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:39222/0 (socket says 172.21.15.73:39222) 2024-05-08T21:49:59.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.258+0000 7fd8ef7fe700 1 -- 172.21.15.73:0/203858638 learned_addr learned my addr 172.21.15.73:0/203858638 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:49:59.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.259+0000 7fd8ee7fc700 1 --2- 172.21.15.73:0/203858638 >> v2:172.21.15.115:3300/0 conn(0x7fd8f0072c60 0x7fd8f006aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:59.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.259+0000 7fd8eeffd700 1 -- 172.21.15.73:0/203858638 >> v2:172.21.15.115:3300/0 conn(0x7fd8f0072c60 msgr2=0x7fd8f006aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:59.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.259+0000 7fd8eeffd700 1 --2- 172.21.15.73:0/203858638 >> v2:172.21.15.115:3300/0 conn(0x7fd8f0072c60 0x7fd8f006aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:59.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.259+0000 7fd8eeffd700 1 -- 172.21.15.73:0/203858638 >> v1:172.21.15.73:6789/0 conn(0x7fd8f015d1e0 legacy=0x7fd8f0153990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:59.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.259+0000 7fd8eeffd700 1 -- 172.21.15.73:0/203858638 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f00c8fe0 con 0x7fd8f0072880 2024-05-08T21:49:59.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.259+0000 7fd8edffb700 1 -- 172.21.15.73:0/203858638 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 743619448 0 0) 0x7fd8f00c9da0 con 0x7fd8f015d1e0 2024-05-08T21:49:59.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.259+0000 7fd8eeffd700 1 --2- 172.21.15.73:0/203858638 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8f0072880 0x7fd8f00cc3b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd8f00c4530 tx=0x7fd8e4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c23a70f20cb3d3ac server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:59.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.259+0000 7fd8edffb700 1 -- 172.21.15.73:0/203858638 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e4011830 con 0x7fd8f0072880 2024-05-08T21:49:59.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.259+0000 7fd8edffb700 1 -- 172.21.15.73:0/203858638 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8e4011990 con 0x7fd8f0072880 2024-05-08T21:49:59.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.259+0000 7fd8edffb700 1 -- 172.21.15.73:0/203858638 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e4011d20 con 0x7fd8f0072880 2024-05-08T21:49:59.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.259+0000 7fd8f590d700 1 -- 172.21.15.73:0/203858638 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8f0072880 msgr2=0x7fd8f00cc3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:59.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.259+0000 7fd8f590d700 1 --2- 172.21.15.73:0/203858638 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8f0072880 0x7fd8f00cc3b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd8f00c4530 tx=0x7fd8e4009b20 comp rx=0 tx=0).stop 2024-05-08T21:49:59.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.259+0000 7fd8f590d700 1 -- 172.21.15.73:0/203858638 shutdown_connections 2024-05-08T21:49:59.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.259+0000 7fd8f590d700 1 --2- 172.21.15.73:0/203858638 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8f0072880 0x7fd8f00cc3b0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:59.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.259+0000 7fd8f590d700 1 --2- 172.21.15.73:0/203858638 >> v2:172.21.15.115:3300/0 conn(0x7fd8f0072c60 0x7fd8f006aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:59.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.259+0000 7fd8f590d700 1 -- 172.21.15.73:0/203858638 >> 172.21.15.73:0/203858638 conn(0x7fd8f0066ab0 msgr2=0x7fd8f006f550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:59.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.260+0000 7fd8f590d700 1 -- 172.21.15.73:0/203858638 shutdown_connections 2024-05-08T21:49:59.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.260+0000 7fd8f590d700 1 -- 172.21.15.73:0/203858638 wait complete. 2024-05-08T21:49:59.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.261+0000 7fd8f590d700 1 Processor -- start 2024-05-08T21:49:59.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.261+0000 7fd8f590d700 1 -- start start 2024-05-08T21:49:59.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.262+0000 7fd8f590d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8f0072880 0x7fd8f015a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:59.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.262+0000 7fd8f590d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd8f0072c60 0x7fd8f01e33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:59.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.262+0000 7fd8f590d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8f015d1e0 0x7fd8f01e4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:59.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.262+0000 7fd8f590d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f01e54e0 con 0x7fd8f015d1e0 2024-05-08T21:49:59.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.262+0000 7fd8f590d700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f01f3360 con 0x7fd8f0072880 2024-05-08T21:49:59.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.262+0000 7fd8f590d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f01f35d0 con 0x7fd8f0072c60 2024-05-08T21:49:59.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.262+0000 7fd8ef7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8f015d1e0 0x7fd8f01e4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:59.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.262+0000 7fd8ef7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8f015d1e0 0x7fd8f01e4010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38532/0 (socket says 172.21.15.73:38532) 2024-05-08T21:49:59.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.262+0000 7fd8ef7fe700 1 -- 172.21.15.73:0/579296890 learned_addr learned my addr 172.21.15.73:0/579296890 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:59.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.262+0000 7fd8eeffd700 1 --2- 172.21.15.73:0/579296890 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8f0072880 0x7fd8f015a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:59.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.262+0000 7fd8ee7fc700 1 --2- 172.21.15.73:0/579296890 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd8f0072c60 0x7fd8f01e33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:59.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.262+0000 7fd8ef7fe700 1 -- 172.21.15.73:0/579296890 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd8f0072c60 msgr2=0x7fd8f01e33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:59.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.262+0000 7fd8ef7fe700 1 --2- 172.21.15.73:0/579296890 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd8f0072c60 0x7fd8f01e33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:59.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.262+0000 7fd8ef7fe700 1 -- 172.21.15.73:0/579296890 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8f0072880 msgr2=0x7fd8f015a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:59.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.262+0000 7fd8ef7fe700 1 --2- 172.21.15.73:0/579296890 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8f0072880 0x7fd8f015a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:59.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.262+0000 7fd8ef7fe700 1 -- 172.21.15.73:0/579296890 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8e40094a0 con 0x7fd8f015d1e0 2024-05-08T21:49:59.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.262+0000 7fd8ef7fe700 1 --2- 172.21.15.73:0/579296890 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8f015d1e0 0x7fd8f01e4010 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd8e800cba0 tx=0x7fd8e800ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:59.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.262+0000 7fd8d7fff700 1 -- 172.21.15.73:0/579296890 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e800aaa0 con 0x7fd8f015d1e0 2024-05-08T21:49:59.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.262+0000 7fd8d7fff700 1 -- 172.21.15.73:0/579296890 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8e800ac20 con 0x7fd8f015d1e0 2024-05-08T21:49:59.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.262+0000 7fd8f590d700 1 -- 172.21.15.73:0/579296890 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8f01e4f20 con 0x7fd8f015d1e0 2024-05-08T21:49:59.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.262+0000 7fd8d7fff700 1 -- 172.21.15.73:0/579296890 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e80070d0 con 0x7fd8f015d1e0 2024-05-08T21:49:59.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.262+0000 7fd8f590d700 1 -- 172.21.15.73:0/579296890 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8f01e4550 con 0x7fd8f015d1e0 2024-05-08T21:49:59.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.263+0000 7fd8f590d700 1 -- 172.21.15.73:0/579296890 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8f0068b80 con 0x7fd8f015d1e0 2024-05-08T21:49:59.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.264+0000 7fd8d7fff700 1 -- 172.21.15.73:0/579296890 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd8e8007230 con 0x7fd8f015d1e0 2024-05-08T21:49:59.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.264+0000 7fd8d7fff700 1 --2- 172.21.15.73:0/579296890 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fd8dc06ac90 0x7fd8dc06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:59.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.264+0000 7fd8d7fff700 1 -- 172.21.15.73:0/579296890 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd8e80890d0 con 0x7fd8f015d1e0 2024-05-08T21:49:59.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.264+0000 7fd8eeffd700 1 --2- 172.21.15.73:0/579296890 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fd8dc06ac90 0x7fd8dc06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:59.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.265+0000 7fd8eeffd700 1 --2- 172.21.15.73:0/579296890 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fd8dc06ac90 0x7fd8dc06d150 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd8e40090b0 tx=0x7fd8e4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:59.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.269+0000 7fd8d7fff700 1 -- 172.21.15.73:0/579296890 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fd8e8054220 con 0x7fd8f015d1e0 2024-05-08T21:49:59.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.463+0000 7fd8f590d700 1 -- 172.21.15.73:0/579296890 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd8f00c73a0 con 0x7fd8f015d1e0 2024-05-08T21:49:59.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.463+0000 7fd8d7fff700 1 -- 172.21.15.73:0/579296890 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd8e80180a0 con 0x7fd8f015d1e0 2024-05-08T21:49:59.465 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-05-08T21:49:59.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.465+0000 7fd8f590d700 1 -- 172.21.15.73:0/579296890 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fd8dc06ac90 msgr2=0x7fd8dc06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:59.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.465+0000 7fd8f590d700 1 --2- 172.21.15.73:0/579296890 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fd8dc06ac90 0x7fd8dc06d150 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd8e40090b0 tx=0x7fd8e4008030 comp rx=0 tx=0).stop 2024-05-08T21:49:59.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.465+0000 7fd8f590d700 1 -- 172.21.15.73:0/579296890 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8f015d1e0 msgr2=0x7fd8f01e4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:59.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.465+0000 7fd8f590d700 1 --2- 172.21.15.73:0/579296890 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8f015d1e0 0x7fd8f01e4010 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd8e800cba0 tx=0x7fd8e800ceb0 comp rx=0 tx=0).stop 2024-05-08T21:49:59.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.465+0000 7fd8f590d700 1 -- 172.21.15.73:0/579296890 shutdown_connections 2024-05-08T21:49:59.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.465+0000 7fd8f590d700 1 --2- 172.21.15.73:0/579296890 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fd8dc06ac90 0x7fd8dc06d150 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:59.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.465+0000 7fd8f590d700 1 --2- 172.21.15.73:0/579296890 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8f015d1e0 0x7fd8f01e4010 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:59.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.465+0000 7fd8f590d700 1 --2- 172.21.15.73:0/579296890 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8f0072880 0x7fd8f015a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:59.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.465+0000 7fd8f590d700 1 --2- 172.21.15.73:0/579296890 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd8f0072c60 0x7fd8f01e33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:59.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.465+0000 7fd8f590d700 1 -- 172.21.15.73:0/579296890 >> 172.21.15.73:0/579296890 conn(0x7fd8f0066ab0 msgr2=0x7fd8f0149dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:59.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.466+0000 7fd8f590d700 1 -- 172.21.15.73:0/579296890 shutdown_connections 2024-05-08T21:49:59.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.466+0000 7fd8f590d700 1 -- 172.21.15.73:0/579296890 wait complete. 2024-05-08T21:49:59.479 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T21:49:59.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.602+0000 7fdd9cd2c700 1 Processor -- start 2024-05-08T21:49:59.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.602+0000 7fdd9cd2c700 1 -- start start 2024-05-08T21:49:59.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.603+0000 7fdd9cd2c700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdd9806d820 0x7fdd98165630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:59.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.603+0000 7fdd9cd2c700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd980cd550 con 0x7fdd980c7fc0 2024-05-08T21:49:59.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.603+0000 7fdd9cd2c700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd9806f240 con 0x7fdd9815df80 2024-05-08T21:49:59.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.603+0000 7fdd9cd2c700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd9806d1d0 con 0x7fdd9806d820 2024-05-08T21:49:59.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.603+0000 7fdd96d9d700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdd9806d820 0x7fdd98165630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:59.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.603+0000 7fdd95d9b700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fdd980c7fc0 0x7fdd980c8750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:39228/0 (socket says 172.21.15.73:39228) 2024-05-08T21:49:59.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.603+0000 7fdd95d9b700 1 -- 172.21.15.73:0/386580930 learned_addr learned my addr 172.21.15.73:0/386580930 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:49:59.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.603+0000 7fdd96d9d700 1 -- 172.21.15.73:0/386580930 >> v1:172.21.15.115:6789/0 conn(0x7fdd9815df80 legacy=0x7fdd980cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:49:59.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.603+0000 7fdd96d9d700 1 -- 172.21.15.73:0/386580930 >> v1:172.21.15.73:6789/0 conn(0x7fdd980c7fc0 legacy=0x7fdd980c8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:59.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.603+0000 7fdd96d9d700 1 -- 172.21.15.73:0/386580930 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd980c4400 con 0x7fdd9806d820 2024-05-08T21:49:59.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.603+0000 7fdd96d9d700 1 --2- 172.21.15.73:0/386580930 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd9806d820 0x7fdd98165630 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fdd90009d90 tx=0x7fdd9000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9257441ff51872e7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:59.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.603+0000 7fdd9559a700 1 -- 172.21.15.73:0/386580930 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9000e070 con 0x7fdd9806d820 2024-05-08T21:49:59.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.603+0000 7fdd9559a700 1 -- 172.21.15.73:0/386580930 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd9000bad0 con 0x7fdd9806d820 2024-05-08T21:49:59.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.603+0000 7fdd9559a700 1 -- 172.21.15.73:0/386580930 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9000be80 con 0x7fdd9806d820 2024-05-08T21:49:59.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.604+0000 7fdd9cd2c700 1 -- 172.21.15.73:0/386580930 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd9806d820 msgr2=0x7fdd98165630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:59.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.604+0000 7fdd9cd2c700 1 --2- 172.21.15.73:0/386580930 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd9806d820 0x7fdd98165630 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fdd90009d90 tx=0x7fdd9000b330 comp rx=0 tx=0).stop 2024-05-08T21:49:59.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.604+0000 7fdd9cd2c700 1 -- 172.21.15.73:0/386580930 shutdown_connections 2024-05-08T21:49:59.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.604+0000 7fdd9cd2c700 1 --2- 172.21.15.73:0/386580930 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd9806d820 0x7fdd98165630 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:59.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.604+0000 7fdd9cd2c700 1 -- 172.21.15.73:0/386580930 >> 172.21.15.73:0/386580930 conn(0x7fdd9806aff0 msgr2=0x7fdd980666c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:59.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.604+0000 7fdd9cd2c700 1 -- 172.21.15.73:0/386580930 shutdown_connections 2024-05-08T21:49:59.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.604+0000 7fdd9cd2c700 1 -- 172.21.15.73:0/386580930 wait complete. 2024-05-08T21:49:59.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.605+0000 7fdd9cd2c700 1 Processor -- start 2024-05-08T21:49:59.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.605+0000 7fdd9cd2c700 1 -- start start 2024-05-08T21:49:59.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.606+0000 7fdd9cd2c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd9806d820 0x7fdd980cc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:59.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.606+0000 7fdd9cd2c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd980c7fc0 0x7fdd980c49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:59.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.606+0000 7fdd9cd2c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd9815df80 0x7fdd980c4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:59.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.606+0000 7fdd9cd2c700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd980c57c0 con 0x7fdd980c7fc0 2024-05-08T21:49:59.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.606+0000 7fdd9cd2c700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd980c3830 con 0x7fdd9806d820 2024-05-08T21:49:59.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.606+0000 7fdd9cd2c700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9815aee0 con 0x7fdd9815df80 2024-05-08T21:49:59.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.606+0000 7fdd95d9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd980c7fc0 0x7fdd980c49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:59.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.606+0000 7fdd95d9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd980c7fc0 0x7fdd980c49c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38544/0 (socket says 172.21.15.73:38544) 2024-05-08T21:49:59.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.606+0000 7fdd95d9b700 1 -- 172.21.15.73:0/3832517003 learned_addr learned my addr 172.21.15.73:0/3832517003 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:59.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.606+0000 7fdd9659c700 1 --2- 172.21.15.73:0/3832517003 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd9806d820 0x7fdd980cc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:59.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.606+0000 7fdd96d9d700 1 --2- 172.21.15.73:0/3832517003 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd9815df80 0x7fdd980c4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:59.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.606+0000 7fdd95d9b700 1 -- 172.21.15.73:0/3832517003 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd9815df80 msgr2=0x7fdd980c4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:59.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.606+0000 7fdd95d9b700 1 --2- 172.21.15.73:0/3832517003 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd9815df80 0x7fdd980c4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:59.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.606+0000 7fdd95d9b700 1 -- 172.21.15.73:0/3832517003 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd9806d820 msgr2=0x7fdd980cc7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:59.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.606+0000 7fdd95d9b700 1 --2- 172.21.15.73:0/3832517003 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd9806d820 0x7fdd980cc7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:59.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.606+0000 7fdd95d9b700 1 -- 172.21.15.73:0/3832517003 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd90009a70 con 0x7fdd980c7fc0 2024-05-08T21:49:59.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.606+0000 7fdd9659c700 1 --2- 172.21.15.73:0/3832517003 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd9806d820 0x7fdd980cc7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:49:59.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.606+0000 7fdd95d9b700 1 --2- 172.21.15.73:0/3832517003 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd980c7fc0 0x7fdd980c49c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c00c830 tx=0x7fdd8c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:59.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.607+0000 7fdd86ffd700 1 -- 172.21.15.73:0/3832517003 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c005d70 con 0x7fdd980c7fc0 2024-05-08T21:49:59.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.607+0000 7fdd86ffd700 1 -- 172.21.15.73:0/3832517003 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd8c007070 con 0x7fdd980c7fc0 2024-05-08T21:49:59.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.607+0000 7fdd9cd2c700 1 -- 172.21.15.73:0/3832517003 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd980c54e0 con 0x7fdd980c7fc0 2024-05-08T21:49:59.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.607+0000 7fdd86ffd700 1 -- 172.21.15.73:0/3832517003 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c007420 con 0x7fdd980c7fc0 2024-05-08T21:49:59.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.607+0000 7fdd9cd2c700 1 -- 172.21.15.73:0/3832517003 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd9815b410 con 0x7fdd980c7fc0 2024-05-08T21:49:59.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.608+0000 7fdd9cd2c700 1 -- 172.21.15.73:0/3832517003 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd9815bc10 con 0x7fdd980c7fc0 2024-05-08T21:49:59.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.608+0000 7fdd86ffd700 1 -- 172.21.15.73:0/3832517003 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fdd8c007580 con 0x7fdd980c7fc0 2024-05-08T21:49:59.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.608+0000 7fdd86ffd700 1 --2- 172.21.15.73:0/3832517003 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fdd7806acc0 0x7fdd7806d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:59.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.608+0000 7fdd86ffd700 1 -- 172.21.15.73:0/3832517003 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdd8c0888b0 con 0x7fdd980c7fc0 2024-05-08T21:49:59.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.608+0000 7fdd9659c700 1 --2- 172.21.15.73:0/3832517003 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fdd7806acc0 0x7fdd7806d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:59.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.609+0000 7fdd9659c700 1 --2- 172.21.15.73:0/3832517003 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fdd7806acc0 0x7fdd7806d180 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fdd88009930 tx=0x7fdd88008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:59.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.613+0000 7fdd86ffd700 1 -- 172.21.15.73:0/3832517003 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fdd9815bc10 con 0x7fdd980c7fc0 2024-05-08T21:49:59.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.810+0000 7fdd9cd2c700 1 -- 172.21.15.73:0/3832517003 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdd9815bc10 con 0x7fdd980c7fc0 2024-05-08T21:49:59.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.811+0000 7fdd86ffd700 1 -- 172.21.15.73:0/3832517003 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdd9815bc10 con 0x7fdd980c7fc0 2024-05-08T21:49:59.812 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-05-08T21:49:59.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.813+0000 7fdd9cd2c700 1 -- 172.21.15.73:0/3832517003 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fdd7806acc0 msgr2=0x7fdd7806d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:59.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.813+0000 7fdd9cd2c700 1 --2- 172.21.15.73:0/3832517003 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fdd7806acc0 0x7fdd7806d180 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fdd88009930 tx=0x7fdd88008040 comp rx=0 tx=0).stop 2024-05-08T21:49:59.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.813+0000 7fdd9cd2c700 1 -- 172.21.15.73:0/3832517003 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd980c7fc0 msgr2=0x7fdd980c49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:59.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.813+0000 7fdd9cd2c700 1 --2- 172.21.15.73:0/3832517003 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd980c7fc0 0x7fdd980c49c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c00c830 tx=0x7fdd8c00cbf0 comp rx=0 tx=0).stop 2024-05-08T21:49:59.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.813+0000 7fdd9cd2c700 1 -- 172.21.15.73:0/3832517003 shutdown_connections 2024-05-08T21:49:59.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.813+0000 7fdd9cd2c700 1 --2- 172.21.15.73:0/3832517003 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fdd7806acc0 0x7fdd7806d180 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:59.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.813+0000 7fdd9cd2c700 1 --2- 172.21.15.73:0/3832517003 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd9815df80 0x7fdd980c4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:59.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.813+0000 7fdd9cd2c700 1 --2- 172.21.15.73:0/3832517003 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd9806d820 0x7fdd980cc7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:59.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.813+0000 7fdd9cd2c700 1 --2- 172.21.15.73:0/3832517003 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd980c7fc0 0x7fdd980c49c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:59.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.813+0000 7fdd9cd2c700 1 -- 172.21.15.73:0/3832517003 >> 172.21.15.73:0/3832517003 conn(0x7fdd9806aff0 msgr2=0x7fdd980af160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:59.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.813+0000 7fdd9cd2c700 1 -- 172.21.15.73:0/3832517003 shutdown_connections 2024-05-08T21:49:59.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.813+0000 7fdd9cd2c700 1 -- 172.21.15.73:0/3832517003 wait complete. 2024-05-08T21:49:59.826 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T21:49:59.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.949+0000 7f035ac5d700 1 Processor -- start 2024-05-08T21:49:59.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.949+0000 7f035ac5d700 1 -- start start 2024-05-08T21:49:59.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.950+0000 7f035ac5d700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f03540cac40 0x7f03540720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:59.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.950+0000 7f035ac5d700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03540c9f90 con 0x7f0354072630 2024-05-08T21:49:59.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.950+0000 7f035ac5d700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0354159c00 con 0x7f0354153e20 2024-05-08T21:49:59.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.950+0000 7f035ac5d700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03540ca250 con 0x7f03540cac40 2024-05-08T21:49:59.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.950+0000 7f0353fff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f03540cac40 0x7f03540720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:59.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.950+0000 7f03591fa700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f0354072630 0x7f035415a100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:39238/0 (socket says 172.21.15.73:39238) 2024-05-08T21:49:59.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.950+0000 7f03591fa700 1 -- 172.21.15.73:0/2960872497 learned_addr learned my addr 172.21.15.73:0/2960872497 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:49:59.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.950+0000 7f0353fff700 1 -- 172.21.15.73:0/2960872497 >> v1:172.21.15.115:6789/0 conn(0x7f0354153e20 legacy=0x7f035415dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:59.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.950+0000 7f0353fff700 1 -- 172.21.15.73:0/2960872497 >> v1:172.21.15.73:6789/0 conn(0x7f0354072630 legacy=0x7f035415a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:59.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.950+0000 7f0353fff700 1 -- 172.21.15.73:0/2960872497 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03540cb7e0 con 0x7f03540cac40 2024-05-08T21:49:59.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.950+0000 7f03537fe700 1 -- 172.21.15.73:0/2960872497 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1983819956 0 0) 0x7f03540c9f90 con 0x7f0354072630 2024-05-08T21:49:59.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.951+0000 7f0353fff700 1 --2- 172.21.15.73:0/2960872497 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03540cac40 0x7f03540720f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0340009840 tx=0x7f0340009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=537817119485fbc6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:59.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.951+0000 7f03537fe700 1 -- 172.21.15.73:0/2960872497 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0340011830 con 0x7f03540cac40 2024-05-08T21:49:59.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.951+0000 7f03537fe700 1 -- 172.21.15.73:0/2960872497 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0340011990 con 0x7f03540cac40 2024-05-08T21:49:59.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.951+0000 7f03537fe700 1 -- 172.21.15.73:0/2960872497 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0340011d20 con 0x7f03540cac40 2024-05-08T21:49:59.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.951+0000 7f035ac5d700 1 -- 172.21.15.73:0/2960872497 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03540cac40 msgr2=0x7f03540720f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:59.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.951+0000 7f035ac5d700 1 --2- 172.21.15.73:0/2960872497 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03540cac40 0x7f03540720f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0340009840 tx=0x7f0340009b50 comp rx=0 tx=0).stop 2024-05-08T21:49:59.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.951+0000 7f035ac5d700 1 -- 172.21.15.73:0/2960872497 shutdown_connections 2024-05-08T21:49:59.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.951+0000 7f035ac5d700 1 --2- 172.21.15.73:0/2960872497 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03540cac40 0x7f03540720f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:59.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.951+0000 7f035ac5d700 1 -- 172.21.15.73:0/2960872497 >> 172.21.15.73:0/2960872497 conn(0x7f035406be90 msgr2=0x7f035406c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:49:59.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.951+0000 7f035ac5d700 1 -- 172.21.15.73:0/2960872497 shutdown_connections 2024-05-08T21:49:59.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.951+0000 7f035ac5d700 1 -- 172.21.15.73:0/2960872497 wait complete. 2024-05-08T21:49:59.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.952+0000 7f035ac5d700 1 Processor -- start 2024-05-08T21:49:59.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.952+0000 7f035ac5d700 1 -- start start 2024-05-08T21:49:59.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.953+0000 7f035ac5d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0354072630 0x7f0354150660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:59.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.953+0000 7f035ac5d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f03540cac40 0x7f0354146f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:59.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.953+0000 7f035ac5d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0354153e20 0x7f0354147490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:59.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.953+0000 7f035ac5d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03540b4d10 con 0x7f0354072630 2024-05-08T21:49:59.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.953+0000 7f035ac5d700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03540b3b80 con 0x7f03540cac40 2024-05-08T21:49:59.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.953+0000 7f035ac5d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03540b3db0 con 0x7f0354153e20 2024-05-08T21:49:59.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.953+0000 7f03589f9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0354072630 0x7f0354150660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:59.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.953+0000 7f03589f9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0354072630 0x7f0354150660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38562/0 (socket says 172.21.15.73:38562) 2024-05-08T21:49:59.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.953+0000 7f03589f9700 1 -- 172.21.15.73:0/1112491742 learned_addr learned my addr 172.21.15.73:0/1112491742 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:49:59.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.954+0000 7f0353fff700 1 --2- 172.21.15.73:0/1112491742 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f03540cac40 0x7f0354146f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:59.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.954+0000 7f03589f9700 1 -- 172.21.15.73:0/1112491742 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0354153e20 msgr2=0x7f0354147490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:59.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.954+0000 7f03591fa700 1 --2- 172.21.15.73:0/1112491742 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0354153e20 0x7f0354147490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:59.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.954+0000 7f03589f9700 1 --2- 172.21.15.73:0/1112491742 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0354153e20 0x7f0354147490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:59.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.954+0000 7f03589f9700 1 -- 172.21.15.73:0/1112491742 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f03540cac40 msgr2=0x7f0354146f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:49:59.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.954+0000 7f03589f9700 1 --2- 172.21.15.73:0/1112491742 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f03540cac40 0x7f0354146f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:49:59.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.954+0000 7f03589f9700 1 -- 172.21.15.73:0/1112491742 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03400094a0 con 0x7f0354072630 2024-05-08T21:49:59.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.954+0000 7f03591fa700 1 --2- 172.21.15.73:0/1112491742 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0354153e20 0x7f0354147490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:49:59.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.954+0000 7f03589f9700 1 --2- 172.21.15.73:0/1112491742 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0354072630 0x7f0354150660 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f034800c450 tx=0x7f034800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:59.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.954+0000 7f03517fa700 1 -- 172.21.15.73:0/1112491742 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03480052d0 con 0x7f0354072630 2024-05-08T21:49:59.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.954+0000 7f03517fa700 1 -- 172.21.15.73:0/1112491742 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0348005430 con 0x7f0354072630 2024-05-08T21:49:59.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.954+0000 7f035ac5d700 1 -- 172.21.15.73:0/1112491742 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03540b4090 con 0x7f0354072630 2024-05-08T21:49:59.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.954+0000 7f03517fa700 1 -- 172.21.15.73:0/1112491742 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03480038c0 con 0x7f0354072630 2024-05-08T21:49:59.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.954+0000 7f035ac5d700 1 -- 172.21.15.73:0/1112491742 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03540b4650 con 0x7f0354072630 2024-05-08T21:49:59.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.955+0000 7f035ac5d700 1 -- 172.21.15.73:0/1112491742 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03540c44a0 con 0x7f0354072630 2024-05-08T21:49:59.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.955+0000 7f03517fa700 1 -- 172.21.15.73:0/1112491742 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0348003a20 con 0x7f0354072630 2024-05-08T21:49:59.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.956+0000 7f03517fa700 1 --2- 172.21.15.73:0/1112491742 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f033806acc0 0x7f033806d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:49:59.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.956+0000 7f0353fff700 1 --2- 172.21.15.73:0/1112491742 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f033806acc0 0x7f033806d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:49:59.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.956+0000 7f03517fa700 1 -- 172.21.15.73:0/1112491742 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0348088770 con 0x7f0354072630 2024-05-08T21:49:59.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.956+0000 7f0353fff700 1 --2- 172.21.15.73:0/1112491742 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f033806acc0 0x7f033806d180 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0354142d70 tx=0x7f034001c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:49:59.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:49:59.960+0000 7f03517fa700 1 -- 172.21.15.73:0/1112491742 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f03480538b0 con 0x7f0354072630 2024-05-08T21:50:00.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.157+0000 7f035ac5d700 1 -- 172.21.15.73:0/1112491742 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f03540b4f80 con 0x7f0354072630 2024-05-08T21:50:00.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.157+0000 7f03517fa700 1 -- 172.21.15.73:0/1112491742 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0348056ed0 con 0x7f0354072630 2024-05-08T21:50:00.158 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-05-08T21:50:00.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.159+0000 7f035ac5d700 1 -- 172.21.15.73:0/1112491742 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f033806acc0 msgr2=0x7f033806d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:00.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.159+0000 7f035ac5d700 1 --2- 172.21.15.73:0/1112491742 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f033806acc0 0x7f033806d180 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0354142d70 tx=0x7f034001c040 comp rx=0 tx=0).stop 2024-05-08T21:50:00.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.159+0000 7f035ac5d700 1 -- 172.21.15.73:0/1112491742 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0354072630 msgr2=0x7f0354150660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:00.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.159+0000 7f035ac5d700 1 --2- 172.21.15.73:0/1112491742 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0354072630 0x7f0354150660 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f034800c450 tx=0x7f034800c810 comp rx=0 tx=0).stop 2024-05-08T21:50:00.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.159+0000 7f035ac5d700 1 -- 172.21.15.73:0/1112491742 shutdown_connections 2024-05-08T21:50:00.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.159+0000 7f035ac5d700 1 --2- 172.21.15.73:0/1112491742 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f033806acc0 0x7f033806d180 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:00.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.159+0000 7f035ac5d700 1 --2- 172.21.15.73:0/1112491742 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0354153e20 0x7f0354147490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:00.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.159+0000 7f035ac5d700 1 --2- 172.21.15.73:0/1112491742 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0354072630 0x7f0354150660 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:00.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.159+0000 7f035ac5d700 1 --2- 172.21.15.73:0/1112491742 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f03540cac40 0x7f0354146f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:00.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.159+0000 7f035ac5d700 1 -- 172.21.15.73:0/1112491742 >> 172.21.15.73:0/1112491742 conn(0x7f035406be90 msgr2=0x7f0354158060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:50:00.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.159+0000 7f035ac5d700 1 -- 172.21.15.73:0/1112491742 shutdown_connections 2024-05-08T21:50:00.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.159+0000 7f035ac5d700 1 -- 172.21.15.73:0/1112491742 wait complete. 2024-05-08T21:50:00.173 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:50:00.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.295+0000 7fd2294ee700 1 Processor -- start 2024-05-08T21:50:00.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.295+0000 7fd2294ee700 1 -- start start 2024-05-08T21:50:00.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.296+0000 7fd2294ee700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd224153e70 0x7fd2240ca650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:00.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.296+0000 7fd2294ee700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd2240cfb50 0x7fd2240cab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:00.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.296+0000 7fd2294ee700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2240cb100 con 0x7fd224154250 2024-05-08T21:50:00.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.296+0000 7fd2294ee700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2240cbf60 con 0x7fd224153e70 2024-05-08T21:50:00.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.296+0000 7fd2294ee700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2240cb350 con 0x7fd2240cfb50 2024-05-08T21:50:00.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.296+0000 7fd2227fc700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fd224154250 0x7fd2240cf440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:39242/0 (socket says 172.21.15.73:39242) 2024-05-08T21:50:00.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.296+0000 7fd2227fc700 1 -- 172.21.15.73:0/3073843604 learned_addr learned my addr 172.21.15.73:0/3073843604 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:50:00.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.297+0000 7fd221ffb700 1 -- 172.21.15.73:0/3073843604 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1072752745 0 0) 0x7fd2240cb100 con 0x7fd224154250 2024-05-08T21:50:00.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.297+0000 7fd221ffb700 1 -- 172.21.15.73:0/3073843604 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd20c0035b0 con 0x7fd224154250 2024-05-08T21:50:00.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.297+0000 7fd222ffd700 1 --2- 172.21.15.73:0/3073843604 >> v2:172.21.15.115:3300/0 conn(0x7fd224153e70 0x7fd2240ca650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:00.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.297+0000 7fd2237fe700 1 --2- 172.21.15.73:0/3073843604 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd2240cfb50 0x7fd2240cab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:00.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.297+0000 7fd221ffb700 1 -- 172.21.15.73:0/3073843604 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 74972773 0 0) 0x7fd20c0035b0 con 0x7fd224154250 2024-05-08T21:50:00.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.297+0000 7fd221ffb700 1 -- 172.21.15.73:0/3073843604 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd2240cfb50 msgr2=0x7fd2240cab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:50:00.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.297+0000 7fd221ffb700 1 --2- 172.21.15.73:0/3073843604 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd2240cfb50 0x7fd2240cab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:00.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.297+0000 7fd221ffb700 1 -- 172.21.15.73:0/3073843604 >> v2:172.21.15.115:3300/0 conn(0x7fd224153e70 msgr2=0x7fd2240ca650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:50:00.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.297+0000 7fd221ffb700 1 --2- 172.21.15.73:0/3073843604 >> v2:172.21.15.115:3300/0 conn(0x7fd224153e70 0x7fd2240ca650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:00.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.297+0000 7fd221ffb700 1 -- 172.21.15.73:0/3073843604 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2240cb630 con 0x7fd224154250 2024-05-08T21:50:00.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.297+0000 7fd221ffb700 1 -- 172.21.15.73:0/3073843604 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 953298616 0 0) 0x7fd214001670 con 0x7fd224154250 2024-05-08T21:50:00.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.297+0000 7fd221ffb700 1 -- 172.21.15.73:0/3073843604 >> v1:172.21.15.73:6789/0 conn(0x7fd224154250 legacy=0x7fd2240cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:00.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.297+0000 7fd221ffb700 1 --2- 172.21.15.73:0/3073843604 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd20c003a00 0x7fd20c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:00.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.297+0000 7fd221ffb700 1 --2- 172.21.15.73:0/3073843604 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd20c004850 0x7fd20c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:00.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.297+0000 7fd221ffb700 1 --2- 172.21.15.73:0/3073843604 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd20c005210 0x7fd20c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:00.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.297+0000 7fd221ffb700 1 -- 172.21.15.73:0/3073843604 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2240cbf60 con 0x7fd20c005210 2024-05-08T21:50:00.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.297+0000 7fd221ffb700 1 -- 172.21.15.73:0/3073843604 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2240cb350 con 0x7fd20c003a00 2024-05-08T21:50:00.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.297+0000 7fd221ffb700 1 -- 172.21.15.73:0/3073843604 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd20c00c0e0 con 0x7fd20c004850 2024-05-08T21:50:00.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.297+0000 7fd2237fe700 1 --2- 172.21.15.73:0/3073843604 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd2240cfb50 0x7fd2240cab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:50:00.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.297+0000 7fd222ffd700 1 --2- 172.21.15.73:0/3073843604 >> v2:172.21.15.115:3300/0 conn(0x7fd224153e70 0x7fd2240ca650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:50:00.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.297+0000 7fd2237fe700 1 --2- 172.21.15.73:0/3073843604 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd20c005210 0x7fd20c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:00.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.297+0000 7fd222ffd700 1 --2- 172.21.15.73:0/3073843604 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd20c003a00 0x7fd20c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:00.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.297+0000 7fd2227fc700 1 --2- 172.21.15.73:0/3073843604 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd20c004850 0x7fd20c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:00.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.297+0000 7fd2237fe700 1 -- 172.21.15.73:0/3073843604 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd20c004850 msgr2=0x7fd20c004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:50:00.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.297+0000 7fd2237fe700 1 --2- 172.21.15.73:0/3073843604 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd20c004850 0x7fd20c004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:00.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.297+0000 7fd2237fe700 1 -- 172.21.15.73:0/3073843604 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd20c003a00 msgr2=0x7fd20c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:50:00.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.297+0000 7fd2237fe700 1 --2- 172.21.15.73:0/3073843604 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd20c003a00 0x7fd20c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:00.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.297+0000 7fd2237fe700 1 -- 172.21.15.73:0/3073843604 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd20c0035b0 con 0x7fd20c005210 2024-05-08T21:50:00.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.297+0000 7fd2237fe700 1 --2- 172.21.15.73:0/3073843604 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd20c005210 0x7fd20c00ba10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd2240ccf90 tx=0x7fd20c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4011cac81fea3e21 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:00.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.298+0000 7fd221ffb700 1 -- 172.21.15.73:0/3073843604 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21c007d90 con 0x7fd20c005210 2024-05-08T21:50:00.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.298+0000 7fd221ffb700 1 -- 172.21.15.73:0/3073843604 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd21c00f040 con 0x7fd20c005210 2024-05-08T21:50:00.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.298+0000 7fd221ffb700 1 -- 172.21.15.73:0/3073843604 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21c003c60 con 0x7fd20c005210 2024-05-08T21:50:00.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.298+0000 7fd2294ee700 1 -- 172.21.15.73:0/3073843604 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd20c005210 msgr2=0x7fd20c00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:00.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.298+0000 7fd2294ee700 1 --2- 172.21.15.73:0/3073843604 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd20c005210 0x7fd20c00ba10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd2240ccf90 tx=0x7fd20c005880 comp rx=0 tx=0).stop 2024-05-08T21:50:00.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.298+0000 7fd2237fe700 1 -- 172.21.15.73:0/3073843604 reap_dead start 2024-05-08T21:50:00.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.298+0000 7fd2294ee700 1 -- 172.21.15.73:0/3073843604 shutdown_connections 2024-05-08T21:50:00.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.298+0000 7fd2294ee700 1 -- 172.21.15.73:0/3073843604 >> 172.21.15.73:0/3073843604 conn(0x7fd224072720 msgr2=0x7fd22406b6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:50:00.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.298+0000 7fd2294ee700 1 -- 172.21.15.73:0/3073843604 shutdown_connections 2024-05-08T21:50:00.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.298+0000 7fd2294ee700 1 -- 172.21.15.73:0/3073843604 wait complete. 2024-05-08T21:50:00.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.300+0000 7fd2294ee700 1 Processor -- start 2024-05-08T21:50:00.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.300+0000 7fd2294ee700 1 -- start start 2024-05-08T21:50:00.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.300+0000 7fd2294ee700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd20c005210 0x7fd22414bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:00.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.300+0000 7fd2294ee700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd224154640 0x7fd2240c7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:00.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.300+0000 7fd2294ee700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd2240c3700 0x7fd2240c7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:00.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.300+0000 7fd2294ee700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2240c3cb0 con 0x7fd2240c3700 2024-05-08T21:50:00.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.300+0000 7fd2294ee700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2241ef0e0 con 0x7fd224154640 2024-05-08T21:50:00.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.300+0000 7fd2294ee700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2241ef3c0 con 0x7fd20c005210 2024-05-08T21:50:00.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.300+0000 7fd2237fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd2240c3700 0x7fd2240c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:00.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.300+0000 7fd2237fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd2240c3700 0x7fd2240c7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38580/0 (socket says 172.21.15.73:38580) 2024-05-08T21:50:00.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.300+0000 7fd2237fe700 1 -- 172.21.15.73:0/2623170412 learned_addr learned my addr 172.21.15.73:0/2623170412 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:50:00.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.301+0000 7fd2237fe700 1 -- 172.21.15.73:0/2623170412 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd20c005210 msgr2=0x7fd22414bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:00.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.301+0000 7fd2237fe700 1 --2- 172.21.15.73:0/2623170412 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd20c005210 0x7fd22414bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:00.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.301+0000 7fd2237fe700 1 -- 172.21.15.73:0/2623170412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd224154640 msgr2=0x7fd2240c7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:00.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.301+0000 7fd2227fc700 1 --2- 172.21.15.73:0/2623170412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd224154640 0x7fd2240c7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:00.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.301+0000 7fd2237fe700 1 --2- 172.21.15.73:0/2623170412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd224154640 0x7fd2240c7120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:00.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.301+0000 7fd2237fe700 1 -- 172.21.15.73:0/2623170412 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2241ef6a0 con 0x7fd2240c3700 2024-05-08T21:50:00.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.301+0000 7fd2237fe700 1 --2- 172.21.15.73:0/2623170412 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd2240c3700 0x7fd2240c7660 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd21c000f80 tx=0x7fd21c004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:00.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.301+0000 7fd20b7fe700 1 -- 172.21.15.73:0/2623170412 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21c004440 con 0x7fd2240c3700 2024-05-08T21:50:00.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.301+0000 7fd20b7fe700 1 -- 172.21.15.73:0/2623170412 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd21c0045a0 con 0x7fd2240c3700 2024-05-08T21:50:00.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.301+0000 7fd2294ee700 1 -- 172.21.15.73:0/2623170412 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2241ef980 con 0x7fd2240c3700 2024-05-08T21:50:00.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.301+0000 7fd20b7fe700 1 -- 172.21.15.73:0/2623170412 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21c004930 con 0x7fd2240c3700 2024-05-08T21:50:00.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.301+0000 7fd2294ee700 1 -- 172.21.15.73:0/2623170412 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd22414c010 con 0x7fd2240c3700 2024-05-08T21:50:00.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.302+0000 7fd2294ee700 1 -- 172.21.15.73:0/2623170412 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2241efea0 con 0x7fd2240c3700 2024-05-08T21:50:00.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.302+0000 7fd20b7fe700 1 -- 172.21.15.73:0/2623170412 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd21c028460 con 0x7fd2240c3700 2024-05-08T21:50:00.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.303+0000 7fd20b7fe700 1 --2- 172.21.15.73:0/2623170412 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fd21006acc0 0x7fd21006d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:00.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.303+0000 7fd222ffd700 1 --2- 172.21.15.73:0/2623170412 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fd21006acc0 0x7fd21006d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:00.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.303+0000 7fd20b7fe700 1 -- 172.21.15.73:0/2623170412 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd21c08a5e0 con 0x7fd2240c3700 2024-05-08T21:50:00.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.303+0000 7fd222ffd700 1 --2- 172.21.15.73:0/2623170412 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fd21006acc0 0x7fd21006d180 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd2180099c0 tx=0x7fd2180095a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:00.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.307+0000 7fd20b7fe700 1 -- 172.21.15.73:0/2623170412 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fd21c0592e0 con 0x7fd2240c3700 2024-05-08T21:50:00.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.547+0000 7fd2294ee700 1 -- 172.21.15.73:0/2623170412 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd224067a20 con 0x7fd2240c3700 2024-05-08T21:50:00.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.548+0000 7fd20b7fe700 1 -- 172.21.15.73:0/2623170412 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+6250 (secure 0 0 0) 0x7fd21c058e70 con 0x7fd2240c3700 2024-05-08T21:50:00.549 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:50:00.549 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3242319177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6833","nonce":3242319177},{"type":"v1","addr":"172.21.15.115:6835","nonce":3242319177}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6834/2136341349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2136341349},{"type":"v1","addr":"172.21.15.115:6834","nonce":2136341349}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4249,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1439647913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1439647913},{"type":"v1","addr":"172.21.15.115:6837","nonce":1439647913}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/2386382396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2386382396},{"type":"v1","addr":"172.21.15.73:6836","nonce":2386382396}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/1772457954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":1772457954},{"type":"v1","addr":"172.21.15.73:6837","nonce":1772457954}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:49:43.747162+0000","modified":"2024-05-08T21:49:48.814033+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.73:6839/1477468490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1477468490},{"type":"v1","addr":"172.21.15.73:6839","nonce":1477468490}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:50:00.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.550+0000 7fd2294ee700 1 -- 172.21.15.73:0/2623170412 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fd21006acc0 msgr2=0x7fd21006d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:00.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.550+0000 7fd2294ee700 1 --2- 172.21.15.73:0/2623170412 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fd21006acc0 0x7fd21006d180 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd2180099c0 tx=0x7fd2180095a0 comp rx=0 tx=0).stop 2024-05-08T21:50:00.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.550+0000 7fd2294ee700 1 -- 172.21.15.73:0/2623170412 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd2240c3700 msgr2=0x7fd2240c7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:00.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.550+0000 7fd2294ee700 1 --2- 172.21.15.73:0/2623170412 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd2240c3700 0x7fd2240c7660 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd21c000f80 tx=0x7fd21c004b40 comp rx=0 tx=0).stop 2024-05-08T21:50:00.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.550+0000 7fd2294ee700 1 -- 172.21.15.73:0/2623170412 shutdown_connections 2024-05-08T21:50:00.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.550+0000 7fd2294ee700 1 --2- 172.21.15.73:0/2623170412 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fd21006acc0 0x7fd21006d180 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:00.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.550+0000 7fd2294ee700 1 --2- 172.21.15.73:0/2623170412 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd2240c3700 0x7fd2240c7660 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:00.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.550+0000 7fd2294ee700 1 --2- 172.21.15.73:0/2623170412 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd20c005210 0x7fd22414bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:00.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.550+0000 7fd2294ee700 1 --2- 172.21.15.73:0/2623170412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd224154640 0x7fd2240c7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:00.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.550+0000 7fd2294ee700 1 -- 172.21.15.73:0/2623170412 >> 172.21.15.73:0/2623170412 conn(0x7fd224072720 msgr2=0x7fd2240c6900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:50:00.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.550+0000 7fd2294ee700 1 -- 172.21.15.73:0/2623170412 shutdown_connections 2024-05-08T21:50:00.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.550+0000 7fd2294ee700 1 -- 172.21.15.73:0/2623170412 wait complete. 2024-05-08T21:50:00.553 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 8 2024-05-08T21:50:00.563 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T21:50:00.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.684+0000 7ff4bdbb2700 1 Processor -- start 2024-05-08T21:50:00.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.684+0000 7ff4bdbb2700 1 -- start start 2024-05-08T21:50:00.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.685+0000 7ff4bdbb2700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff4b806afc0 0x7ff4b80724e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:00.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.685+0000 7ff4bdbb2700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff4b8072a20 0x7ff4b815d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:00.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.685+0000 7ff4bdbb2700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4b8154490 con 0x7ff4b81540b0 2024-05-08T21:50:00.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.685+0000 7ff4bdbb2700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4b806b430 con 0x7ff4b806afc0 2024-05-08T21:50:00.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.685+0000 7ff4bdbb2700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4b80c79b0 con 0x7ff4b8072a20 2024-05-08T21:50:00.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.685+0000 7ff4b6ffd700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff4b806afc0 0x7ff4b80724e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:00.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.685+0000 7ff4b77fe700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7ff4b81540b0 0x7ff4b8071d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:39254/0 (socket says 172.21.15.73:39254) 2024-05-08T21:50:00.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.685+0000 7ff4b77fe700 1 -- 172.21.15.73:0/2071102824 learned_addr learned my addr 172.21.15.73:0/2071102824 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:50:00.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.685+0000 7ff4b7fff700 1 --2- 172.21.15.73:0/2071102824 >> v2:172.21.15.115:3300/0 conn(0x7ff4b8072a20 0x7ff4b815d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:00.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.685+0000 7ff4b67fc700 1 -- 172.21.15.73:0/2071102824 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1497867123 0 0) 0x7ff4b8154490 con 0x7ff4b81540b0 2024-05-08T21:50:00.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.685+0000 7ff4b67fc700 1 -- 172.21.15.73:0/2071102824 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4a00035b0 con 0x7ff4b81540b0 2024-05-08T21:50:00.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.685+0000 7ff4b6ffd700 1 -- 172.21.15.73:0/2071102824 >> v2:172.21.15.115:3300/0 conn(0x7ff4b8072a20 msgr2=0x7ff4b815d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:50:00.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.685+0000 7ff4b6ffd700 1 --2- 172.21.15.73:0/2071102824 >> v2:172.21.15.115:3300/0 conn(0x7ff4b8072a20 0x7ff4b815d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:00.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.685+0000 7ff4b6ffd700 1 -- 172.21.15.73:0/2071102824 >> v1:172.21.15.73:6789/0 conn(0x7ff4b81540b0 legacy=0x7ff4b8071d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:00.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.685+0000 7ff4b6ffd700 1 -- 172.21.15.73:0/2071102824 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b80c7c90 con 0x7ff4b806afc0 2024-05-08T21:50:00.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.685+0000 7ff4b6ffd700 1 --2- 172.21.15.73:0/2071102824 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4b806afc0 0x7ff4b80724e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff4b8071a80 tx=0x7ff4ac009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e32d099fb6fdd9d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:00.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.685+0000 7ff4b67fc700 1 -- 172.21.15.73:0/2071102824 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac011830 con 0x7ff4b806afc0 2024-05-08T21:50:00.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.685+0000 7ff4b67fc700 1 -- 172.21.15.73:0/2071102824 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4ac011990 con 0x7ff4b806afc0 2024-05-08T21:50:00.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.685+0000 7ff4b67fc700 1 -- 172.21.15.73:0/2071102824 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac011d20 con 0x7ff4b806afc0 2024-05-08T21:50:00.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.686+0000 7ff4bdbb2700 1 -- 172.21.15.73:0/2071102824 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4b806afc0 msgr2=0x7ff4b80724e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:00.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.686+0000 7ff4bdbb2700 1 --2- 172.21.15.73:0/2071102824 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4b806afc0 0x7ff4b80724e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff4b8071a80 tx=0x7ff4ac009b20 comp rx=0 tx=0).stop 2024-05-08T21:50:00.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.686+0000 7ff4bdbb2700 1 -- 172.21.15.73:0/2071102824 shutdown_connections 2024-05-08T21:50:00.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.686+0000 7ff4bdbb2700 1 --2- 172.21.15.73:0/2071102824 >> v2:172.21.15.115:3300/0 conn(0x7ff4b8072a20 0x7ff4b815d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:00.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.686+0000 7ff4bdbb2700 1 --2- 172.21.15.73:0/2071102824 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4b806afc0 0x7ff4b80724e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:00.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.686+0000 7ff4bdbb2700 1 -- 172.21.15.73:0/2071102824 >> 172.21.15.73:0/2071102824 conn(0x7ff4b8066d70 msgr2=0x7ff4b80cc500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:50:00.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.686+0000 7ff4bdbb2700 1 -- 172.21.15.73:0/2071102824 shutdown_connections 2024-05-08T21:50:00.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.686+0000 7ff4bdbb2700 1 -- 172.21.15.73:0/2071102824 wait complete. 2024-05-08T21:50:00.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.687+0000 7ff4bdbb2700 1 Processor -- start 2024-05-08T21:50:00.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.688+0000 7ff4bdbb2700 1 -- start start 2024-05-08T21:50:00.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.689+0000 7ff4bdbb2700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff4b806afc0 0x7ff4b8154680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:00.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.689+0000 7ff4bdbb2700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4b8072a20 0x7ff4b81f0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:00.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.689+0000 7ff4bdbb2700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4b81540b0 0x7ff4b80ca780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:00.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.689+0000 7ff4bdbb2700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b8154f60 con 0x7ff4b8072a20 2024-05-08T21:50:00.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.689+0000 7ff4bdbb2700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b80cb7a0 con 0x7ff4b81540b0 2024-05-08T21:50:00.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.689+0000 7ff4bdbb2700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b8154bc0 con 0x7ff4b806afc0 2024-05-08T21:50:00.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.689+0000 7ff4b6ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4b8072a20 0x7ff4b81f0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:00.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.689+0000 7ff4b6ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4b8072a20 0x7ff4b81f0160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38592/0 (socket says 172.21.15.73:38592) 2024-05-08T21:50:00.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.689+0000 7ff4b6ffd700 1 -- 172.21.15.73:0/3844316059 learned_addr learned my addr 172.21.15.73:0/3844316059 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:50:00.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.689+0000 7ff4b7fff700 1 --2- 172.21.15.73:0/3844316059 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4b81540b0 0x7ff4b80ca780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:00.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.689+0000 7ff4b6ffd700 1 -- 172.21.15.73:0/3844316059 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff4b806afc0 msgr2=0x7ff4b8154680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:00.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.689+0000 7ff4b77fe700 1 --2- 172.21.15.73:0/3844316059 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff4b806afc0 0x7ff4b8154680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:00.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.689+0000 7ff4b6ffd700 1 --2- 172.21.15.73:0/3844316059 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff4b806afc0 0x7ff4b8154680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:00.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.689+0000 7ff4b6ffd700 1 -- 172.21.15.73:0/3844316059 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4b81540b0 msgr2=0x7ff4b80ca780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:00.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.689+0000 7ff4b6ffd700 1 --2- 172.21.15.73:0/3844316059 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4b81540b0 0x7ff4b80ca780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:00.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.689+0000 7ff4b6ffd700 1 -- 172.21.15.73:0/3844316059 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4ac0094a0 con 0x7ff4b8072a20 2024-05-08T21:50:00.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.689+0000 7ff4b7fff700 1 --2- 172.21.15.73:0/3844316059 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4b81540b0 0x7ff4b80ca780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:50:00.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.689+0000 7ff4b77fe700 1 --2- 172.21.15.73:0/3844316059 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff4b806afc0 0x7ff4b8154680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:50:00.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.689+0000 7ff4b6ffd700 1 --2- 172.21.15.73:0/3844316059 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4b8072a20 0x7ff4b81f0160 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac009b60 tx=0x7ff4ac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:00.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.689+0000 7ff49ffff700 1 -- 172.21.15.73:0/3844316059 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac0038a0 con 0x7ff4b8072a20 2024-05-08T21:50:00.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.689+0000 7ff49ffff700 1 -- 172.21.15.73:0/3844316059 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4ac01f070 con 0x7ff4b8072a20 2024-05-08T21:50:00.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.689+0000 7ff4bdbb2700 1 -- 172.21.15.73:0/3844316059 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4b81efcd0 con 0x7ff4b8072a20 2024-05-08T21:50:00.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.689+0000 7ff49ffff700 1 -- 172.21.15.73:0/3844316059 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac003c40 con 0x7ff4b8072a20 2024-05-08T21:50:00.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.689+0000 7ff4bdbb2700 1 -- 172.21.15.73:0/3844316059 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4b80cbcb0 con 0x7ff4b8072a20 2024-05-08T21:50:00.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.690+0000 7ff4bdbb2700 1 -- 172.21.15.73:0/3844316059 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4b8068b80 con 0x7ff4b8072a20 2024-05-08T21:50:00.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.691+0000 7ff49ffff700 1 -- 172.21.15.73:0/3844316059 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff4ac026480 con 0x7ff4b8072a20 2024-05-08T21:50:00.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.691+0000 7ff49ffff700 1 --2- 172.21.15.73:0/3844316059 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7ff4a406ac90 0x7ff4a406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:00.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.691+0000 7ff49ffff700 1 -- 172.21.15.73:0/3844316059 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff4ac021070 con 0x7ff4b8072a20 2024-05-08T21:50:00.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.691+0000 7ff4b77fe700 1 --2- 172.21.15.73:0/3844316059 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7ff4a406ac90 0x7ff4a406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:00.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.691+0000 7ff4b77fe700 1 --2- 172.21.15.73:0/3844316059 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7ff4a406ac90 0x7ff4a406d150 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff4a80011e0 tx=0x7ff4a8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:00.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.696+0000 7ff49ffff700 1 -- 172.21.15.73:0/3844316059 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7ff4ac055da0 con 0x7ff4b8072a20 2024-05-08T21:50:00.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.892+0000 7ff4bdbb2700 1 -- 172.21.15.73:0/3844316059 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4b81577b0 con 0x7ff4b8072a20 2024-05-08T21:50:00.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.893+0000 7ff49ffff700 1 -- 172.21.15.73:0/3844316059 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16037 (secure 0 0 0) 0x7ff4ac02b090 con 0x7ff4b8072a20 2024-05-08T21:50:00.894 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:50:00.895 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":21,"fsid":"143164b7-c9c7-4737-a494-7dafa5a3320c","created":"2024-05-08T21:49:26.221909+0000","modified":"2024-05-08T21:49:44.748794+0000","last_up_change":"2024-05-08T21:49:37.118386+0000","last_in_change":"2024-05-08T21:49:28.836944+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T21:49:35.998578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T21:49:42.171760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T21:49:42.576293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6b7439c1-daaa-44af-8333-a455f9e9dc67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":47228},{"type":"v1","addr":"172.21.15.73:6809","nonce":47228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":47228},{"type":"v1","addr":"172.21.15.73:6811","nonce":47228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":47228},{"type":"v1","addr":"172.21.15.73:6815","nonce":47228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":47228},{"type":"v1","addr":"172.21.15.73:6813","nonce":47228}]},"public_addr":"172.21.15.73:6809/47228","cluster_addr":"172.21.15.73:6811/47228","heartbeat_back_addr":"172.21.15.73:6815/47228","heartbeat_front_addr":"172.21.15.73:6813/47228","state":["exists","up"]},{"osd":1,"uuid":"fb67886a-d7f7-45ac-832f-36c871c8a208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":47227},{"type":"v1","addr":"172.21.15.73:6801","nonce":47227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":47227},{"type":"v1","addr":"172.21.15.73:6803","nonce":47227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":47227},{"type":"v1","addr":"172.21.15.73:6807","nonce":47227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":47227},{"type":"v1","addr":"172.21.15.73:6805","nonce":47227}]},"public_addr":"172.21.15.73:6801/47227","cluster_addr":"172.21.15.73:6803/47227","heartbeat_back_addr":"172.21.15.73:6807/47227","heartbeat_front_addr":"172.21.15.73:6805/47227","state":["exists","up"]},{"osd":2,"uuid":"a5cd6e98-6621-473a-bfb8-5c648abbb563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":47229},{"type":"v1","addr":"172.21.15.73:6817","nonce":47229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":47229},{"type":"v1","addr":"172.21.15.73:6819","nonce":47229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":47229},{"type":"v1","addr":"172.21.15.73:6823","nonce":47229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":47229},{"type":"v1","addr":"172.21.15.73:6821","nonce":47229}]},"public_addr":"172.21.15.73:6817/47229","cluster_addr":"172.21.15.73:6819/47229","heartbeat_back_addr":"172.21.15.73:6823/47229","heartbeat_front_addr":"172.21.15.73:6821/47229","state":["exists","up"]},{"osd":3,"uuid":"36927c20-4241-4f3b-91b5-a6a6f27598e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":47232},{"type":"v1","addr":"172.21.15.73:6825","nonce":47232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":47232},{"type":"v1","addr":"172.21.15.73:6827","nonce":47232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":47232},{"type":"v1","addr":"172.21.15.73:6831","nonce":47232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":47232},{"type":"v1","addr":"172.21.15.73:6829","nonce":47232}]},"public_addr":"172.21.15.73:6825/47232","cluster_addr":"172.21.15.73:6827/47232","heartbeat_back_addr":"172.21.15.73:6831/47232","heartbeat_front_addr":"172.21.15.73:6829/47232","state":["exists","up"]},{"osd":4,"uuid":"4ebe0a18-8216-4815-878a-39c39a6cd3fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":47200},{"type":"v1","addr":"172.21.15.115:6801","nonce":47200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":47200},{"type":"v1","addr":"172.21.15.115:6803","nonce":47200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":47200},{"type":"v1","addr":"172.21.15.115:6807","nonce":47200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":47200},{"type":"v1","addr":"172.21.15.115:6805","nonce":47200}]},"public_addr":"172.21.15.115:6801/47200","cluster_addr":"172.21.15.115:6803/47200","heartbeat_back_addr":"172.21.15.115:6807/47200","heartbeat_front_addr":"172.21.15.115:6805/47200","state":["exists","up"]},{"osd":5,"uuid":"957f0ac1-5f26-4f02-8c05-488e6b67ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":47201},{"type":"v1","addr":"172.21.15.115:6809","nonce":47201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":47201},{"type":"v1","addr":"172.21.15.115:6811","nonce":47201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":47201},{"type":"v1","addr":"172.21.15.115:6815","nonce":47201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":47201},{"type":"v1","addr":"172.21.15.115:6813","nonce":47201}]},"public_addr":"172.21.15.115:6809/47201","cluster_addr":"172.21.15.115:6811/47201","heartbeat_back_addr":"172.21.15.115:6815/47201","heartbeat_front_addr":"172.21.15.115:6813/47201","state":["exists","up"]},{"osd":6,"uuid":"f5a6768f-ba7f-4f66-b335-0c303b158e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":47202},{"type":"v1","addr":"172.21.15.115:6817","nonce":47202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":47202},{"type":"v1","addr":"172.21.15.115:6819","nonce":47202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":47202},{"type":"v1","addr":"172.21.15.115:6823","nonce":47202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":47202},{"type":"v1","addr":"172.21.15.115:6821","nonce":47202}]},"public_addr":"172.21.15.115:6817/47202","cluster_addr":"172.21.15.115:6819/47202","heartbeat_back_addr":"172.21.15.115:6823/47202","heartbeat_front_addr":"172.21.15.115:6821/47202","state":["exists","up"]},{"osd":7,"uuid":"f4187743-f9e6-42e6-aca9-0604a58db1ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":47211},{"type":"v1","addr":"172.21.15.115:6825","nonce":47211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":47211},{"type":"v1","addr":"172.21.15.115:6827","nonce":47211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":47211},{"type":"v1","addr":"172.21.15.115:6831","nonce":47211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":47211},{"type":"v1","addr":"172.21.15.115:6829","nonce":47211}]},"public_addr":"172.21.15.115:6825/47211","cluster_addr":"172.21.15.115:6827/47211","heartbeat_back_addr":"172.21.15.115:6831/47211","heartbeat_front_addr":"172.21.15.115:6829/47211","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:33.996335+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:33.687451+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:34.072549+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:33.997588+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:34.047260+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:34.876272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:33.965472+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:34.038637+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T21:50:00.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.895+0000 7ff4bdbb2700 1 -- 172.21.15.73:0/3844316059 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7ff4a406ac90 msgr2=0x7ff4a406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:00.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.895+0000 7ff4bdbb2700 1 --2- 172.21.15.73:0/3844316059 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7ff4a406ac90 0x7ff4a406d150 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff4a80011e0 tx=0x7ff4a8009040 comp rx=0 tx=0).stop 2024-05-08T21:50:00.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.895+0000 7ff4bdbb2700 1 -- 172.21.15.73:0/3844316059 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4b8072a20 msgr2=0x7ff4b81f0160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:00.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.895+0000 7ff4bdbb2700 1 --2- 172.21.15.73:0/3844316059 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4b8072a20 0x7ff4b81f0160 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac009b60 tx=0x7ff4ac004750 comp rx=0 tx=0).stop 2024-05-08T21:50:00.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.896+0000 7ff4bdbb2700 1 -- 172.21.15.73:0/3844316059 shutdown_connections 2024-05-08T21:50:00.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.896+0000 7ff4bdbb2700 1 --2- 172.21.15.73:0/3844316059 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7ff4a406ac90 0x7ff4a406d150 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:00.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.896+0000 7ff4bdbb2700 1 --2- 172.21.15.73:0/3844316059 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4b81540b0 0x7ff4b80ca780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:00.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.896+0000 7ff4bdbb2700 1 --2- 172.21.15.73:0/3844316059 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff4b806afc0 0x7ff4b8154680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:00.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.896+0000 7ff4bdbb2700 1 --2- 172.21.15.73:0/3844316059 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4b8072a20 0x7ff4b81f0160 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:00.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.896+0000 7ff4bdbb2700 1 -- 172.21.15.73:0/3844316059 >> 172.21.15.73:0/3844316059 conn(0x7ff4b8066d70 msgr2=0x7ff4b8152af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:50:00.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.896+0000 7ff4bdbb2700 1 -- 172.21.15.73:0/3844316059 shutdown_connections 2024-05-08T21:50:00.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:00.896+0000 7ff4bdbb2700 1 -- 172.21.15.73:0/3844316059 wait complete. 2024-05-08T21:50:00.909 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T21:49:35.998578+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T21:49:42.171760+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T21:49:42.576293+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T21:50:00.909 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T21:50:01.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.033+0000 7f93b0b99700 1 Processor -- start 2024-05-08T21:50:01.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.033+0000 7f93b0b99700 1 -- start start 2024-05-08T21:50:01.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.034+0000 7f93b0b99700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f93ac1517b0 0x7f93ac157920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:01.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.034+0000 7f93b0b99700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f93ac151b90 0x7f93ac0c5b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:01.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.034+0000 7f93b0b99700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93ac0c9730 con 0x7f93ac0c9bc0 2024-05-08T21:50:01.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.034+0000 7f93b0b99700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93ac0c91d0 con 0x7f93ac151b90 2024-05-08T21:50:01.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.034+0000 7f93b0b99700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac071a50 con 0x7f93ac1517b0 2024-05-08T21:50:01.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.034+0000 7f93a9d9b700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f93ac0c9bc0 0x7f93ac0c8ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:39260/0 (socket says 172.21.15.73:39260) 2024-05-08T21:50:01.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.034+0000 7f93a9d9b700 1 -- 172.21.15.73:0/1860861349 learned_addr learned my addr 172.21.15.73:0/1860861349 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:50:01.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.035+0000 7f93aad9d700 1 --2- 172.21.15.73:0/1860861349 >> v2:172.21.15.115:3300/0 conn(0x7f93ac151b90 0x7f93ac0c5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:01.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.035+0000 7f93aa59c700 1 --2- 172.21.15.73:0/1860861349 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f93ac1517b0 0x7f93ac157920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:01.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.035+0000 7f93a959a700 1 -- 172.21.15.73:0/1860861349 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3908834741 0 0) 0x7f93ac0c9730 con 0x7f93ac0c9bc0 2024-05-08T21:50:01.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.035+0000 7f93a959a700 1 -- 172.21.15.73:0/1860861349 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93940035b0 con 0x7f93ac0c9bc0 2024-05-08T21:50:01.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.035+0000 7f93a959a700 1 -- 172.21.15.73:0/1860861349 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2656610998 0 0) 0x7f93940035b0 con 0x7f93ac0c9bc0 2024-05-08T21:50:01.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.035+0000 7f93aad9d700 1 -- 172.21.15.73:0/1860861349 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f93ac1517b0 msgr2=0x7f93ac157920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:50:01.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.035+0000 7f93aad9d700 1 --2- 172.21.15.73:0/1860861349 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f93ac1517b0 0x7f93ac157920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:01.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.035+0000 7f93aad9d700 1 -- 172.21.15.73:0/1860861349 >> v1:172.21.15.73:6789/0 conn(0x7f93ac0c9bc0 legacy=0x7f93ac0c8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:01.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.035+0000 7f93aad9d700 1 -- 172.21.15.73:0/1860861349 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93ac0c71a0 con 0x7f93ac151b90 2024-05-08T21:50:01.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.035+0000 7f93aad9d700 1 --2- 172.21.15.73:0/1860861349 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93ac151b90 0x7f93ac0c5b30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f93a4009d90 tx=0x7f93a400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ba01f4f6c5126a8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:01.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.035+0000 7f93a959a700 1 -- 172.21.15.73:0/1860861349 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a400e070 con 0x7f93ac151b90 2024-05-08T21:50:01.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.035+0000 7f93a959a700 1 -- 172.21.15.73:0/1860861349 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a4003a20 con 0x7f93ac151b90 2024-05-08T21:50:01.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.035+0000 7f93a959a700 1 -- 172.21.15.73:0/1860861349 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939c001670 con 0x7f93ac151b90 2024-05-08T21:50:01.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.036+0000 7f93b0b99700 1 -- 172.21.15.73:0/1860861349 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93ac151b90 msgr2=0x7f93ac0c5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:01.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.036+0000 7f93b0b99700 1 --2- 172.21.15.73:0/1860861349 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93ac151b90 0x7f93ac0c5b30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f93a4009d90 tx=0x7f93a400b330 comp rx=0 tx=0).stop 2024-05-08T21:50:01.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.036+0000 7f93b0b99700 1 -- 172.21.15.73:0/1860861349 shutdown_connections 2024-05-08T21:50:01.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.036+0000 7f93b0b99700 1 --2- 172.21.15.73:0/1860861349 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93ac151b90 0x7f93ac0c5b30 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:01.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.036+0000 7f93b0b99700 1 --2- 172.21.15.73:0/1860861349 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f93ac1517b0 0x7f93ac157920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:01.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.036+0000 7f93b0b99700 1 -- 172.21.15.73:0/1860861349 >> 172.21.15.73:0/1860861349 conn(0x7f93ac066ab0 msgr2=0x7f93ac06f550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:50:01.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.036+0000 7f93b0b99700 1 -- 172.21.15.73:0/1860861349 shutdown_connections 2024-05-08T21:50:01.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.036+0000 7f93b0b99700 1 -- 172.21.15.73:0/1860861349 wait complete. 2024-05-08T21:50:01.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.037+0000 7f93b0b99700 1 Processor -- start 2024-05-08T21:50:01.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.037+0000 7f93b0b99700 1 -- start start 2024-05-08T21:50:01.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.038+0000 7f93b0b99700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93ac0c9bc0 0x7f93ac14a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:01.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.038+0000 7f93b0b99700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93ac1517b0 0x7f93ac156170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:01.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.038+0000 7f93b0b99700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f93ac151b90 0x7f93ac0cab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:01.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.038+0000 7f93b0b99700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac1521f0 con 0x7f93ac1517b0 2024-05-08T21:50:01.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.038+0000 7f93b0b99700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac149140 con 0x7f93ac0c9bc0 2024-05-08T21:50:01.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.038+0000 7f93b0b99700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac149960 con 0x7f93ac151b90 2024-05-08T21:50:01.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.038+0000 7f93a9d9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93ac1517b0 0x7f93ac156170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:01.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.038+0000 7f93a9d9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93ac1517b0 0x7f93ac156170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38608/0 (socket says 172.21.15.73:38608) 2024-05-08T21:50:01.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.038+0000 7f93a9d9b700 1 -- 172.21.15.73:0/3565292146 learned_addr learned my addr 172.21.15.73:0/3565292146 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:50:01.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.038+0000 7f93aa59c700 1 --2- 172.21.15.73:0/3565292146 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93ac0c9bc0 0x7f93ac14a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:01.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.038+0000 7f93aad9d700 1 --2- 172.21.15.73:0/3565292146 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f93ac151b90 0x7f93ac0cab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:01.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.038+0000 7f93a9d9b700 1 -- 172.21.15.73:0/3565292146 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f93ac151b90 msgr2=0x7f93ac0cab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:01.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.038+0000 7f93a9d9b700 1 --2- 172.21.15.73:0/3565292146 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f93ac151b90 0x7f93ac0cab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:01.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.038+0000 7f93a9d9b700 1 -- 172.21.15.73:0/3565292146 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93ac0c9bc0 msgr2=0x7f93ac14a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:01.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.038+0000 7f93a9d9b700 1 --2- 172.21.15.73:0/3565292146 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93ac0c9bc0 0x7f93ac14a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:01.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.038+0000 7f93a9d9b700 1 -- 172.21.15.73:0/3565292146 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a4009a70 con 0x7f93ac1517b0 2024-05-08T21:50:01.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.038+0000 7f93aa59c700 1 --2- 172.21.15.73:0/3565292146 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93ac0c9bc0 0x7f93ac14a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:50:01.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.039+0000 7f93a9d9b700 1 --2- 172.21.15.73:0/3565292146 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93ac1517b0 0x7f93ac156170 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f939c00c750 tx=0x7f939c00cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:01.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.039+0000 7f939affd700 1 -- 172.21.15.73:0/3565292146 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939c004c80 con 0x7f93ac1517b0 2024-05-08T21:50:01.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.039+0000 7f939affd700 1 -- 172.21.15.73:0/3565292146 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f939c004de0 con 0x7f93ac1517b0 2024-05-08T21:50:01.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.039+0000 7f93b0b99700 1 -- 172.21.15.73:0/3565292146 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93ac1493a0 con 0x7f93ac1517b0 2024-05-08T21:50:01.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.039+0000 7f939affd700 1 -- 172.21.15.73:0/3565292146 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939c0072d0 con 0x7f93ac1517b0 2024-05-08T21:50:01.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.039+0000 7f93b0b99700 1 -- 172.21.15.73:0/3565292146 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93ac0ca350 con 0x7f93ac1517b0 2024-05-08T21:50:01.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.040+0000 7f93b0b99700 1 -- 172.21.15.73:0/3565292146 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93ac067c30 con 0x7f93ac1517b0 2024-05-08T21:50:01.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.040+0000 7f939affd700 1 -- 172.21.15.73:0/3565292146 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f939c007430 con 0x7f93ac1517b0 2024-05-08T21:50:01.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.041+0000 7f939affd700 1 --2- 172.21.15.73:0/3565292146 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f938c06ac90 0x7f938c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:01.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.041+0000 7f93aa59c700 1 --2- 172.21.15.73:0/3565292146 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f938c06ac90 0x7f938c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:01.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.041+0000 7f939affd700 1 -- 172.21.15.73:0/3565292146 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f939c089100 con 0x7f93ac1517b0 2024-05-08T21:50:01.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.041+0000 7f93aa59c700 1 --2- 172.21.15.73:0/3565292146 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f938c06ac90 0x7f938c06d150 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f93a0009b60 tx=0x7f93a0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:01.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.045+0000 7f939affd700 1 -- 172.21.15.73:0/3565292146 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f939c0542e0 con 0x7f93ac1517b0 2024-05-08T21:50:01.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.239+0000 7f93b0b99700 1 -- 172.21.15.73:0/3565292146 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f93ac0c7780 con 0x7f93ac1517b0 2024-05-08T21:50:01.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.239+0000 7f939affd700 1 -- 172.21.15.73:0/3565292146 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f939c057900 con 0x7f93ac1517b0 2024-05-08T21:50:01.240 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-05-08T21:50:01.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.241+0000 7f93b0b99700 1 -- 172.21.15.73:0/3565292146 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f938c06ac90 msgr2=0x7f938c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:01.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.241+0000 7f93b0b99700 1 --2- 172.21.15.73:0/3565292146 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f938c06ac90 0x7f938c06d150 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f93a0009b60 tx=0x7f93a0008040 comp rx=0 tx=0).stop 2024-05-08T21:50:01.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.241+0000 7f93b0b99700 1 -- 172.21.15.73:0/3565292146 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93ac1517b0 msgr2=0x7f93ac156170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:01.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.241+0000 7f93b0b99700 1 --2- 172.21.15.73:0/3565292146 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93ac1517b0 0x7f93ac156170 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f939c00c750 tx=0x7f939c00cb10 comp rx=0 tx=0).stop 2024-05-08T21:50:01.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.241+0000 7f93b0b99700 1 -- 172.21.15.73:0/3565292146 shutdown_connections 2024-05-08T21:50:01.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.241+0000 7f93b0b99700 1 --2- 172.21.15.73:0/3565292146 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f938c06ac90 0x7f938c06d150 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:01.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.241+0000 7f93b0b99700 1 --2- 172.21.15.73:0/3565292146 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f93ac151b90 0x7f93ac0cab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:01.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.241+0000 7f93b0b99700 1 --2- 172.21.15.73:0/3565292146 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93ac0c9bc0 0x7f93ac14a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:01.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.241+0000 7f93b0b99700 1 --2- 172.21.15.73:0/3565292146 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93ac1517b0 0x7f93ac156170 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:01.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.241+0000 7f93b0b99700 1 -- 172.21.15.73:0/3565292146 >> 172.21.15.73:0/3565292146 conn(0x7f93ac066ab0 msgr2=0x7f93ac14c820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:50:01.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.241+0000 7f93b0b99700 1 -- 172.21.15.73:0/3565292146 shutdown_connections 2024-05-08T21:50:01.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.241+0000 7f93b0b99700 1 -- 172.21.15.73:0/3565292146 wait complete. 2024-05-08T21:50:01.255 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T21:50:01.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.376+0000 7f6cf8b97700 1 Processor -- start 2024-05-08T21:50:01.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.377+0000 7f6cf8b97700 1 -- start start 2024-05-08T21:50:01.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.377+0000 7f6cf8b97700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6cf40c5da0 0x7f6cf40c6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:01.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.377+0000 7f6cf8b97700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6cf40c6180 0x7f6cf406b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:01.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.378+0000 7f6cf8b97700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cf40c8e80 con 0x7f6cf415aef0 2024-05-08T21:50:01.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.378+0000 7f6cf8b97700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cf40c7410 con 0x7f6cf40c5da0 2024-05-08T21:50:01.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.378+0000 7f6cf8b97700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf40719b0 con 0x7f6cf40c6180 2024-05-08T21:50:01.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.378+0000 7f6cf259c700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6cf40c5da0 0x7f6cf40c6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:01.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.378+0000 7f6cf2d9d700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f6cf415aef0 0x7f6cf4151640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:39272/0 (socket says 172.21.15.73:39272) 2024-05-08T21:50:01.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.378+0000 7f6cf2d9d700 1 -- 172.21.15.73:0/1866527721 learned_addr learned my addr 172.21.15.73:0/1866527721 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:50:01.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.378+0000 7f6cf1d9b700 1 --2- 172.21.15.73:0/1866527721 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6cf40c6180 0x7f6cf406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:01.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.378+0000 7f6cf259c700 1 -- 172.21.15.73:0/1866527721 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6cf40c6180 msgr2=0x7f6cf406b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:50:01.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.378+0000 7f6cf259c700 1 --2- 172.21.15.73:0/1866527721 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6cf40c6180 0x7f6cf406b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:01.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.378+0000 7f6cf259c700 1 -- 172.21.15.73:0/1866527721 >> v1:172.21.15.73:6789/0 conn(0x7f6cf415aef0 legacy=0x7f6cf4151640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:01.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.378+0000 7f6cf259c700 1 -- 172.21.15.73:0/1866527721 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cf4071c90 con 0x7f6cf40c5da0 2024-05-08T21:50:01.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.378+0000 7f6cf159a700 1 -- 172.21.15.73:0/1866527721 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3110960341 0 0) 0x7f6cf40c8e80 con 0x7f6cf415aef0 2024-05-08T21:50:01.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.378+0000 7f6cf259c700 1 --2- 172.21.15.73:0/1866527721 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6cf40c5da0 0x7f6cf40c6e20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6ce8009840 tx=0x7f6ce8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aee206f03708723 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:01.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.378+0000 7f6cf159a700 1 -- 172.21.15.73:0/1866527721 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce8011830 con 0x7f6cf40c5da0 2024-05-08T21:50:01.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.378+0000 7f6cf159a700 1 -- 172.21.15.73:0/1866527721 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ce8011990 con 0x7f6cf40c5da0 2024-05-08T21:50:01.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.378+0000 7f6cf159a700 1 -- 172.21.15.73:0/1866527721 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce8011d20 con 0x7f6cf40c5da0 2024-05-08T21:50:01.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.379+0000 7f6cf8b97700 1 -- 172.21.15.73:0/1866527721 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6cf40c5da0 msgr2=0x7f6cf40c6e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:01.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.379+0000 7f6cf8b97700 1 --2- 172.21.15.73:0/1866527721 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6cf40c5da0 0x7f6cf40c6e20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6ce8009840 tx=0x7f6ce8009b50 comp rx=0 tx=0).stop 2024-05-08T21:50:01.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.379+0000 7f6cf8b97700 1 -- 172.21.15.73:0/1866527721 shutdown_connections 2024-05-08T21:50:01.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.379+0000 7f6cf8b97700 1 --2- 172.21.15.73:0/1866527721 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6cf40c5da0 0x7f6cf40c6e20 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:01.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.379+0000 7f6cf8b97700 1 --2- 172.21.15.73:0/1866527721 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6cf40c6180 0x7f6cf406b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:01.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.379+0000 7f6cf8b97700 1 -- 172.21.15.73:0/1866527721 >> 172.21.15.73:0/1866527721 conn(0x7f6cf4066ab0 msgr2=0x7f6cf406f550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:50:01.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.379+0000 7f6cf8b97700 1 -- 172.21.15.73:0/1866527721 shutdown_connections 2024-05-08T21:50:01.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.379+0000 7f6cf8b97700 1 -- 172.21.15.73:0/1866527721 wait complete. 2024-05-08T21:50:01.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.380+0000 7f6cf8b97700 1 Processor -- start 2024-05-08T21:50:01.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.380+0000 7f6cf8b97700 1 -- start start 2024-05-08T21:50:01.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.381+0000 7f6cf8b97700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6cf40c5da0 0x7f6cf40cc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:01.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.381+0000 7f6cf8b97700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6cf40c6180 0x7f6cf41e1110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:01.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.381+0000 7f6cf8b97700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6cf415aef0 0x7f6cf41e1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:01.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.381+0000 7f6cf8b97700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf41f1840 con 0x7f6cf415aef0 2024-05-08T21:50:01.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.381+0000 7f6cf8b97700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf41e1650 con 0x7f6cf40c5da0 2024-05-08T21:50:01.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.381+0000 7f6cf8b97700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf40cd010 con 0x7f6cf40c6180 2024-05-08T21:50:01.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.381+0000 7f6cf2d9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6cf415aef0 0x7f6cf41e1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:01.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.381+0000 7f6cf2d9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6cf415aef0 0x7f6cf41e1990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38624/0 (socket says 172.21.15.73:38624) 2024-05-08T21:50:01.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.381+0000 7f6cf2d9d700 1 -- 172.21.15.73:0/3078829225 learned_addr learned my addr 172.21.15.73:0/3078829225 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:50:01.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.381+0000 7f6cf259c700 1 --2- 172.21.15.73:0/3078829225 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6cf40c5da0 0x7f6cf40cc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:01.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.381+0000 7f6cf2d9d700 1 -- 172.21.15.73:0/3078829225 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6cf40c6180 msgr2=0x7f6cf41e1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:01.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.381+0000 7f6cf1d9b700 1 --2- 172.21.15.73:0/3078829225 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6cf40c6180 0x7f6cf41e1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:01.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.381+0000 7f6cf2d9d700 1 --2- 172.21.15.73:0/3078829225 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6cf40c6180 0x7f6cf41e1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:01.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.381+0000 7f6cf2d9d700 1 -- 172.21.15.73:0/3078829225 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6cf40c5da0 msgr2=0x7f6cf40cc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:01.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.381+0000 7f6cf2d9d700 1 --2- 172.21.15.73:0/3078829225 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6cf40c5da0 0x7f6cf40cc9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:01.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.381+0000 7f6cf2d9d700 1 -- 172.21.15.73:0/3078829225 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce80094a0 con 0x7f6cf415aef0 2024-05-08T21:50:01.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.381+0000 7f6cf259c700 1 --2- 172.21.15.73:0/3078829225 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6cf40c5da0 0x7f6cf40cc9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:50:01.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.381+0000 7f6cf1d9b700 1 --2- 172.21.15.73:0/3078829225 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6cf40c6180 0x7f6cf41e1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:50:01.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.382+0000 7f6cf2d9d700 1 --2- 172.21.15.73:0/3078829225 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6cf415aef0 0x7f6cf41e1990 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6cec00cba0 tx=0x7f6cec00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:01.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.382+0000 7f6ce2ffd700 1 -- 172.21.15.73:0/3078829225 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cec00ab80 con 0x7f6cf415aef0 2024-05-08T21:50:01.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.382+0000 7f6ce2ffd700 1 -- 172.21.15.73:0/3078829225 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cec00ad00 con 0x7f6cf415aef0 2024-05-08T21:50:01.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.382+0000 7f6cf8b97700 1 -- 172.21.15.73:0/3078829225 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cf41f0a80 con 0x7f6cf415aef0 2024-05-08T21:50:01.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.382+0000 7f6ce2ffd700 1 -- 172.21.15.73:0/3078829225 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cec007310 con 0x7f6cf415aef0 2024-05-08T21:50:01.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.382+0000 7f6cf8b97700 1 -- 172.21.15.73:0/3078829225 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cf41f1040 con 0x7f6cf415aef0 2024-05-08T21:50:01.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.383+0000 7f6cf8b97700 1 -- 172.21.15.73:0/3078829225 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cf4068b80 con 0x7f6cf415aef0 2024-05-08T21:50:01.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.383+0000 7f6ce2ffd700 1 -- 172.21.15.73:0/3078829225 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6cec007470 con 0x7f6cf415aef0 2024-05-08T21:50:01.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.384+0000 7f6ce2ffd700 1 --2- 172.21.15.73:0/3078829225 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f6cd406acc0 0x7f6cd406d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:01.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.384+0000 7f6cf259c700 1 --2- 172.21.15.73:0/3078829225 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f6cd406acc0 0x7f6cd406d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:01.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.384+0000 7f6ce2ffd700 1 -- 172.21.15.73:0/3078829225 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6cec089070 con 0x7f6cf415aef0 2024-05-08T21:50:01.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.384+0000 7f6cf259c700 1 --2- 172.21.15.73:0/3078829225 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f6cd406acc0 0x7f6cd406d180 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6ce80090b0 tx=0x7f6ce8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:01.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.388+0000 7f6ce2ffd700 1 -- 172.21.15.73:0/3078829225 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f6cec0542e0 con 0x7f6cf415aef0 2024-05-08T21:50:01.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.583+0000 7f6cf8b97700 1 -- 172.21.15.73:0/3078829225 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6cf406aff0 con 0x7f6cf415aef0 2024-05-08T21:50:01.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.583+0000 7f6ce2ffd700 1 -- 172.21.15.73:0/3078829225 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6cec057900 con 0x7f6cf415aef0 2024-05-08T21:50:01.584 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-05-08T21:50:01.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.585+0000 7f6cf8b97700 1 -- 172.21.15.73:0/3078829225 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f6cd406acc0 msgr2=0x7f6cd406d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:01.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.585+0000 7f6cf8b97700 1 --2- 172.21.15.73:0/3078829225 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f6cd406acc0 0x7f6cd406d180 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6ce80090b0 tx=0x7f6ce8008030 comp rx=0 tx=0).stop 2024-05-08T21:50:01.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.585+0000 7f6cf8b97700 1 -- 172.21.15.73:0/3078829225 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6cf415aef0 msgr2=0x7f6cf41e1990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:01.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.585+0000 7f6cf8b97700 1 --2- 172.21.15.73:0/3078829225 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6cf415aef0 0x7f6cf41e1990 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6cec00cba0 tx=0x7f6cec00cf60 comp rx=0 tx=0).stop 2024-05-08T21:50:01.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.585+0000 7f6cf8b97700 1 -- 172.21.15.73:0/3078829225 shutdown_connections 2024-05-08T21:50:01.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.585+0000 7f6cf8b97700 1 --2- 172.21.15.73:0/3078829225 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f6cd406acc0 0x7f6cd406d180 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:01.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.585+0000 7f6cf8b97700 1 --2- 172.21.15.73:0/3078829225 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6cf415aef0 0x7f6cf41e1990 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:01.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.585+0000 7f6cf8b97700 1 --2- 172.21.15.73:0/3078829225 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6cf40c5da0 0x7f6cf40cc9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:01.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.585+0000 7f6cf8b97700 1 --2- 172.21.15.73:0/3078829225 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6cf40c6180 0x7f6cf41e1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:01.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.585+0000 7f6cf8b97700 1 -- 172.21.15.73:0/3078829225 >> 172.21.15.73:0/3078829225 conn(0x7f6cf4066ab0 msgr2=0x7f6cf4149d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:50:01.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.585+0000 7f6cf8b97700 1 -- 172.21.15.73:0/3078829225 shutdown_connections 2024-05-08T21:50:01.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.585+0000 7f6cf8b97700 1 -- 172.21.15.73:0/3078829225 wait complete. 2024-05-08T21:50:01.598 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T21:50:01.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.721+0000 7f08f4c82700 1 Processor -- start 2024-05-08T21:50:01.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.722+0000 7f08f4c82700 1 -- start start 2024-05-08T21:50:01.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.722+0000 7f08f4c82700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f08f014e630 0x7f08f0157a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:01.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.722+0000 7f08f4c82700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08f00c4330 0x7f08f0162400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:01.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.722+0000 7f08f4c82700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08f014ea10 con 0x7f08f006ff30 2024-05-08T21:50:01.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.722+0000 7f08f4c82700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08f006f790 con 0x7f08f014e630 2024-05-08T21:50:01.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.722+0000 7f08f4c82700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08f00c2710 con 0x7f08f00c4330 2024-05-08T21:50:01.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.723+0000 7f08ee59c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f08f014e630 0x7f08f0157a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:01.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.723+0000 7f08eed9d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08f00c4330 0x7f08f0162400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:01.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.723+0000 7f08edd9b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f08f006ff30 0x7f08f00c9340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.73:49268/0 (socket says 172.21.15.73:49268) 2024-05-08T21:50:01.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.723+0000 7f08ee59c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f08f014e630 0x7f08f0157a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.73:49756/0 (socket says 172.21.15.73:49756) 2024-05-08T21:50:01.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.723+0000 7f08edd9b700 1 -- 172.21.15.73:0/3342956257 learned_addr learned my addr 172.21.15.73:0/3342956257 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:50:01.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.723+0000 7f08ee59c700 1 -- 172.21.15.73:0/3342956257 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08f00c4330 msgr2=0x7f08f0162400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:50:01.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.723+0000 7f08ee59c700 1 --2- 172.21.15.73:0/3342956257 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08f00c4330 0x7f08f0162400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:01.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.723+0000 7f08ee59c700 1 -- 172.21.15.73:0/3342956257 >> v1:172.21.15.115:6789/0 conn(0x7f08f006ff30 legacy=0x7f08f00c9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:01.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.723+0000 7f08ee59c700 1 -- 172.21.15.73:0/3342956257 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f00c80f0 con 0x7f08f014e630 2024-05-08T21:50:01.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.723+0000 7f08ee59c700 1 --2- 172.21.15.73:0/3342956257 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08f014e630 0x7f08f0157a80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f08e4009840 tx=0x7f08e4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1354e661086e9085 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:01.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.724+0000 7f08ed59a700 1 -- 172.21.15.73:0/3342956257 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e4011830 con 0x7f08f014e630 2024-05-08T21:50:01.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.724+0000 7f08ed59a700 1 -- 172.21.15.73:0/3342956257 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e4011990 con 0x7f08f014e630 2024-05-08T21:50:01.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.724+0000 7f08ed59a700 1 -- 172.21.15.73:0/3342956257 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e4011d20 con 0x7f08f014e630 2024-05-08T21:50:01.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.724+0000 7f08f4c82700 1 -- 172.21.15.73:0/3342956257 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08f014e630 msgr2=0x7f08f0157a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:01.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.724+0000 7f08f4c82700 1 --2- 172.21.15.73:0/3342956257 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08f014e630 0x7f08f0157a80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f08e4009840 tx=0x7f08e4009b50 comp rx=0 tx=0).stop 2024-05-08T21:50:01.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.724+0000 7f08f4c82700 1 -- 172.21.15.73:0/3342956257 shutdown_connections 2024-05-08T21:50:01.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.724+0000 7f08f4c82700 1 --2- 172.21.15.73:0/3342956257 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08f00c4330 0x7f08f0162400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:01.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.724+0000 7f08f4c82700 1 --2- 172.21.15.73:0/3342956257 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08f014e630 0x7f08f0157a80 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:01.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.724+0000 7f08f4c82700 1 -- 172.21.15.73:0/3342956257 >> 172.21.15.73:0/3342956257 conn(0x7f08f006aff0 msgr2=0x7f08f00666c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:50:01.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.724+0000 7f08f4c82700 1 -- 172.21.15.73:0/3342956257 shutdown_connections 2024-05-08T21:50:01.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.725+0000 7f08f4c82700 1 -- 172.21.15.73:0/3342956257 wait complete. 2024-05-08T21:50:01.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.726+0000 7f08f4c82700 1 Processor -- start 2024-05-08T21:50:01.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.726+0000 7f08f4c82700 1 -- start start 2024-05-08T21:50:01.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.726+0000 7f08f4c82700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08f006ff30 0x7f08f006ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:01.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.726+0000 7f08f4c82700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08f00c4330 0x7f08f01f3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:01.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.726+0000 7f08f4c82700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08f014e630 0x7f08f0157240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:01.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.726+0000 7f08f4c82700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f006db50 con 0x7f08f00c4330 2024-05-08T21:50:01.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.726+0000 7f08f4c82700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f006d3b0 con 0x7f08f006ff30 2024-05-08T21:50:01.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.726+0000 7f08f4c82700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08f01ef8c0 con 0x7f08f014e630 2024-05-08T21:50:01.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.727+0000 7f08edd9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08f00c4330 0x7f08f01f3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:01.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.727+0000 7f08edd9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08f00c4330 0x7f08f01f3810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38632/0 (socket says 172.21.15.73:38632) 2024-05-08T21:50:01.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.727+0000 7f08edd9b700 1 -- 172.21.15.73:0/1212688635 learned_addr learned my addr 172.21.15.73:0/1212688635 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:50:01.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.727+0000 7f08ee59c700 1 --2- 172.21.15.73:0/1212688635 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08f006ff30 0x7f08f006ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:01.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.727+0000 7f08eed9d700 1 --2- 172.21.15.73:0/1212688635 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08f014e630 0x7f08f0157240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:01.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.727+0000 7f08edd9b700 1 -- 172.21.15.73:0/1212688635 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08f014e630 msgr2=0x7f08f0157240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:01.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.727+0000 7f08edd9b700 1 --2- 172.21.15.73:0/1212688635 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08f014e630 0x7f08f0157240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:01.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.727+0000 7f08edd9b700 1 -- 172.21.15.73:0/1212688635 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08f006ff30 msgr2=0x7f08f006ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:01.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.727+0000 7f08edd9b700 1 --2- 172.21.15.73:0/1212688635 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08f006ff30 0x7f08f006ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:01.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.727+0000 7f08edd9b700 1 -- 172.21.15.73:0/1212688635 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e40094a0 con 0x7f08f00c4330 2024-05-08T21:50:01.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.727+0000 7f08edd9b700 1 --2- 172.21.15.73:0/1212688635 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08f00c4330 0x7f08f01f3810 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f08e000c500 tx=0x7f08e000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:01.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.727+0000 7f08deffd700 1 -- 172.21.15.73:0/1212688635 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e0005d70 con 0x7f08f00c4330 2024-05-08T21:50:01.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.727+0000 7f08deffd700 1 -- 172.21.15.73:0/1212688635 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e00070d0 con 0x7f08f00c4330 2024-05-08T21:50:01.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.727+0000 7f08f4c82700 1 -- 172.21.15.73:0/1212688635 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08f01f3d50 con 0x7f08f00c4330 2024-05-08T21:50:01.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.727+0000 7f08deffd700 1 -- 172.21.15.73:0/1212688635 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e0007440 con 0x7f08f00c4330 2024-05-08T21:50:01.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.727+0000 7f08f4c82700 1 -- 172.21.15.73:0/1212688635 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08f006d870 con 0x7f08f00c4330 2024-05-08T21:50:01.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.728+0000 7f08f4c82700 1 -- 172.21.15.73:0/1212688635 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08f00b3960 con 0x7f08f00c4330 2024-05-08T21:50:01.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.729+0000 7f08deffd700 1 -- 172.21.15.73:0/1212688635 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f08e00075a0 con 0x7f08f00c4330 2024-05-08T21:50:01.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.729+0000 7f08deffd700 1 --2- 172.21.15.73:0/1212688635 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f08d006ac90 0x7f08d006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:01.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.729+0000 7f08ee59c700 1 --2- 172.21.15.73:0/1212688635 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f08d006ac90 0x7f08d006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:01.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.729+0000 7f08deffd700 1 -- 172.21.15.73:0/1212688635 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f08e0088560 con 0x7f08f00c4330 2024-05-08T21:50:01.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.730+0000 7f08ee59c700 1 --2- 172.21.15.73:0/1212688635 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f08d006ac90 0x7f08d006d150 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f08e4000c00 tx=0x7f08e401c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:01.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.734+0000 7f08deffd700 1 -- 172.21.15.73:0/1212688635 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f08e00537f0 con 0x7f08f00c4330 2024-05-08T21:50:01.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.930+0000 7f08f4c82700 1 -- 172.21.15.73:0/1212688635 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f08f00c7cb0 con 0x7f08f00c4330 2024-05-08T21:50:01.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.930+0000 7f08deffd700 1 -- 172.21.15.73:0/1212688635 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f08e0056e10 con 0x7f08f00c4330 2024-05-08T21:50:01.931 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-05-08T21:50:01.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.932+0000 7f08f4c82700 1 -- 172.21.15.73:0/1212688635 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f08d006ac90 msgr2=0x7f08d006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:01.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.932+0000 7f08f4c82700 1 --2- 172.21.15.73:0/1212688635 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f08d006ac90 0x7f08d006d150 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f08e4000c00 tx=0x7f08e401c040 comp rx=0 tx=0).stop 2024-05-08T21:50:01.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.932+0000 7f08f4c82700 1 -- 172.21.15.73:0/1212688635 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08f00c4330 msgr2=0x7f08f01f3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:01.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.932+0000 7f08f4c82700 1 --2- 172.21.15.73:0/1212688635 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08f00c4330 0x7f08f01f3810 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f08e000c500 tx=0x7f08e000c810 comp rx=0 tx=0).stop 2024-05-08T21:50:01.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.932+0000 7f08f4c82700 1 -- 172.21.15.73:0/1212688635 shutdown_connections 2024-05-08T21:50:01.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.932+0000 7f08f4c82700 1 --2- 172.21.15.73:0/1212688635 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f08d006ac90 0x7f08d006d150 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:01.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.932+0000 7f08f4c82700 1 --2- 172.21.15.73:0/1212688635 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08f014e630 0x7f08f0157240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:01.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.932+0000 7f08f4c82700 1 --2- 172.21.15.73:0/1212688635 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08f006ff30 0x7f08f006ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:01.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.932+0000 7f08f4c82700 1 --2- 172.21.15.73:0/1212688635 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08f00c4330 0x7f08f01f3810 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:01.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.932+0000 7f08f4c82700 1 -- 172.21.15.73:0/1212688635 >> 172.21.15.73:0/1212688635 conn(0x7f08f006aff0 msgr2=0x7f08f00ccae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:50:01.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.932+0000 7f08f4c82700 1 -- 172.21.15.73:0/1212688635 shutdown_connections 2024-05-08T21:50:01.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:01.932+0000 7f08f4c82700 1 -- 172.21.15.73:0/1212688635 wait complete. 2024-05-08T21:50:01.946 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:50:02.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.067+0000 7f5458cbf700 1 Processor -- start 2024-05-08T21:50:02.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.067+0000 7f5458cbf700 1 -- start start 2024-05-08T21:50:02.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.068+0000 7f5458cbf700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f54540c3490 0x7f5454072460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:02.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.068+0000 7f5458cbf700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f54540c3a00 0x7f5454161350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:02.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.068+0000 7f5458cbf700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54540c3f10 con 0x7f5454072080 2024-05-08T21:50:02.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.068+0000 7f5458cbf700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54540729a0 con 0x7f54540c3490 2024-05-08T21:50:02.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.068+0000 7f5458cbf700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54540c41b0 con 0x7f54540c3a00 2024-05-08T21:50:02.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.068+0000 7f5451d9b700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f54540c3490 0x7f5454072460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:02.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.068+0000 7f5451d9b700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f54540c3490 0x7f5454072460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38648/0 (socket says 172.21.15.73:38648) 2024-05-08T21:50:02.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.068+0000 7f5451d9b700 1 -- 172.21.15.73:0/3022644707 learned_addr learned my addr 172.21.15.73:0/3022644707 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:50:02.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.068+0000 7f5452d9d700 1 --2- 172.21.15.73:0/3022644707 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f54540c3a00 0x7f5454161350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:02.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.068+0000 7f5451d9b700 1 -- 172.21.15.73:0/3022644707 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f54540c3a00 msgr2=0x7f5454161350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:50:02.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.068+0000 7f5451d9b700 1 --2- 172.21.15.73:0/3022644707 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f54540c3a00 0x7f5454161350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:02.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.068+0000 7f5451d9b700 1 -- 172.21.15.73:0/3022644707 >> v1:172.21.15.115:6789/0 conn(0x7f5454072080 legacy=0x7f5454156dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:02.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.068+0000 7f5451d9b700 1 -- 172.21.15.73:0/3022644707 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54540c7820 con 0x7f54540c3490 2024-05-08T21:50:02.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.068+0000 7f5451d9b700 1 --2- 172.21.15.73:0/3022644707 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54540c3490 0x7f5454072460 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f54480098f0 tx=0x7f5448009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=199bbb1897c1fa80 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:02.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.068+0000 7f545159a700 1 -- 172.21.15.73:0/3022644707 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544800b8a0 con 0x7f54540c3490 2024-05-08T21:50:02.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.068+0000 7f545159a700 1 -- 172.21.15.73:0/3022644707 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f544800ba00 con 0x7f54540c3490 2024-05-08T21:50:02.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.068+0000 7f545159a700 1 -- 172.21.15.73:0/3022644707 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544800bd90 con 0x7f54540c3490 2024-05-08T21:50:02.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.069+0000 7f5458cbf700 1 -- 172.21.15.73:0/3022644707 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54540c3490 msgr2=0x7f5454072460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:02.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.069+0000 7f5458cbf700 1 --2- 172.21.15.73:0/3022644707 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54540c3490 0x7f5454072460 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f54480098f0 tx=0x7f5448009c00 comp rx=0 tx=0).stop 2024-05-08T21:50:02.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.069+0000 7f5458cbf700 1 -- 172.21.15.73:0/3022644707 shutdown_connections 2024-05-08T21:50:02.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.069+0000 7f5458cbf700 1 --2- 172.21.15.73:0/3022644707 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f54540c3a00 0x7f5454161350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:02.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.069+0000 7f5458cbf700 1 --2- 172.21.15.73:0/3022644707 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54540c3490 0x7f5454072460 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:02.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.069+0000 7f5458cbf700 1 -- 172.21.15.73:0/3022644707 >> 172.21.15.73:0/3022644707 conn(0x7f5454066d70 msgr2=0x7f54540cc500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:50:02.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.069+0000 7f5458cbf700 1 -- 172.21.15.73:0/3022644707 shutdown_connections 2024-05-08T21:50:02.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.069+0000 7f5458cbf700 1 -- 172.21.15.73:0/3022644707 wait complete. 2024-05-08T21:50:02.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.070+0000 7f5458cbf700 1 Processor -- start 2024-05-08T21:50:02.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.070+0000 7f5458cbf700 1 -- start start 2024-05-08T21:50:02.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.071+0000 7f5458cbf700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5454072080 0x7f5454143010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:02.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.071+0000 7f5458cbf700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54540c3490 0x7f5454141cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:02.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.071+0000 7f5458cbf700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f54540c3a00 0x7f5454143d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:02.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.071+0000 7f5458cbf700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f545414e1c0 con 0x7f5454072080 2024-05-08T21:50:02.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.071+0000 7f5458cbf700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54541437a0 con 0x7f54540c3490 2024-05-08T21:50:02.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.071+0000 7f5458cbf700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f545414b910 con 0x7f54540c3a00 2024-05-08T21:50:02.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.071+0000 7f545259c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5454072080 0x7f5454143010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:02.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.071+0000 7f545259c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5454072080 0x7f5454143010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38650/0 (socket says 172.21.15.73:38650) 2024-05-08T21:50:02.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.071+0000 7f545259c700 1 -- 172.21.15.73:0/1931088816 learned_addr learned my addr 172.21.15.73:0/1931088816 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:50:02.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.071+0000 7f5451d9b700 1 --2- 172.21.15.73:0/1931088816 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54540c3490 0x7f5454141cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:02.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.071+0000 7f5452d9d700 1 --2- 172.21.15.73:0/1931088816 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f54540c3a00 0x7f5454143d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:02.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.072+0000 7f545259c700 1 -- 172.21.15.73:0/1931088816 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f54540c3a00 msgr2=0x7f5454143d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:02.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.072+0000 7f545259c700 1 --2- 172.21.15.73:0/1931088816 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f54540c3a00 0x7f5454143d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:02.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.072+0000 7f545259c700 1 -- 172.21.15.73:0/1931088816 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54540c3490 msgr2=0x7f5454141cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:02.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.072+0000 7f545259c700 1 --2- 172.21.15.73:0/1931088816 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54540c3490 0x7f5454141cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:02.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.072+0000 7f545259c700 1 -- 172.21.15.73:0/1931088816 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5448009550 con 0x7f5454072080 2024-05-08T21:50:02.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.072+0000 7f545259c700 1 --2- 172.21.15.73:0/1931088816 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5454072080 0x7f5454143010 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f544400c510 tx=0x7f544400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:02.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.072+0000 7f5442ffd700 1 -- 172.21.15.73:0/1931088816 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54440052d0 con 0x7f5454072080 2024-05-08T21:50:02.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.072+0000 7f5442ffd700 1 -- 172.21.15.73:0/1931088816 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5444005450 con 0x7f5454072080 2024-05-08T21:50:02.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.072+0000 7f5458cbf700 1 -- 172.21.15.73:0/1931088816 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f545414b630 con 0x7f5454072080 2024-05-08T21:50:02.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.072+0000 7f5442ffd700 1 -- 172.21.15.73:0/1931088816 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54440038c0 con 0x7f5454072080 2024-05-08T21:50:02.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.072+0000 7f5458cbf700 1 -- 172.21.15.73:0/1931088816 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f545414de50 con 0x7f5454072080 2024-05-08T21:50:02.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.073+0000 7f5458cbf700 1 -- 172.21.15.73:0/1931088816 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f545414dfe0 con 0x7f5454072080 2024-05-08T21:50:02.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.073+0000 7f5442ffd700 1 -- 172.21.15.73:0/1931088816 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5444003a20 con 0x7f5454072080 2024-05-08T21:50:02.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.074+0000 7f5442ffd700 1 --2- 172.21.15.73:0/1931088816 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f543406ac90 0x7f543406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:02.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.074+0000 7f5442ffd700 1 -- 172.21.15.73:0/1931088816 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5444088700 con 0x7f5454072080 2024-05-08T21:50:02.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.074+0000 7f5451d9b700 1 --2- 172.21.15.73:0/1931088816 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f543406ac90 0x7f543406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:02.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.074+0000 7f5451d9b700 1 --2- 172.21.15.73:0/1931088816 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f543406ac90 0x7f543406d150 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f54480098f0 tx=0x7f5448008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:02.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.078+0000 7f5442ffd700 1 -- 172.21.15.73:0/1931088816 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f5444053970 con 0x7f5454072080 2024-05-08T21:50:02.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.322+0000 7f5458cbf700 1 -- 172.21.15.73:0/1931088816 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5454143b90 con 0x7f5454072080 2024-05-08T21:50:02.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.322+0000 7f5442ffd700 1 -- 172.21.15.73:0/1931088816 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+6250 (secure 0 0 0) 0x7f5444056f90 con 0x7f5454072080 2024-05-08T21:50:02.324 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:50:02.324 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3242319177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6833","nonce":3242319177},{"type":"v1","addr":"172.21.15.115:6835","nonce":3242319177}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6834/2136341349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2136341349},{"type":"v1","addr":"172.21.15.115:6834","nonce":2136341349}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4249,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1439647913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1439647913},{"type":"v1","addr":"172.21.15.115:6837","nonce":1439647913}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/2386382396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2386382396},{"type":"v1","addr":"172.21.15.73:6836","nonce":2386382396}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/1772457954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":1772457954},{"type":"v1","addr":"172.21.15.73:6837","nonce":1772457954}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:49:43.747162+0000","modified":"2024-05-08T21:49:48.814033+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.73:6839/1477468490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1477468490},{"type":"v1","addr":"172.21.15.73:6839","nonce":1477468490}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:50:02.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.324+0000 7f5458cbf700 1 -- 172.21.15.73:0/1931088816 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f543406ac90 msgr2=0x7f543406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:02.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.324+0000 7f5458cbf700 1 --2- 172.21.15.73:0/1931088816 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f543406ac90 0x7f543406d150 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f54480098f0 tx=0x7f5448008030 comp rx=0 tx=0).stop 2024-05-08T21:50:02.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.324+0000 7f5458cbf700 1 -- 172.21.15.73:0/1931088816 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5454072080 msgr2=0x7f5454143010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:02.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.324+0000 7f5458cbf700 1 --2- 172.21.15.73:0/1931088816 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5454072080 0x7f5454143010 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f544400c510 tx=0x7f544400c8d0 comp rx=0 tx=0).stop 2024-05-08T21:50:02.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.325+0000 7f5458cbf700 1 -- 172.21.15.73:0/1931088816 shutdown_connections 2024-05-08T21:50:02.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.325+0000 7f5458cbf700 1 --2- 172.21.15.73:0/1931088816 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f543406ac90 0x7f543406d150 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:02.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.325+0000 7f5458cbf700 1 --2- 172.21.15.73:0/1931088816 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f54540c3a00 0x7f5454143d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:02.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.325+0000 7f5458cbf700 1 --2- 172.21.15.73:0/1931088816 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5454072080 0x7f5454143010 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:02.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.325+0000 7f5458cbf700 1 --2- 172.21.15.73:0/1931088816 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54540c3490 0x7f5454141cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:02.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.325+0000 7f5458cbf700 1 -- 172.21.15.73:0/1931088816 >> 172.21.15.73:0/1931088816 conn(0x7f5454066d70 msgr2=0x7f54540c8930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:50:02.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.325+0000 7f5458cbf700 1 -- 172.21.15.73:0/1931088816 shutdown_connections 2024-05-08T21:50:02.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.325+0000 7f5458cbf700 1 -- 172.21.15.73:0/1931088816 wait complete. 2024-05-08T21:50:02.327 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 8 2024-05-08T21:50:02.337 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T21:50:02.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.457+0000 7fb5577ec700 1 Processor -- start 2024-05-08T21:50:02.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.457+0000 7fb5577ec700 1 -- start start 2024-05-08T21:50:02.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.458+0000 7fb5577ec700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb5500c3490 0x7fb550072460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:02.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.458+0000 7fb5577ec700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb5500c3a00 0x7fb550161350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:02.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.458+0000 7fb5577ec700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5500c3f10 con 0x7fb550072080 2024-05-08T21:50:02.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.458+0000 7fb5577ec700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5500729a0 con 0x7fb5500c3490 2024-05-08T21:50:02.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.458+0000 7fb5577ec700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5500c41b0 con 0x7fb5500c3a00 2024-05-08T21:50:02.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.458+0000 7fb555588700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fb550072080 0x7fb550156dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:39286/0 (socket says 172.21.15.73:39286) 2024-05-08T21:50:02.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.458+0000 7fb555588700 1 -- 172.21.15.73:0/831036835 learned_addr learned my addr 172.21.15.73:0/831036835 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:50:02.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.458+0000 7fb547fff700 1 -- 172.21.15.73:0/831036835 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1946605657 0 0) 0x7fb5500c3f10 con 0x7fb550072080 2024-05-08T21:50:02.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.458+0000 7fb554d87700 1 --2- 172.21.15.73:0/831036835 >> v2:172.21.15.115:3300/0 conn(0x7fb5500c3490 0x7fb550072460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:02.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.458+0000 7fb555d89700 1 --2- 172.21.15.73:0/831036835 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb5500c3a00 0x7fb550161350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:02.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.458+0000 7fb547fff700 1 -- 172.21.15.73:0/831036835 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb53c0035b0 con 0x7fb550072080 2024-05-08T21:50:02.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.458+0000 7fb547fff700 1 -- 172.21.15.73:0/831036835 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3582351092 0 0) 0x7fb53c0035b0 con 0x7fb550072080 2024-05-08T21:50:02.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.458+0000 7fb547fff700 1 -- 172.21.15.73:0/831036835 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb5500c3a00 msgr2=0x7fb550161350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:50:02.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.458+0000 7fb547fff700 1 --2- 172.21.15.73:0/831036835 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb5500c3a00 0x7fb550161350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:02.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.458+0000 7fb547fff700 1 -- 172.21.15.73:0/831036835 >> v2:172.21.15.115:3300/0 conn(0x7fb5500c3490 msgr2=0x7fb550072460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:50:02.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.458+0000 7fb547fff700 1 --2- 172.21.15.73:0/831036835 >> v2:172.21.15.115:3300/0 conn(0x7fb5500c3490 0x7fb550072460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:02.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.458+0000 7fb547fff700 1 -- 172.21.15.73:0/831036835 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5500c7820 con 0x7fb550072080 2024-05-08T21:50:02.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.458+0000 7fb547fff700 1 -- 172.21.15.73:0/831036835 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 953298616 0 0) 0x7fb54c001670 con 0x7fb550072080 2024-05-08T21:50:02.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.458+0000 7fb547fff700 1 -- 172.21.15.73:0/831036835 >> v1:172.21.15.73:6789/0 conn(0x7fb550072080 legacy=0x7fb550156dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:02.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.458+0000 7fb547fff700 1 --2- 172.21.15.73:0/831036835 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb5500c3a00 0x7fb53c003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:02.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.458+0000 7fb547fff700 1 --2- 172.21.15.73:0/831036835 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb53c003f80 0x7fb53c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:02.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.458+0000 7fb547fff700 1 --2- 172.21.15.73:0/831036835 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb53c004d90 0x7fb53c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:02.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.458+0000 7fb547fff700 1 -- 172.21.15.73:0/831036835 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5500729a0 con 0x7fb53c004d90 2024-05-08T21:50:02.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.458+0000 7fb547fff700 1 -- 172.21.15.73:0/831036835 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5500c41b0 con 0x7fb53c003f80 2024-05-08T21:50:02.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.458+0000 7fb547fff700 1 -- 172.21.15.73:0/831036835 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb53c00ba40 con 0x7fb5500c3a00 2024-05-08T21:50:02.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.459+0000 7fb555d89700 1 --2- 172.21.15.73:0/831036835 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb53c004d90 0x7fb53c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:02.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.459+0000 7fb554d87700 1 --2- 172.21.15.73:0/831036835 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb53c003f80 0x7fb53c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:02.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.459+0000 7fb555588700 1 --2- 172.21.15.73:0/831036835 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb5500c3a00 0x7fb53c003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:02.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.459+0000 7fb555d89700 1 -- 172.21.15.73:0/831036835 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb5500c3a00 msgr2=0x7fb53c003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:50:02.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.459+0000 7fb555d89700 1 --2- 172.21.15.73:0/831036835 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb5500c3a00 0x7fb53c003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:02.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.459+0000 7fb555d89700 1 -- 172.21.15.73:0/831036835 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb53c003f80 msgr2=0x7fb53c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:50:02.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.459+0000 7fb555d89700 1 --2- 172.21.15.73:0/831036835 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb53c003f80 0x7fb53c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:02.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.459+0000 7fb555d89700 1 -- 172.21.15.73:0/831036835 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb53c0035b0 con 0x7fb53c004d90 2024-05-08T21:50:02.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.459+0000 7fb555d89700 1 --2- 172.21.15.73:0/831036835 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb53c004d90 0x7fb53c005210 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb548009fc0 tx=0x7fb53c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=243eb6001143447a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:02.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.459+0000 7fb547fff700 1 -- 172.21.15.73:0/831036835 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54800ec30 con 0x7fb53c004d90 2024-05-08T21:50:02.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.459+0000 7fb547fff700 1 -- 172.21.15.73:0/831036835 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb54800f040 con 0x7fb53c004d90 2024-05-08T21:50:02.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.459+0000 7fb547fff700 1 -- 172.21.15.73:0/831036835 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb548014480 con 0x7fb53c004d90 2024-05-08T21:50:02.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.460+0000 7fb5577ec700 1 -- 172.21.15.73:0/831036835 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb53c004d90 msgr2=0x7fb53c005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:02.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.460+0000 7fb5577ec700 1 --2- 172.21.15.73:0/831036835 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb53c004d90 0x7fb53c005210 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb548009fc0 tx=0x7fb53c005880 comp rx=0 tx=0).stop 2024-05-08T21:50:02.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.460+0000 7fb555d89700 1 -- 172.21.15.73:0/831036835 reap_dead start 2024-05-08T21:50:02.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.460+0000 7fb5577ec700 1 -- 172.21.15.73:0/831036835 shutdown_connections 2024-05-08T21:50:02.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.460+0000 7fb5577ec700 1 -- 172.21.15.73:0/831036835 >> 172.21.15.73:0/831036835 conn(0x7fb550066d70 msgr2=0x7fb5500cc500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:50:02.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.460+0000 7fb5577ec700 1 -- 172.21.15.73:0/831036835 shutdown_connections 2024-05-08T21:50:02.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.460+0000 7fb5577ec700 1 -- 172.21.15.73:0/831036835 wait complete. 2024-05-08T21:50:02.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.461+0000 7fb5577ec700 1 Processor -- start 2024-05-08T21:50:02.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.461+0000 7fb5577ec700 1 -- start start 2024-05-08T21:50:02.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.462+0000 7fb5577ec700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb5501453d0 0x7fb5501f0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:02.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.462+0000 7fb5577ec700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb55014df90 0x7fb55013f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:02.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.462+0000 7fb5577ec700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5501457b0 0x7fb55013fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:02.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.462+0000 7fb5577ec700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb550154500 con 0x7fb55014df90 2024-05-08T21:50:02.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.462+0000 7fb5577ec700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb550147060 con 0x7fb5501457b0 2024-05-08T21:50:02.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.462+0000 7fb5577ec700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb550146bd0 con 0x7fb5501453d0 2024-05-08T21:50:02.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.462+0000 7fb554d87700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb55014df90 0x7fb55013f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:02.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.462+0000 7fb554d87700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb55014df90 0x7fb55013f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38660/0 (socket says 172.21.15.73:38660) 2024-05-08T21:50:02.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.462+0000 7fb554d87700 1 -- 172.21.15.73:0/331694153 learned_addr learned my addr 172.21.15.73:0/331694153 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:50:02.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.462+0000 7fb555588700 1 --2- 172.21.15.73:0/331694153 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb5501453d0 0x7fb5501f0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:02.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.462+0000 7fb555d89700 1 --2- 172.21.15.73:0/331694153 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5501457b0 0x7fb55013fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:02.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.462+0000 7fb554d87700 1 -- 172.21.15.73:0/331694153 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb5501453d0 msgr2=0x7fb5501f0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:02.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.462+0000 7fb554d87700 1 --2- 172.21.15.73:0/331694153 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb5501453d0 0x7fb5501f0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:02.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.462+0000 7fb554d87700 1 -- 172.21.15.73:0/331694153 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5501457b0 msgr2=0x7fb55013fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:02.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.462+0000 7fb554d87700 1 --2- 172.21.15.73:0/331694153 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5501457b0 0x7fb55013fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:02.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.462+0000 7fb554d87700 1 -- 172.21.15.73:0/331694153 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb550154220 con 0x7fb55014df90 2024-05-08T21:50:02.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.462+0000 7fb554d87700 1 --2- 172.21.15.73:0/331694153 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb55014df90 0x7fb55013f600 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb5400119a0 tx=0x7fb540011cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:02.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.462+0000 7fb545ffb700 1 -- 172.21.15.73:0/331694153 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54000f780 con 0x7fb55014df90 2024-05-08T21:50:02.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.462+0000 7fb545ffb700 1 -- 172.21.15.73:0/331694153 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb54000f8e0 con 0x7fb55014df90 2024-05-08T21:50:02.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.462+0000 7fb5577ec700 1 -- 172.21.15.73:0/331694153 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5501462a0 con 0x7fb55014df90 2024-05-08T21:50:02.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.462+0000 7fb545ffb700 1 -- 172.21.15.73:0/331694153 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54000fc90 con 0x7fb55014df90 2024-05-08T21:50:02.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.463+0000 7fb5577ec700 1 -- 172.21.15.73:0/331694153 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb550146860 con 0x7fb55014df90 2024-05-08T21:50:02.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.463+0000 7fb5577ec700 1 -- 172.21.15.73:0/331694153 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb550146d40 con 0x7fb55014df90 2024-05-08T21:50:02.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.464+0000 7fb545ffb700 1 -- 172.21.15.73:0/331694153 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb540014440 con 0x7fb55014df90 2024-05-08T21:50:02.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.464+0000 7fb545ffb700 1 --2- 172.21.15.73:0/331694153 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fb53406ac90 0x7fb53406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:02.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.464+0000 7fb545ffb700 1 -- 172.21.15.73:0/331694153 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb5400898e0 con 0x7fb55014df90 2024-05-08T21:50:02.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.464+0000 7fb555588700 1 --2- 172.21.15.73:0/331694153 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fb53406ac90 0x7fb53406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:02.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.465+0000 7fb555588700 1 --2- 172.21.15.73:0/331694153 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fb53406ac90 0x7fb53406d150 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb54c0048d0 tx=0x7fb54c007980 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:02.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.469+0000 7fb545ffb700 1 -- 172.21.15.73:0/331694153 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fb540054b60 con 0x7fb55014df90 2024-05-08T21:50:02.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.668+0000 7fb5577ec700 1 -- 172.21.15.73:0/331694153 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb550068b80 con 0x7fb55014df90 2024-05-08T21:50:02.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.669+0000 7fb545ffb700 1 -- 172.21.15.73:0/331694153 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16037 (secure 0 0 0) 0x7fb54000fdf0 con 0x7fb55014df90 2024-05-08T21:50:02.670 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:50:02.670 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":21,"fsid":"143164b7-c9c7-4737-a494-7dafa5a3320c","created":"2024-05-08T21:49:26.221909+0000","modified":"2024-05-08T21:49:44.748794+0000","last_up_change":"2024-05-08T21:49:37.118386+0000","last_in_change":"2024-05-08T21:49:28.836944+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T21:49:35.998578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T21:49:42.171760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T21:49:42.576293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6b7439c1-daaa-44af-8333-a455f9e9dc67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":47228},{"type":"v1","addr":"172.21.15.73:6809","nonce":47228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":47228},{"type":"v1","addr":"172.21.15.73:6811","nonce":47228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":47228},{"type":"v1","addr":"172.21.15.73:6815","nonce":47228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":47228},{"type":"v1","addr":"172.21.15.73:6813","nonce":47228}]},"public_addr":"172.21.15.73:6809/47228","cluster_addr":"172.21.15.73:6811/47228","heartbeat_back_addr":"172.21.15.73:6815/47228","heartbeat_front_addr":"172.21.15.73:6813/47228","state":["exists","up"]},{"osd":1,"uuid":"fb67886a-d7f7-45ac-832f-36c871c8a208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":47227},{"type":"v1","addr":"172.21.15.73:6801","nonce":47227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":47227},{"type":"v1","addr":"172.21.15.73:6803","nonce":47227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":47227},{"type":"v1","addr":"172.21.15.73:6807","nonce":47227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":47227},{"type":"v1","addr":"172.21.15.73:6805","nonce":47227}]},"public_addr":"172.21.15.73:6801/47227","cluster_addr":"172.21.15.73:6803/47227","heartbeat_back_addr":"172.21.15.73:6807/47227","heartbeat_front_addr":"172.21.15.73:6805/47227","state":["exists","up"]},{"osd":2,"uuid":"a5cd6e98-6621-473a-bfb8-5c648abbb563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":47229},{"type":"v1","addr":"172.21.15.73:6817","nonce":47229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":47229},{"type":"v1","addr":"172.21.15.73:6819","nonce":47229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":47229},{"type":"v1","addr":"172.21.15.73:6823","nonce":47229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":47229},{"type":"v1","addr":"172.21.15.73:6821","nonce":47229}]},"public_addr":"172.21.15.73:6817/47229","cluster_addr":"172.21.15.73:6819/47229","heartbeat_back_addr":"172.21.15.73:6823/47229","heartbeat_front_addr":"172.21.15.73:6821/47229","state":["exists","up"]},{"osd":3,"uuid":"36927c20-4241-4f3b-91b5-a6a6f27598e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":47232},{"type":"v1","addr":"172.21.15.73:6825","nonce":47232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":47232},{"type":"v1","addr":"172.21.15.73:6827","nonce":47232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":47232},{"type":"v1","addr":"172.21.15.73:6831","nonce":47232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":47232},{"type":"v1","addr":"172.21.15.73:6829","nonce":47232}]},"public_addr":"172.21.15.73:6825/47232","cluster_addr":"172.21.15.73:6827/47232","heartbeat_back_addr":"172.21.15.73:6831/47232","heartbeat_front_addr":"172.21.15.73:6829/47232","state":["exists","up"]},{"osd":4,"uuid":"4ebe0a18-8216-4815-878a-39c39a6cd3fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":47200},{"type":"v1","addr":"172.21.15.115:6801","nonce":47200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":47200},{"type":"v1","addr":"172.21.15.115:6803","nonce":47200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":47200},{"type":"v1","addr":"172.21.15.115:6807","nonce":47200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":47200},{"type":"v1","addr":"172.21.15.115:6805","nonce":47200}]},"public_addr":"172.21.15.115:6801/47200","cluster_addr":"172.21.15.115:6803/47200","heartbeat_back_addr":"172.21.15.115:6807/47200","heartbeat_front_addr":"172.21.15.115:6805/47200","state":["exists","up"]},{"osd":5,"uuid":"957f0ac1-5f26-4f02-8c05-488e6b67ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":47201},{"type":"v1","addr":"172.21.15.115:6809","nonce":47201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":47201},{"type":"v1","addr":"172.21.15.115:6811","nonce":47201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":47201},{"type":"v1","addr":"172.21.15.115:6815","nonce":47201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":47201},{"type":"v1","addr":"172.21.15.115:6813","nonce":47201}]},"public_addr":"172.21.15.115:6809/47201","cluster_addr":"172.21.15.115:6811/47201","heartbeat_back_addr":"172.21.15.115:6815/47201","heartbeat_front_addr":"172.21.15.115:6813/47201","state":["exists","up"]},{"osd":6,"uuid":"f5a6768f-ba7f-4f66-b335-0c303b158e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":47202},{"type":"v1","addr":"172.21.15.115:6817","nonce":47202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":47202},{"type":"v1","addr":"172.21.15.115:6819","nonce":47202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":47202},{"type":"v1","addr":"172.21.15.115:6823","nonce":47202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":47202},{"type":"v1","addr":"172.21.15.115:6821","nonce":47202}]},"public_addr":"172.21.15.115:6817/47202","cluster_addr":"172.21.15.115:6819/47202","heartbeat_back_addr":"172.21.15.115:6823/47202","heartbeat_front_addr":"172.21.15.115:6821/47202","state":["exists","up"]},{"osd":7,"uuid":"f4187743-f9e6-42e6-aca9-0604a58db1ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":47211},{"type":"v1","addr":"172.21.15.115:6825","nonce":47211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":47211},{"type":"v1","addr":"172.21.15.115:6827","nonce":47211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":47211},{"type":"v1","addr":"172.21.15.115:6831","nonce":47211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":47211},{"type":"v1","addr":"172.21.15.115:6829","nonce":47211}]},"public_addr":"172.21.15.115:6825/47211","cluster_addr":"172.21.15.115:6827/47211","heartbeat_back_addr":"172.21.15.115:6831/47211","heartbeat_front_addr":"172.21.15.115:6829/47211","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:33.996335+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:33.687451+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:34.072549+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:33.997588+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:34.047260+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:34.876272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:33.965472+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:34.038637+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T21:50:02.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.671+0000 7fb5577ec700 1 -- 172.21.15.73:0/331694153 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fb53406ac90 msgr2=0x7fb53406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:02.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.671+0000 7fb5577ec700 1 --2- 172.21.15.73:0/331694153 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fb53406ac90 0x7fb53406d150 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb54c0048d0 tx=0x7fb54c007980 comp rx=0 tx=0).stop 2024-05-08T21:50:02.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.671+0000 7fb5577ec700 1 -- 172.21.15.73:0/331694153 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb55014df90 msgr2=0x7fb55013f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:02.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.671+0000 7fb5577ec700 1 --2- 172.21.15.73:0/331694153 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb55014df90 0x7fb55013f600 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb5400119a0 tx=0x7fb540011cb0 comp rx=0 tx=0).stop 2024-05-08T21:50:02.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.671+0000 7fb5577ec700 1 -- 172.21.15.73:0/331694153 shutdown_connections 2024-05-08T21:50:02.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.671+0000 7fb5577ec700 1 --2- 172.21.15.73:0/331694153 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fb53406ac90 0x7fb53406d150 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:02.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.671+0000 7fb5577ec700 1 --2- 172.21.15.73:0/331694153 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5501457b0 0x7fb55013fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:02.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.671+0000 7fb5577ec700 1 --2- 172.21.15.73:0/331694153 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb5501453d0 0x7fb5501f0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:02.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.671+0000 7fb5577ec700 1 --2- 172.21.15.73:0/331694153 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb55014df90 0x7fb55013f600 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:02.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.671+0000 7fb5577ec700 1 -- 172.21.15.73:0/331694153 >> 172.21.15.73:0/331694153 conn(0x7fb550066d70 msgr2=0x7fb5500c8670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:50:02.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.671+0000 7fb5577ec700 1 -- 172.21.15.73:0/331694153 shutdown_connections 2024-05-08T21:50:02.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.671+0000 7fb5577ec700 1 -- 172.21.15.73:0/331694153 wait complete. 2024-05-08T21:50:02.685 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:50:02.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.804+0000 7f88c55b1700 1 Processor -- start 2024-05-08T21:50:02.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.805+0000 7f88c55b1700 1 -- start start 2024-05-08T21:50:02.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.805+0000 7f88c55b1700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f88c01509c0 0x7f88c00c29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:02.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.805+0000 7f88c55b1700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f88c01574b0 0x7f88c0159db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:02.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.805+0000 7f88c55b1700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88c015a2f0 con 0x7f88c00c4490 2024-05-08T21:50:02.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.805+0000 7f88c55b1700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88c00c2ee0 con 0x7f88c01574b0 2024-05-08T21:50:02.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.805+0000 7f88c55b1700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88c01567c0 con 0x7f88c01509c0 2024-05-08T21:50:02.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.805+0000 7f88be7fc700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f88c01574b0 0x7f88c0159db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:02.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.805+0000 7f88be7fc700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f88c01574b0 0x7f88c0159db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38670/0 (socket says 172.21.15.73:38670) 2024-05-08T21:50:02.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.805+0000 7f88be7fc700 1 -- 172.21.15.73:0/1556362330 learned_addr learned my addr 172.21.15.73:0/1556362330 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:50:02.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.806+0000 7f88beffd700 1 --2- 172.21.15.73:0/1556362330 >> v2:172.21.15.115:3300/0 conn(0x7f88c01509c0 0x7f88c00c29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:02.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.806+0000 7f88be7fc700 1 -- 172.21.15.73:0/1556362330 >> v2:172.21.15.115:3300/0 conn(0x7f88c01509c0 msgr2=0x7f88c00c29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:50:02.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.806+0000 7f88be7fc700 1 --2- 172.21.15.73:0/1556362330 >> v2:172.21.15.115:3300/0 conn(0x7f88c01509c0 0x7f88c00c29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:02.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.806+0000 7f88be7fc700 1 -- 172.21.15.73:0/1556362330 >> v1:172.21.15.115:6789/0 conn(0x7f88c00c4490 legacy=0x7f88c00c6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:50:02.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.806+0000 7f88be7fc700 1 -- 172.21.15.73:0/1556362330 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c00c4ef0 con 0x7f88c01574b0 2024-05-08T21:50:02.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.806+0000 7f88be7fc700 1 --2- 172.21.15.73:0/1556362330 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88c01574b0 0x7f88c0159db0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f88c006e760 tx=0x7f88b000be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35bcc82c23011b23 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:02.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.806+0000 7f88bdffb700 1 -- 172.21.15.73:0/1556362330 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b000dcf0 con 0x7f88c01574b0 2024-05-08T21:50:02.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.806+0000 7f88bdffb700 1 -- 172.21.15.73:0/1556362330 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88b000de50 con 0x7f88c01574b0 2024-05-08T21:50:02.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.806+0000 7f88bdffb700 1 -- 172.21.15.73:0/1556362330 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b0004250 con 0x7f88c01574b0 2024-05-08T21:50:02.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.806+0000 7f88c55b1700 1 -- 172.21.15.73:0/1556362330 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88c01574b0 msgr2=0x7f88c0159db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:02.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.807+0000 7f88c55b1700 1 --2- 172.21.15.73:0/1556362330 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88c01574b0 0x7f88c0159db0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f88c006e760 tx=0x7f88b000be70 comp rx=0 tx=0).stop 2024-05-08T21:50:02.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.807+0000 7f88c55b1700 1 -- 172.21.15.73:0/1556362330 shutdown_connections 2024-05-08T21:50:02.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.807+0000 7f88c55b1700 1 --2- 172.21.15.73:0/1556362330 >> v2:172.21.15.115:3300/0 conn(0x7f88c01509c0 0x7f88c00c29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:02.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.807+0000 7f88c55b1700 1 --2- 172.21.15.73:0/1556362330 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88c01574b0 0x7f88c0159db0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:02.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.807+0000 7f88c55b1700 1 -- 172.21.15.73:0/1556362330 >> 172.21.15.73:0/1556362330 conn(0x7f88c006ce80 msgr2=0x7f88c006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:50:02.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.807+0000 7f88c55b1700 1 -- 172.21.15.73:0/1556362330 shutdown_connections 2024-05-08T21:50:02.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.807+0000 7f88c55b1700 1 -- 172.21.15.73:0/1556362330 wait complete. 2024-05-08T21:50:02.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.808+0000 7f88c55b1700 1 Processor -- start 2024-05-08T21:50:02.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.808+0000 7f88c55b1700 1 -- start start 2024-05-08T21:50:02.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.809+0000 7f88c55b1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88c00c4490 0x7f88c01ee920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:02.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.809+0000 7f88c55b1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88c01509c0 0x7f88c0158be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:02.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.809+0000 7f88c55b1700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f88c01574b0 0x7f88c01eb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:02.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.809+0000 7f88c55b1700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c01eb7f0 con 0x7f88c01509c0 2024-05-08T21:50:02.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.809+0000 7f88c55b1700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c0071c70 con 0x7f88c01574b0 2024-05-08T21:50:02.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.809+0000 7f88c55b1700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c01534f0 con 0x7f88c00c4490 2024-05-08T21:50:02.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.809+0000 7f88be7fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88c01509c0 0x7f88c0158be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:02.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.809+0000 7f88be7fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88c01509c0 0x7f88c0158be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38686/0 (socket says 172.21.15.73:38686) 2024-05-08T21:50:02.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.809+0000 7f88be7fc700 1 -- 172.21.15.73:0/3173514392 learned_addr learned my addr 172.21.15.73:0/3173514392 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:50:02.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.810+0000 7f88bf7fe700 1 --2- 172.21.15.73:0/3173514392 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f88c01574b0 0x7f88c01eb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:02.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.810+0000 7f88beffd700 1 --2- 172.21.15.73:0/3173514392 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88c00c4490 0x7f88c01ee920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:02.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.810+0000 7f88be7fc700 1 -- 172.21.15.73:0/3173514392 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88c00c4490 msgr2=0x7f88c01ee920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:02.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.810+0000 7f88be7fc700 1 --2- 172.21.15.73:0/3173514392 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88c00c4490 0x7f88c01ee920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:02.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.810+0000 7f88be7fc700 1 -- 172.21.15.73:0/3173514392 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f88c01574b0 msgr2=0x7f88c01eb2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:02.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.810+0000 7f88be7fc700 1 --2- 172.21.15.73:0/3173514392 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f88c01574b0 0x7f88c01eb2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:02.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.810+0000 7f88be7fc700 1 -- 172.21.15.73:0/3173514392 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b000b7f0 con 0x7f88c01509c0 2024-05-08T21:50:02.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.810+0000 7f88beffd700 1 --2- 172.21.15.73:0/3173514392 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88c00c4490 0x7f88c01ee920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:50:02.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.810+0000 7f88be7fc700 1 --2- 172.21.15.73:0/3173514392 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88c01509c0 0x7f88c0158be0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f88b000beb0 tx=0x7f88b0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:02.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.810+0000 7f88b77fe700 1 -- 172.21.15.73:0/3173514392 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b0020070 con 0x7f88c01509c0 2024-05-08T21:50:02.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.810+0000 7f88c55b1700 1 -- 172.21.15.73:0/3173514392 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88c01537d0 con 0x7f88c01509c0 2024-05-08T21:50:02.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.810+0000 7f88c55b1700 1 -- 172.21.15.73:0/3173514392 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88c01ee120 con 0x7f88c01509c0 2024-05-08T21:50:02.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.810+0000 7f88b77fe700 1 -- 172.21.15.73:0/3173514392 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88b0004030 con 0x7f88c01509c0 2024-05-08T21:50:02.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.810+0000 7f88b77fe700 1 -- 172.21.15.73:0/3173514392 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b0010470 con 0x7f88c01509c0 2024-05-08T21:50:02.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.811+0000 7f88c55b1700 1 -- 172.21.15.73:0/3173514392 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88c0067a20 con 0x7f88c01509c0 2024-05-08T21:50:02.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.811+0000 7f88b77fe700 1 -- 172.21.15.73:0/3173514392 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f88b00105d0 con 0x7f88c01509c0 2024-05-08T21:50:02.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.812+0000 7f88b77fe700 1 --2- 172.21.15.73:0/3173514392 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f88a006ac90 0x7f88a006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:02.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.812+0000 7f88beffd700 1 --2- 172.21.15.73:0/3173514392 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f88a006ac90 0x7f88a006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:02.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.812+0000 7f88b77fe700 1 -- 172.21.15.73:0/3173514392 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f88b008c8e0 con 0x7f88c01509c0 2024-05-08T21:50:02.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.812+0000 7f88beffd700 1 --2- 172.21.15.73:0/3173514392 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f88a006ac90 0x7f88a006d150 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f88a8009a00 tx=0x7f88a8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:02.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:02.816+0000 7f88b77fe700 1 -- 172.21.15.73:0/3173514392 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f88b0057b80 con 0x7f88c01509c0 2024-05-08T21:50:03.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.059+0000 7f88c55b1700 1 -- 172.21.15.73:0/3173514392 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f88c01540d0 con 0x7f88c01509c0 2024-05-08T21:50:03.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.060+0000 7f88b77fe700 1 -- 172.21.15.73:0/3173514392 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+6250 (secure 0 0 0) 0x7f88b005b1a0 con 0x7f88c01509c0 2024-05-08T21:50:03.061 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:50:03.061 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3242319177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6833","nonce":3242319177},{"type":"v1","addr":"172.21.15.115:6835","nonce":3242319177}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6834/2136341349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2136341349},{"type":"v1","addr":"172.21.15.115:6834","nonce":2136341349}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4249,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1439647913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1439647913},{"type":"v1","addr":"172.21.15.115:6837","nonce":1439647913}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/2386382396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2386382396},{"type":"v1","addr":"172.21.15.73:6836","nonce":2386382396}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/1772457954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":1772457954},{"type":"v1","addr":"172.21.15.73:6837","nonce":1772457954}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:49:43.747162+0000","modified":"2024-05-08T21:49:48.814033+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.73:6839/1477468490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1477468490},{"type":"v1","addr":"172.21.15.73:6839","nonce":1477468490}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:50:03.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.062+0000 7f88c55b1700 1 -- 172.21.15.73:0/3173514392 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f88a006ac90 msgr2=0x7f88a006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:03.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.062+0000 7f88c55b1700 1 --2- 172.21.15.73:0/3173514392 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f88a006ac90 0x7f88a006d150 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f88a8009a00 tx=0x7f88a8008040 comp rx=0 tx=0).stop 2024-05-08T21:50:03.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.062+0000 7f88c55b1700 1 -- 172.21.15.73:0/3173514392 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88c01509c0 msgr2=0x7f88c0158be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:03.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.062+0000 7f88c55b1700 1 --2- 172.21.15.73:0/3173514392 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88c01509c0 0x7f88c0158be0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f88b000beb0 tx=0x7f88b0004750 comp rx=0 tx=0).stop 2024-05-08T21:50:03.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.062+0000 7f88c55b1700 1 -- 172.21.15.73:0/3173514392 shutdown_connections 2024-05-08T21:50:03.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.062+0000 7f88c55b1700 1 --2- 172.21.15.73:0/3173514392 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f88a006ac90 0x7f88a006d150 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:03.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.062+0000 7f88c55b1700 1 --2- 172.21.15.73:0/3173514392 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f88c01574b0 0x7f88c01eb2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:03.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.062+0000 7f88c55b1700 1 --2- 172.21.15.73:0/3173514392 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88c00c4490 0x7f88c01ee920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:03.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.062+0000 7f88c55b1700 1 --2- 172.21.15.73:0/3173514392 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88c01509c0 0x7f88c0158be0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:03.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.062+0000 7f88c55b1700 1 -- 172.21.15.73:0/3173514392 >> 172.21.15.73:0/3173514392 conn(0x7f88c006ce80 msgr2=0x7f88c014dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:50:03.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.062+0000 7f88c55b1700 1 -- 172.21.15.73:0/3173514392 shutdown_connections 2024-05-08T21:50:03.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.063+0000 7f88c55b1700 1 -- 172.21.15.73:0/3173514392 wait complete. 2024-05-08T21:50:03.065 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 8 2024-05-08T21:50:03.680 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-08T21:49:43.747162+0000', 'modified': '2024-05-08T21:49:48.814033+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4275}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4275': {'gid': 4275, 'name': 'e', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.73:6839/1477468490', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6838', 'nonce': 1477468490}, {'type': 'v1', 'addr': '172.21.15.73:6839', 'nonce': 1477468490}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-05-08T21:50:03.680 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-08T21:50:03.680 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-05-08T21:50:03.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.804+0000 7f8903833700 1 Processor -- start 2024-05-08T21:50:03.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.804+0000 7f8903833700 1 -- start start 2024-05-08T21:50:03.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.805+0000 7f8903833700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88fc150c50 0x7f88fc072a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:03.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.805+0000 7f8903833700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f88fc0ca140 0x7f88fc0ca5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:03.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.805+0000 7f8903833700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88fc0c3eb0 con 0x7f88fc0cb250 2024-05-08T21:50:03.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.805+0000 7f8903833700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88fc0c9720 con 0x7f88fc0ca140 2024-05-08T21:50:03.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.805+0000 7f8903833700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88fc0c3bd0 con 0x7f88fc150c50 2024-05-08T21:50:03.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.805+0000 7f8900dce700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f88fc0cb250 0x7f88fc0c9010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:39294/0 (socket says 172.21.15.73:39294) 2024-05-08T21:50:03.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.805+0000 7f8900dce700 1 -- 172.21.15.73:0/3357272986 learned_addr learned my addr 172.21.15.73:0/3357272986 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:50:03.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.806+0000 7f8901dd0700 1 --2- 172.21.15.73:0/3357272986 >> v2:172.21.15.115:3300/0 conn(0x7f88fc0ca140 0x7f88fc0ca5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:03.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.806+0000 7f88f3fff700 1 -- 172.21.15.73:0/3357272986 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3037899370 0 0) 0x7f88fc0c3eb0 con 0x7f88fc0cb250 2024-05-08T21:50:03.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.806+0000 7f89015cf700 1 --2- 172.21.15.73:0/3357272986 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88fc150c50 0x7f88fc072a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:03.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.806+0000 7f88f3fff700 1 -- 172.21.15.73:0/3357272986 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88e80035b0 con 0x7f88fc0cb250 2024-05-08T21:50:03.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.806+0000 7f88f3fff700 1 -- 172.21.15.73:0/3357272986 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 982041860 0 0) 0x7f88e80035b0 con 0x7f88fc0cb250 2024-05-08T21:50:03.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.806+0000 7f88f3fff700 1 -- 172.21.15.73:0/3357272986 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88fc150c50 msgr2=0x7f88fc072a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:50:03.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.806+0000 7f88f3fff700 1 --2- 172.21.15.73:0/3357272986 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88fc150c50 0x7f88fc072a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:03.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.806+0000 7f88f3fff700 1 -- 172.21.15.73:0/3357272986 >> v2:172.21.15.115:3300/0 conn(0x7f88fc0ca140 msgr2=0x7f88fc0ca5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:50:03.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.806+0000 7f88f3fff700 1 --2- 172.21.15.73:0/3357272986 >> v2:172.21.15.115:3300/0 conn(0x7f88fc0ca140 0x7f88fc0ca5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:03.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.806+0000 7f88f3fff700 1 -- 172.21.15.73:0/3357272986 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88fc0c5580 con 0x7f88fc0cb250 2024-05-08T21:50:03.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.806+0000 7f88f3fff700 1 -- 172.21.15.73:0/3357272986 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 953298616 0 0) 0x7f88f8001670 con 0x7f88fc0cb250 2024-05-08T21:50:03.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.806+0000 7f88f3fff700 1 -- 172.21.15.73:0/3357272986 >> v1:172.21.15.73:6789/0 conn(0x7f88fc0cb250 legacy=0x7f88fc0c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:03.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.806+0000 7f88f3fff700 1 --2- 172.21.15.73:0/3357272986 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88e8003a00 0x7f88e8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:03.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.806+0000 7f88f3fff700 1 --2- 172.21.15.73:0/3357272986 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f88e8004850 0x7f88e8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:03.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.806+0000 7f88f3fff700 1 --2- 172.21.15.73:0/3357272986 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88fc150c50 0x7f88e8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:03.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.806+0000 7f88f3fff700 1 -- 172.21.15.73:0/3357272986 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88fc0c9720 con 0x7f88e8003a00 2024-05-08T21:50:03.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.806+0000 7f88f3fff700 1 -- 172.21.15.73:0/3357272986 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88fc0c3bd0 con 0x7f88e8004850 2024-05-08T21:50:03.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.806+0000 7f88f3fff700 1 -- 172.21.15.73:0/3357272986 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88e800ba10 con 0x7f88fc150c50 2024-05-08T21:50:03.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.806+0000 7f89015cf700 1 --2- 172.21.15.73:0/3357272986 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88e8003a00 0x7f88e8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:03.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.806+0000 7f8900dce700 1 --2- 172.21.15.73:0/3357272986 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f88e8004850 0x7f88e8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:03.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.806+0000 7f8901dd0700 1 --2- 172.21.15.73:0/3357272986 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88fc150c50 0x7f88e8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:03.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.806+0000 7f89015cf700 1 -- 172.21.15.73:0/3357272986 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88fc150c50 msgr2=0x7f88e8005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:50:03.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.806+0000 7f89015cf700 1 --2- 172.21.15.73:0/3357272986 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88fc150c50 0x7f88e8005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:03.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.806+0000 7f89015cf700 1 -- 172.21.15.73:0/3357272986 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f88e8004850 msgr2=0x7f88e8004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:50:03.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.806+0000 7f89015cf700 1 --2- 172.21.15.73:0/3357272986 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f88e8004850 0x7f88e8004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:03.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.806+0000 7f89015cf700 1 -- 172.21.15.73:0/3357272986 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e80035b0 con 0x7f88e8003a00 2024-05-08T21:50:03.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.807+0000 7f89015cf700 1 --2- 172.21.15.73:0/3357272986 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88e8003a00 0x7f88e8003e20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f88ec009b60 tx=0x7f88e8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8524101770ab0168 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:03.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.807+0000 7f88f3fff700 1 -- 172.21.15.73:0/3357272986 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ec009e70 con 0x7f88e8003a00 2024-05-08T21:50:03.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.807+0000 7f88f3fff700 1 -- 172.21.15.73:0/3357272986 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88ec015860 con 0x7f88e8003a00 2024-05-08T21:50:03.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.807+0000 7f88f3fff700 1 -- 172.21.15.73:0/3357272986 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ec015c10 con 0x7f88e8003a00 2024-05-08T21:50:03.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.807+0000 7f8903833700 1 -- 172.21.15.73:0/3357272986 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88e8003a00 msgr2=0x7f88e8003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:03.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.807+0000 7f8903833700 1 --2- 172.21.15.73:0/3357272986 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88e8003a00 0x7f88e8003e20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f88ec009b60 tx=0x7f88e8005880 comp rx=0 tx=0).stop 2024-05-08T21:50:03.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.807+0000 7f8901dd0700 1 -- 172.21.15.73:0/3357272986 reap_dead start 2024-05-08T21:50:03.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.807+0000 7f8903833700 1 -- 172.21.15.73:0/3357272986 shutdown_connections 2024-05-08T21:50:03.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.807+0000 7f8903833700 1 -- 172.21.15.73:0/3357272986 >> 172.21.15.73:0/3357272986 conn(0x7f88fc06bad0 msgr2=0x7f88fc06bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:50:03.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.807+0000 7f8903833700 1 -- 172.21.15.73:0/3357272986 shutdown_connections 2024-05-08T21:50:03.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.807+0000 7f8903833700 1 -- 172.21.15.73:0/3357272986 wait complete. 2024-05-08T21:50:03.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.809+0000 7f8903833700 1 Processor -- start 2024-05-08T21:50:03.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.809+0000 7f8903833700 1 -- start start 2024-05-08T21:50:03.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.809+0000 7f8903833700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88e8003a00 0x7f88fc154e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:03.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.809+0000 7f8903833700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f88fc155720 0x7f88fc1eb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:03.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.809+0000 7f8903833700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88fc14dbc0 0x7f88fc140b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:03.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.809+0000 7f8903833700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88fc1441a0 con 0x7f88fc14dbc0 2024-05-08T21:50:03.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.809+0000 7f8903833700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88fc1428c0 con 0x7f88fc155720 2024-05-08T21:50:03.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.809+0000 7f8903833700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88fc155bd0 con 0x7f88e8003a00 2024-05-08T21:50:03.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.809+0000 7f8901dd0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88fc14dbc0 0x7f88fc140b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:03.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.809+0000 7f8901dd0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88fc14dbc0 0x7f88fc140b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38712/0 (socket says 172.21.15.73:38712) 2024-05-08T21:50:03.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.809+0000 7f8901dd0700 1 -- 172.21.15.73:0/3805342385 learned_addr learned my addr 172.21.15.73:0/3805342385 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:50:03.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.810+0000 7f89015cf700 1 --2- 172.21.15.73:0/3805342385 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88e8003a00 0x7f88fc154e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:03.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.810+0000 7f8900dce700 1 --2- 172.21.15.73:0/3805342385 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f88fc155720 0x7f88fc1eb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:03.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.810+0000 7f8901dd0700 1 -- 172.21.15.73:0/3805342385 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88e8003a00 msgr2=0x7f88fc154e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:03.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.810+0000 7f8901dd0700 1 --2- 172.21.15.73:0/3805342385 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88e8003a00 0x7f88fc154e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:03.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.810+0000 7f8901dd0700 1 -- 172.21.15.73:0/3805342385 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f88fc155720 msgr2=0x7f88fc1eb2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:03.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.810+0000 7f8901dd0700 1 --2- 172.21.15.73:0/3805342385 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f88fc155720 0x7f88fc1eb2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:03.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.810+0000 7f8901dd0700 1 -- 172.21.15.73:0/3805342385 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88fc155e20 con 0x7f88fc14dbc0 2024-05-08T21:50:03.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.810+0000 7f8901dd0700 1 --2- 172.21.15.73:0/3805342385 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88fc14dbc0 0x7f88fc140b90 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f88f4011c80 tx=0x7f88f400f490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:03.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.810+0000 7f88f1ffb700 1 -- 172.21.15.73:0/3805342385 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f400e040 con 0x7f88fc14dbc0 2024-05-08T21:50:03.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.810+0000 7f88f1ffb700 1 -- 172.21.15.73:0/3805342385 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88f400f040 con 0x7f88fc14dbc0 2024-05-08T21:50:03.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.810+0000 7f8903833700 1 -- 172.21.15.73:0/3805342385 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88fc156120 con 0x7f88fc14dbc0 2024-05-08T21:50:03.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.810+0000 7f88f1ffb700 1 -- 172.21.15.73:0/3805342385 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f4015670 con 0x7f88fc14dbc0 2024-05-08T21:50:03.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.810+0000 7f8903833700 1 -- 172.21.15.73:0/3805342385 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88fc143dc0 con 0x7f88fc14dbc0 2024-05-08T21:50:03.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.811+0000 7f88f1ffb700 1 -- 172.21.15.73:0/3805342385 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f88f40157d0 con 0x7f88fc14dbc0 2024-05-08T21:50:03.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.812+0000 7f88f1ffb700 1 --2- 172.21.15.73:0/3805342385 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f88e006ac90 0x7f88e006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:03.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.812+0000 7f88f1ffb700 1 -- 172.21.15.73:0/3805342385 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f88f4089730 con 0x7f88fc14dbc0 2024-05-08T21:50:03.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.812+0000 7f89015cf700 1 --2- 172.21.15.73:0/3805342385 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f88e006ac90 0x7f88e006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:03.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.812+0000 7f89015cf700 1 --2- 172.21.15.73:0/3805342385 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f88e006ac90 0x7f88e006d150 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f88ec0090b0 tx=0x7f88ec008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:03.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.814+0000 7f890f9edb80 1 Processor -- start 2024-05-08T21:50:03.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.814+0000 7f890f9edb80 1 -- start start 2024-05-08T21:50:03.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.815+0000 7f890f9edb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d8f1f7dd0 0x561d8f1f7450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:03.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.815+0000 7f890f9edb80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561d8f1ba930 0x561d8f1e1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:03.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.815+0000 7f890f9edb80 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x561d8f1f81b0 0x561d8f1e1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:03.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.815+0000 7f890f9edb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d8f10f100 con 0x561d8f1f7dd0 2024-05-08T21:50:03.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.815+0000 7f890f9edb80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d8f10cac0 con 0x561d8f1ba930 2024-05-08T21:50:03.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.815+0000 7f890f9edb80 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x561d8f1083b0 con 0x561d8f1f81b0 2024-05-08T21:50:03.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.815+0000 7f89015cf700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d8f1f7dd0 0x561d8f1f7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:03.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.815+0000 7f89015cf700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d8f1f7dd0 0x561d8f1f7450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38716/0 (socket says 172.21.15.73:38716) 2024-05-08T21:50:03.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.815+0000 7f89015cf700 1 -- 172.21.15.73:0/3788100802 learned_addr learned my addr 172.21.15.73:0/3788100802 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:50:03.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.815+0000 7f8900dce700 1 --2- 172.21.15.73:0/3788100802 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561d8f1ba930 0x561d8f1e1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:03.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.815+0000 7f8901dd0700 1 --2- 172.21.15.73:0/3788100802 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x561d8f1f81b0 0x561d8f1e1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:03.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.815+0000 7f89015cf700 1 -- 172.21.15.73:0/3788100802 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x561d8f1f81b0 msgr2=0x561d8f1e1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:50:03.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.815+0000 7f89015cf700 1 --2- 172.21.15.73:0/3788100802 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x561d8f1f81b0 0x561d8f1e1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:03.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.815+0000 7f89015cf700 1 -- 172.21.15.73:0/3788100802 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561d8f1ba930 msgr2=0x561d8f1e1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:50:03.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.815+0000 7f89015cf700 1 --2- 172.21.15.73:0/3788100802 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561d8f1ba930 0x561d8f1e1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:03.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.815+0000 7f89015cf700 1 -- 172.21.15.73:0/3788100802 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561d8ef89360 con 0x561d8f1f7dd0 2024-05-08T21:50:03.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.815+0000 7f89015cf700 1 --2- 172.21.15.73:0/3788100802 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d8f1f7dd0 0x561d8f1f7450 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f88ec00e4b0 tx=0x7f88ec017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72e265830f651ef4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:03.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.815+0000 7f88e6ffd700 1 -- 172.21.15.73:0/3788100802 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ec031070 con 0x561d8f1f7dd0 2024-05-08T21:50:03.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.815+0000 7f88e6ffd700 1 -- 172.21.15.73:0/3788100802 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88ec024040 con 0x561d8f1f7dd0 2024-05-08T21:50:03.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.815+0000 7f88e6ffd700 1 -- 172.21.15.73:0/3788100802 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ec015e90 con 0x561d8f1f7dd0 2024-05-08T21:50:03.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.816+0000 7f890f9edb80 1 -- 172.21.15.73:0/3788100802 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d8f1f7dd0 msgr2=0x561d8f1f7450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:03.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.816+0000 7f890f9edb80 1 --2- 172.21.15.73:0/3788100802 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d8f1f7dd0 0x561d8f1f7450 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f88ec00e4b0 tx=0x7f88ec017000 comp rx=0 tx=0).stop 2024-05-08T21:50:03.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.816+0000 7f890f9edb80 1 -- 172.21.15.73:0/3788100802 shutdown_connections 2024-05-08T21:50:03.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.816+0000 7f890f9edb80 1 --2- 172.21.15.73:0/3788100802 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x561d8f1f81b0 0x561d8f1e1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:03.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.816+0000 7f890f9edb80 1 --2- 172.21.15.73:0/3788100802 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d8f1f7dd0 0x561d8f1f7450 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:03.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.816+0000 7f890f9edb80 1 --2- 172.21.15.73:0/3788100802 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561d8f1ba930 0x561d8f1e1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:03.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.816+0000 7f890f9edb80 1 -- 172.21.15.73:0/3788100802 >> 172.21.15.73:0/3788100802 conn(0x561d8f1161c0 msgr2=0x561d8f1b6300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:50:03.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.816+0000 7f890f9edb80 1 -- 172.21.15.73:0/3788100802 shutdown_connections 2024-05-08T21:50:03.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.816+0000 7f890f9edb80 1 -- 172.21.15.73:0/3788100802 wait complete. 2024-05-08T21:50:03.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.817+0000 7f890f9edb80 1 -- start start 2024-05-08T21:50:03.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.817+0000 7f890f9edb80 1 Processor -- start 2024-05-08T21:50:03.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.818+0000 7f890f9edb80 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x561d8f1f7dd0 0x561d8f1ddb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:03.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.818+0000 7f890f9edb80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561d8f1f81b0 0x561d8f1fbe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:03.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.818+0000 7f890f9edb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d8f1dca80 0x561d8f209040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:03.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.818+0000 7f890f9edb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d8f0a4510 con 0x561d8f1dca80 2024-05-08T21:50:03.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.818+0000 7f890f9edb80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d8f0a41b0 con 0x561d8f1f81b0 2024-05-08T21:50:03.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.818+0000 7f890f9edb80 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x561d8ef8b650 con 0x561d8f1f7dd0 2024-05-08T21:50:03.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.818+0000 7f890f9edb80 10 client.0 _ll_register_callbacks cb 0x561d8f0adae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T21:50:03.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.818+0000 7f8901dd0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d8f1dca80 0x561d8f209040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:03.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.818+0000 7f8901dd0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d8f1dca80 0x561d8f209040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38728/0 (socket says 172.21.15.73:38728) 2024-05-08T21:50:03.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.818+0000 7f8901dd0700 1 -- 172.21.15.73:0/1483514399 learned_addr learned my addr 172.21.15.73:0/1483514399 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:50:03.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.818+0000 7f8900dce700 1 --2- 172.21.15.73:0/1483514399 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561d8f1f81b0 0x561d8f1fbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:03.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.818+0000 7f89015cf700 1 --2- 172.21.15.73:0/1483514399 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x561d8f1f7dd0 0x561d8f1ddb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:03.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.818+0000 7f8901dd0700 1 -- 172.21.15.73:0/1483514399 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x561d8f1f7dd0 msgr2=0x561d8f1ddb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:50:03.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.818+0000 7f8901dd0700 1 --2- 172.21.15.73:0/1483514399 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x561d8f1f7dd0 0x561d8f1ddb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:03.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.818+0000 7f8901dd0700 1 -- 172.21.15.73:0/1483514399 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561d8f1f81b0 msgr2=0x561d8f1fbe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:50:03.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.818+0000 7f8901dd0700 1 --2- 172.21.15.73:0/1483514399 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561d8f1f81b0 0x561d8f1fbe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:03.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.818+0000 7f8901dd0700 1 -- 172.21.15.73:0/1483514399 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88e80035b0 con 0x561d8f1dca80 2024-05-08T21:50:03.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.818+0000 7f8901dd0700 1 --2- 172.21.15.73:0/1483514399 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d8f1dca80 0x561d8f209040 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f88f4087c90 tx=0x7f88f4058800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=368f94c3bea207ec server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:03.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.818+0000 7f88dbfff700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-08T21:50:03.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.818+0000 7f88dbfff700 1 -- 172.21.15.73:0/1483514399 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f4060a50 con 0x561d8f1dca80 2024-05-08T21:50:03.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.818+0000 7f88dbfff700 1 -- 172.21.15.73:0/1483514399 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f88f400fe50 con 0x561d8f1dca80 2024-05-08T21:50:03.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.818+0000 7f890f9edb80 1 -- 172.21.15.73:0/1483514399 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561d8f061220 con 0x561d8f1dca80 2024-05-08T21:50:03.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.818+0000 7f88dbfff700 1 -- 172.21.15.73:0/1483514399 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f88f405c150 con 0x561d8f1dca80 2024-05-08T21:50:03.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.818+0000 7f890f9edb80 10 client.4671 fetch_fsmap learned FSMap version 8 2024-05-08T21:50:03.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.818+0000 7f890f9edb80 1 -- 172.21.15.73:0/1483514399 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x561d8ef35b10 con 0x561d8f1dca80 2024-05-08T21:50:03.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.819+0000 7f88dbfff700 1 -- 172.21.15.73:0/1483514399 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561d8f061220 con 0x561d8f1dca80 2024-05-08T21:50:03.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.819+0000 7f88dbfff700 1 -- 172.21.15.73:0/1483514399 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 8) v1 ==== 4204+0+0 (secure 0 0 0) 0x7f88f4058970 con 0x561d8f1dca80 2024-05-08T21:50:03.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.819+0000 7f890f9edb80 10 client.4671 fetch_fsmap finished waiting for FSMap version 8 2024-05-08T21:50:03.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.819+0000 7f890f9edb80 10 client.4671 resolve_mds: resolved name 'e' to daemon mds.e 2024-05-08T21:50:03.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.819+0000 7f890f9edb80 20 client.4671 populate_metadata read hostname 'smithi073' 2024-05-08T21:50:03.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.819+0000 7f890f9edb80 1 --2- 172.21.15.73:0/1483514399 >> [v2:172.21.15.73:6838/1477468490,v1:172.21.15.73:6839/1477468490] conn(0x561d8f1d5a90 0x561d8f1b9030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:03.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.819+0000 7f890f9edb80 4 client.4671 mds_command: new command op to 4275 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T21:50:03.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.819+0000 7f890f9edb80 1 -- 172.21.15.73:0/1483514399 --> [v2:172.21.15.73:6838/1477468490,v1:172.21.15.73:6839/1477468490] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561d8f187790 con 0x561d8f1d5a90 2024-05-08T21:50:03.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.819+0000 7f89015cf700 1 --2- 172.21.15.73:0/1483514399 >> [v2:172.21.15.73:6838/1477468490,v1:172.21.15.73:6839/1477468490] conn(0x561d8f1d5a90 0x561d8f1b9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:03.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.819+0000 7f88dbfff700 10 client.4671 ms_handle_connect on v2:172.21.15.73:6838/1477468490 2024-05-08T21:50:03.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.819+0000 7f89015cf700 1 --2- 172.21.15.73:0/1483514399 >> [v2:172.21.15.73:6838/1477468490,v1:172.21.15.73:6839/1477468490] conn(0x561d8f1d5a90 0x561d8f1b9030 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a99b9a27a6df8115 server_cookie=6441e96eb582b486 in_seq=0 out_seq=0 2024-05-08T21:50:03.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.820+0000 7f88dbfff700 1 -- 172.21.15.73:0/1483514399 <== mds.0 v2:172.21.15.73:6838/1477468490 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x561d8f187790 con 0x561d8f1d5a90 2024-05-08T21:50:03.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.820+0000 7f88dbfff700 10 client.4671 handle_command_reply: tid=0 2024-05-08T21:50:03.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.820+0000 7f890f9edb80 1 client.4671 shutdown 2024-05-08T21:50:03.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.820+0000 7f890f9edb80 1 -- 172.21.15.73:0/1483514399 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d8f1dca80 msgr2=0x561d8f209040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:03.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.820+0000 7f890f9edb80 1 --2- 172.21.15.73:0/1483514399 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d8f1dca80 0x561d8f209040 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f88f4087c90 tx=0x7f88f4058800 comp rx=0 tx=0).stop 2024-05-08T21:50:03.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.820+0000 7f890f9edb80 1 -- 172.21.15.73:0/1483514399 shutdown_connections 2024-05-08T21:50:03.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.820+0000 7f890f9edb80 1 --2- 172.21.15.73:0/1483514399 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d8f1dca80 0x561d8f209040 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:03.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.820+0000 7f890f9edb80 1 --2- 172.21.15.73:0/1483514399 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x561d8f1f7dd0 0x561d8f1ddb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:03.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.820+0000 7f890f9edb80 1 --2- 172.21.15.73:0/1483514399 >> [v2:172.21.15.73:6838/1477468490,v1:172.21.15.73:6839/1477468490] conn(0x561d8f1d5a90 0x561d8f1b9030 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:03.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.820+0000 7f890f9edb80 1 --2- 172.21.15.73:0/1483514399 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561d8f1f81b0 0x561d8f1fbe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:03.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.820+0000 7f88dbfff700 0 client.4671 ms_handle_reset on v2:172.21.15.73:6838/1477468490 2024-05-08T21:50:03.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.820+0000 7f890f9edb80 1 -- 172.21.15.73:0/1483514399 >> 172.21.15.73:0/1483514399 conn(0x561d8f1161c0 msgr2=0x561d8f1b3450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:50:03.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.820+0000 7f890f9edb80 1 -- 172.21.15.73:0/1483514399 shutdown_connections 2024-05-08T21:50:03.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.820+0000 7f890f9edb80 1 -- 172.21.15.73:0/1483514399 wait complete. 2024-05-08T21:50:03.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.820+0000 7f890f9edb80 20 client.4671 trim_cache size 0 max 16384 2024-05-08T21:50:03.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.838+0000 7f890f9edb80 1 Processor -- start 2024-05-08T21:50:03.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.838+0000 7f890f9edb80 1 -- start start 2024-05-08T21:50:03.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.839+0000 7f890f9edb80 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x561d8f1dca80 0x561d8f20b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:03.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.839+0000 7f890f9edb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d8f1f7dd0 0x561d8f20bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:03.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.839+0000 7f890f9edb80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561d8f1f81b0 0x561d8f1b2f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:03.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.839+0000 7f890f9edb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d8f1e2750 con 0x561d8f1f7dd0 2024-05-08T21:50:03.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.839+0000 7f890f9edb80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d8f1b2a80 con 0x561d8f1f81b0 2024-05-08T21:50:03.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.839+0000 7f890f9edb80 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x561d8f1b8610 con 0x561d8f1dca80 2024-05-08T21:50:03.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.839+0000 7f8900dce700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d8f1f7dd0 0x561d8f20bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:03.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.839+0000 7f8900dce700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d8f1f7dd0 0x561d8f20bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38736/0 (socket says 172.21.15.73:38736) 2024-05-08T21:50:03.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.839+0000 7f8900dce700 1 -- 172.21.15.73:0/4136387313 learned_addr learned my addr 172.21.15.73:0/4136387313 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:50:03.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.839+0000 7f8901dd0700 1 --2- 172.21.15.73:0/4136387313 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561d8f1f81b0 0x561d8f1b2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:03.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.839+0000 7f89015cf700 1 --2- 172.21.15.73:0/4136387313 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x561d8f1dca80 0x561d8f20b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:03.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.839+0000 7f8900dce700 1 -- 172.21.15.73:0/4136387313 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x561d8f1dca80 msgr2=0x561d8f20b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:50:03.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.839+0000 7f8900dce700 1 --2- 172.21.15.73:0/4136387313 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x561d8f1dca80 0x561d8f20b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:03.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.839+0000 7f8900dce700 1 -- 172.21.15.73:0/4136387313 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561d8f1f81b0 msgr2=0x561d8f1b2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:50:03.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.839+0000 7f8900dce700 1 --2- 172.21.15.73:0/4136387313 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561d8f1f81b0 0x561d8f1b2f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:03.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.839+0000 7f8900dce700 1 -- 172.21.15.73:0/4136387313 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561d8f0ce510 con 0x561d8f1f7dd0 2024-05-08T21:50:03.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.839+0000 7f8900dce700 1 --2- 172.21.15.73:0/4136387313 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d8f1f7dd0 0x561d8f20bca0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f88fc1544f0 tx=0x7f88f8007980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e10e8f2181773d2c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:03.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.839+0000 7f88e77fe700 1 -- 172.21.15.73:0/4136387313 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f8007140 con 0x561d8f1f7dd0 2024-05-08T21:50:03.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.839+0000 7f88e77fe700 1 -- 172.21.15.73:0/4136387313 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88f80072c0 con 0x561d8f1f7dd0 2024-05-08T21:50:03.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.839+0000 7f88e77fe700 1 -- 172.21.15.73:0/4136387313 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f8007670 con 0x561d8f1f7dd0 2024-05-08T21:50:03.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.840+0000 7f890f9edb80 1 -- 172.21.15.73:0/4136387313 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d8f1f7dd0 msgr2=0x561d8f20bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:03.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.840+0000 7f890f9edb80 1 --2- 172.21.15.73:0/4136387313 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d8f1f7dd0 0x561d8f20bca0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f88fc1544f0 tx=0x7f88f8007980 comp rx=0 tx=0).stop 2024-05-08T21:50:03.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.840+0000 7f890f9edb80 1 -- 172.21.15.73:0/4136387313 shutdown_connections 2024-05-08T21:50:03.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.840+0000 7f890f9edb80 1 --2- 172.21.15.73:0/4136387313 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561d8f1f81b0 0x561d8f1b2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:03.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.840+0000 7f890f9edb80 1 --2- 172.21.15.73:0/4136387313 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x561d8f1dca80 0x561d8f20b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:03.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.840+0000 7f890f9edb80 1 --2- 172.21.15.73:0/4136387313 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d8f1f7dd0 0x561d8f20bca0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:03.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.840+0000 7f890f9edb80 1 -- 172.21.15.73:0/4136387313 >> 172.21.15.73:0/4136387313 conn(0x561d8f1161c0 msgr2=0x561d8f1b7f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:50:03.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.840+0000 7f890f9edb80 1 -- 172.21.15.73:0/4136387313 shutdown_connections 2024-05-08T21:50:03.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.840+0000 7f890f9edb80 1 -- 172.21.15.73:0/4136387313 wait complete. 2024-05-08T21:50:03.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.840+0000 7f890f9edb80 1 -- start start 2024-05-08T21:50:03.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.840+0000 7f890f9edb80 1 Processor -- start 2024-05-08T21:50:03.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.841+0000 7f890f9edb80 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x561d8f1dca80 0x561d8f1b9290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:03.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.841+0000 7f890f9edb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d8f1f7dd0 0x561d8f25c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:03.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.841+0000 7f890f9edb80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561d8f1f81b0 0x561d8f25cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:03.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.841+0000 7f890f9edb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d8f1e11b0 con 0x561d8f1f7dd0 2024-05-08T21:50:03.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.841+0000 7f890f9edb80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d8f1b97d0 con 0x561d8f1f81b0 2024-05-08T21:50:03.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.841+0000 7f890f9edb80 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x561d8f1dfbb0 con 0x561d8f1dca80 2024-05-08T21:50:03.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.841+0000 7f890f9edb80 10 client.0 _ll_register_callbacks cb 0x561d8f0adae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T21:50:03.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.841+0000 7f8900dce700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d8f1f7dd0 0x561d8f25c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:03.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.841+0000 7f8900dce700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d8f1f7dd0 0x561d8f25c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38740/0 (socket says 172.21.15.73:38740) 2024-05-08T21:50:03.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.841+0000 7f8900dce700 1 -- 172.21.15.73:0/586537063 learned_addr learned my addr 172.21.15.73:0/586537063 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:50:03.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.842+0000 7f8901dd0700 1 --2- 172.21.15.73:0/586537063 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561d8f1f81b0 0x561d8f25cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:03.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.842+0000 7f89015cf700 1 --2- 172.21.15.73:0/586537063 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x561d8f1dca80 0x561d8f1b9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:03.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.842+0000 7f8900dce700 1 -- 172.21.15.73:0/586537063 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x561d8f1dca80 msgr2=0x561d8f1b9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:50:03.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.842+0000 7f8900dce700 1 --2- 172.21.15.73:0/586537063 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x561d8f1dca80 0x561d8f1b9290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:03.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.842+0000 7f8900dce700 1 -- 172.21.15.73:0/586537063 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561d8f1f81b0 msgr2=0x561d8f25cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:50:03.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.842+0000 7f8900dce700 1 --2- 172.21.15.73:0/586537063 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561d8f1f81b0 0x561d8f25cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:03.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.842+0000 7f8900dce700 1 -- 172.21.15.73:0/586537063 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88fc0c5580 con 0x561d8f1f7dd0 2024-05-08T21:50:03.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.842+0000 7f89015cf700 1 --2- 172.21.15.73:0/586537063 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x561d8f1dca80 0x561d8f1b9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:50:03.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.842+0000 7f8900dce700 1 --2- 172.21.15.73:0/586537063 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d8f1f7dd0 0x561d8f25c9f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f88f8000c00 tx=0x7f88f8001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c978491dca329a2c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:03.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.842+0000 7f88dbfff700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-08T21:50:03.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.842+0000 7f88dbfff700 1 -- 172.21.15.73:0/586537063 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f8016830 con 0x561d8f1f7dd0 2024-05-08T21:50:03.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.842+0000 7f88dbfff700 1 -- 172.21.15.73:0/586537063 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f88f8016990 con 0x561d8f1f7dd0 2024-05-08T21:50:03.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.842+0000 7f890f9edb80 1 -- 172.21.15.73:0/586537063 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561d8f1d6800 con 0x561d8f1f7dd0 2024-05-08T21:50:03.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.842+0000 7f88dbfff700 1 -- 172.21.15.73:0/586537063 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f88f8016b70 con 0x561d8f1f7dd0 2024-05-08T21:50:03.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.842+0000 7f890f9edb80 10 client.4677 fetch_fsmap learned FSMap version 8 2024-05-08T21:50:03.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.842+0000 7f890f9edb80 1 -- 172.21.15.73:0/586537063 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x561d8ef8dc80 con 0x561d8f1f7dd0 2024-05-08T21:50:03.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.842+0000 7f88dbfff700 1 -- 172.21.15.73:0/586537063 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561d8f1d6800 con 0x561d8f1f7dd0 2024-05-08T21:50:03.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.842+0000 7f88dbfff700 1 -- 172.21.15.73:0/586537063 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 8) v1 ==== 4204+0+0 (secure 0 0 0) 0x7f88f8016cd0 con 0x561d8f1f7dd0 2024-05-08T21:50:03.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.842+0000 7f890f9edb80 10 client.4677 fetch_fsmap finished waiting for FSMap version 8 2024-05-08T21:50:03.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.842+0000 7f890f9edb80 10 client.4677 resolve_mds: resolved name 'e' to daemon mds.e 2024-05-08T21:50:03.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.842+0000 7f890f9edb80 20 client.4677 populate_metadata read hostname 'smithi073' 2024-05-08T21:50:03.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.842+0000 7f890f9edb80 1 --2- 172.21.15.73:0/586537063 >> [v2:172.21.15.73:6838/1477468490,v1:172.21.15.73:6839/1477468490] conn(0x561d8f205ac0 0x561d8f205ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:03.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.842+0000 7f890f9edb80 4 client.4677 mds_command: new command op to 4275 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-08T21:50:03.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.842+0000 7f890f9edb80 1 -- 172.21.15.73:0/586537063 --> [v2:172.21.15.73:6838/1477468490,v1:172.21.15.73:6839/1477468490] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f88ec024040 con 0x561d8f205ac0 2024-05-08T21:50:03.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.843+0000 7f89015cf700 1 --2- 172.21.15.73:0/586537063 >> [v2:172.21.15.73:6838/1477468490,v1:172.21.15.73:6839/1477468490] conn(0x561d8f205ac0 0x561d8f205ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:03.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.843+0000 7f88dbfff700 10 client.4677 ms_handle_connect on v2:172.21.15.73:6838/1477468490 2024-05-08T21:50:03.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.843+0000 7f89015cf700 1 --2- 172.21.15.73:0/586537063 >> [v2:172.21.15.73:6838/1477468490,v1:172.21.15.73:6839/1477468490] conn(0x561d8f205ac0 0x561d8f205ea0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95bb7dfb39ac8255 server_cookie=503f1979fc48242d in_seq=0 out_seq=0 2024-05-08T21:50:03.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.843+0000 7f88dbfff700 1 -- 172.21.15.73:0/586537063 <== mds.0 v2:172.21.15.73:6838/1477468490 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x7f88ec024040 con 0x561d8f205ac0 2024-05-08T21:50:03.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.843+0000 7f88dbfff700 10 client.4677 handle_command_reply: tid=0 2024-05-08T21:50:03.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.843+0000 7f890f9edb80 1 client.4677 shutdown 2024-05-08T21:50:03.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.843+0000 7f890f9edb80 1 -- 172.21.15.73:0/586537063 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d8f1f7dd0 msgr2=0x561d8f25c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:03.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.843+0000 7f890f9edb80 1 --2- 172.21.15.73:0/586537063 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d8f1f7dd0 0x561d8f25c9f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f88f8000c00 tx=0x7f88f8001a00 comp rx=0 tx=0).stop 2024-05-08T21:50:03.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.843+0000 7f890f9edb80 1 -- 172.21.15.73:0/586537063 shutdown_connections 2024-05-08T21:50:03.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.843+0000 7f890f9edb80 1 --2- 172.21.15.73:0/586537063 >> [v2:172.21.15.73:6838/1477468490,v1:172.21.15.73:6839/1477468490] conn(0x561d8f205ac0 0x561d8f205ea0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:03.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.843+0000 7f890f9edb80 1 --2- 172.21.15.73:0/586537063 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561d8f1f81b0 0x561d8f25cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:03.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.843+0000 7f890f9edb80 1 --2- 172.21.15.73:0/586537063 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x561d8f1dca80 0x561d8f1b9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:03.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.843+0000 7f890f9edb80 1 --2- 172.21.15.73:0/586537063 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d8f1f7dd0 0x561d8f25c9f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:03.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.843+0000 7f88dbfff700 0 client.4677 ms_handle_reset on v2:172.21.15.73:6838/1477468490 2024-05-08T21:50:03.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.843+0000 7f890f9edb80 1 -- 172.21.15.73:0/586537063 >> 172.21.15.73:0/586537063 conn(0x561d8f1161c0 msgr2=0x561d8f1f6960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:50:03.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.843+0000 7f890f9edb80 1 -- 172.21.15.73:0/586537063 shutdown_connections 2024-05-08T21:50:03.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.843+0000 7f890f9edb80 1 -- 172.21.15.73:0/586537063 wait complete. 2024-05-08T21:50:03.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.843+0000 7f890f9edb80 20 client.4677 trim_cache size 0 max 16384 2024-05-08T21:50:03.852 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-05-08T21:50:03.852 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_fsid": "143164b7-c9c7-4737-a494-7dafa5a3320c", 2024-05-08T21:50:03.852 INFO:teuthology.orchestra.run.smithi073.stdout: "whoami": 0, 2024-05-08T21:50:03.852 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 4275, 2024-05-08T21:50:03.852 INFO:teuthology.orchestra.run.smithi073.stdout: "want_state": "up:active", 2024-05-08T21:50:03.852 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "up:active", 2024-05-08T21:50:03.852 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs", 2024-05-08T21:50:03.852 INFO:teuthology.orchestra.run.smithi073.stdout: "rank_uptime": 20.095731249, 2024-05-08T21:50:03.852 INFO:teuthology.orchestra.run.smithi073.stdout: "mdsmap_epoch": 8, 2024-05-08T21:50:03.852 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch": 21, 2024-05-08T21:50:03.852 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch_barrier": 21, 2024-05-08T21:50:03.852 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 26.465370958000001 2024-05-08T21:50:03.852 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-05-08T21:50:03.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.844+0000 7f8903833700 1 -- 172.21.15.73:0/3805342385 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f88e006ac90 msgr2=0x7f88e006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:03.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.844+0000 7f8903833700 1 --2- 172.21.15.73:0/3805342385 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f88e006ac90 0x7f88e006d150 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f88ec0090b0 tx=0x7f88ec008030 comp rx=0 tx=0).stop 2024-05-08T21:50:03.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.844+0000 7f8903833700 1 -- 172.21.15.73:0/3805342385 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88fc14dbc0 msgr2=0x7f88fc140b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:03.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.844+0000 7f8903833700 1 --2- 172.21.15.73:0/3805342385 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88fc14dbc0 0x7f88fc140b90 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f88f4011c80 tx=0x7f88f400f490 comp rx=0 tx=0).stop 2024-05-08T21:50:03.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.844+0000 7f8903833700 1 -- 172.21.15.73:0/3805342385 shutdown_connections 2024-05-08T21:50:03.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.844+0000 7f8903833700 1 --2- 172.21.15.73:0/3805342385 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f88e006ac90 0x7f88e006d150 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:03.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.844+0000 7f8903833700 1 --2- 172.21.15.73:0/3805342385 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88fc14dbc0 0x7f88fc140b90 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:03.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.844+0000 7f8903833700 1 --2- 172.21.15.73:0/3805342385 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88e8003a00 0x7f88fc154e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:03.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.844+0000 7f8903833700 1 --2- 172.21.15.73:0/3805342385 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f88fc155720 0x7f88fc1eb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:03.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.844+0000 7f8903833700 1 -- 172.21.15.73:0/3805342385 >> 172.21.15.73:0/3805342385 conn(0x7f88fc06bad0 msgr2=0x7f88fc0cb730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:50:03.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.844+0000 7f8903833700 1 -- 172.21.15.73:0/3805342385 shutdown_connections 2024-05-08T21:50:03.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:03.844+0000 7f8903833700 1 -- 172.21.15.73:0/3805342385 wait complete. 2024-05-08T21:50:03.857 INFO:teuthology.run_tasks:Running task sequential... 2024-05-08T21:50:03.884 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-05-08T21:50:03.884 INFO:teuthology.task.sequential:In sequential, running task print... 2024-05-08T21:50:03.884 INFO:teuthology.task.print:Enabling mgr modules 2024-05-08T21:50:03.884 INFO:teuthology.run_tasks:Running task kclient... 2024-05-08T21:50:03.905 INFO:tasks.kclient:Mounting kernel clients... 2024-05-08T21:50:03.905 INFO:tasks.kclient:config is {'client.0': {}} 2024-05-08T21:50:03.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:50:03.906 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2024-05-08T21:50:03.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:50:03.923 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link delete ceph-brx 2024-05-08T21:50:03.991 INFO:teuthology.orchestra.run.smithi073.stderr:Cannot find device "ceph-brx" 2024-05-08T21:50:03.992 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T21:50:03.993 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-05-08T21:50:03.993 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-08T21:50:03.993 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-08T21:50:03.993 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-08T21:50:04.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.154+0000 7f1d86c4b700 1 Processor -- start 2024-05-08T21:50:04.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.154+0000 7f1d86c4b700 1 -- start start 2024-05-08T21:50:04.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.155+0000 7f1d86c4b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d80151ae0 0x7f1d8015ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:04.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.155+0000 7f1d86c4b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1d800c55c0 0x7f1d80157a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:04.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.155+0000 7f1d86c4b700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1d800c2810 0x7f1d800c5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:04.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.155+0000 7f1d86c4b700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d8015b000 con 0x7f1d800c2810 2024-05-08T21:50:04.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.155+0000 7f1d86c4b700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d8015b5c0 con 0x7f1d800c55c0 2024-05-08T21:50:04.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.155+0000 7f1d86c4b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8015bf90 con 0x7f1d80151ae0 2024-05-08T21:50:04.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.156+0000 7f1d851e8700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1d800c2810 0x7f1d800c5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:04.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.156+0000 7f1d851e8700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1d800c2810 0x7f1d800c5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38756/0 (socket says 172.21.15.73:38756) 2024-05-08T21:50:04.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.156+0000 7f1d851e8700 1 -- 172.21.15.73:0/2764126484 learned_addr learned my addr 172.21.15.73:0/2764126484 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:50:04.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.156+0000 7f1d7ffff700 1 --2- 172.21.15.73:0/2764126484 >> v2:172.21.15.115:3300/0 conn(0x7f1d800c55c0 0x7f1d80157a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:04.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.156+0000 7f1d849e7700 1 --2- 172.21.15.73:0/2764126484 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d80151ae0 0x7f1d8015ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:04.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.156+0000 7f1d851e8700 1 -- 172.21.15.73:0/2764126484 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d80151ae0 msgr2=0x7f1d8015ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:50:04.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.156+0000 7f1d851e8700 1 --2- 172.21.15.73:0/2764126484 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d80151ae0 0x7f1d8015ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:04.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.156+0000 7f1d851e8700 1 -- 172.21.15.73:0/2764126484 >> v2:172.21.15.115:3300/0 conn(0x7f1d800c55c0 msgr2=0x7f1d80157a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:50:04.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.156+0000 7f1d851e8700 1 --2- 172.21.15.73:0/2764126484 >> v2:172.21.15.115:3300/0 conn(0x7f1d800c55c0 0x7f1d80157a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:04.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.156+0000 7f1d851e8700 1 -- 172.21.15.73:0/2764126484 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d80151ec0 con 0x7f1d800c2810 2024-05-08T21:50:04.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.156+0000 7f1d851e8700 1 --2- 172.21.15.73:0/2764126484 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d800c2810 0x7f1d800c5d10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1d8006d4f0 tx=0x7f1d7800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaacd787c8435fed server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:04.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.156+0000 7f1d7f7fe700 1 -- 172.21.15.73:0/2764126484 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7800e070 con 0x7f1d800c2810 2024-05-08T21:50:04.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.156+0000 7f1d7f7fe700 1 -- 172.21.15.73:0/2764126484 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d7800b9c0 con 0x7f1d800c2810 2024-05-08T21:50:04.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.156+0000 7f1d7f7fe700 1 -- 172.21.15.73:0/2764126484 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7800bd70 con 0x7f1d800c2810 2024-05-08T21:50:04.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.157+0000 7f1d86c4b700 1 -- 172.21.15.73:0/2764126484 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d800c2810 msgr2=0x7f1d800c5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:04.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.157+0000 7f1d86c4b700 1 --2- 172.21.15.73:0/2764126484 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d800c2810 0x7f1d800c5d10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1d8006d4f0 tx=0x7f1d7800b330 comp rx=0 tx=0).stop 2024-05-08T21:50:04.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.157+0000 7f1d86c4b700 1 -- 172.21.15.73:0/2764126484 shutdown_connections 2024-05-08T21:50:04.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.157+0000 7f1d86c4b700 1 --2- 172.21.15.73:0/2764126484 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d800c2810 0x7f1d800c5d10 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:04.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.157+0000 7f1d86c4b700 1 --2- 172.21.15.73:0/2764126484 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d80151ae0 0x7f1d8015ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:04.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.157+0000 7f1d86c4b700 1 --2- 172.21.15.73:0/2764126484 >> v2:172.21.15.115:3300/0 conn(0x7f1d800c55c0 0x7f1d80157a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:04.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.157+0000 7f1d86c4b700 1 -- 172.21.15.73:0/2764126484 >> 172.21.15.73:0/2764126484 conn(0x7f1d8006ce80 msgr2=0x7f1d8006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:50:04.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.157+0000 7f1d86c4b700 1 -- 172.21.15.73:0/2764126484 shutdown_connections 2024-05-08T21:50:04.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.157+0000 7f1d86c4b700 1 -- 172.21.15.73:0/2764126484 wait complete. 2024-05-08T21:50:04.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.158+0000 7f1d86c4b700 1 Processor -- start 2024-05-08T21:50:04.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.158+0000 7f1d86c4b700 1 -- start start 2024-05-08T21:50:04.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.159+0000 7f1d86c4b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d800c2810 0x7f1d800ca2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:04.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.159+0000 7f1d86c4b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d800c55c0 0x7f1d80156b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:04.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.159+0000 7f1d86c4b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d80151ae0 0x7f1d801f06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:04.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.159+0000 7f1d86c4b700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d80154ba0 con 0x7f1d80151ae0 2024-05-08T21:50:04.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.159+0000 7f1d86c4b700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d80153550 con 0x7f1d800c55c0 2024-05-08T21:50:04.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.159+0000 7f1d86c4b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d80154f50 con 0x7f1d800c2810 2024-05-08T21:50:04.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.159+0000 7f1d851e8700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d80151ae0 0x7f1d801f06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:04.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.159+0000 7f1d851e8700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d80151ae0 0x7f1d801f06f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38762/0 (socket says 172.21.15.73:38762) 2024-05-08T21:50:04.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.159+0000 7f1d851e8700 1 -- 172.21.15.73:0/3029713307 learned_addr learned my addr 172.21.15.73:0/3029713307 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:50:04.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.159+0000 7f1d7ffff700 1 --2- 172.21.15.73:0/3029713307 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d800c55c0 0x7f1d80156b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:04.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.159+0000 7f1d849e7700 1 --2- 172.21.15.73:0/3029713307 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d800c2810 0x7f1d800ca2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:04.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.159+0000 7f1d851e8700 1 -- 172.21.15.73:0/3029713307 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d800c2810 msgr2=0x7f1d800ca2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:04.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.159+0000 7f1d851e8700 1 --2- 172.21.15.73:0/3029713307 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d800c2810 0x7f1d800ca2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:04.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.159+0000 7f1d851e8700 1 -- 172.21.15.73:0/3029713307 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d800c55c0 msgr2=0x7f1d80156b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:04.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.159+0000 7f1d851e8700 1 --2- 172.21.15.73:0/3029713307 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d800c55c0 0x7f1d80156b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:04.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.159+0000 7f1d851e8700 1 -- 172.21.15.73:0/3029713307 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d78009b30 con 0x7f1d80151ae0 2024-05-08T21:50:04.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.159+0000 7f1d849e7700 1 --2- 172.21.15.73:0/3029713307 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d800c2810 0x7f1d800ca2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:50:04.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.159+0000 7f1d851e8700 1 --2- 172.21.15.73:0/3029713307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d80151ae0 0x7f1d801f06f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1d7800b370 tx=0x7f1d78004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:04.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.159+0000 7f1d7d7fa700 1 -- 172.21.15.73:0/3029713307 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d78004930 con 0x7f1d80151ae0 2024-05-08T21:50:04.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.159+0000 7f1d7d7fa700 1 -- 172.21.15.73:0/3029713307 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d780092e0 con 0x7f1d80151ae0 2024-05-08T21:50:04.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.159+0000 7f1d86c4b700 1 -- 172.21.15.73:0/3029713307 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d80152660 con 0x7f1d80151ae0 2024-05-08T21:50:04.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.159+0000 7f1d7d7fa700 1 -- 172.21.15.73:0/3029713307 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7801b650 con 0x7f1d80151ae0 2024-05-08T21:50:04.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.159+0000 7f1d86c4b700 1 -- 172.21.15.73:0/3029713307 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d80152c20 con 0x7f1d80151ae0 2024-05-08T21:50:04.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.160+0000 7f1d86c4b700 1 -- 172.21.15.73:0/3029713307 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d80153700 con 0x7f1d80151ae0 2024-05-08T21:50:04.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.161+0000 7f1d7d7fa700 1 -- 172.21.15.73:0/3029713307 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1d7801b7b0 con 0x7f1d80151ae0 2024-05-08T21:50:04.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.161+0000 7f1d7d7fa700 1 --2- 172.21.15.73:0/3029713307 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f1d6406ac90 0x7f1d6406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:04.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.161+0000 7f1d849e7700 1 --2- 172.21.15.73:0/3029713307 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f1d6406ac90 0x7f1d6406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:04.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.161+0000 7f1d7d7fa700 1 -- 172.21.15.73:0/3029713307 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1d7808a9d0 con 0x7f1d80151ae0 2024-05-08T21:50:04.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.162+0000 7f1d849e7700 1 --2- 172.21.15.73:0/3029713307 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f1d6406ac90 0x7f1d6406d150 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1d7400aa50 tx=0x7f1d74008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:04.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.166+0000 7f1d7d7fa700 1 -- 172.21.15.73:0/3029713307 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f1d78055c80 con 0x7f1d80151ae0 2024-05-08T21:50:04.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.409+0000 7f1d86c4b700 1 -- 172.21.15.73:0/3029713307 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1d80068430 con 0x7f1d80151ae0 2024-05-08T21:50:04.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.410+0000 7f1d7d7fa700 1 -- 172.21.15.73:0/3029713307 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1d780592a0 con 0x7f1d80151ae0 2024-05-08T21:50:04.411 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-08T21:50:04.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.412+0000 7f1d86c4b700 1 -- 172.21.15.73:0/3029713307 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f1d6406ac90 msgr2=0x7f1d6406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:04.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.412+0000 7f1d86c4b700 1 --2- 172.21.15.73:0/3029713307 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f1d6406ac90 0x7f1d6406d150 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1d7400aa50 tx=0x7f1d74008040 comp rx=0 tx=0).stop 2024-05-08T21:50:04.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.412+0000 7f1d86c4b700 1 -- 172.21.15.73:0/3029713307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d80151ae0 msgr2=0x7f1d801f06f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:04.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.412+0000 7f1d86c4b700 1 --2- 172.21.15.73:0/3029713307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d80151ae0 0x7f1d801f06f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1d7800b370 tx=0x7f1d78004ad0 comp rx=0 tx=0).stop 2024-05-08T21:50:04.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.412+0000 7f1d86c4b700 1 -- 172.21.15.73:0/3029713307 shutdown_connections 2024-05-08T21:50:04.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.412+0000 7f1d86c4b700 1 --2- 172.21.15.73:0/3029713307 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f1d6406ac90 0x7f1d6406d150 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:04.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.412+0000 7f1d86c4b700 1 --2- 172.21.15.73:0/3029713307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d80151ae0 0x7f1d801f06f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:04.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.412+0000 7f1d86c4b700 1 --2- 172.21.15.73:0/3029713307 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d800c2810 0x7f1d800ca2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:04.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.412+0000 7f1d86c4b700 1 --2- 172.21.15.73:0/3029713307 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d800c55c0 0x7f1d80156b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:04.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.412+0000 7f1d86c4b700 1 -- 172.21.15.73:0/3029713307 >> 172.21.15.73:0/3029713307 conn(0x7f1d8006ce80 msgr2=0x7f1d8014fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:50:04.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.412+0000 7f1d86c4b700 1 -- 172.21.15.73:0/3029713307 shutdown_connections 2024-05-08T21:50:04.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:04.412+0000 7f1d86c4b700 1 -- 172.21.15.73:0/3029713307 wait complete. 2024-05-08T21:50:04.425 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-08T21:50:04.425 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-08T21:50:04.425 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi073.front.sepia.ceph.com 2024-05-08T21:50:04.425 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-08T21:50:04.425 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-08T21:50:04.425 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-08T21:50:04.425 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-08T21:50:04.425 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-08T21:50:04.425 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-08T21:50:04.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:50:04.426 DEBUG:teuthology.orchestra.run.smithi073:> ip addr 2024-05-08T21:50:04.443 INFO:teuthology.orchestra.run.smithi073.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-08T21:50:04.443 INFO:teuthology.orchestra.run.smithi073.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-08T21:50:04.443 INFO:teuthology.orchestra.run.smithi073.stdout: inet 127.0.0.1/8 scope host lo 2024-05-08T21:50:04.444 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-05-08T21:50:04.444 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 ::1/128 scope host 2024-05-08T21:50:04.444 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-05-08T21:50:04.444 INFO:teuthology.orchestra.run.smithi073.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T21:50:04.444 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:ea brd ff:ff:ff:ff:ff:ff 2024-05-08T21:50:04.444 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f0 2024-05-08T21:50:04.444 INFO:teuthology.orchestra.run.smithi073.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T21:50:04.444 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:eb brd ff:ff:ff:ff:ff:ff 2024-05-08T21:50:04.444 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f1 2024-05-08T21:50:04.444 INFO:teuthology.orchestra.run.smithi073.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T21:50:04.444 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7c brd ff:ff:ff:ff:ff:ff 2024-05-08T21:50:04.444 INFO:teuthology.orchestra.run.smithi073.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-08T21:50:04.444 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7d brd ff:ff:ff:ff:ff:ff 2024-05-08T21:50:04.444 INFO:teuthology.orchestra.run.smithi073.stdout: inet 172.21.15.73/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-08T21:50:04.445 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft 42274sec preferred_lft 42274sec 2024-05-08T21:50:04.445 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::9eda:b92:1bc8:3e91/64 scope link noprefixroute 2024-05-08T21:50:04.445 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-05-08T21:50:04.445 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-08T21:50:04.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:50:04.445 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2024-05-08T21:50:04.445 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-05-08T21:50:04.445 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link add name ceph-brx type bridge 2024-05-08T21:50:04.446 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip addr flush dev ceph-brx 2024-05-08T21:50:04.446 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set ceph-brx up 2024-05-08T21:50:04.446 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-08T21:50:04.446 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-05-08T21:50:04.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:50:04.611 DEBUG:teuthology.orchestra.run.smithi073:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-08T21:50:04.639 INFO:teuthology.orchestra.run.smithi073.stdout:1 2024-05-08T21:50:04.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:50:04.640 DEBUG:teuthology.orchestra.run.smithi073:> route 2024-05-08T21:50:04.711 INFO:teuthology.orchestra.run.smithi073.stdout:Kernel IP routing table 2024-05-08T21:50:04.711 INFO:teuthology.orchestra.run.smithi073.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-08T21:50:04.711 INFO:teuthology.orchestra.run.smithi073.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-08T21:50:04.712 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-08T21:50:04.712 INFO:teuthology.orchestra.run.smithi073.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-08T21:50:04.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:50:04.712 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2024-05-08T21:50:04.712 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-05-08T21:50:04.712 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-08T21:50:04.712 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-08T21:50:04.712 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-08T21:50:04.713 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-05-08T21:50:04.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:50:04.948 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2024-05-08T21:50:04.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:50:04.966 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list-id 2024-05-08T21:50:05.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:50:05.023 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2024-05-08T21:50:05.023 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-05-08T21:50:05.023 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-08T21:50:05.023 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-08T21:50:05.023 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-05-08T21:50:05.119 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-08T21:50:05.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:50:05.119 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2024-05-08T21:50:05.119 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-05-08T21:50:05.120 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-08T21:50:05.120 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-08T21:50:05.120 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-08T21:50:05.120 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-08T21:50:05.120 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-08T21:50:05.120 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-05-08T21:50:05.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:50:05.351 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2024-05-08T21:50:05.351 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-05-08T21:50:05.351 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set brx.0 up 2024-05-08T21:50:05.351 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set dev brx.0 master ceph-brx 2024-05-08T21:50:05.351 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-05-08T21:50:05.449 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T21:50:05.449 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-08T21:50:05.466 INFO:teuthology.orchestra.run.smithi073.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-08T21:50:05.466 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T21:50:05.466 DEBUG:teuthology.orchestra.run.smithi073:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-08T21:50:05.522 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-05-08T21:50:05.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:50:05.523 DEBUG:teuthology.orchestra.run.smithi073:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-08T21:50:05.609 INFO:teuthology.orchestra.run.smithi073.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-08T21:50:05.609 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-08T21:50:05.696 INFO:teuthology.orchestra.run.smithi073.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-08T21:50:05.697 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-08T21:50:05.697 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: resolved to: "172.21.15.73:3300,172.21.15.115:3300,172.21.15.115:3301" 2024-05-08T21:50:05.697 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: trying mount with new device syntax: 0@143164b7-c9c7-4737-a494-7dafa5a3320c.cephfs=/ 2024-05-08T21:50:05.697 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.73:3300/172.21.15.115:3300/172.21.15.115:3301" will pass to kernel 2024-05-08T21:50:05.697 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: v2 mount support check returned 2 2024-05-08T21:50:05.697 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: kernel does not support v2 syntax 2024-05-08T21:50:05.697 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-08T21:50:05.715 INFO:teuthology.orchestra.run.smithi073.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-08T21:50:05.716 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-08T21:50:05.716 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: resolved to: "172.21.15.73:3300,172.21.15.115:3300,172.21.15.115:3301" 2024-05-08T21:50:05.716 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: trying mount with new device syntax: 0@143164b7-c9c7-4737-a494-7dafa5a3320c.cephfs=/ 2024-05-08T21:50:05.716 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.73:3300/172.21.15.115:3300/172.21.15.115:3301" will pass to kernel 2024-05-08T21:50:05.716 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: v2 mount support check returned 2 2024-05-08T21:50:05.716 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: kernel does not support v2 syntax 2024-05-08T21:50:05.716 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-08T21:50:05.716 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: resolved to: "172.21.15.73:6789,172.21.15.115:6789,172.21.15.115:6790" 2024-05-08T21:50:05.716 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.73:6789,172.21.15.115:6789,172.21.15.115:6790:/ 2024-05-08T21:50:05.716 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=143164b7-c9c7-4737-a494-7dafa5a3320c" will pass to kernel 2024-05-08T21:50:05.718 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-08T21:50:05.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:50:05.719 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-08T21:50:05.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:50:05.745 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-08T21:50:05.827 INFO:teuthology.orchestra.run.smithi073.stdout:client4567 2024-05-08T21:50:05.828 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-05-08T21:50:05.828 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T21:50:05.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:50:05.885 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-08T21:50:05.968 INFO:teuthology.orchestra.run.smithi073.stdout:client4567 2024-05-08T21:50:05.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:50:05.968 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-08T21:50:06.052 INFO:teuthology.orchestra.run.smithi073.stdout:client4567 2024-05-08T21:50:06.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:50:06.053 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/143164b7-c9c7-4737-a494-7dafa5a3320c.client4567/status') 2024-05-08T21:50:06.143 INFO:teuthology.orchestra.run.smithi073.stdout:instance: client.4567 (3)172.21.15.73:0/406749613 2024-05-08T21:50:06.143 INFO:teuthology.orchestra.run.smithi073.stdout:blocklisted: false 2024-05-08T21:50:06.143 INFO:teuthology.orchestra.run.smithi073.stderr:0+1 records in 2024-05-08T21:50:06.143 INFO:teuthology.orchestra.run.smithi073.stderr:0+1 records out 2024-05-08T21:50:06.143 INFO:teuthology.orchestra.run.smithi073.stderr:69 bytes copied, 3.716e-05 s, 1.9 MB/s 2024-05-08T21:50:06.144 INFO:teuthology.run_tasks:Running task mds_thrash... 2024-05-08T21:50:06.156 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T21:50:06.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.278+0000 7f7a19e57700 1 Processor -- start 2024-05-08T21:50:06.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.278+0000 7f7a19e57700 1 -- start start 2024-05-08T21:50:06.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.279+0000 7f7a19e57700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f7a140cb630 0x7f7a140cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:06.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.279+0000 7f7a19e57700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7a140cafc0 0x7f7a140cc480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:06.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.279+0000 7f7a19e57700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a1415e1b0 con 0x7f7a14153ed0 2024-05-08T21:50:06.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.279+0000 7f7a19e57700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a140ca930 con 0x7f7a140cb630 2024-05-08T21:50:06.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.279+0000 7f7a19e57700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1406bc00 con 0x7f7a140cafc0 2024-05-08T21:50:06.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.279+0000 7f7a12ffd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f7a140cb630 0x7f7a140cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:06.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.279+0000 7f7a13fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7a140cafc0 0x7f7a140cc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:06.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.279+0000 7f7a12ffd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f7a140cb630 0x7f7a140cbf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.73:49892/0 (socket says 172.21.15.73:49892) 2024-05-08T21:50:06.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.279+0000 7f7a12ffd700 1 -- 172.21.15.73:0/3384858318 learned_addr learned my addr 172.21.15.73:0/3384858318 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:50:06.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.279+0000 7f7a12ffd700 1 -- 172.21.15.73:0/3384858318 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7a140cafc0 msgr2=0x7f7a140cc480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:50:06.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.279+0000 7f7a12ffd700 1 --2- 172.21.15.73:0/3384858318 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7a140cafc0 0x7f7a140cc480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:06.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.279+0000 7f7a12ffd700 1 -- 172.21.15.73:0/3384858318 >> v1:172.21.15.115:6789/0 conn(0x7f7a14153ed0 legacy=0x7f7a1406c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:06.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.279+0000 7f7a12ffd700 1 -- 172.21.15.73:0/3384858318 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a140cbcc0 con 0x7f7a140cb630 2024-05-08T21:50:06.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.279+0000 7f7a13fff700 1 --2- 172.21.15.73:0/3384858318 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7a140cafc0 0x7f7a140cc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:50:06.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.280+0000 7f7a12ffd700 1 --2- 172.21.15.73:0/3384858318 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7a140cb630 0x7f7a140cbf40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7a040098f0 tx=0x7f7a04009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a07946827225995f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:06.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.280+0000 7f7a127fc700 1 -- 172.21.15.73:0/3384858318 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a04011830 con 0x7f7a140cb630 2024-05-08T21:50:06.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.280+0000 7f7a127fc700 1 -- 172.21.15.73:0/3384858318 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a04011990 con 0x7f7a140cb630 2024-05-08T21:50:06.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.280+0000 7f7a127fc700 1 -- 172.21.15.73:0/3384858318 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a04011d20 con 0x7f7a140cb630 2024-05-08T21:50:06.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.280+0000 7f7a19e57700 1 -- 172.21.15.73:0/3384858318 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7a140cb630 msgr2=0x7f7a140cbf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:06.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.280+0000 7f7a19e57700 1 --2- 172.21.15.73:0/3384858318 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7a140cb630 0x7f7a140cbf40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7a040098f0 tx=0x7f7a04009c00 comp rx=0 tx=0).stop 2024-05-08T21:50:06.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.280+0000 7f7a19e57700 1 -- 172.21.15.73:0/3384858318 shutdown_connections 2024-05-08T21:50:06.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.280+0000 7f7a19e57700 1 --2- 172.21.15.73:0/3384858318 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7a140cafc0 0x7f7a140cc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:06.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.280+0000 7f7a19e57700 1 --2- 172.21.15.73:0/3384858318 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7a140cb630 0x7f7a140cbf40 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:06.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.280+0000 7f7a19e57700 1 -- 172.21.15.73:0/3384858318 >> 172.21.15.73:0/3384858318 conn(0x7f7a140666c0 msgr2=0x7f7a14066ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:50:06.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.280+0000 7f7a19e57700 1 -- 172.21.15.73:0/3384858318 shutdown_connections 2024-05-08T21:50:06.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.280+0000 7f7a19e57700 1 -- 172.21.15.73:0/3384858318 wait complete. 2024-05-08T21:50:06.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.282+0000 7f7a19e57700 1 Processor -- start 2024-05-08T21:50:06.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.282+0000 7f7a19e57700 1 -- start start 2024-05-08T21:50:06.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.282+0000 7f7a19e57700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7a140cafc0 0x7f7a141ef880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:06.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.282+0000 7f7a19e57700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7a140cb630 0x7f7a1415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:06.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.282+0000 7f7a19e57700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a14153ed0 0x7f7a140c7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:06.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.282+0000 7f7a19e57700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a140c6c10 con 0x7f7a14153ed0 2024-05-08T21:50:06.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.282+0000 7f7a19e57700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a140c8750 con 0x7f7a140cafc0 2024-05-08T21:50:06.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.282+0000 7f7a19e57700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a140c8a30 con 0x7f7a140cb630 2024-05-08T21:50:06.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.283+0000 7f7a13fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a14153ed0 0x7f7a140c7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:06.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.283+0000 7f7a13fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a14153ed0 0x7f7a140c7e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38766/0 (socket says 172.21.15.73:38766) 2024-05-08T21:50:06.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.283+0000 7f7a13fff700 1 -- 172.21.15.73:0/3581339123 learned_addr learned my addr 172.21.15.73:0/3581339123 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:50:06.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.283+0000 7f7a137fe700 1 --2- 172.21.15.73:0/3581339123 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7a140cafc0 0x7f7a141ef880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:06.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.283+0000 7f7a12ffd700 1 --2- 172.21.15.73:0/3581339123 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7a140cb630 0x7f7a1415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:06.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.283+0000 7f7a13fff700 1 -- 172.21.15.73:0/3581339123 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7a140cb630 msgr2=0x7f7a1415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:06.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.283+0000 7f7a13fff700 1 --2- 172.21.15.73:0/3581339123 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7a140cb630 0x7f7a1415d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:06.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.283+0000 7f7a13fff700 1 -- 172.21.15.73:0/3581339123 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7a140cafc0 msgr2=0x7f7a141ef880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:06.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.283+0000 7f7a13fff700 1 --2- 172.21.15.73:0/3581339123 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7a140cafc0 0x7f7a141ef880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:06.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.283+0000 7f7a13fff700 1 -- 172.21.15.73:0/3581339123 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a0c009a70 con 0x7f7a14153ed0 2024-05-08T21:50:06.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.283+0000 7f7a13fff700 1 --2- 172.21.15.73:0/3581339123 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a14153ed0 0x7f7a140c7e50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c00ef90 tx=0x7f7a0c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:06.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.283+0000 7f79fbfff700 1 -- 172.21.15.73:0/3581339123 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0c00cc90 con 0x7f7a14153ed0 2024-05-08T21:50:06.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.283+0000 7f79fbfff700 1 -- 172.21.15.73:0/3581339123 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a0c00f040 con 0x7f7a14153ed0 2024-05-08T21:50:06.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.283+0000 7f7a19e57700 1 -- 172.21.15.73:0/3581339123 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a04009550 con 0x7f7a14153ed0 2024-05-08T21:50:06.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.283+0000 7f79fbfff700 1 -- 172.21.15.73:0/3581339123 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0c0146c0 con 0x7f7a14153ed0 2024-05-08T21:50:06.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.283+0000 7f7a19e57700 1 -- 172.21.15.73:0/3581339123 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a140c8ff0 con 0x7f7a14153ed0 2024-05-08T21:50:06.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.284+0000 7f7a19e57700 1 -- 172.21.15.73:0/3581339123 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a140c9d90 con 0x7f7a14153ed0 2024-05-08T21:50:06.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.285+0000 7f79fbfff700 1 -- 172.21.15.73:0/3581339123 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7a0c014820 con 0x7f7a14153ed0 2024-05-08T21:50:06.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.285+0000 7f79fbfff700 1 --2- 172.21.15.73:0/3581339123 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f7a0006ac90 0x7f7a0006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:06.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.285+0000 7f79fbfff700 1 -- 172.21.15.73:0/3581339123 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7a0c089f50 con 0x7f7a14153ed0 2024-05-08T21:50:06.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.285+0000 7f7a137fe700 1 --2- 172.21.15.73:0/3581339123 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f7a0006ac90 0x7f7a0006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:06.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.285+0000 7f7a137fe700 1 --2- 172.21.15.73:0/3581339123 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f7a0006ac90 0x7f7a0006d150 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7a08007fd0 tx=0x7f7a08009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:06.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.289+0000 7f79fbfff700 1 -- 172.21.15.73:0/3581339123 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f7a0c055130 con 0x7f7a14153ed0 2024-05-08T21:50:06.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.486+0000 7f7a19e57700 1 -- 172.21.15.73:0/3581339123 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7a140c6d50 con 0x7f7a14153ed0 2024-05-08T21:50:06.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.487+0000 7f79fbfff700 1 -- 172.21.15.73:0/3581339123 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16037 (secure 0 0 0) 0x7f7a140c6d50 con 0x7f7a14153ed0 2024-05-08T21:50:06.488 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:50:06.488 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":21,"fsid":"143164b7-c9c7-4737-a494-7dafa5a3320c","created":"2024-05-08T21:49:26.221909+0000","modified":"2024-05-08T21:49:44.748794+0000","last_up_change":"2024-05-08T21:49:37.118386+0000","last_in_change":"2024-05-08T21:49:28.836944+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T21:49:35.998578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T21:49:42.171760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T21:49:42.576293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6b7439c1-daaa-44af-8333-a455f9e9dc67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":47228},{"type":"v1","addr":"172.21.15.73:6809","nonce":47228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":47228},{"type":"v1","addr":"172.21.15.73:6811","nonce":47228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":47228},{"type":"v1","addr":"172.21.15.73:6815","nonce":47228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":47228},{"type":"v1","addr":"172.21.15.73:6813","nonce":47228}]},"public_addr":"172.21.15.73:6809/47228","cluster_addr":"172.21.15.73:6811/47228","heartbeat_back_addr":"172.21.15.73:6815/47228","heartbeat_front_addr":"172.21.15.73:6813/47228","state":["exists","up"]},{"osd":1,"uuid":"fb67886a-d7f7-45ac-832f-36c871c8a208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":47227},{"type":"v1","addr":"172.21.15.73:6801","nonce":47227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":47227},{"type":"v1","addr":"172.21.15.73:6803","nonce":47227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":47227},{"type":"v1","addr":"172.21.15.73:6807","nonce":47227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":47227},{"type":"v1","addr":"172.21.15.73:6805","nonce":47227}]},"public_addr":"172.21.15.73:6801/47227","cluster_addr":"172.21.15.73:6803/47227","heartbeat_back_addr":"172.21.15.73:6807/47227","heartbeat_front_addr":"172.21.15.73:6805/47227","state":["exists","up"]},{"osd":2,"uuid":"a5cd6e98-6621-473a-bfb8-5c648abbb563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":47229},{"type":"v1","addr":"172.21.15.73:6817","nonce":47229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":47229},{"type":"v1","addr":"172.21.15.73:6819","nonce":47229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":47229},{"type":"v1","addr":"172.21.15.73:6823","nonce":47229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":47229},{"type":"v1","addr":"172.21.15.73:6821","nonce":47229}]},"public_addr":"172.21.15.73:6817/47229","cluster_addr":"172.21.15.73:6819/47229","heartbeat_back_addr":"172.21.15.73:6823/47229","heartbeat_front_addr":"172.21.15.73:6821/47229","state":["exists","up"]},{"osd":3,"uuid":"36927c20-4241-4f3b-91b5-a6a6f27598e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":47232},{"type":"v1","addr":"172.21.15.73:6825","nonce":47232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":47232},{"type":"v1","addr":"172.21.15.73:6827","nonce":47232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":47232},{"type":"v1","addr":"172.21.15.73:6831","nonce":47232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":47232},{"type":"v1","addr":"172.21.15.73:6829","nonce":47232}]},"public_addr":"172.21.15.73:6825/47232","cluster_addr":"172.21.15.73:6827/47232","heartbeat_back_addr":"172.21.15.73:6831/47232","heartbeat_front_addr":"172.21.15.73:6829/47232","state":["exists","up"]},{"osd":4,"uuid":"4ebe0a18-8216-4815-878a-39c39a6cd3fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":47200},{"type":"v1","addr":"172.21.15.115:6801","nonce":47200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":47200},{"type":"v1","addr":"172.21.15.115:6803","nonce":47200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":47200},{"type":"v1","addr":"172.21.15.115:6807","nonce":47200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":47200},{"type":"v1","addr":"172.21.15.115:6805","nonce":47200}]},"public_addr":"172.21.15.115:6801/47200","cluster_addr":"172.21.15.115:6803/47200","heartbeat_back_addr":"172.21.15.115:6807/47200","heartbeat_front_addr":"172.21.15.115:6805/47200","state":["exists","up"]},{"osd":5,"uuid":"957f0ac1-5f26-4f02-8c05-488e6b67ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":47201},{"type":"v1","addr":"172.21.15.115:6809","nonce":47201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":47201},{"type":"v1","addr":"172.21.15.115:6811","nonce":47201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":47201},{"type":"v1","addr":"172.21.15.115:6815","nonce":47201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":47201},{"type":"v1","addr":"172.21.15.115:6813","nonce":47201}]},"public_addr":"172.21.15.115:6809/47201","cluster_addr":"172.21.15.115:6811/47201","heartbeat_back_addr":"172.21.15.115:6815/47201","heartbeat_front_addr":"172.21.15.115:6813/47201","state":["exists","up"]},{"osd":6,"uuid":"f5a6768f-ba7f-4f66-b335-0c303b158e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":47202},{"type":"v1","addr":"172.21.15.115:6817","nonce":47202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":47202},{"type":"v1","addr":"172.21.15.115:6819","nonce":47202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":47202},{"type":"v1","addr":"172.21.15.115:6823","nonce":47202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":47202},{"type":"v1","addr":"172.21.15.115:6821","nonce":47202}]},"public_addr":"172.21.15.115:6817/47202","cluster_addr":"172.21.15.115:6819/47202","heartbeat_back_addr":"172.21.15.115:6823/47202","heartbeat_front_addr":"172.21.15.115:6821/47202","state":["exists","up"]},{"osd":7,"uuid":"f4187743-f9e6-42e6-aca9-0604a58db1ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":47211},{"type":"v1","addr":"172.21.15.115:6825","nonce":47211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":47211},{"type":"v1","addr":"172.21.15.115:6827","nonce":47211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":47211},{"type":"v1","addr":"172.21.15.115:6831","nonce":47211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":47211},{"type":"v1","addr":"172.21.15.115:6829","nonce":47211}]},"public_addr":"172.21.15.115:6825/47211","cluster_addr":"172.21.15.115:6827/47211","heartbeat_back_addr":"172.21.15.115:6831/47211","heartbeat_front_addr":"172.21.15.115:6829/47211","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:33.996335+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:33.687451+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:34.072549+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:33.997588+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:34.047260+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:34.876272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:33.965472+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:34.038637+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T21:50:06.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.489+0000 7f7a19e57700 1 -- 172.21.15.73:0/3581339123 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f7a0006ac90 msgr2=0x7f7a0006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:06.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.489+0000 7f7a19e57700 1 --2- 172.21.15.73:0/3581339123 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f7a0006ac90 0x7f7a0006d150 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7a08007fd0 tx=0x7f7a08009040 comp rx=0 tx=0).stop 2024-05-08T21:50:06.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.489+0000 7f7a19e57700 1 -- 172.21.15.73:0/3581339123 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a14153ed0 msgr2=0x7f7a140c7e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:06.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.489+0000 7f7a19e57700 1 --2- 172.21.15.73:0/3581339123 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a14153ed0 0x7f7a140c7e50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c00ef90 tx=0x7f7a0c00c3a0 comp rx=0 tx=0).stop 2024-05-08T21:50:06.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.489+0000 7f7a19e57700 1 -- 172.21.15.73:0/3581339123 shutdown_connections 2024-05-08T21:50:06.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.489+0000 7f7a19e57700 1 --2- 172.21.15.73:0/3581339123 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f7a0006ac90 0x7f7a0006d150 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:06.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.489+0000 7f7a19e57700 1 --2- 172.21.15.73:0/3581339123 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a14153ed0 0x7f7a140c7e50 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:06.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.489+0000 7f7a19e57700 1 --2- 172.21.15.73:0/3581339123 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7a140cafc0 0x7f7a141ef880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:06.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.489+0000 7f7a19e57700 1 --2- 172.21.15.73:0/3581339123 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7a140cb630 0x7f7a1415d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:06.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.489+0000 7f7a19e57700 1 -- 172.21.15.73:0/3581339123 >> 172.21.15.73:0/3581339123 conn(0x7f7a140666c0 msgr2=0x7f7a140c4cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:50:06.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.489+0000 7f7a19e57700 1 -- 172.21.15.73:0/3581339123 shutdown_connections 2024-05-08T21:50:06.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.489+0000 7f7a19e57700 1 -- 172.21.15.73:0/3581339123 wait complete. 2024-05-08T21:50:06.502 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T21:49:35.998578+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T21:49:42.171760+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T21:49:42.576293+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T21:50:06.502 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T21:50:06.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.626+0000 7f0557e68700 1 Processor -- start 2024-05-08T21:50:06.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.626+0000 7f0557e68700 1 -- start start 2024-05-08T21:50:06.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.627+0000 7f0557e68700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f05501501e0 0x7f0550156b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:06.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.627+0000 7f0557e68700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f05500c5f60 0x7f05500c9030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:06.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.627+0000 7f0557e68700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05500c7440 con 0x7f055006a9c0 2024-05-08T21:50:06.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.627+0000 7f0557e68700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05500c6830 con 0x7f05500c5f60 2024-05-08T21:50:06.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.627+0000 7f0557e68700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05500c6b10 con 0x7f05501501e0 2024-05-08T21:50:06.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.627+0000 7f0556405700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f055006a9c0 0x7f0550159680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:39298/0 (socket says 172.21.15.73:39298) 2024-05-08T21:50:06.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.627+0000 7f0556405700 1 -- 172.21.15.73:0/1920893071 learned_addr learned my addr 172.21.15.73:0/1920893071 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:50:06.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.628+0000 7f0555c04700 1 --2- 172.21.15.73:0/1920893071 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f05501501e0 0x7f0550156b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:06.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.628+0000 7f0555403700 1 --2- 172.21.15.73:0/1920893071 >> v2:172.21.15.115:3300/0 conn(0x7f05500c5f60 0x7f05500c9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:06.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.628+0000 7f0554c02700 1 -- 172.21.15.73:0/1920893071 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3263856545 0 0) 0x7f05500c7440 con 0x7f055006a9c0 2024-05-08T21:50:06.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.628+0000 7f0554c02700 1 -- 172.21.15.73:0/1920893071 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f053c0035b0 con 0x7f055006a9c0 2024-05-08T21:50:06.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.628+0000 7f0555403700 1 -- 172.21.15.73:0/1920893071 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f05501501e0 msgr2=0x7f0550156b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:50:06.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.628+0000 7f0555403700 1 --2- 172.21.15.73:0/1920893071 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f05501501e0 0x7f0550156b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:06.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.628+0000 7f0555403700 1 -- 172.21.15.73:0/1920893071 >> v1:172.21.15.73:6789/0 conn(0x7f055006a9c0 legacy=0x7f0550159680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:06.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.628+0000 7f0555403700 1 -- 172.21.15.73:0/1920893071 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05500c6df0 con 0x7f05500c5f60 2024-05-08T21:50:06.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.628+0000 7f0555403700 1 --2- 172.21.15.73:0/1920893071 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05500c5f60 0x7f05500c9030 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f054c00a9e0 tx=0x7f054c00acf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6cd014b3eeecb06 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:06.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.628+0000 7f0554c02700 1 -- 172.21.15.73:0/1920893071 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054c00cb70 con 0x7f05500c5f60 2024-05-08T21:50:06.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.628+0000 7f0554c02700 1 -- 172.21.15.73:0/1920893071 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f054c00ccd0 con 0x7f05500c5f60 2024-05-08T21:50:06.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.628+0000 7f0554c02700 1 -- 172.21.15.73:0/1920893071 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054c018620 con 0x7f05500c5f60 2024-05-08T21:50:06.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.629+0000 7f0557e68700 1 -- 172.21.15.73:0/1920893071 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05500c5f60 msgr2=0x7f05500c9030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:06.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.629+0000 7f0557e68700 1 --2- 172.21.15.73:0/1920893071 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05500c5f60 0x7f05500c9030 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f054c00a9e0 tx=0x7f054c00acf0 comp rx=0 tx=0).stop 2024-05-08T21:50:06.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.629+0000 7f0557e68700 1 -- 172.21.15.73:0/1920893071 shutdown_connections 2024-05-08T21:50:06.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.629+0000 7f0557e68700 1 --2- 172.21.15.73:0/1920893071 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f05501501e0 0x7f0550156b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:06.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.629+0000 7f0557e68700 1 --2- 172.21.15.73:0/1920893071 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05500c5f60 0x7f05500c9030 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:06.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.629+0000 7f0557e68700 1 -- 172.21.15.73:0/1920893071 >> 172.21.15.73:0/1920893071 conn(0x7f05500cb230 msgr2=0x7f05500cb610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:50:06.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.629+0000 7f0557e68700 1 -- 172.21.15.73:0/1920893071 shutdown_connections 2024-05-08T21:50:06.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.629+0000 7f0557e68700 1 -- 172.21.15.73:0/1920893071 wait complete. 2024-05-08T21:50:06.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.630+0000 7f0557e68700 1 Processor -- start 2024-05-08T21:50:06.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.631+0000 7f0557e68700 1 -- start start 2024-05-08T21:50:06.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.631+0000 7f0557e68700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f055006a9c0 0x7f05501dfa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:06.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.631+0000 7f0557e68700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f05500c5f60 0x7f05500c3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:06.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.631+0000 7f0557e68700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05501501e0 0x7f05501eb160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:06.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.631+0000 7f0557e68700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0550149350 con 0x7f05501501e0 2024-05-08T21:50:06.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.631+0000 7f0557e68700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05501ded90 con 0x7f055006a9c0 2024-05-08T21:50:06.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.631+0000 7f0557e68700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05501dea90 con 0x7f05500c5f60 2024-05-08T21:50:06.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.632+0000 7f0556405700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05501501e0 0x7f05501eb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:06.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.632+0000 7f0556405700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05501501e0 0x7f05501eb160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38776/0 (socket says 172.21.15.73:38776) 2024-05-08T21:50:06.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.632+0000 7f0556405700 1 -- 172.21.15.73:0/2655765819 learned_addr learned my addr 172.21.15.73:0/2655765819 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:50:06.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.632+0000 7f0555c04700 1 --2- 172.21.15.73:0/2655765819 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f055006a9c0 0x7f05501dfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:06.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.632+0000 7f0555403700 1 --2- 172.21.15.73:0/2655765819 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f05500c5f60 0x7f05500c3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:06.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.632+0000 7f0556405700 1 -- 172.21.15.73:0/2655765819 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f05500c5f60 msgr2=0x7f05500c3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:06.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.632+0000 7f0556405700 1 --2- 172.21.15.73:0/2655765819 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f05500c5f60 0x7f05500c3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:06.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.632+0000 7f0556405700 1 -- 172.21.15.73:0/2655765819 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f055006a9c0 msgr2=0x7f05501dfa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:06.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.632+0000 7f0556405700 1 --2- 172.21.15.73:0/2655765819 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f055006a9c0 0x7f05501dfa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:06.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.632+0000 7f0556405700 1 -- 172.21.15.73:0/2655765819 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f054c00a640 con 0x7f05501501e0 2024-05-08T21:50:06.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.632+0000 7f0555403700 1 --2- 172.21.15.73:0/2655765819 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f05500c5f60 0x7f05500c3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:50:06.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.632+0000 7f0556405700 1 --2- 172.21.15.73:0/2655765819 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05501501e0 0x7f05501eb160 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f054800ee40 tx=0x7f054800c550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:06.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.632+0000 7f05467fc700 1 -- 172.21.15.73:0/2655765819 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0548011470 con 0x7f05501501e0 2024-05-08T21:50:06.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.632+0000 7f05467fc700 1 -- 172.21.15.73:0/2655765819 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05480115d0 con 0x7f05501501e0 2024-05-08T21:50:06.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.632+0000 7f05467fc700 1 -- 172.21.15.73:0/2655765819 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0548011960 con 0x7f05501501e0 2024-05-08T21:50:06.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.632+0000 7f0557e68700 1 -- 172.21.15.73:0/2655765819 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0550148370 con 0x7f05501501e0 2024-05-08T21:50:06.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.632+0000 7f0557e68700 1 -- 172.21.15.73:0/2655765819 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0550148650 con 0x7f05501501e0 2024-05-08T21:50:06.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.633+0000 7f0557e68700 1 -- 172.21.15.73:0/2655765819 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05501df120 con 0x7f05501501e0 2024-05-08T21:50:06.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.633+0000 7f05467fc700 1 -- 172.21.15.73:0/2655765819 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0548011ac0 con 0x7f05501501e0 2024-05-08T21:50:06.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.634+0000 7f05467fc700 1 --2- 172.21.15.73:0/2655765819 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f053406acc0 0x7f053406d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:06.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.634+0000 7f0555c04700 1 --2- 172.21.15.73:0/2655765819 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f053406acc0 0x7f053406d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:06.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.634+0000 7f05467fc700 1 -- 172.21.15.73:0/2655765819 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f054808be90 con 0x7f05501501e0 2024-05-08T21:50:06.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.634+0000 7f0555c04700 1 --2- 172.21.15.73:0/2655765819 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f053406acc0 0x7f053406d180 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0540009b40 tx=0x7f0540009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:06.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.638+0000 7f05467fc700 1 -- 172.21.15.73:0/2655765819 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f0548057100 con 0x7f05501501e0 2024-05-08T21:50:06.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.831+0000 7f0557e68700 1 -- 172.21.15.73:0/2655765819 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0550067a20 con 0x7f05501501e0 2024-05-08T21:50:06.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.832+0000 7f05467fc700 1 -- 172.21.15.73:0/2655765819 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f054805a720 con 0x7f05501501e0 2024-05-08T21:50:06.833 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-05-08T21:50:06.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.834+0000 7f0557e68700 1 -- 172.21.15.73:0/2655765819 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f053406acc0 msgr2=0x7f053406d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:06.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.834+0000 7f0557e68700 1 --2- 172.21.15.73:0/2655765819 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f053406acc0 0x7f053406d180 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0540009b40 tx=0x7f0540009210 comp rx=0 tx=0).stop 2024-05-08T21:50:06.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.834+0000 7f0557e68700 1 -- 172.21.15.73:0/2655765819 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05501501e0 msgr2=0x7f05501eb160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:06.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.834+0000 7f0557e68700 1 --2- 172.21.15.73:0/2655765819 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05501501e0 0x7f05501eb160 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f054800ee40 tx=0x7f054800c550 comp rx=0 tx=0).stop 2024-05-08T21:50:06.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.834+0000 7f0557e68700 1 -- 172.21.15.73:0/2655765819 shutdown_connections 2024-05-08T21:50:06.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.834+0000 7f0557e68700 1 --2- 172.21.15.73:0/2655765819 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f053406acc0 0x7f053406d180 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:06.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.834+0000 7f0557e68700 1 --2- 172.21.15.73:0/2655765819 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05501501e0 0x7f05501eb160 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:06.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.834+0000 7f0557e68700 1 --2- 172.21.15.73:0/2655765819 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f055006a9c0 0x7f05501dfa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:06.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.834+0000 7f0557e68700 1 --2- 172.21.15.73:0/2655765819 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f05500c5f60 0x7f05500c3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:06.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.834+0000 7f0557e68700 1 -- 172.21.15.73:0/2655765819 >> 172.21.15.73:0/2655765819 conn(0x7f05500cb230 msgr2=0x7f055014ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:50:06.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.834+0000 7f0557e68700 1 -- 172.21.15.73:0/2655765819 shutdown_connections 2024-05-08T21:50:06.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.835+0000 7f0557e68700 1 -- 172.21.15.73:0/2655765819 wait complete. 2024-05-08T21:50:06.847 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T21:50:06.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.972+0000 7fa939fd0700 1 Processor -- start 2024-05-08T21:50:06.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.972+0000 7fa939fd0700 1 -- start start 2024-05-08T21:50:06.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.972+0000 7fa939fd0700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa934150d80 0x7fa934072ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:06.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.972+0000 7fa939fd0700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa9340c6e20 0x7fa93415a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:06.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.972+0000 7fa939fd0700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa93415a3a0 con 0x7fa9340c6600 2024-05-08T21:50:06.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.972+0000 7fa939fd0700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9340722f0 con 0x7fa9340c6e20 2024-05-08T21:50:06.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.972+0000 7fa939fd0700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9340c4010 con 0x7fa934150d80 2024-05-08T21:50:06.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.972+0000 7fa933fff700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fa9340c6600 0x7fa9340c55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:39310/0 (socket says 172.21.15.73:39310) 2024-05-08T21:50:06.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.972+0000 7fa933fff700 1 -- 172.21.15.73:0/1178385018 learned_addr learned my addr 172.21.15.73:0/1178385018 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:50:06.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.973+0000 7fa92bfff700 1 --2- 172.21.15.73:0/1178385018 >> v2:172.21.15.115:3300/0 conn(0x7fa9340c6e20 0x7fa93415a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:06.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.973+0000 7fa9337fe700 1 --2- 172.21.15.73:0/1178385018 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa934150d80 0x7fa934072ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:06.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.973+0000 7fa932ffd700 1 -- 172.21.15.73:0/1178385018 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3473553761 0 0) 0x7fa93415a3a0 con 0x7fa9340c6600 2024-05-08T21:50:06.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.973+0000 7fa932ffd700 1 -- 172.21.15.73:0/1178385018 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9200035b0 con 0x7fa9340c6600 2024-05-08T21:50:06.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.973+0000 7fa92bfff700 1 -- 172.21.15.73:0/1178385018 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa934150d80 msgr2=0x7fa934072ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:50:06.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.973+0000 7fa932ffd700 1 -- 172.21.15.73:0/1178385018 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2087514172 0 0) 0x7fa9200035b0 con 0x7fa9340c6600 2024-05-08T21:50:06.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.973+0000 7fa92bfff700 1 --2- 172.21.15.73:0/1178385018 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa934150d80 0x7fa934072ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:06.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.973+0000 7fa92bfff700 1 -- 172.21.15.73:0/1178385018 >> v1:172.21.15.73:6789/0 conn(0x7fa9340c6600 legacy=0x7fa9340c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:06.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.973+0000 7fa92bfff700 1 -- 172.21.15.73:0/1178385018 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9340c3a50 con 0x7fa9340c6e20 2024-05-08T21:50:06.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.973+0000 7fa9337fe700 1 --2- 172.21.15.73:0/1178385018 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa934150d80 0x7fa934072ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:50:06.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.973+0000 7fa92bfff700 1 --2- 172.21.15.73:0/1178385018 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa9340c6e20 0x7fa93415a830 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa91c009840 tx=0x7fa91c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8dc9fca558d9ad9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:06.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.973+0000 7fa932ffd700 1 -- 172.21.15.73:0/1178385018 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa92c0019f0 con 0x7fa9340c6e20 2024-05-08T21:50:06.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.973+0000 7fa932ffd700 1 -- 172.21.15.73:0/1178385018 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa91c004030 con 0x7fa9340c6e20 2024-05-08T21:50:06.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.973+0000 7fa932ffd700 1 -- 172.21.15.73:0/1178385018 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91c0043c0 con 0x7fa9340c6e20 2024-05-08T21:50:06.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.974+0000 7fa939fd0700 1 -- 172.21.15.73:0/1178385018 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa9340c6e20 msgr2=0x7fa93415a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:06.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.974+0000 7fa939fd0700 1 --2- 172.21.15.73:0/1178385018 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa9340c6e20 0x7fa93415a830 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa91c009840 tx=0x7fa91c009b50 comp rx=0 tx=0).stop 2024-05-08T21:50:06.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.974+0000 7fa939fd0700 1 -- 172.21.15.73:0/1178385018 shutdown_connections 2024-05-08T21:50:06.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.974+0000 7fa939fd0700 1 --2- 172.21.15.73:0/1178385018 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa934150d80 0x7fa934072ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:06.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.974+0000 7fa939fd0700 1 --2- 172.21.15.73:0/1178385018 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa9340c6e20 0x7fa93415a830 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:06.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.974+0000 7fa939fd0700 1 -- 172.21.15.73:0/1178385018 >> 172.21.15.73:0/1178385018 conn(0x7fa934066ab0 msgr2=0x7fa93406f550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:50:06.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.974+0000 7fa939fd0700 1 -- 172.21.15.73:0/1178385018 shutdown_connections 2024-05-08T21:50:06.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.974+0000 7fa939fd0700 1 -- 172.21.15.73:0/1178385018 wait complete. 2024-05-08T21:50:06.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.975+0000 7fa939fd0700 1 Processor -- start 2024-05-08T21:50:06.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.975+0000 7fa939fd0700 1 -- start start 2024-05-08T21:50:06.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.976+0000 7fa939fd0700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa9340c6600 0x7fa934155870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:06.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.976+0000 7fa939fd0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9340c6e20 0x7fa934156980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:06.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.976+0000 7fa939fd0700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa934150d80 0x7fa934151500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:06.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.976+0000 7fa939fd0700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa934152090 con 0x7fa9340c6e20 2024-05-08T21:50:06.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.976+0000 7fa939fd0700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa934072cd0 con 0x7fa9340c6600 2024-05-08T21:50:06.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.976+0000 7fa939fd0700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9341522c0 con 0x7fa934150d80 2024-05-08T21:50:06.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.976+0000 7fa92bfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9340c6e20 0x7fa934156980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:06.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.976+0000 7fa92bfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9340c6e20 0x7fa934156980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38780/0 (socket says 172.21.15.73:38780) 2024-05-08T21:50:06.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.976+0000 7fa92bfff700 1 -- 172.21.15.73:0/896925374 learned_addr learned my addr 172.21.15.73:0/896925374 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:50:06.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.976+0000 7fa933fff700 1 --2- 172.21.15.73:0/896925374 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa934150d80 0x7fa934151500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:06.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.976+0000 7fa9337fe700 1 --2- 172.21.15.73:0/896925374 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa9340c6600 0x7fa934155870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:06.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.976+0000 7fa92bfff700 1 -- 172.21.15.73:0/896925374 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa934150d80 msgr2=0x7fa934151500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:06.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.976+0000 7fa92bfff700 1 --2- 172.21.15.73:0/896925374 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa934150d80 0x7fa934151500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:06.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.976+0000 7fa92bfff700 1 -- 172.21.15.73:0/896925374 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa9340c6600 msgr2=0x7fa934155870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:06.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.976+0000 7fa92bfff700 1 --2- 172.21.15.73:0/896925374 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa9340c6600 0x7fa934155870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:06.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.976+0000 7fa92bfff700 1 -- 172.21.15.73:0/896925374 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9240094a0 con 0x7fa9340c6e20 2024-05-08T21:50:06.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.976+0000 7fa92bfff700 1 --2- 172.21.15.73:0/896925374 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9340c6e20 0x7fa934156980 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa91c00a010 tx=0x7fa91c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:06.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.977+0000 7fa930ff9700 1 -- 172.21.15.73:0/896925374 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91c003cf0 con 0x7fa9340c6e20 2024-05-08T21:50:06.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.977+0000 7fa930ff9700 1 -- 172.21.15.73:0/896925374 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa91c01f070 con 0x7fa9340c6e20 2024-05-08T21:50:06.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.977+0000 7fa930ff9700 1 -- 172.21.15.73:0/896925374 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91c011870 con 0x7fa9340c6e20 2024-05-08T21:50:06.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.977+0000 7fa939fd0700 1 -- 172.21.15.73:0/896925374 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa91c0094a0 con 0x7fa9340c6e20 2024-05-08T21:50:06.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.977+0000 7fa939fd0700 1 -- 172.21.15.73:0/896925374 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9341edd20 con 0x7fa9340c6e20 2024-05-08T21:50:06.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.977+0000 7fa939fd0700 1 -- 172.21.15.73:0/896925374 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9340c7e40 con 0x7fa9340c6e20 2024-05-08T21:50:06.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.978+0000 7fa930ff9700 1 -- 172.21.15.73:0/896925374 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa91c0119d0 con 0x7fa9340c6e20 2024-05-08T21:50:06.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.978+0000 7fa930ff9700 1 --2- 172.21.15.73:0/896925374 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fa91406ac90 0x7fa91406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:06.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.978+0000 7fa930ff9700 1 -- 172.21.15.73:0/896925374 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa91c021070 con 0x7fa9340c6e20 2024-05-08T21:50:06.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.978+0000 7fa9337fe700 1 --2- 172.21.15.73:0/896925374 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fa91406ac90 0x7fa91406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:06.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.979+0000 7fa9337fe700 1 --2- 172.21.15.73:0/896925374 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fa91406ac90 0x7fa91406d150 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa924009d70 tx=0x7fa924009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:06.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:06.983+0000 7fa930ff9700 1 -- 172.21.15.73:0/896925374 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fa91c0559d0 con 0x7fa9340c6e20 2024-05-08T21:50:07.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.181+0000 7fa939fd0700 1 -- 172.21.15.73:0/896925374 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa9341edf10 con 0x7fa9340c6e20 2024-05-08T21:50:07.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.182+0000 7fa930ff9700 1 -- 172.21.15.73:0/896925374 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa91c02b020 con 0x7fa9340c6e20 2024-05-08T21:50:07.183 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-05-08T21:50:07.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.184+0000 7fa939fd0700 1 -- 172.21.15.73:0/896925374 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fa91406ac90 msgr2=0x7fa91406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:07.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.184+0000 7fa939fd0700 1 --2- 172.21.15.73:0/896925374 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fa91406ac90 0x7fa91406d150 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa924009d70 tx=0x7fa924009210 comp rx=0 tx=0).stop 2024-05-08T21:50:07.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.184+0000 7fa939fd0700 1 -- 172.21.15.73:0/896925374 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9340c6e20 msgr2=0x7fa934156980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:07.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.184+0000 7fa939fd0700 1 --2- 172.21.15.73:0/896925374 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9340c6e20 0x7fa934156980 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa91c00a010 tx=0x7fa91c004750 comp rx=0 tx=0).stop 2024-05-08T21:50:07.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.184+0000 7fa939fd0700 1 -- 172.21.15.73:0/896925374 shutdown_connections 2024-05-08T21:50:07.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.184+0000 7fa939fd0700 1 --2- 172.21.15.73:0/896925374 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fa91406ac90 0x7fa91406d150 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:07.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.184+0000 7fa939fd0700 1 --2- 172.21.15.73:0/896925374 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa934150d80 0x7fa934151500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:07.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.184+0000 7fa939fd0700 1 --2- 172.21.15.73:0/896925374 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa9340c6600 0x7fa934155870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:07.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.184+0000 7fa939fd0700 1 --2- 172.21.15.73:0/896925374 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9340c6e20 0x7fa934156980 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:07.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.184+0000 7fa939fd0700 1 -- 172.21.15.73:0/896925374 >> 172.21.15.73:0/896925374 conn(0x7fa934066ab0 msgr2=0x7fa9341458a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:50:07.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.184+0000 7fa939fd0700 1 -- 172.21.15.73:0/896925374 shutdown_connections 2024-05-08T21:50:07.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.184+0000 7fa939fd0700 1 -- 172.21.15.73:0/896925374 wait complete. 2024-05-08T21:50:07.197 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T21:50:07.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.320+0000 7f69b1e38700 1 Processor -- start 2024-05-08T21:50:07.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.320+0000 7f69b1e38700 1 -- start start 2024-05-08T21:50:07.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.321+0000 7f69b1e38700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f69ac150d80 0x7f69ac072ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:07.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.321+0000 7f69b1e38700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69ac15a3a0 con 0x7f69ac0c6e20 2024-05-08T21:50:07.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.321+0000 7f69b1e38700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69ac0c3a50 con 0x7f69ac0c6600 2024-05-08T21:50:07.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.321+0000 7f69b1e38700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69ac0722f0 con 0x7f69ac150d80 2024-05-08T21:50:07.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.321+0000 7f69aaffd700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f69ac0c6e20 0x7f69ac15a830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:39316/0 (socket says 172.21.15.73:39316) 2024-05-08T21:50:07.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.321+0000 7f69aaffd700 1 -- 172.21.15.73:0/768011378 learned_addr learned my addr 172.21.15.73:0/768011378 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:50:07.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.321+0000 7f69ab7fe700 1 --2- 172.21.15.73:0/768011378 >> v2:172.21.15.115:3300/0 conn(0x7f69ac150d80 0x7f69ac072ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:07.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.322+0000 7f69aa7fc700 1 -- 172.21.15.73:0/768011378 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4214082290 0 0) 0x7f69ac15a3a0 con 0x7f69ac0c6e20 2024-05-08T21:50:07.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.322+0000 7f69aa7fc700 1 -- 172.21.15.73:0/768011378 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69940035b0 con 0x7f69ac0c6e20 2024-05-08T21:50:07.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.322+0000 7f69aa7fc700 1 -- 172.21.15.73:0/768011378 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3440049307 0 0) 0x7f69940035b0 con 0x7f69ac0c6e20 2024-05-08T21:50:07.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.322+0000 7f69aa7fc700 1 -- 172.21.15.73:0/768011378 >> v2:172.21.15.115:3300/0 conn(0x7f69ac150d80 msgr2=0x7f69ac072ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:50:07.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.322+0000 7f69aa7fc700 1 --2- 172.21.15.73:0/768011378 >> v2:172.21.15.115:3300/0 conn(0x7f69ac150d80 0x7f69ac072ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:07.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.322+0000 7f69aa7fc700 1 -- 172.21.15.73:0/768011378 >> v1:172.21.15.115:6789/0 conn(0x7f69ac0c6600 legacy=0x7f69ac0c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:07.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.322+0000 7f69aa7fc700 1 -- 172.21.15.73:0/768011378 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69ac0c3d30 con 0x7f69ac0c6e20 2024-05-08T21:50:07.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.322+0000 7f69aa7fc700 1 -- 172.21.15.73:0/768011378 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 953298616 0 0) 0x7f699c001670 con 0x7f69ac0c6e20 2024-05-08T21:50:07.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.322+0000 7f69aa7fc700 1 -- 172.21.15.73:0/768011378 >> v1:172.21.15.73:6789/0 conn(0x7f69ac0c6e20 legacy=0x7f69ac15a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:07.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.322+0000 7f69aa7fc700 1 --2- 172.21.15.73:0/768011378 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6994003a00 0x7f6994003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:07.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.322+0000 7f69aa7fc700 1 --2- 172.21.15.73:0/768011378 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6994004850 0x7f6994004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:07.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.322+0000 7f69aa7fc700 1 --2- 172.21.15.73:0/768011378 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6994005210 0x7f699400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:07.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.322+0000 7f69aa7fc700 1 -- 172.21.15.73:0/768011378 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69ac0722f0 con 0x7f6994004850 2024-05-08T21:50:07.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.322+0000 7f69aa7fc700 1 -- 172.21.15.73:0/768011378 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f699400c1b0 con 0x7f6994005210 2024-05-08T21:50:07.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.322+0000 7f69aa7fc700 1 -- 172.21.15.73:0/768011378 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f699400c370 con 0x7f6994003a00 2024-05-08T21:50:07.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.322+0000 7f69aaffd700 1 --2- 172.21.15.73:0/768011378 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6994004850 0x7f6994004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:07.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.322+0000 7f69ab7fe700 1 --2- 172.21.15.73:0/768011378 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6994003a00 0x7f6994003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:07.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.322+0000 7f69abfff700 1 --2- 172.21.15.73:0/768011378 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6994005210 0x7f699400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:07.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.322+0000 7f69aaffd700 1 -- 172.21.15.73:0/768011378 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6994003a00 msgr2=0x7f6994003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:50:07.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.322+0000 7f69aaffd700 1 --2- 172.21.15.73:0/768011378 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6994003a00 0x7f6994003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:07.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.322+0000 7f69aaffd700 1 -- 172.21.15.73:0/768011378 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6994005210 msgr2=0x7f699400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:50:07.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.322+0000 7f69aaffd700 1 --2- 172.21.15.73:0/768011378 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6994005210 0x7f699400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:07.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.322+0000 7f69aaffd700 1 -- 172.21.15.73:0/768011378 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69940035b0 con 0x7f6994004850 2024-05-08T21:50:07.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.322+0000 7f69abfff700 1 --2- 172.21.15.73:0/768011378 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6994005210 0x7f699400ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:50:07.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.322+0000 7f69abfff700 1 -- 172.21.15.73:0/768011378 reap_dead start 2024-05-08T21:50:07.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.322+0000 7f69aaffd700 1 --2- 172.21.15.73:0/768011378 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6994004850 0x7f6994004cd0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f699c00c270 tx=0x7f6994005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48c0f558c554864e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:07.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.323+0000 7f69aa7fc700 1 -- 172.21.15.73:0/768011378 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f699c007c10 con 0x7f6994004850 2024-05-08T21:50:07.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.323+0000 7f69aa7fc700 1 -- 172.21.15.73:0/768011378 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f699c00cdb0 con 0x7f6994004850 2024-05-08T21:50:07.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.323+0000 7f69aa7fc700 1 -- 172.21.15.73:0/768011378 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f699c005ba0 con 0x7f6994004850 2024-05-08T21:50:07.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.323+0000 7f69b1e38700 1 -- 172.21.15.73:0/768011378 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6994004850 msgr2=0x7f6994004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:07.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.323+0000 7f69b1e38700 1 --2- 172.21.15.73:0/768011378 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6994004850 0x7f6994004cd0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f699c00c270 tx=0x7f6994005880 comp rx=0 tx=0).stop 2024-05-08T21:50:07.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.323+0000 7f69b1e38700 1 -- 172.21.15.73:0/768011378 shutdown_connections 2024-05-08T21:50:07.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.323+0000 7f69b1e38700 1 --2- 172.21.15.73:0/768011378 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6994004850 0x7f6994004cd0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:07.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.323+0000 7f69b1e38700 1 -- 172.21.15.73:0/768011378 >> 172.21.15.73:0/768011378 conn(0x7f69ac066ab0 msgr2=0x7f69ac06f550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:50:07.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.323+0000 7f69b1e38700 1 -- 172.21.15.73:0/768011378 shutdown_connections 2024-05-08T21:50:07.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.323+0000 7f69b1e38700 1 -- 172.21.15.73:0/768011378 wait complete. 2024-05-08T21:50:07.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.324+0000 7f69b1e38700 1 Processor -- start 2024-05-08T21:50:07.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.325+0000 7f69b1e38700 1 -- start start 2024-05-08T21:50:07.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.325+0000 7f69b1e38700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6994004850 0x7f69ac153a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:07.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.325+0000 7f69b1e38700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69ac151290 0x7f69ac0c8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:07.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.325+0000 7f69b1e38700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f69ac159220 0x7f69ac1596a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:07.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.325+0000 7f69b1e38700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69ac0c4010 con 0x7f69ac151290 2024-05-08T21:50:07.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.325+0000 7f69b1e38700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69ac158e00 con 0x7f6994004850 2024-05-08T21:50:07.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.325+0000 7f69b1e38700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69ac151b00 con 0x7f69ac159220 2024-05-08T21:50:07.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.325+0000 7f69aaffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69ac151290 0x7f69ac0c8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:07.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.325+0000 7f69aaffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69ac151290 0x7f69ac0c8480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38796/0 (socket says 172.21.15.73:38796) 2024-05-08T21:50:07.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.325+0000 7f69aaffd700 1 -- 172.21.15.73:0/4225251670 learned_addr learned my addr 172.21.15.73:0/4225251670 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:50:07.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.326+0000 7f69abfff700 1 --2- 172.21.15.73:0/4225251670 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f69ac159220 0x7f69ac1596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:07.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.326+0000 7f69ab7fe700 1 --2- 172.21.15.73:0/4225251670 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6994004850 0x7f69ac153a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:07.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.326+0000 7f69aaffd700 1 -- 172.21.15.73:0/4225251670 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f69ac159220 msgr2=0x7f69ac1596a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:07.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.326+0000 7f69aaffd700 1 --2- 172.21.15.73:0/4225251670 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f69ac159220 0x7f69ac1596a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:07.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.326+0000 7f69aaffd700 1 -- 172.21.15.73:0/4225251670 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6994004850 msgr2=0x7f69ac153a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:07.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.326+0000 7f69aaffd700 1 --2- 172.21.15.73:0/4225251670 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6994004850 0x7f69ac153a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:07.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.326+0000 7f69aaffd700 1 -- 172.21.15.73:0/4225251670 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69ac1541e0 con 0x7f69ac151290 2024-05-08T21:50:07.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.326+0000 7f69ab7fe700 1 --2- 172.21.15.73:0/4225251670 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6994004850 0x7f69ac153a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:50:07.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.326+0000 7f69aaffd700 1 --2- 172.21.15.73:0/4225251670 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69ac151290 0x7f69ac0c8480 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f699400c180 tx=0x7f69ac0c33b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:07.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.326+0000 7f6993fff700 1 -- 172.21.15.73:0/4225251670 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f699c001670 con 0x7f69ac151290 2024-05-08T21:50:07.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.326+0000 7f6993fff700 1 -- 172.21.15.73:0/4225251670 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f699c0070d0 con 0x7f69ac151290 2024-05-08T21:50:07.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.326+0000 7f69b1e38700 1 -- 172.21.15.73:0/4225251670 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69ac153f70 con 0x7f69ac151290 2024-05-08T21:50:07.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.326+0000 7f6993fff700 1 -- 172.21.15.73:0/4225251670 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f699c007480 con 0x7f69ac151290 2024-05-08T21:50:07.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.326+0000 7f69b1e38700 1 -- 172.21.15.73:0/4225251670 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69ac158180 con 0x7f69ac151290 2024-05-08T21:50:07.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.327+0000 7f69b1e38700 1 -- 172.21.15.73:0/4225251670 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69ac158f40 con 0x7f69ac151290 2024-05-08T21:50:07.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.327+0000 7f6993fff700 1 -- 172.21.15.73:0/4225251670 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f699c0075e0 con 0x7f69ac151290 2024-05-08T21:50:07.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.328+0000 7f6993fff700 1 --2- 172.21.15.73:0/4225251670 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f699806acc0 0x7f699806d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:07.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.328+0000 7f6993fff700 1 -- 172.21.15.73:0/4225251670 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f699c08a670 con 0x7f69ac151290 2024-05-08T21:50:07.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.328+0000 7f69ab7fe700 1 --2- 172.21.15.73:0/4225251670 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f699806acc0 0x7f699806d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:07.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.328+0000 7f69ab7fe700 1 --2- 172.21.15.73:0/4225251670 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f699806acc0 0x7f699806d180 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f69a0009bd0 tx=0x7f69a0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:07.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.332+0000 7f6993fff700 1 -- 172.21.15.73:0/4225251670 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f69ac158f40 con 0x7f69ac151290 2024-05-08T21:50:07.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.526+0000 7f69b1e38700 1 -- 172.21.15.73:0/4225251670 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f69ac158f40 con 0x7f69ac151290 2024-05-08T21:50:07.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.527+0000 7f6993fff700 1 -- 172.21.15.73:0/4225251670 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f69ac158f40 con 0x7f69ac151290 2024-05-08T21:50:07.528 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-05-08T21:50:07.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.529+0000 7f69b1e38700 1 -- 172.21.15.73:0/4225251670 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f699806acc0 msgr2=0x7f699806d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:07.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.529+0000 7f69b1e38700 1 --2- 172.21.15.73:0/4225251670 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f699806acc0 0x7f699806d180 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f69a0009bd0 tx=0x7f69a0008040 comp rx=0 tx=0).stop 2024-05-08T21:50:07.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.529+0000 7f69b1e38700 1 -- 172.21.15.73:0/4225251670 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69ac151290 msgr2=0x7f69ac0c8480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:07.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.529+0000 7f69b1e38700 1 --2- 172.21.15.73:0/4225251670 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69ac151290 0x7f69ac0c8480 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f699400c180 tx=0x7f69ac0c33b0 comp rx=0 tx=0).stop 2024-05-08T21:50:07.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.529+0000 7f69b1e38700 1 -- 172.21.15.73:0/4225251670 shutdown_connections 2024-05-08T21:50:07.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.529+0000 7f69b1e38700 1 --2- 172.21.15.73:0/4225251670 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f699806acc0 0x7f699806d180 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:07.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.529+0000 7f69b1e38700 1 --2- 172.21.15.73:0/4225251670 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f69ac159220 0x7f69ac1596a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:07.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.529+0000 7f69b1e38700 1 --2- 172.21.15.73:0/4225251670 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6994004850 0x7f69ac153a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:07.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.529+0000 7f69b1e38700 1 --2- 172.21.15.73:0/4225251670 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69ac151290 0x7f69ac0c8480 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:07.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.529+0000 7f69b1e38700 1 -- 172.21.15.73:0/4225251670 >> 172.21.15.73:0/4225251670 conn(0x7f69ac066ab0 msgr2=0x7f69ac0c9700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:50:07.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.529+0000 7f69b1e38700 1 -- 172.21.15.73:0/4225251670 shutdown_connections 2024-05-08T21:50:07.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.529+0000 7f69b1e38700 1 -- 172.21.15.73:0/4225251670 wait complete. 2024-05-08T21:50:07.542 INFO:tasks.mds_thrash:mds thrasher using random seed: 1715205007 2024-05-08T21:50:07.542 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T21:50:07.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.661+0000 7f35c3809700 1 Processor -- start 2024-05-08T21:50:07.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.661+0000 7f35c3809700 1 -- start start 2024-05-08T21:50:07.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.662+0000 7f35c3809700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f35bc150df0 0x7f35bc0c6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:07.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.662+0000 7f35c3809700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f35bc0c7a90 0x7f35bc0c5b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:07.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.662+0000 7f35c3809700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35bc0c4020 con 0x7f35bc0c7fe0 2024-05-08T21:50:07.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.662+0000 7f35c3809700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35bc0c5770 con 0x7f35bc0c7a90 2024-05-08T21:50:07.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.662+0000 7f35c3809700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35bc1511d0 con 0x7f35bc150df0 2024-05-08T21:50:07.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.662+0000 7f35c1da6700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f35bc0c7a90 0x7f35bc0c5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:07.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.662+0000 7f35c0da4700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f35bc0c7fe0 0x7f35bc0c8e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:39326/0 (socket says 172.21.15.73:39326) 2024-05-08T21:50:07.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.662+0000 7f35c0da4700 1 -- 172.21.15.73:0/4156973542 learned_addr learned my addr 172.21.15.73:0/4156973542 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:50:07.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.662+0000 7f35c15a5700 1 --2- 172.21.15.73:0/4156973542 >> v2:172.21.15.115:3300/0 conn(0x7f35bc150df0 0x7f35bc0c6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:07.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.662+0000 7f35c1da6700 1 -- 172.21.15.73:0/4156973542 >> v2:172.21.15.115:3300/0 conn(0x7f35bc150df0 msgr2=0x7f35bc0c6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:50:07.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.662+0000 7f35c1da6700 1 --2- 172.21.15.73:0/4156973542 >> v2:172.21.15.115:3300/0 conn(0x7f35bc150df0 0x7f35bc0c6e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:07.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.662+0000 7f35c1da6700 1 -- 172.21.15.73:0/4156973542 >> v1:172.21.15.73:6789/0 conn(0x7f35bc0c7fe0 legacy=0x7f35bc0c8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:07.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.662+0000 7f35c1da6700 1 -- 172.21.15.73:0/4156973542 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35bc0c3d40 con 0x7f35bc0c7a90 2024-05-08T21:50:07.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.662+0000 7f35b3fff700 1 -- 172.21.15.73:0/4156973542 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2582364936 0 0) 0x7f35bc0c4020 con 0x7f35bc0c7fe0 2024-05-08T21:50:07.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.662+0000 7f35c1da6700 1 --2- 172.21.15.73:0/4156973542 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35bc0c7a90 0x7f35bc0c5b90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f35bc072b40 tx=0x7f35b400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ba964ea2d9b8950 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:07.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.662+0000 7f35b3fff700 1 -- 172.21.15.73:0/4156973542 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b400e070 con 0x7f35bc0c7a90 2024-05-08T21:50:07.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.662+0000 7f35b3fff700 1 -- 172.21.15.73:0/4156973542 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b400bbd0 con 0x7f35bc0c7a90 2024-05-08T21:50:07.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.662+0000 7f35b3fff700 1 -- 172.21.15.73:0/4156973542 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b4012430 con 0x7f35bc0c7a90 2024-05-08T21:50:07.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.663+0000 7f35c3809700 1 -- 172.21.15.73:0/4156973542 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35bc0c7a90 msgr2=0x7f35bc0c5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:07.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.663+0000 7f35c3809700 1 --2- 172.21.15.73:0/4156973542 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35bc0c7a90 0x7f35bc0c5b90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f35bc072b40 tx=0x7f35b400b330 comp rx=0 tx=0).stop 2024-05-08T21:50:07.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.663+0000 7f35c3809700 1 -- 172.21.15.73:0/4156973542 shutdown_connections 2024-05-08T21:50:07.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.663+0000 7f35c3809700 1 --2- 172.21.15.73:0/4156973542 >> v2:172.21.15.115:3300/0 conn(0x7f35bc150df0 0x7f35bc0c6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:07.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.663+0000 7f35c3809700 1 --2- 172.21.15.73:0/4156973542 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35bc0c7a90 0x7f35bc0c5b90 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:07.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.663+0000 7f35c3809700 1 -- 172.21.15.73:0/4156973542 >> 172.21.15.73:0/4156973542 conn(0x7f35bc0cc420 msgr2=0x7f35bc0cc800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:50:07.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.663+0000 7f35c3809700 1 -- 172.21.15.73:0/4156973542 shutdown_connections 2024-05-08T21:50:07.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.663+0000 7f35c3809700 1 -- 172.21.15.73:0/4156973542 wait complete. 2024-05-08T21:50:07.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.664+0000 7f35c3809700 1 Processor -- start 2024-05-08T21:50:07.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.665+0000 7f35c3809700 1 -- start start 2024-05-08T21:50:07.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.665+0000 7f35c3809700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f35bc0c7a90 0x7f35bc156d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:07.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.665+0000 7f35c3809700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35bc0c7fe0 0x7f35bc152450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:07.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.665+0000 7f35c3809700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35bc150df0 0x7f35bc13fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:07.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.665+0000 7f35c3809700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35bc154490 con 0x7f35bc0c7fe0 2024-05-08T21:50:07.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.665+0000 7f35c3809700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35bc158e70 con 0x7f35bc150df0 2024-05-08T21:50:07.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.665+0000 7f35c3809700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35bc159300 con 0x7f35bc0c7a90 2024-05-08T21:50:07.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.666+0000 7f35c0da4700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35bc0c7fe0 0x7f35bc152450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:07.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.666+0000 7f35c0da4700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35bc0c7fe0 0x7f35bc152450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38812/0 (socket says 172.21.15.73:38812) 2024-05-08T21:50:07.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.666+0000 7f35c0da4700 1 -- 172.21.15.73:0/627757847 learned_addr learned my addr 172.21.15.73:0/627757847 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:50:07.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.666+0000 7f35c15a5700 1 --2- 172.21.15.73:0/627757847 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f35bc0c7a90 0x7f35bc156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:07.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.666+0000 7f35c0da4700 1 -- 172.21.15.73:0/627757847 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f35bc0c7a90 msgr2=0x7f35bc156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:07.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.666+0000 7f35c0da4700 1 --2- 172.21.15.73:0/627757847 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f35bc0c7a90 0x7f35bc156d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:07.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.666+0000 7f35c0da4700 1 -- 172.21.15.73:0/627757847 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35bc150df0 msgr2=0x7f35bc13fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:07.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.666+0000 7f35c1da6700 1 --2- 172.21.15.73:0/627757847 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35bc150df0 0x7f35bc13fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:07.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.666+0000 7f35c0da4700 1 --2- 172.21.15.73:0/627757847 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35bc150df0 0x7f35bc13fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:07.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.666+0000 7f35c0da4700 1 -- 172.21.15.73:0/627757847 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b4009a70 con 0x7f35bc0c7fe0 2024-05-08T21:50:07.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.666+0000 7f35c0da4700 1 --2- 172.21.15.73:0/627757847 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35bc0c7fe0 0x7f35bc152450 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f35ac00c580 tx=0x7f35ac00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:07.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.666+0000 7f35b1ffb700 1 -- 172.21.15.73:0/627757847 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ac004c80 con 0x7f35bc0c7fe0 2024-05-08T21:50:07.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.666+0000 7f35b1ffb700 1 -- 172.21.15.73:0/627757847 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35ac004e00 con 0x7f35bc0c7fe0 2024-05-08T21:50:07.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.666+0000 7f35c3809700 1 -- 172.21.15.73:0/627757847 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35bc153ed0 con 0x7f35bc0c7fe0 2024-05-08T21:50:07.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.666+0000 7f35b1ffb700 1 -- 172.21.15.73:0/627757847 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ac007310 con 0x7f35bc0c7fe0 2024-05-08T21:50:07.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.666+0000 7f35c3809700 1 -- 172.21.15.73:0/627757847 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35bc158820 con 0x7f35bc0c7fe0 2024-05-08T21:50:07.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.667+0000 7f35c3809700 1 -- 172.21.15.73:0/627757847 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35bc068b80 con 0x7f35bc0c7fe0 2024-05-08T21:50:07.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.667+0000 7f35b1ffb700 1 -- 172.21.15.73:0/627757847 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f35ac007470 con 0x7f35bc0c7fe0 2024-05-08T21:50:07.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.668+0000 7f35b1ffb700 1 --2- 172.21.15.73:0/627757847 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f35a006ac90 0x7f35a006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:07.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.668+0000 7f35b1ffb700 1 -- 172.21.15.73:0/627757847 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f35ac089080 con 0x7f35bc0c7fe0 2024-05-08T21:50:07.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.668+0000 7f35c15a5700 1 --2- 172.21.15.73:0/627757847 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f35a006ac90 0x7f35a006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:07.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.668+0000 7f35c15a5700 1 --2- 172.21.15.73:0/627757847 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f35a006ac90 0x7f35a006d150 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f35b800b840 tx=0x7f35b8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:07.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.672+0000 7f35b1ffb700 1 -- 172.21.15.73:0/627757847 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f35ac054260 con 0x7f35bc0c7fe0 2024-05-08T21:50:07.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.870+0000 7f35c3809700 1 -- 172.21.15.73:0/627757847 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f35bc158fb0 con 0x7f35bc0c7fe0 2024-05-08T21:50:07.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.871+0000 7f35b1ffb700 1 -- 172.21.15.73:0/627757847 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16037 (secure 0 0 0) 0x7f35ac057880 con 0x7f35bc0c7fe0 2024-05-08T21:50:07.872 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:50:07.873 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":21,"fsid":"143164b7-c9c7-4737-a494-7dafa5a3320c","created":"2024-05-08T21:49:26.221909+0000","modified":"2024-05-08T21:49:44.748794+0000","last_up_change":"2024-05-08T21:49:37.118386+0000","last_in_change":"2024-05-08T21:49:28.836944+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T21:49:35.998578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T21:49:42.171760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T21:49:42.576293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6b7439c1-daaa-44af-8333-a455f9e9dc67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":47228},{"type":"v1","addr":"172.21.15.73:6809","nonce":47228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":47228},{"type":"v1","addr":"172.21.15.73:6811","nonce":47228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":47228},{"type":"v1","addr":"172.21.15.73:6815","nonce":47228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":47228},{"type":"v1","addr":"172.21.15.73:6813","nonce":47228}]},"public_addr":"172.21.15.73:6809/47228","cluster_addr":"172.21.15.73:6811/47228","heartbeat_back_addr":"172.21.15.73:6815/47228","heartbeat_front_addr":"172.21.15.73:6813/47228","state":["exists","up"]},{"osd":1,"uuid":"fb67886a-d7f7-45ac-832f-36c871c8a208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":47227},{"type":"v1","addr":"172.21.15.73:6801","nonce":47227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":47227},{"type":"v1","addr":"172.21.15.73:6803","nonce":47227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":47227},{"type":"v1","addr":"172.21.15.73:6807","nonce":47227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":47227},{"type":"v1","addr":"172.21.15.73:6805","nonce":47227}]},"public_addr":"172.21.15.73:6801/47227","cluster_addr":"172.21.15.73:6803/47227","heartbeat_back_addr":"172.21.15.73:6807/47227","heartbeat_front_addr":"172.21.15.73:6805/47227","state":["exists","up"]},{"osd":2,"uuid":"a5cd6e98-6621-473a-bfb8-5c648abbb563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":47229},{"type":"v1","addr":"172.21.15.73:6817","nonce":47229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":47229},{"type":"v1","addr":"172.21.15.73:6819","nonce":47229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":47229},{"type":"v1","addr":"172.21.15.73:6823","nonce":47229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":47229},{"type":"v1","addr":"172.21.15.73:6821","nonce":47229}]},"public_addr":"172.21.15.73:6817/47229","cluster_addr":"172.21.15.73:6819/47229","heartbeat_back_addr":"172.21.15.73:6823/47229","heartbeat_front_addr":"172.21.15.73:6821/47229","state":["exists","up"]},{"osd":3,"uuid":"36927c20-4241-4f3b-91b5-a6a6f27598e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":47232},{"type":"v1","addr":"172.21.15.73:6825","nonce":47232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":47232},{"type":"v1","addr":"172.21.15.73:6827","nonce":47232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":47232},{"type":"v1","addr":"172.21.15.73:6831","nonce":47232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":47232},{"type":"v1","addr":"172.21.15.73:6829","nonce":47232}]},"public_addr":"172.21.15.73:6825/47232","cluster_addr":"172.21.15.73:6827/47232","heartbeat_back_addr":"172.21.15.73:6831/47232","heartbeat_front_addr":"172.21.15.73:6829/47232","state":["exists","up"]},{"osd":4,"uuid":"4ebe0a18-8216-4815-878a-39c39a6cd3fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":47200},{"type":"v1","addr":"172.21.15.115:6801","nonce":47200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":47200},{"type":"v1","addr":"172.21.15.115:6803","nonce":47200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":47200},{"type":"v1","addr":"172.21.15.115:6807","nonce":47200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":47200},{"type":"v1","addr":"172.21.15.115:6805","nonce":47200}]},"public_addr":"172.21.15.115:6801/47200","cluster_addr":"172.21.15.115:6803/47200","heartbeat_back_addr":"172.21.15.115:6807/47200","heartbeat_front_addr":"172.21.15.115:6805/47200","state":["exists","up"]},{"osd":5,"uuid":"957f0ac1-5f26-4f02-8c05-488e6b67ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":47201},{"type":"v1","addr":"172.21.15.115:6809","nonce":47201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":47201},{"type":"v1","addr":"172.21.15.115:6811","nonce":47201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":47201},{"type":"v1","addr":"172.21.15.115:6815","nonce":47201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":47201},{"type":"v1","addr":"172.21.15.115:6813","nonce":47201}]},"public_addr":"172.21.15.115:6809/47201","cluster_addr":"172.21.15.115:6811/47201","heartbeat_back_addr":"172.21.15.115:6815/47201","heartbeat_front_addr":"172.21.15.115:6813/47201","state":["exists","up"]},{"osd":6,"uuid":"f5a6768f-ba7f-4f66-b335-0c303b158e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":47202},{"type":"v1","addr":"172.21.15.115:6817","nonce":47202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":47202},{"type":"v1","addr":"172.21.15.115:6819","nonce":47202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":47202},{"type":"v1","addr":"172.21.15.115:6823","nonce":47202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":47202},{"type":"v1","addr":"172.21.15.115:6821","nonce":47202}]},"public_addr":"172.21.15.115:6817/47202","cluster_addr":"172.21.15.115:6819/47202","heartbeat_back_addr":"172.21.15.115:6823/47202","heartbeat_front_addr":"172.21.15.115:6821/47202","state":["exists","up"]},{"osd":7,"uuid":"f4187743-f9e6-42e6-aca9-0604a58db1ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":47211},{"type":"v1","addr":"172.21.15.115:6825","nonce":47211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":47211},{"type":"v1","addr":"172.21.15.115:6827","nonce":47211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":47211},{"type":"v1","addr":"172.21.15.115:6831","nonce":47211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":47211},{"type":"v1","addr":"172.21.15.115:6829","nonce":47211}]},"public_addr":"172.21.15.115:6825/47211","cluster_addr":"172.21.15.115:6827/47211","heartbeat_back_addr":"172.21.15.115:6831/47211","heartbeat_front_addr":"172.21.15.115:6829/47211","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:33.996335+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:33.687451+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:34.072549+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:33.997588+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:34.047260+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:34.876272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:33.965472+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:34.038637+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T21:50:07.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.873+0000 7f35c3809700 1 -- 172.21.15.73:0/627757847 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f35a006ac90 msgr2=0x7f35a006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:07.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.873+0000 7f35c3809700 1 --2- 172.21.15.73:0/627757847 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f35a006ac90 0x7f35a006d150 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f35b800b840 tx=0x7f35b8008040 comp rx=0 tx=0).stop 2024-05-08T21:50:07.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.874+0000 7f35c3809700 1 -- 172.21.15.73:0/627757847 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35bc0c7fe0 msgr2=0x7f35bc152450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:07.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.874+0000 7f35c3809700 1 --2- 172.21.15.73:0/627757847 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35bc0c7fe0 0x7f35bc152450 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f35ac00c580 tx=0x7f35ac00c940 comp rx=0 tx=0).stop 2024-05-08T21:50:07.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.874+0000 7f35c3809700 1 -- 172.21.15.73:0/627757847 shutdown_connections 2024-05-08T21:50:07.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.874+0000 7f35c3809700 1 --2- 172.21.15.73:0/627757847 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f35a006ac90 0x7f35a006d150 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:07.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.874+0000 7f35c3809700 1 --2- 172.21.15.73:0/627757847 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35bc150df0 0x7f35bc13fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:07.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.874+0000 7f35c3809700 1 --2- 172.21.15.73:0/627757847 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f35bc0c7a90 0x7f35bc156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:07.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.874+0000 7f35c3809700 1 --2- 172.21.15.73:0/627757847 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35bc0c7fe0 0x7f35bc152450 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:07.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.874+0000 7f35c3809700 1 -- 172.21.15.73:0/627757847 >> 172.21.15.73:0/627757847 conn(0x7f35bc0cc420 msgr2=0x7f35bc0cc800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:50:07.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.874+0000 7f35c3809700 1 -- 172.21.15.73:0/627757847 shutdown_connections 2024-05-08T21:50:07.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:07.874+0000 7f35c3809700 1 -- 172.21.15.73:0/627757847 wait complete. 2024-05-08T21:50:07.887 INFO:tasks.mds_thrash.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T21:49:35.998578+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T21:49:42.171760+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T21:49:42.576293+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T21:50:07.887 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T21:50:08.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.010+0000 7eff542ba700 1 Processor -- start 2024-05-08T21:50:08.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.010+0000 7eff542ba700 1 -- start start 2024-05-08T21:50:08.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.011+0000 7eff542ba700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff4c0c65d0 0x7eff4c0cc390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:08.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.011+0000 7eff542ba700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7eff4c071db0 0x7eff4c0cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:08.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.011+0000 7eff542ba700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff4c156d60 con 0x7eff4c150b40 2024-05-08T21:50:08.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.011+0000 7eff542ba700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff4c0722f0 con 0x7eff4c071db0 2024-05-08T21:50:08.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.011+0000 7eff542ba700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff4c0c39c0 con 0x7eff4c0c65d0 2024-05-08T21:50:08.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.011+0000 7eff52056700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7eff4c150b40 0x7eff4c1571f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:39332/0 (socket says 172.21.15.73:39332) 2024-05-08T21:50:08.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.011+0000 7eff52056700 1 -- 172.21.15.73:0/3844794943 learned_addr learned my addr 172.21.15.73:0/3844794943 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:50:08.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.011+0000 7eff52857700 1 --2- 172.21.15.73:0/3844794943 >> v2:172.21.15.115:3300/0 conn(0x7eff4c071db0 0x7eff4c0cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:08.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.011+0000 7eff51855700 1 --2- 172.21.15.73:0/3844794943 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff4c0c65d0 0x7eff4c0cc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:08.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.011+0000 7eff51054700 1 -- 172.21.15.73:0/3844794943 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3446156687 0 0) 0x7eff4c156d60 con 0x7eff4c150b40 2024-05-08T21:50:08.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.011+0000 7eff51054700 1 -- 172.21.15.73:0/3844794943 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff380035b0 con 0x7eff4c150b40 2024-05-08T21:50:08.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.012+0000 7eff51054700 1 -- 172.21.15.73:0/3844794943 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1035567004 0 0) 0x7eff380035b0 con 0x7eff4c150b40 2024-05-08T21:50:08.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.012+0000 7eff52857700 1 -- 172.21.15.73:0/3844794943 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff4c0c65d0 msgr2=0x7eff4c0cc390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:50:08.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.012+0000 7eff52857700 1 --2- 172.21.15.73:0/3844794943 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff4c0c65d0 0x7eff4c0cc390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:08.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.012+0000 7eff52857700 1 -- 172.21.15.73:0/3844794943 >> v1:172.21.15.73:6789/0 conn(0x7eff4c150b40 legacy=0x7eff4c1571f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:08.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.012+0000 7eff52857700 1 -- 172.21.15.73:0/3844794943 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff4c0c3ca0 con 0x7eff4c071db0 2024-05-08T21:50:08.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.012+0000 7eff51855700 1 --2- 172.21.15.73:0/3844794943 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff4c0c65d0 0x7eff4c0cc390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:50:08.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.012+0000 7eff52857700 1 --2- 172.21.15.73:0/3844794943 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff4c071db0 0x7eff4c0cc8d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7eff44009d90 tx=0x7eff4400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed03b4c7e8985f11 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:08.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.012+0000 7eff51054700 1 -- 172.21.15.73:0/3844794943 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4400e070 con 0x7eff4c071db0 2024-05-08T21:50:08.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.012+0000 7eff51054700 1 -- 172.21.15.73:0/3844794943 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff44003a20 con 0x7eff4c071db0 2024-05-08T21:50:08.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.012+0000 7eff51054700 1 -- 172.21.15.73:0/3844794943 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3c001670 con 0x7eff4c071db0 2024-05-08T21:50:08.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.013+0000 7eff542ba700 1 -- 172.21.15.73:0/3844794943 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff4c071db0 msgr2=0x7eff4c0cc8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:08.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.013+0000 7eff542ba700 1 --2- 172.21.15.73:0/3844794943 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff4c071db0 0x7eff4c0cc8d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7eff44009d90 tx=0x7eff4400b330 comp rx=0 tx=0).stop 2024-05-08T21:50:08.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.013+0000 7eff542ba700 1 -- 172.21.15.73:0/3844794943 shutdown_connections 2024-05-08T21:50:08.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.013+0000 7eff542ba700 1 --2- 172.21.15.73:0/3844794943 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff4c071db0 0x7eff4c0cc8d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:08.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.013+0000 7eff542ba700 1 --2- 172.21.15.73:0/3844794943 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff4c0c65d0 0x7eff4c0cc390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:08.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.013+0000 7eff542ba700 1 -- 172.21.15.73:0/3844794943 >> 172.21.15.73:0/3844794943 conn(0x7eff4c066ab0 msgr2=0x7eff4c06f550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:50:08.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.013+0000 7eff542ba700 1 -- 172.21.15.73:0/3844794943 shutdown_connections 2024-05-08T21:50:08.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.013+0000 7eff542ba700 1 -- 172.21.15.73:0/3844794943 wait complete. 2024-05-08T21:50:08.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.014+0000 7eff542ba700 1 Processor -- start 2024-05-08T21:50:08.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.014+0000 7eff542ba700 1 -- start start 2024-05-08T21:50:08.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.015+0000 7eff542ba700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff4c071db0 0x7eff4c14f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:08.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.015+0000 7eff542ba700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff4c0c65d0 0x7eff4c0c76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:08.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.015+0000 7eff542ba700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff4c150b40 0x7eff4c144e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:08.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.015+0000 7eff542ba700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff4c0c8910 con 0x7eff4c071db0 2024-05-08T21:50:08.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.015+0000 7eff542ba700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff4c1e4620 con 0x7eff4c0c65d0 2024-05-08T21:50:08.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.015+0000 7eff542ba700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff4c1f3c70 con 0x7eff4c150b40 2024-05-08T21:50:08.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.015+0000 7eff52056700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff4c071db0 0x7eff4c14f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:08.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.015+0000 7eff52056700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff4c071db0 0x7eff4c14f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38814/0 (socket says 172.21.15.73:38814) 2024-05-08T21:50:08.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.015+0000 7eff52056700 1 -- 172.21.15.73:0/741460776 learned_addr learned my addr 172.21.15.73:0/741460776 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:50:08.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.015+0000 7eff51855700 1 --2- 172.21.15.73:0/741460776 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff4c0c65d0 0x7eff4c0c76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:08.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.015+0000 7eff52857700 1 --2- 172.21.15.73:0/741460776 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff4c150b40 0x7eff4c144e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:08.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.015+0000 7eff52056700 1 -- 172.21.15.73:0/741460776 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff4c150b40 msgr2=0x7eff4c144e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:08.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.015+0000 7eff52056700 1 --2- 172.21.15.73:0/741460776 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff4c150b40 0x7eff4c144e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:08.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.015+0000 7eff52056700 1 -- 172.21.15.73:0/741460776 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff4c0c65d0 msgr2=0x7eff4c0c76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:08.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.015+0000 7eff52056700 1 --2- 172.21.15.73:0/741460776 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff4c0c65d0 0x7eff4c0c76b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:08.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.015+0000 7eff52056700 1 -- 172.21.15.73:0/741460776 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff480094a0 con 0x7eff4c071db0 2024-05-08T21:50:08.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.015+0000 7eff52056700 1 --2- 172.21.15.73:0/741460776 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff4c071db0 0x7eff4c14f600 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7eff3c00c520 tx=0x7eff3c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:08.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.015+0000 7eff42ffd700 1 -- 172.21.15.73:0/741460776 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3c004c80 con 0x7eff4c071db0 2024-05-08T21:50:08.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.015+0000 7eff42ffd700 1 -- 172.21.15.73:0/741460776 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff3c004de0 con 0x7eff4c071db0 2024-05-08T21:50:08.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.015+0000 7eff42ffd700 1 -- 172.21.15.73:0/741460776 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3c007310 con 0x7eff4c071db0 2024-05-08T21:50:08.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.015+0000 7eff542ba700 1 -- 172.21.15.73:0/741460776 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff44009a70 con 0x7eff4c071db0 2024-05-08T21:50:08.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.016+0000 7eff542ba700 1 -- 172.21.15.73:0/741460776 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff4c1f2eb0 con 0x7eff4c071db0 2024-05-08T21:50:08.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.016+0000 7eff542ba700 1 -- 172.21.15.73:0/741460776 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff4c068b80 con 0x7eff4c071db0 2024-05-08T21:50:08.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.017+0000 7eff42ffd700 1 -- 172.21.15.73:0/741460776 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7eff3c007470 con 0x7eff4c071db0 2024-05-08T21:50:08.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.017+0000 7eff42ffd700 1 --2- 172.21.15.73:0/741460776 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7eff3006ac90 0x7eff3006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:08.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.017+0000 7eff42ffd700 1 -- 172.21.15.73:0/741460776 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7eff3c088ed0 con 0x7eff4c071db0 2024-05-08T21:50:08.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.017+0000 7eff51855700 1 --2- 172.21.15.73:0/741460776 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7eff3006ac90 0x7eff3006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:08.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.018+0000 7eff51855700 1 --2- 172.21.15.73:0/741460776 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7eff3006ac90 0x7eff3006d150 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7eff4c14d8a0 tx=0x7eff48009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:08.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.022+0000 7eff42ffd700 1 -- 172.21.15.73:0/741460776 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7eff3c054140 con 0x7eff4c071db0 2024-05-08T21:50:08.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.218+0000 7eff542ba700 1 -- 172.21.15.73:0/741460776 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7eff4c072940 con 0x7eff4c071db0 2024-05-08T21:50:08.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.218+0000 7eff42ffd700 1 -- 172.21.15.73:0/741460776 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7eff3c057760 con 0x7eff4c071db0 2024-05-08T21:50:08.220 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-05-08T21:50:08.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.221+0000 7eff542ba700 1 -- 172.21.15.73:0/741460776 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7eff3006ac90 msgr2=0x7eff3006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:08.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.221+0000 7eff542ba700 1 --2- 172.21.15.73:0/741460776 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7eff3006ac90 0x7eff3006d150 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7eff4c14d8a0 tx=0x7eff48009210 comp rx=0 tx=0).stop 2024-05-08T21:50:08.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.221+0000 7eff542ba700 1 -- 172.21.15.73:0/741460776 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff4c071db0 msgr2=0x7eff4c14f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:08.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.221+0000 7eff542ba700 1 --2- 172.21.15.73:0/741460776 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff4c071db0 0x7eff4c14f600 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7eff3c00c520 tx=0x7eff3c00c830 comp rx=0 tx=0).stop 2024-05-08T21:50:08.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.221+0000 7eff542ba700 1 -- 172.21.15.73:0/741460776 shutdown_connections 2024-05-08T21:50:08.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.221+0000 7eff542ba700 1 --2- 172.21.15.73:0/741460776 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7eff3006ac90 0x7eff3006d150 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:08.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.221+0000 7eff542ba700 1 --2- 172.21.15.73:0/741460776 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff4c150b40 0x7eff4c144e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:08.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.221+0000 7eff542ba700 1 --2- 172.21.15.73:0/741460776 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff4c071db0 0x7eff4c14f600 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:08.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.221+0000 7eff542ba700 1 --2- 172.21.15.73:0/741460776 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff4c0c65d0 0x7eff4c0c76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:08.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.221+0000 7eff542ba700 1 -- 172.21.15.73:0/741460776 >> 172.21.15.73:0/741460776 conn(0x7eff4c066ab0 msgr2=0x7eff4c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:50:08.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.221+0000 7eff542ba700 1 -- 172.21.15.73:0/741460776 shutdown_connections 2024-05-08T21:50:08.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.221+0000 7eff542ba700 1 -- 172.21.15.73:0/741460776 wait complete. 2024-05-08T21:50:08.234 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T21:50:08.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.357+0000 7f884eb92700 1 Processor -- start 2024-05-08T21:50:08.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.357+0000 7f884eb92700 1 -- start start 2024-05-08T21:50:08.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.358+0000 7f884eb92700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f884806ff30 0x7f88480c9340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:08.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.358+0000 7f884eb92700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f884814ea10 con 0x7f884814e630 2024-05-08T21:50:08.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.358+0000 7f884eb92700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f884806f790 con 0x7f88480c4330 2024-05-08T21:50:08.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.358+0000 7f884eb92700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8848158190 con 0x7f884806ff30 2024-05-08T21:50:08.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.358+0000 7f884c92e700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f884814e630 0x7f8848157a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:58442/0 (socket says 172.21.15.73:58442) 2024-05-08T21:50:08.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.358+0000 7f884c92e700 1 -- 172.21.15.73:0/1819339839 learned_addr learned my addr 172.21.15.73:0/1819339839 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:50:08.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.358+0000 7f8847fff700 1 --2- 172.21.15.73:0/1819339839 >> v2:172.21.15.115:3300/0 conn(0x7f884806ff30 0x7f88480c9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:08.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.358+0000 7f88477fe700 1 -- 172.21.15.73:0/1819339839 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1983715874 0 0) 0x7f884814ea10 con 0x7f884814e630 2024-05-08T21:50:08.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.358+0000 7f88477fe700 1 -- 172.21.15.73:0/1819339839 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88380035b0 con 0x7f884814e630 2024-05-08T21:50:08.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.358+0000 7f88477fe700 1 -- 172.21.15.73:0/1819339839 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1406423544 0 0) 0x7f88380035b0 con 0x7f884814e630 2024-05-08T21:50:08.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.358+0000 7f88477fe700 1 -- 172.21.15.73:0/1819339839 >> v2:172.21.15.115:3300/0 conn(0x7f884806ff30 msgr2=0x7f88480c9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:50:08.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.358+0000 7f88477fe700 1 --2- 172.21.15.73:0/1819339839 >> v2:172.21.15.115:3300/0 conn(0x7f884806ff30 0x7f88480c9340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:08.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.358+0000 7f88477fe700 1 -- 172.21.15.73:0/1819339839 >> v1:172.21.15.115:6789/0 conn(0x7f88480c4330 legacy=0x7f8848162400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:08.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.358+0000 7f88477fe700 1 -- 172.21.15.73:0/1819339839 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88480c2710 con 0x7f884814e630 2024-05-08T21:50:08.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.358+0000 7f88477fe700 1 -- 172.21.15.73:0/1819339839 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 953298616 0 0) 0x7f883c001670 con 0x7f884814e630 2024-05-08T21:50:08.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.358+0000 7f88477fe700 1 -- 172.21.15.73:0/1819339839 >> v1:172.21.15.73:6789/0 conn(0x7f884814e630 legacy=0x7f8848157a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:08.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.358+0000 7f88477fe700 1 --2- 172.21.15.73:0/1819339839 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8838003a00 0x7f8838003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:08.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.358+0000 7f88477fe700 1 --2- 172.21.15.73:0/1819339839 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8838004850 0x7f8838004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:08.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.358+0000 7f88477fe700 1 --2- 172.21.15.73:0/1819339839 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8838005210 0x7f883800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:08.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.359+0000 7f88477fe700 1 -- 172.21.15.73:0/1819339839 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8848158190 con 0x7f8838005210 2024-05-08T21:50:08.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.359+0000 7f88477fe700 1 -- 172.21.15.73:0/1819339839 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f883800c1b0 con 0x7f8838004850 2024-05-08T21:50:08.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.359+0000 7f88477fe700 1 -- 172.21.15.73:0/1819339839 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f883800c370 con 0x7f8838003a00 2024-05-08T21:50:08.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.359+0000 7f884d12f700 1 --2- 172.21.15.73:0/1819339839 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8838005210 0x7f883800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:08.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.359+0000 7f884c92e700 1 --2- 172.21.15.73:0/1819339839 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8838003a00 0x7f8838003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:08.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.359+0000 7f8847fff700 1 --2- 172.21.15.73:0/1819339839 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8838004850 0x7f8838004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:08.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.359+0000 7f884d12f700 1 -- 172.21.15.73:0/1819339839 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8838003a00 msgr2=0x7f8838003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:50:08.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.359+0000 7f884d12f700 1 --2- 172.21.15.73:0/1819339839 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8838003a00 0x7f8838003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:08.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.359+0000 7f884d12f700 1 -- 172.21.15.73:0/1819339839 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8838004850 msgr2=0x7f8838004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:50:08.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.359+0000 7f884d12f700 1 --2- 172.21.15.73:0/1819339839 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8838004850 0x7f8838004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:08.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.359+0000 7f884d12f700 1 -- 172.21.15.73:0/1819339839 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88380035b0 con 0x7f8838005210 2024-05-08T21:50:08.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.359+0000 7f884d12f700 1 -- 172.21.15.73:0/1819339839 reap_dead start 2024-05-08T21:50:08.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.359+0000 7f884d12f700 1 --2- 172.21.15.73:0/1819339839 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8838005210 0x7f883800ba10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f884000c190 tx=0x7f8838005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f9d6c00f1c67fd7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:08.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.359+0000 7f88477fe700 1 -- 172.21.15.73:0/1819339839 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8840001db0 con 0x7f8838005210 2024-05-08T21:50:08.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.359+0000 7f88477fe700 1 -- 172.21.15.73:0/1819339839 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f884000ccf0 con 0x7f8838005210 2024-05-08T21:50:08.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.359+0000 7f88477fe700 1 -- 172.21.15.73:0/1819339839 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8840003c40 con 0x7f8838005210 2024-05-08T21:50:08.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.360+0000 7f884eb92700 1 -- 172.21.15.73:0/1819339839 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8838005210 msgr2=0x7f883800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:08.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.360+0000 7f884eb92700 1 --2- 172.21.15.73:0/1819339839 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8838005210 0x7f883800ba10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f884000c190 tx=0x7f8838005880 comp rx=0 tx=0).stop 2024-05-08T21:50:08.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.360+0000 7f884eb92700 1 -- 172.21.15.73:0/1819339839 shutdown_connections 2024-05-08T21:50:08.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.360+0000 7f884eb92700 1 --2- 172.21.15.73:0/1819339839 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8838005210 0x7f883800ba10 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:08.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.360+0000 7f884eb92700 1 -- 172.21.15.73:0/1819339839 >> 172.21.15.73:0/1819339839 conn(0x7f884806aff0 msgr2=0x7f88480666c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:50:08.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.360+0000 7f884eb92700 1 -- 172.21.15.73:0/1819339839 shutdown_connections 2024-05-08T21:50:08.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.360+0000 7f884eb92700 1 -- 172.21.15.73:0/1819339839 wait complete. 2024-05-08T21:50:08.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.361+0000 7f884eb92700 1 Processor -- start 2024-05-08T21:50:08.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.361+0000 7f884eb92700 1 -- start start 2024-05-08T21:50:08.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.362+0000 7f884eb92700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8838005210 0x7f88480ccc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:08.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.362+0000 7f884eb92700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8848158c40 0x7f884814c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:08.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.362+0000 7f884eb92700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f884814ce10 0x7f88481ed630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:08.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.362+0000 7f884eb92700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88481f0ba0 con 0x7f884814ce10 2024-05-08T21:50:08.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.362+0000 7f884eb92700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f884814ec90 con 0x7f8838005210 2024-05-08T21:50:08.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.362+0000 7f884eb92700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f884814d2f0 con 0x7f8848158c40 2024-05-08T21:50:08.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.362+0000 7f884d12f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f884814ce10 0x7f88481ed630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:08.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.362+0000 7f884d12f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f884814ce10 0x7f88481ed630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36388/0 (socket says 172.21.15.73:36388) 2024-05-08T21:50:08.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.362+0000 7f884d12f700 1 -- 172.21.15.73:0/729347764 learned_addr learned my addr 172.21.15.73:0/729347764 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:50:08.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.362+0000 7f884c92e700 1 --2- 172.21.15.73:0/729347764 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8838005210 0x7f88480ccc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:08.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.362+0000 7f8847fff700 1 --2- 172.21.15.73:0/729347764 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8848158c40 0x7f884814c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:08.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.362+0000 7f884d12f700 1 -- 172.21.15.73:0/729347764 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8848158c40 msgr2=0x7f884814c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:08.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.362+0000 7f884d12f700 1 --2- 172.21.15.73:0/729347764 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8848158c40 0x7f884814c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:08.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.362+0000 7f884d12f700 1 -- 172.21.15.73:0/729347764 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8838005210 msgr2=0x7f88480ccc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:08.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.362+0000 7f884d12f700 1 --2- 172.21.15.73:0/729347764 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8838005210 0x7f88480ccc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:08.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.362+0000 7f884d12f700 1 -- 172.21.15.73:0/729347764 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88481f0df0 con 0x7f884814ce10 2024-05-08T21:50:08.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.362+0000 7f884d12f700 1 --2- 172.21.15.73:0/729347764 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f884814ce10 0x7f88481ed630 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f88480672c0 tx=0x7f88400014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:08.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.362+0000 7f88457fa700 1 -- 172.21.15.73:0/729347764 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8840003e90 con 0x7f884814ce10 2024-05-08T21:50:08.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.362+0000 7f88457fa700 1 -- 172.21.15.73:0/729347764 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8840005070 con 0x7f884814ce10 2024-05-08T21:50:08.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.362+0000 7f884eb92700 1 -- 172.21.15.73:0/729347764 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88481f10d0 con 0x7f884814ce10 2024-05-08T21:50:08.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.362+0000 7f88457fa700 1 -- 172.21.15.73:0/729347764 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8840005400 con 0x7f884814ce10 2024-05-08T21:50:08.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.363+0000 7f884eb92700 1 -- 172.21.15.73:0/729347764 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88481f1690 con 0x7f884814ce10 2024-05-08T21:50:08.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.363+0000 7f884eb92700 1 -- 172.21.15.73:0/729347764 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88481f18b0 con 0x7f884814ce10 2024-05-08T21:50:08.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.364+0000 7f88457fa700 1 -- 172.21.15.73:0/729347764 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8840005560 con 0x7f884814ce10 2024-05-08T21:50:08.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.364+0000 7f88457fa700 1 --2- 172.21.15.73:0/729347764 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f882c06acc0 0x7f882c06d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:08.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.364+0000 7f88457fa700 1 -- 172.21.15.73:0/729347764 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f884008a640 con 0x7f884814ce10 2024-05-08T21:50:08.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.364+0000 7f884c92e700 1 --2- 172.21.15.73:0/729347764 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f882c06acc0 0x7f882c06d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:08.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.365+0000 7f884c92e700 1 --2- 172.21.15.73:0/729347764 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f882c06acc0 0x7f882c06d180 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f883c0017a0 tx=0x7f883c001550 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:08.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.369+0000 7f88457fa700 1 -- 172.21.15.73:0/729347764 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f8840055810 con 0x7f884814ce10 2024-05-08T21:50:08.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.565+0000 7f884eb92700 1 -- 172.21.15.73:0/729347764 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8848068b80 con 0x7f884814ce10 2024-05-08T21:50:08.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.566+0000 7f88457fa700 1 -- 172.21.15.73:0/729347764 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8840005810 con 0x7f884814ce10 2024-05-08T21:50:08.567 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-05-08T21:50:08.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.568+0000 7f884eb92700 1 -- 172.21.15.73:0/729347764 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f882c06acc0 msgr2=0x7f882c06d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:08.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.568+0000 7f884eb92700 1 --2- 172.21.15.73:0/729347764 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f882c06acc0 0x7f882c06d180 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f883c0017a0 tx=0x7f883c001550 comp rx=0 tx=0).stop 2024-05-08T21:50:08.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.568+0000 7f884eb92700 1 -- 172.21.15.73:0/729347764 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f884814ce10 msgr2=0x7f88481ed630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:08.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.568+0000 7f884eb92700 1 --2- 172.21.15.73:0/729347764 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f884814ce10 0x7f88481ed630 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f88480672c0 tx=0x7f88400014a0 comp rx=0 tx=0).stop 2024-05-08T21:50:08.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.568+0000 7f884eb92700 1 -- 172.21.15.73:0/729347764 shutdown_connections 2024-05-08T21:50:08.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.568+0000 7f884eb92700 1 --2- 172.21.15.73:0/729347764 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f882c06acc0 0x7f882c06d180 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:08.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.568+0000 7f884eb92700 1 --2- 172.21.15.73:0/729347764 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f884814ce10 0x7f88481ed630 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:08.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.568+0000 7f884eb92700 1 --2- 172.21.15.73:0/729347764 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8838005210 0x7f88480ccc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:08.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.568+0000 7f884eb92700 1 --2- 172.21.15.73:0/729347764 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8848158c40 0x7f884814c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:08.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.568+0000 7f884eb92700 1 -- 172.21.15.73:0/729347764 >> 172.21.15.73:0/729347764 conn(0x7f884806aff0 msgr2=0x7f88480666c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:50:08.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.568+0000 7f884eb92700 1 -- 172.21.15.73:0/729347764 shutdown_connections 2024-05-08T21:50:08.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.568+0000 7f884eb92700 1 -- 172.21.15.73:0/729347764 wait complete. 2024-05-08T21:50:08.581 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T21:50:08.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.704+0000 7f7ae8056700 1 Processor -- start 2024-05-08T21:50:08.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.704+0000 7f7ae8056700 1 -- start start 2024-05-08T21:50:08.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.705+0000 7f7ae8056700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7ae00cac40 0x7f7ae00720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:08.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.705+0000 7f7ae8056700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ae00c9f90 con 0x7f7ae0072630 2024-05-08T21:50:08.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.705+0000 7f7ae8056700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ae0159c00 con 0x7f7ae0153e20 2024-05-08T21:50:08.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.705+0000 7f7ae8056700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ae00ca250 con 0x7f7ae00cac40 2024-05-08T21:50:08.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.705+0000 7f7ae55f1700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7ae00cac40 0x7f7ae00720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:08.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.705+0000 7f7ae65f3700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f7ae0072630 0x7f7ae015a100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:58446/0 (socket says 172.21.15.73:58446) 2024-05-08T21:50:08.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.705+0000 7f7ae65f3700 1 -- 172.21.15.73:0/998032368 learned_addr learned my addr 172.21.15.73:0/998032368 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:50:08.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.705+0000 7f7ae55f1700 1 -- 172.21.15.73:0/998032368 >> v1:172.21.15.115:6789/0 conn(0x7f7ae0153e20 legacy=0x7f7ae015dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:50:08.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.705+0000 7f7ae55f1700 1 -- 172.21.15.73:0/998032368 >> v1:172.21.15.73:6789/0 conn(0x7f7ae0072630 legacy=0x7f7ae015a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:08.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.706+0000 7f7ae55f1700 1 -- 172.21.15.73:0/998032368 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ae00cb7e0 con 0x7f7ae00cac40 2024-05-08T21:50:08.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.706+0000 7f7ae55f1700 1 --2- 172.21.15.73:0/998032368 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ae00cac40 0x7f7ae00720f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7adc009840 tx=0x7f7adc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=134d87e340f307b7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:08.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.706+0000 7f7ae4df0700 1 -- 172.21.15.73:0/998032368 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7adc004230 con 0x7f7ae00cac40 2024-05-08T21:50:08.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.706+0000 7f7ae4df0700 1 -- 172.21.15.73:0/998032368 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7adc004390 con 0x7f7ae00cac40 2024-05-08T21:50:08.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.706+0000 7f7ae4df0700 1 -- 172.21.15.73:0/998032368 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7adc0036a0 con 0x7f7ae00cac40 2024-05-08T21:50:08.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.706+0000 7f7ae8056700 1 -- 172.21.15.73:0/998032368 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ae00cac40 msgr2=0x7f7ae00720f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:08.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.706+0000 7f7ae8056700 1 --2- 172.21.15.73:0/998032368 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ae00cac40 0x7f7ae00720f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7adc009840 tx=0x7f7adc009b50 comp rx=0 tx=0).stop 2024-05-08T21:50:08.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.706+0000 7f7ae8056700 1 -- 172.21.15.73:0/998032368 shutdown_connections 2024-05-08T21:50:08.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.706+0000 7f7ae8056700 1 --2- 172.21.15.73:0/998032368 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ae00cac40 0x7f7ae00720f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:08.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.706+0000 7f7ae8056700 1 -- 172.21.15.73:0/998032368 >> 172.21.15.73:0/998032368 conn(0x7f7ae006be90 msgr2=0x7f7ae006c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:50:08.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.707+0000 7f7ae8056700 1 -- 172.21.15.73:0/998032368 shutdown_connections 2024-05-08T21:50:08.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.707+0000 7f7ae8056700 1 -- 172.21.15.73:0/998032368 wait complete. 2024-05-08T21:50:08.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.708+0000 7f7ae8056700 1 Processor -- start 2024-05-08T21:50:08.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.708+0000 7f7ae8056700 1 -- start start 2024-05-08T21:50:08.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.708+0000 7f7ae8056700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ae0072630 0x7f7ae01f3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:08.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.708+0000 7f7ae8056700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ae00cac40 0x7f7ae00c7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:08.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.708+0000 7f7ae8056700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7ae0153e20 0x7f7ae00ce580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:08.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.708+0000 7f7ae8056700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae01f3a40 con 0x7f7ae00cac40 2024-05-08T21:50:08.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.708+0000 7f7ae8056700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae0148ab0 con 0x7f7ae0072630 2024-05-08T21:50:08.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.708+0000 7f7ae8056700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae01ef5b0 con 0x7f7ae0153e20 2024-05-08T21:50:08.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.708+0000 7f7ae55f1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ae00cac40 0x7f7ae00c7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:08.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.709+0000 7f7ae55f1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ae00cac40 0x7f7ae00c7ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36418/0 (socket says 172.21.15.73:36418) 2024-05-08T21:50:08.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.709+0000 7f7ae55f1700 1 -- 172.21.15.73:0/2619099124 learned_addr learned my addr 172.21.15.73:0/2619099124 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:50:08.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.709+0000 7f7ae55f1700 1 -- 172.21.15.73:0/2619099124 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7ae0153e20 msgr2=0x7f7ae00ce580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:08.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.709+0000 7f7ae55f1700 1 --2- 172.21.15.73:0/2619099124 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7ae0153e20 0x7f7ae00ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:08.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.709+0000 7f7ae55f1700 1 -- 172.21.15.73:0/2619099124 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ae0072630 msgr2=0x7f7ae01f3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:08.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.709+0000 7f7ae5df2700 1 --2- 172.21.15.73:0/2619099124 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ae0072630 0x7f7ae01f3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:08.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.709+0000 7f7ae55f1700 1 --2- 172.21.15.73:0/2619099124 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ae0072630 0x7f7ae01f3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:08.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.709+0000 7f7ae55f1700 1 -- 172.21.15.73:0/2619099124 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7adc0094a0 con 0x7f7ae00cac40 2024-05-08T21:50:08.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.709+0000 7f7ae5df2700 1 --2- 172.21.15.73:0/2619099124 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ae0072630 0x7f7ae01f3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:50:08.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.709+0000 7f7ae55f1700 1 --2- 172.21.15.73:0/2619099124 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ae00cac40 0x7f7ae00c7ea0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7adc0090b0 tx=0x7f7adc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:08.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.709+0000 7f7ad67fc700 1 -- 172.21.15.73:0/2619099124 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7adc011830 con 0x7f7ae00cac40 2024-05-08T21:50:08.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.709+0000 7f7ad67fc700 1 -- 172.21.15.73:0/2619099124 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7adc01e070 con 0x7f7ae00cac40 2024-05-08T21:50:08.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.709+0000 7f7ad67fc700 1 -- 172.21.15.73:0/2619099124 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7adc011bf0 con 0x7f7ae00cac40 2024-05-08T21:50:08.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.709+0000 7f7ae8056700 1 -- 172.21.15.73:0/2619099124 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ae0148d50 con 0x7f7ae00cac40 2024-05-08T21:50:08.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.709+0000 7f7ae8056700 1 -- 172.21.15.73:0/2619099124 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ae01efb50 con 0x7f7ae00cac40 2024-05-08T21:50:08.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.710+0000 7f7ae8056700 1 -- 172.21.15.73:0/2619099124 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ae0068b80 con 0x7f7ae00cac40 2024-05-08T21:50:08.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.710+0000 7f7ad67fc700 1 -- 172.21.15.73:0/2619099124 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7adc011d50 con 0x7f7ae00cac40 2024-05-08T21:50:08.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.711+0000 7f7ad67fc700 1 --2- 172.21.15.73:0/2619099124 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f7ac406ac90 0x7f7ac406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:08.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.711+0000 7f7ad67fc700 1 -- 172.21.15.73:0/2619099124 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7adc08a630 con 0x7f7ae00cac40 2024-05-08T21:50:08.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.711+0000 7f7ae5df2700 1 --2- 172.21.15.73:0/2619099124 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f7ac406ac90 0x7f7ac406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:08.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.711+0000 7f7ae5df2700 1 --2- 172.21.15.73:0/2619099124 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f7ac406ac90 0x7f7ac406d150 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0006fd0 tx=0x7f7ad0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:08.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.715+0000 7f7ad67fc700 1 -- 172.21.15.73:0/2619099124 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f7adc055810 con 0x7f7ae00cac40 2024-05-08T21:50:08.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.911+0000 7f7ae8056700 1 -- 172.21.15.73:0/2619099124 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7ae0068b80 con 0x7f7ae00cac40 2024-05-08T21:50:08.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.911+0000 7f7ad67fc700 1 -- 172.21.15.73:0/2619099124 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7adc058e30 con 0x7f7ae00cac40 2024-05-08T21:50:08.912 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-05-08T21:50:08.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.913+0000 7f7ae8056700 1 -- 172.21.15.73:0/2619099124 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f7ac406ac90 msgr2=0x7f7ac406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:08.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.913+0000 7f7ae8056700 1 --2- 172.21.15.73:0/2619099124 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f7ac406ac90 0x7f7ac406d150 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0006fd0 tx=0x7f7ad0008040 comp rx=0 tx=0).stop 2024-05-08T21:50:08.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.913+0000 7f7ae8056700 1 -- 172.21.15.73:0/2619099124 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ae00cac40 msgr2=0x7f7ae00c7ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:08.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.913+0000 7f7ae8056700 1 --2- 172.21.15.73:0/2619099124 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ae00cac40 0x7f7ae00c7ea0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7adc0090b0 tx=0x7f7adc004750 comp rx=0 tx=0).stop 2024-05-08T21:50:08.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.913+0000 7f7ae8056700 1 -- 172.21.15.73:0/2619099124 shutdown_connections 2024-05-08T21:50:08.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.913+0000 7f7ae8056700 1 --2- 172.21.15.73:0/2619099124 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f7ac406ac90 0x7f7ac406d150 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:08.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.913+0000 7f7ae8056700 1 --2- 172.21.15.73:0/2619099124 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7ae0153e20 0x7f7ae00ce580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:08.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.913+0000 7f7ae8056700 1 --2- 172.21.15.73:0/2619099124 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ae0072630 0x7f7ae01f3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:08.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.913+0000 7f7ae8056700 1 --2- 172.21.15.73:0/2619099124 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ae00cac40 0x7f7ae00c7ea0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:08.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.913+0000 7f7ae8056700 1 -- 172.21.15.73:0/2619099124 >> 172.21.15.73:0/2619099124 conn(0x7f7ae006be90 msgr2=0x7f7ae00cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:50:08.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.914+0000 7f7ae8056700 1 -- 172.21.15.73:0/2619099124 shutdown_connections 2024-05-08T21:50:08.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:08.914+0000 7f7ae8056700 1 -- 172.21.15.73:0/2619099124 wait complete. 2024-05-08T21:50:08.926 INFO:tasks.mds_thrash:Wait for all MDSs to reach steady state... 2024-05-08T21:50:08.927 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:50:09.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.047+0000 7f50c08f3700 1 Processor -- start 2024-05-08T21:50:09.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.047+0000 7f50c08f3700 1 -- start start 2024-05-08T21:50:09.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.048+0000 7f50c08f3700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f50bc072d60 0x7f50bc153860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:09.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.048+0000 7f50c08f3700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50bc15dfc0 con 0x7f50bc072980 2024-05-08T21:50:09.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.048+0000 7f50c08f3700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50bc15d3b0 con 0x7f50bc072260 2024-05-08T21:50:09.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.048+0000 7f50c08f3700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50bc070120 con 0x7f50bc072d60 2024-05-08T21:50:09.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.048+0000 7f50ba59c700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f50bc072980 0x7f50bc06f970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:58460/0 (socket says 172.21.15.73:58460) 2024-05-08T21:50:09.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.048+0000 7f50ba59c700 1 -- 172.21.15.73:0/2038238840 learned_addr learned my addr 172.21.15.73:0/2038238840 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:50:09.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.048+0000 7f50bad9d700 1 --2- 172.21.15.73:0/2038238840 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f50bc072d60 0x7f50bc153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:09.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.048+0000 7f50b959a700 1 -- 172.21.15.73:0/2038238840 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3001918142 0 0) 0x7f50bc15dfc0 con 0x7f50bc072980 2024-05-08T21:50:09.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.048+0000 7f50b959a700 1 -- 172.21.15.73:0/2038238840 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50a40035b0 con 0x7f50bc072980 2024-05-08T21:50:09.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.048+0000 7f50b959a700 1 -- 172.21.15.73:0/2038238840 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 356875979 0 0) 0x7f50bc15d3b0 con 0x7f50bc072260 2024-05-08T21:50:09.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.048+0000 7f50b959a700 1 -- 172.21.15.73:0/2038238840 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50bc15dfc0 con 0x7f50bc072260 2024-05-08T21:50:09.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.048+0000 7f50bad9d700 1 -- 172.21.15.73:0/2038238840 >> v1:172.21.15.115:6789/0 conn(0x7f50bc072260 legacy=0x7f50bc159d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:09.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.048+0000 7f50bad9d700 1 -- 172.21.15.73:0/2038238840 >> v1:172.21.15.73:6789/0 conn(0x7f50bc072980 legacy=0x7f50bc06f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:09.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.048+0000 7f50bad9d700 1 -- 172.21.15.73:0/2038238840 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50bc15d690 con 0x7f50bc072d60 2024-05-08T21:50:09.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.049+0000 7f50bad9d700 1 --2- 172.21.15.73:0/2038238840 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f50bc072d60 0x7f50bc153860 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f50b4009dc0 tx=0x7f50b400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1900f0823558a886 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:09.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.049+0000 7f50b959a700 1 -- 172.21.15.73:0/2038238840 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b400e070 con 0x7f50bc072d60 2024-05-08T21:50:09.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.049+0000 7f50b959a700 1 -- 172.21.15.73:0/2038238840 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50b400bb20 con 0x7f50bc072d60 2024-05-08T21:50:09.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.049+0000 7f50b959a700 1 -- 172.21.15.73:0/2038238840 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b4012430 con 0x7f50bc072d60 2024-05-08T21:50:09.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.049+0000 7f50c08f3700 1 -- 172.21.15.73:0/2038238840 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f50bc072d60 msgr2=0x7f50bc153860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:09.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.049+0000 7f50c08f3700 1 --2- 172.21.15.73:0/2038238840 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f50bc072d60 0x7f50bc153860 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f50b4009dc0 tx=0x7f50b400b330 comp rx=0 tx=0).stop 2024-05-08T21:50:09.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.049+0000 7f50c08f3700 1 -- 172.21.15.73:0/2038238840 shutdown_connections 2024-05-08T21:50:09.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.049+0000 7f50c08f3700 1 --2- 172.21.15.73:0/2038238840 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f50bc072d60 0x7f50bc153860 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:09.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.049+0000 7f50c08f3700 1 -- 172.21.15.73:0/2038238840 >> 172.21.15.73:0/2038238840 conn(0x7f50bc066cf0 msgr2=0x7f50bc06bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:50:09.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.049+0000 7f50c08f3700 1 -- 172.21.15.73:0/2038238840 shutdown_connections 2024-05-08T21:50:09.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.049+0000 7f50c08f3700 1 -- 172.21.15.73:0/2038238840 wait complete. 2024-05-08T21:50:09.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.051+0000 7f50c08f3700 1 Processor -- start 2024-05-08T21:50:09.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.051+0000 7f50c08f3700 1 -- start start 2024-05-08T21:50:09.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.051+0000 7f50c08f3700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f50bc072260 0x7f50bc0cc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:09.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.051+0000 7f50c08f3700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50bc072980 0x7f50bc158d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:09.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.051+0000 7f50c08f3700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50bc072d60 0x7f50bc154cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:09.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.051+0000 7f50c08f3700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50bc1f0550 con 0x7f50bc072d60 2024-05-08T21:50:09.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.051+0000 7f50c08f3700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50bc1efff0 con 0x7f50bc072980 2024-05-08T21:50:09.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.051+0000 7f50c08f3700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50bc0c5490 con 0x7f50bc072260 2024-05-08T21:50:09.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.051+0000 7f50bad9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50bc072d60 0x7f50bc154cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:09.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.052+0000 7f50bad9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50bc072d60 0x7f50bc154cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36430/0 (socket says 172.21.15.73:36430) 2024-05-08T21:50:09.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.052+0000 7f50bad9d700 1 -- 172.21.15.73:0/160096940 learned_addr learned my addr 172.21.15.73:0/160096940 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:50:09.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.052+0000 7f50ba59c700 1 --2- 172.21.15.73:0/160096940 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f50bc072260 0x7f50bc0cc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:09.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.052+0000 7f50b9d9b700 1 --2- 172.21.15.73:0/160096940 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50bc072980 0x7f50bc158d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:09.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.052+0000 7f50bad9d700 1 -- 172.21.15.73:0/160096940 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f50bc072260 msgr2=0x7f50bc0cc6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:09.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.052+0000 7f50bad9d700 1 --2- 172.21.15.73:0/160096940 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f50bc072260 0x7f50bc0cc6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:09.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.052+0000 7f50bad9d700 1 -- 172.21.15.73:0/160096940 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50bc072980 msgr2=0x7f50bc158d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:09.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.052+0000 7f50bad9d700 1 --2- 172.21.15.73:0/160096940 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50bc072980 0x7f50bc158d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:09.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.052+0000 7f50bad9d700 1 -- 172.21.15.73:0/160096940 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b4009a70 con 0x7f50bc072d60 2024-05-08T21:50:09.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.052+0000 7f50ba59c700 1 --2- 172.21.15.73:0/160096940 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f50bc072260 0x7f50bc0cc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:50:09.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.052+0000 7f50b9d9b700 1 --2- 172.21.15.73:0/160096940 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50bc072980 0x7f50bc158d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:50:09.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.052+0000 7f50bad9d700 1 --2- 172.21.15.73:0/160096940 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50bc072d60 0x7f50bc154cb0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f50b400b370 tx=0x7f50b4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:09.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.052+0000 7f50aaffd700 1 -- 172.21.15.73:0/160096940 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b401b810 con 0x7f50bc072d60 2024-05-08T21:50:09.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.052+0000 7f50aaffd700 1 -- 172.21.15.73:0/160096940 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50b4020070 con 0x7f50bc072d60 2024-05-08T21:50:09.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.052+0000 7f50c08f3700 1 -- 172.21.15.73:0/160096940 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50bc1544f0 con 0x7f50bc072d60 2024-05-08T21:50:09.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.052+0000 7f50aaffd700 1 -- 172.21.15.73:0/160096940 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b401bbf0 con 0x7f50bc072d60 2024-05-08T21:50:09.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.052+0000 7f50c08f3700 1 -- 172.21.15.73:0/160096940 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50bc0c5730 con 0x7f50bc072d60 2024-05-08T21:50:09.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.053+0000 7f50c08f3700 1 -- 172.21.15.73:0/160096940 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50bc159ed0 con 0x7f50bc072d60 2024-05-08T21:50:09.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.054+0000 7f50aaffd700 1 -- 172.21.15.73:0/160096940 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f50b401bd50 con 0x7f50bc072d60 2024-05-08T21:50:09.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.054+0000 7f50aaffd700 1 --2- 172.21.15.73:0/160096940 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f509c06ac90 0x7f509c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:09.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.054+0000 7f50aaffd700 1 -- 172.21.15.73:0/160096940 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f50b4022070 con 0x7f50bc072d60 2024-05-08T21:50:09.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.054+0000 7f50ba59c700 1 --2- 172.21.15.73:0/160096940 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f509c06ac90 0x7f509c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:09.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.054+0000 7f50ba59c700 1 --2- 172.21.15.73:0/160096940 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f509c06ac90 0x7f509c06d150 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f50ac000f60 tx=0x7f50ac009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:09.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.058+0000 7f50aaffd700 1 -- 172.21.15.73:0/160096940 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f50b40568d0 con 0x7f50bc072d60 2024-05-08T21:50:09.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.299+0000 7f50c08f3700 1 -- 172.21.15.73:0/160096940 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f50bc068b80 con 0x7f50bc072d60 2024-05-08T21:50:09.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.300+0000 7f50aaffd700 1 -- 172.21.15.73:0/160096940 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+6250 (secure 0 0 0) 0x7f50b4059ef0 con 0x7f50bc072d60 2024-05-08T21:50:09.301 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:50:09.301 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3242319177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6833","nonce":3242319177},{"type":"v1","addr":"172.21.15.115:6835","nonce":3242319177}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6834/2136341349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2136341349},{"type":"v1","addr":"172.21.15.115:6834","nonce":2136341349}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4249,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1439647913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1439647913},{"type":"v1","addr":"172.21.15.115:6837","nonce":1439647913}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/2386382396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2386382396},{"type":"v1","addr":"172.21.15.73:6836","nonce":2386382396}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/1772457954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":1772457954},{"type":"v1","addr":"172.21.15.73:6837","nonce":1772457954}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:49:43.747162+0000","modified":"2024-05-08T21:49:48.814033+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.73:6839/1477468490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1477468490},{"type":"v1","addr":"172.21.15.73:6839","nonce":1477468490}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:50:09.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.302+0000 7f50c08f3700 1 -- 172.21.15.73:0/160096940 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f509c06ac90 msgr2=0x7f509c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:09.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.302+0000 7f50c08f3700 1 --2- 172.21.15.73:0/160096940 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f509c06ac90 0x7f509c06d150 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f50ac000f60 tx=0x7f50ac009040 comp rx=0 tx=0).stop 2024-05-08T21:50:09.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.302+0000 7f50c08f3700 1 -- 172.21.15.73:0/160096940 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50bc072d60 msgr2=0x7f50bc154cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:09.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.302+0000 7f50c08f3700 1 --2- 172.21.15.73:0/160096940 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50bc072d60 0x7f50bc154cb0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f50b400b370 tx=0x7f50b4004ad0 comp rx=0 tx=0).stop 2024-05-08T21:50:09.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.302+0000 7f50c08f3700 1 -- 172.21.15.73:0/160096940 shutdown_connections 2024-05-08T21:50:09.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.302+0000 7f50c08f3700 1 --2- 172.21.15.73:0/160096940 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f509c06ac90 0x7f509c06d150 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:09.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.302+0000 7f50c08f3700 1 --2- 172.21.15.73:0/160096940 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50bc072d60 0x7f50bc154cb0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:09.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.302+0000 7f50c08f3700 1 --2- 172.21.15.73:0/160096940 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f50bc072260 0x7f50bc0cc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:09.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.302+0000 7f50c08f3700 1 --2- 172.21.15.73:0/160096940 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50bc072980 0x7f50bc158d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:09.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.302+0000 7f50c08f3700 1 -- 172.21.15.73:0/160096940 >> 172.21.15.73:0/160096940 conn(0x7f50bc066cf0 msgr2=0x7f50bc06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:50:09.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.302+0000 7f50c08f3700 1 -- 172.21.15.73:0/160096940 shutdown_connections 2024-05-08T21:50:09.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.302+0000 7f50c08f3700 1 -- 172.21.15.73:0/160096940 wait complete. 2024-05-08T21:50:09.304 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 8 2024-05-08T21:50:09.315 INFO:tasks.mds_thrash:Ready to start thrashing 2024-05-08T21:50:09.315 INFO:tasks.mds_thrash.ceph_manager:waiting for clean 2024-05-08T21:50:09.315 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T21:50:09.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.436+0000 7f5a9e936700 1 Processor -- start 2024-05-08T21:50:09.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.436+0000 7f5a9e936700 1 -- start start 2024-05-08T21:50:09.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.437+0000 7f5a9e936700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5a980c3490 0x7f5a98072460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:09.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.437+0000 7f5a9e936700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5a980c3a00 0x7f5a98161350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:09.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.437+0000 7f5a9e936700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a980c3f10 con 0x7f5a98072080 2024-05-08T21:50:09.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.437+0000 7f5a9e936700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a980729a0 con 0x7f5a980c3a00 2024-05-08T21:50:09.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.437+0000 7f5a9e936700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a980c41b0 con 0x7f5a980c3490 2024-05-08T21:50:09.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.437+0000 7f5a9ced3700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5a980c3a00 0x7f5a98161350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:09.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.437+0000 7f5a9ced3700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5a980c3a00 0x7f5a98161350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36432/0 (socket says 172.21.15.73:36432) 2024-05-08T21:50:09.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.437+0000 7f5a9ced3700 1 -- 172.21.15.73:0/3697214373 learned_addr learned my addr 172.21.15.73:0/3697214373 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:50:09.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.437+0000 7f5a977fe700 1 --2- 172.21.15.73:0/3697214373 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5a980c3490 0x7f5a98072460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:09.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.437+0000 7f5a9ced3700 1 -- 172.21.15.73:0/3697214373 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5a980c3490 msgr2=0x7f5a98072460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:50:09.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.437+0000 7f5a9ced3700 1 --2- 172.21.15.73:0/3697214373 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5a980c3490 0x7f5a98072460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:09.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.437+0000 7f5a9ced3700 1 -- 172.21.15.73:0/3697214373 >> v1:172.21.15.115:6789/0 conn(0x7f5a98072080 legacy=0x7f5a98156dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:50:09.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.437+0000 7f5a9ced3700 1 -- 172.21.15.73:0/3697214373 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a980c7820 con 0x7f5a980c3a00 2024-05-08T21:50:09.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.437+0000 7f5a9ced3700 1 --2- 172.21.15.73:0/3697214373 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a980c3a00 0x7f5a98161350 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5a90009e50 tx=0x7f5a9000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc5a3f30a06f258f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:09.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.437+0000 7f5a96ffd700 1 -- 172.21.15.73:0/3697214373 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a9000e070 con 0x7f5a980c3a00 2024-05-08T21:50:09.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.437+0000 7f5a96ffd700 1 -- 172.21.15.73:0/3697214373 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a90003a20 con 0x7f5a980c3a00 2024-05-08T21:50:09.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.437+0000 7f5a96ffd700 1 -- 172.21.15.73:0/3697214373 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a90003dd0 con 0x7f5a980c3a00 2024-05-08T21:50:09.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.438+0000 7f5a9e936700 1 -- 172.21.15.73:0/3697214373 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a980c3a00 msgr2=0x7f5a98161350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:09.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.438+0000 7f5a9e936700 1 --2- 172.21.15.73:0/3697214373 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a980c3a00 0x7f5a98161350 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5a90009e50 tx=0x7f5a9000b330 comp rx=0 tx=0).stop 2024-05-08T21:50:09.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.438+0000 7f5a9e936700 1 -- 172.21.15.73:0/3697214373 shutdown_connections 2024-05-08T21:50:09.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.438+0000 7f5a9e936700 1 --2- 172.21.15.73:0/3697214373 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a980c3a00 0x7f5a98161350 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:09.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.438+0000 7f5a9e936700 1 --2- 172.21.15.73:0/3697214373 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5a980c3490 0x7f5a98072460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:09.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.438+0000 7f5a9e936700 1 -- 172.21.15.73:0/3697214373 >> 172.21.15.73:0/3697214373 conn(0x7f5a98066d70 msgr2=0x7f5a980cc500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:50:09.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.438+0000 7f5a9e936700 1 -- 172.21.15.73:0/3697214373 shutdown_connections 2024-05-08T21:50:09.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.438+0000 7f5a9e936700 1 -- 172.21.15.73:0/3697214373 wait complete. 2024-05-08T21:50:09.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.439+0000 7f5a9e936700 1 Processor -- start 2024-05-08T21:50:09.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.439+0000 7f5a9e936700 1 -- start start 2024-05-08T21:50:09.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.440+0000 7f5a9e936700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a98072080 0x7f5a981590d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:09.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.440+0000 7f5a9e936700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5a980c3490 0x7f5a981561e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:09.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.440+0000 7f5a9e936700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5a980c3a00 0x7f5a981f0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:09.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.440+0000 7f5a9e936700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a98159610 con 0x7f5a98072080 2024-05-08T21:50:09.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.440+0000 7f5a9e936700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a981599d0 con 0x7f5a980c3a00 2024-05-08T21:50:09.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.440+0000 7f5a9e936700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a981efba0 con 0x7f5a980c3490 2024-05-08T21:50:09.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.440+0000 7f5a97fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a98072080 0x7f5a981590d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:09.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.440+0000 7f5a97fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a98072080 0x7f5a981590d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36436/0 (socket says 172.21.15.73:36436) 2024-05-08T21:50:09.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.440+0000 7f5a97fff700 1 -- 172.21.15.73:0/1052117062 learned_addr learned my addr 172.21.15.73:0/1052117062 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:50:09.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.440+0000 7f5a977fe700 1 --2- 172.21.15.73:0/1052117062 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5a980c3490 0x7f5a981561e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:09.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.440+0000 7f5a9ced3700 1 --2- 172.21.15.73:0/1052117062 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5a980c3a00 0x7f5a981f0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:09.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.440+0000 7f5a97fff700 1 -- 172.21.15.73:0/1052117062 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5a980c3490 msgr2=0x7f5a981561e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:09.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.440+0000 7f5a97fff700 1 --2- 172.21.15.73:0/1052117062 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5a980c3490 0x7f5a981561e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:09.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.440+0000 7f5a97fff700 1 -- 172.21.15.73:0/1052117062 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5a980c3a00 msgr2=0x7f5a981f0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:09.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.440+0000 7f5a97fff700 1 --2- 172.21.15.73:0/1052117062 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5a980c3a00 0x7f5a981f0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:09.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.440+0000 7f5a97fff700 1 -- 172.21.15.73:0/1052117062 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a90009b30 con 0x7f5a98072080 2024-05-08T21:50:09.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.440+0000 7f5a9ced3700 1 --2- 172.21.15.73:0/1052117062 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5a980c3a00 0x7f5a981f0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:50:09.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.440+0000 7f5a97fff700 1 --2- 172.21.15.73:0/1052117062 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a98072080 0x7f5a981590d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5a8800c500 tx=0x7f5a8800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:09.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.440+0000 7f5a94ff9700 1 -- 172.21.15.73:0/1052117062 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a88011790 con 0x7f5a98072080 2024-05-08T21:50:09.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.441+0000 7f5a94ff9700 1 -- 172.21.15.73:0/1052117062 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a880118f0 con 0x7f5a98072080 2024-05-08T21:50:09.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.441+0000 7f5a94ff9700 1 -- 172.21.15.73:0/1052117062 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a88011ca0 con 0x7f5a98072080 2024-05-08T21:50:09.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.441+0000 7f5a9e936700 1 -- 172.21.15.73:0/1052117062 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a9814aaa0 con 0x7f5a98072080 2024-05-08T21:50:09.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.441+0000 7f5a9e936700 1 -- 172.21.15.73:0/1052117062 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a98159f20 con 0x7f5a98072080 2024-05-08T21:50:09.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.442+0000 7f5a9e936700 1 -- 172.21.15.73:0/1052117062 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a98068b80 con 0x7f5a98072080 2024-05-08T21:50:09.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.442+0000 7f5a94ff9700 1 -- 172.21.15.73:0/1052117062 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5a8801c460 con 0x7f5a98072080 2024-05-08T21:50:09.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.442+0000 7f5a94ff9700 1 --2- 172.21.15.73:0/1052117062 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f5a8406ac90 0x7f5a8406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:09.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.442+0000 7f5a94ff9700 1 -- 172.21.15.73:0/1052117062 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5a880891f0 con 0x7f5a98072080 2024-05-08T21:50:09.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.442+0000 7f5a977fe700 1 --2- 172.21.15.73:0/1052117062 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f5a8406ac90 0x7f5a8406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:09.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.443+0000 7f5a977fe700 1 --2- 172.21.15.73:0/1052117062 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f5a8406ac90 0x7f5a8406d150 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5a9814bfc0 tx=0x7f5a8c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:09.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.447+0000 7f5a94ff9700 1 -- 172.21.15.73:0/1052117062 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f5a880543d0 con 0x7f5a98072080 2024-05-08T21:50:09.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.638+0000 7f5a9e936700 1 -- 172.21.15.73:0/1052117062 --> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5a980c7de0 con 0x7f5a8406ac90 2024-05-08T21:50:09.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.645+0000 7f5a94ff9700 1 -- 172.21.15.73:0/1052117062 <== mgr.4104 v2:172.21.15.73:6832/46949 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264540 (secure 0 0 0) 0x7f5a8c009dd0 con 0x7f5a8406ac90 2024-05-08T21:50:09.650 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:50:09.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.648+0000 7f5a9e936700 1 -- 172.21.15.73:0/1052117062 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f5a8406ac90 msgr2=0x7f5a8406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:09.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.648+0000 7f5a9e936700 1 --2- 172.21.15.73:0/1052117062 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f5a8406ac90 0x7f5a8406d150 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5a9814bfc0 tx=0x7f5a8c008040 comp rx=0 tx=0).stop 2024-05-08T21:50:09.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.648+0000 7f5a9e936700 1 -- 172.21.15.73:0/1052117062 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a98072080 msgr2=0x7f5a981590d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:09.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.648+0000 7f5a9e936700 1 --2- 172.21.15.73:0/1052117062 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a98072080 0x7f5a981590d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5a8800c500 tx=0x7f5a8800c8c0 comp rx=0 tx=0).stop 2024-05-08T21:50:09.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.648+0000 7f5a9e936700 1 -- 172.21.15.73:0/1052117062 shutdown_connections 2024-05-08T21:50:09.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.648+0000 7f5a9e936700 1 --2- 172.21.15.73:0/1052117062 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f5a8406ac90 0x7f5a8406d150 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:09.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.648+0000 7f5a9e936700 1 --2- 172.21.15.73:0/1052117062 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5a980c3a00 0x7f5a981f0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:09.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.648+0000 7f5a9e936700 1 --2- 172.21.15.73:0/1052117062 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a98072080 0x7f5a981590d0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:09.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.648+0000 7f5a9e936700 1 --2- 172.21.15.73:0/1052117062 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5a980c3490 0x7f5a981561e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:09.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.648+0000 7f5a9e936700 1 -- 172.21.15.73:0/1052117062 >> 172.21.15.73:0/1052117062 conn(0x7f5a98066d70 msgr2=0x7f5a98073b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:50:09.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.648+0000 7f5a9e936700 1 -- 172.21.15.73:0/1052117062 shutdown_connections 2024-05-08T21:50:09.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.648+0000 7f5a9e936700 1 -- 172.21.15.73:0/1052117062 wait complete. 2024-05-08T21:50:09.653 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-05-08T21:50:09.661 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2024-05-08T21:50:07.960576+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218984,"kb_used_data":2856,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755736,"statfs":{"total":773094113280,"available":772869873664,"internally_reserved":0,"allocated":2924544,"data_stored":1770172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002661"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.928360+0000","last_change":"2024-05-08T21:49:43.775912+0000","last_active":"2024-05-08T21:49:44.928360+0000","last_peered":"2024-05-08T21:49:44.928360+0000","last_clean":"2024-05-08T21:49:44.928360+0000","last_became_active":"2024-05-08T21:49:43.775657+0000","last_became_peered":"2024-05-08T21:49:43.775657+0000","last_unstale":"2024-05-08T21:49:44.928360+0000","last_undegraded":"2024-05-08T21:49:44.928360+0000","last_fullsized":"2024-05-08T21:49:44.928360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:10:07.209965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755108+0000","last_change":"2024-05-08T21:49:43.766984+0000","last_active":"2024-05-08T21:49:44.755108+0000","last_peered":"2024-05-08T21:49:44.755108+0000","last_clean":"2024-05-08T21:49:44.755108+0000","last_became_active":"2024-05-08T21:49:43.765995+0000","last_became_peered":"2024-05-08T21:49:43.765995+0000","last_unstale":"2024-05-08T21:49:44.755108+0000","last_undegraded":"2024-05-08T21:49:44.755108+0000","last_fullsized":"2024-05-08T21:49:44.755108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:21:41.238890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.926947+0000","last_change":"2024-05-08T21:49:43.766107+0000","last_active":"2024-05-08T21:49:44.926947+0000","last_peered":"2024-05-08T21:49:44.926947+0000","last_clean":"2024-05-08T21:49:44.926947+0000","last_became_active":"2024-05-08T21:49:43.765874+0000","last_became_peered":"2024-05-08T21:49:43.765874+0000","last_unstale":"2024-05-08T21:49:44.926947+0000","last_undegraded":"2024-05-08T21:49:44.926947+0000","last_fullsized":"2024-05-08T21:49:44.926947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:06:50.769169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757017+0000","last_change":"2024-05-08T21:49:43.766355+0000","last_active":"2024-05-08T21:49:44.757017+0000","last_peered":"2024-05-08T21:49:44.757017+0000","last_clean":"2024-05-08T21:49:44.757017+0000","last_became_active":"2024-05-08T21:49:43.765507+0000","last_became_peered":"2024-05-08T21:49:43.765507+0000","last_unstale":"2024-05-08T21:49:44.757017+0000","last_undegraded":"2024-05-08T21:49:44.757017+0000","last_fullsized":"2024-05-08T21:49:44.757017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:09:09.676078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927361+0000","last_change":"2024-05-08T21:49:43.770346+0000","last_active":"2024-05-08T21:49:44.927361+0000","last_peered":"2024-05-08T21:49:44.927361+0000","last_clean":"2024-05-08T21:49:44.927361+0000","last_became_active":"2024-05-08T21:49:43.770067+0000","last_became_peered":"2024-05-08T21:49:43.770067+0000","last_unstale":"2024-05-08T21:49:44.927361+0000","last_undegraded":"2024-05-08T21:49:44.927361+0000","last_fullsized":"2024-05-08T21:49:44.927361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:04:14.416894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756907+0000","last_change":"2024-05-08T21:49:43.771390+0000","last_active":"2024-05-08T21:49:44.756907+0000","last_peered":"2024-05-08T21:49:44.756907+0000","last_clean":"2024-05-08T21:49:44.756907+0000","last_became_active":"2024-05-08T21:49:43.770893+0000","last_became_peered":"2024-05-08T21:49:43.770893+0000","last_unstale":"2024-05-08T21:49:44.756907+0000","last_undegraded":"2024-05-08T21:49:44.756907+0000","last_fullsized":"2024-05-08T21:49:44.756907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:28.979468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927055+0000","last_change":"2024-05-08T21:49:43.769981+0000","last_active":"2024-05-08T21:49:44.927055+0000","last_peered":"2024-05-08T21:49:44.927055+0000","last_clean":"2024-05-08T21:49:44.927055+0000","last_became_active":"2024-05-08T21:49:43.769667+0000","last_became_peered":"2024-05-08T21:49:43.769667+0000","last_unstale":"2024-05-08T21:49:44.927055+0000","last_undegraded":"2024-05-08T21:49:44.927055+0000","last_fullsized":"2024-05-08T21:49:44.927055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:12:00.381761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927368+0000","last_change":"2024-05-08T21:49:43.771078+0000","last_active":"2024-05-08T21:49:44.927368+0000","last_peered":"2024-05-08T21:49:44.927368+0000","last_clean":"2024-05-08T21:49:44.927368+0000","last_became_active":"2024-05-08T21:49:43.770912+0000","last_became_peered":"2024-05-08T21:49:43.770912+0000","last_unstale":"2024-05-08T21:49:44.927368+0000","last_undegraded":"2024-05-08T21:49:44.927368+0000","last_fullsized":"2024-05-08T21:49:44.927368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:12:00.381761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.928368+0000","last_change":"2024-05-08T21:49:43.775880+0000","last_active":"2024-05-08T21:49:44.928368+0000","last_peered":"2024-05-08T21:49:44.928368+0000","last_clean":"2024-05-08T21:49:44.928368+0000","last_became_active":"2024-05-08T21:49:43.775404+0000","last_became_peered":"2024-05-08T21:49:43.775404+0000","last_unstale":"2024-05-08T21:49:44.928368+0000","last_undegraded":"2024-05-08T21:49:44.928368+0000","last_fullsized":"2024-05-08T21:49:44.928368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:23:24.559669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756369+0000","last_change":"2024-05-08T21:49:43.772784+0000","last_active":"2024-05-08T21:49:44.756369+0000","last_peered":"2024-05-08T21:49:44.756369+0000","last_clean":"2024-05-08T21:49:44.756369+0000","last_became_active":"2024-05-08T21:49:43.772505+0000","last_became_peered":"2024-05-08T21:49:43.772505+0000","last_unstale":"2024-05-08T21:49:44.756369+0000","last_undegraded":"2024-05-08T21:49:44.756369+0000","last_fullsized":"2024-05-08T21:49:44.756369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:19:28.925404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756079+0000","last_change":"2024-05-08T21:49:43.771781+0000","last_active":"2024-05-08T21:49:44.756079+0000","last_peered":"2024-05-08T21:49:44.756079+0000","last_clean":"2024-05-08T21:49:44.756079+0000","last_became_active":"2024-05-08T21:49:43.771457+0000","last_became_peered":"2024-05-08T21:49:43.771457+0000","last_unstale":"2024-05-08T21:49:44.756079+0000","last_undegraded":"2024-05-08T21:49:44.756079+0000","last_fullsized":"2024-05-08T21:49:44.756079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:43.798909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927611+0000","last_change":"2024-05-08T21:49:43.764249+0000","last_active":"2024-05-08T21:49:44.927611+0000","last_peered":"2024-05-08T21:49:44.927611+0000","last_clean":"2024-05-08T21:49:44.927611+0000","last_became_active":"2024-05-08T21:49:43.763986+0000","last_became_peered":"2024-05-08T21:49:43.763986+0000","last_unstale":"2024-05-08T21:49:44.927611+0000","last_undegraded":"2024-05-08T21:49:44.927611+0000","last_fullsized":"2024-05-08T21:49:44.927611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:33:13.833915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927054+0000","last_change":"2024-05-08T21:49:43.761127+0000","last_active":"2024-05-08T21:49:44.927054+0000","last_peered":"2024-05-08T21:49:44.927054+0000","last_clean":"2024-05-08T21:49:44.927054+0000","last_became_active":"2024-05-08T21:49:43.760874+0000","last_became_peered":"2024-05-08T21:49:43.760874+0000","last_unstale":"2024-05-08T21:49:44.927054+0000","last_undegraded":"2024-05-08T21:49:44.927054+0000","last_fullsized":"2024-05-08T21:49:44.927054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:17:34.570817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.926846+0000","last_change":"2024-05-08T21:49:43.765829+0000","last_active":"2024-05-08T21:49:44.926846+0000","last_peered":"2024-05-08T21:49:44.926846+0000","last_clean":"2024-05-08T21:49:44.926846+0000","last_became_active":"2024-05-08T21:49:43.765566+0000","last_became_peered":"2024-05-08T21:49:43.765566+0000","last_unstale":"2024-05-08T21:49:44.926846+0000","last_undegraded":"2024-05-08T21:49:44.926846+0000","last_fullsized":"2024-05-08T21:49:44.926846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:39.954320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.754916+0000","last_change":"2024-05-08T21:49:43.765080+0000","last_active":"2024-05-08T21:49:44.754916+0000","last_peered":"2024-05-08T21:49:44.754916+0000","last_clean":"2024-05-08T21:49:44.754916+0000","last_became_active":"2024-05-08T21:49:43.764810+0000","last_became_peered":"2024-05-08T21:49:43.764810+0000","last_unstale":"2024-05-08T21:49:44.754916+0000","last_undegraded":"2024-05-08T21:49:44.754916+0000","last_fullsized":"2024-05-08T21:49:44.754916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:24:11.223913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756634+0000","last_change":"2024-05-08T21:49:43.766717+0000","last_active":"2024-05-08T21:49:44.756634+0000","last_peered":"2024-05-08T21:49:44.756634+0000","last_clean":"2024-05-08T21:49:44.756634+0000","last_became_active":"2024-05-08T21:49:43.766427+0000","last_became_peered":"2024-05-08T21:49:43.766427+0000","last_unstale":"2024-05-08T21:49:44.756634+0000","last_undegraded":"2024-05-08T21:49:44.756634+0000","last_fullsized":"2024-05-08T21:49:44.756634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:49:22.833820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757256+0000","last_change":"2024-05-08T21:49:43.776929+0000","last_active":"2024-05-08T21:49:44.757256+0000","last_peered":"2024-05-08T21:49:44.757256+0000","last_clean":"2024-05-08T21:49:44.757256+0000","last_became_active":"2024-05-08T21:49:43.776509+0000","last_became_peered":"2024-05-08T21:49:43.776509+0000","last_unstale":"2024-05-08T21:49:44.757256+0000","last_undegraded":"2024-05-08T21:49:44.757256+0000","last_fullsized":"2024-05-08T21:49:44.757256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:26.199459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.926679+0000","last_change":"2024-05-08T21:49:43.762646+0000","last_active":"2024-05-08T21:49:44.926679+0000","last_peered":"2024-05-08T21:49:44.926679+0000","last_clean":"2024-05-08T21:49:44.926679+0000","last_became_active":"2024-05-08T21:49:43.762237+0000","last_became_peered":"2024-05-08T21:49:43.762237+0000","last_unstale":"2024-05-08T21:49:44.926679+0000","last_undegraded":"2024-05-08T21:49:44.926679+0000","last_fullsized":"2024-05-08T21:49:44.926679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:46:08.821947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927249+0000","last_change":"2024-05-08T21:49:43.774729+0000","last_active":"2024-05-08T21:49:44.927249+0000","last_peered":"2024-05-08T21:49:44.927249+0000","last_clean":"2024-05-08T21:49:44.927249+0000","last_became_active":"2024-05-08T21:49:43.774450+0000","last_became_peered":"2024-05-08T21:49:43.774450+0000","last_unstale":"2024-05-08T21:49:44.927249+0000","last_undegraded":"2024-05-08T21:49:44.927249+0000","last_fullsized":"2024-05-08T21:49:44.927249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:25.661350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:48.760475+0000","last_change":"2024-05-08T21:49:43.219461+0000","last_active":"2024-05-08T21:49:48.760475+0000","last_peered":"2024-05-08T21:49:48.760475+0000","last_clean":"2024-05-08T21:49:48.760475+0000","last_became_active":"2024-05-08T21:49:43.219161+0000","last_became_peered":"2024-05-08T21:49:43.219161+0000","last_unstale":"2024-05-08T21:49:48.760475+0000","last_undegraded":"2024-05-08T21:49:48.760475+0000","last_fullsized":"2024-05-08T21:49:48.760475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:02:45.778415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927036+0000","last_change":"2024-05-08T21:49:43.764252+0000","last_active":"2024-05-08T21:49:44.927036+0000","last_peered":"2024-05-08T21:49:44.927036+0000","last_clean":"2024-05-08T21:49:44.927036+0000","last_became_active":"2024-05-08T21:49:43.764045+0000","last_became_peered":"2024-05-08T21:49:43.764045+0000","last_unstale":"2024-05-08T21:49:44.927036+0000","last_undegraded":"2024-05-08T21:49:44.927036+0000","last_fullsized":"2024-05-08T21:49:44.927036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:43.798909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927120+0000","last_change":"2024-05-08T21:49:43.221599+0000","last_active":"2024-05-08T21:49:44.927120+0000","last_peered":"2024-05-08T21:49:44.927120+0000","last_clean":"2024-05-08T21:49:44.927120+0000","last_became_active":"2024-05-08T21:49:43.221309+0000","last_became_peered":"2024-05-08T21:49:43.221309+0000","last_unstale":"2024-05-08T21:49:44.927120+0000","last_undegraded":"2024-05-08T21:49:44.927120+0000","last_fullsized":"2024-05-08T21:49:44.927120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:17.379362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927796+0000","last_change":"2024-05-08T21:49:43.771523+0000","last_active":"2024-05-08T21:49:44.927796+0000","last_peered":"2024-05-08T21:49:44.927796+0000","last_clean":"2024-05-08T21:49:44.927796+0000","last_became_active":"2024-05-08T21:49:43.771295+0000","last_became_peered":"2024-05-08T21:49:43.771295+0000","last_unstale":"2024-05-08T21:49:44.927796+0000","last_undegraded":"2024-05-08T21:49:44.927796+0000","last_fullsized":"2024-05-08T21:49:44.927796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:53:14.774835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:48.755678+0000","last_change":"2024-05-08T21:49:43.226637+0000","last_active":"2024-05-08T21:49:48.755678+0000","last_peered":"2024-05-08T21:49:48.755678+0000","last_clean":"2024-05-08T21:49:48.755678+0000","last_became_active":"2024-05-08T21:49:43.226284+0000","last_became_peered":"2024-05-08T21:49:43.226284+0000","last_unstale":"2024-05-08T21:49:48.755678+0000","last_undegraded":"2024-05-08T21:49:48.755678+0000","last_fullsized":"2024-05-08T21:49:48.755678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:01.844011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756849+0000","last_change":"2024-05-08T21:49:43.766694+0000","last_active":"2024-05-08T21:49:44.756849+0000","last_peered":"2024-05-08T21:49:44.756849+0000","last_clean":"2024-05-08T21:49:44.756849+0000","last_became_active":"2024-05-08T21:49:43.766079+0000","last_became_peered":"2024-05-08T21:49:43.766079+0000","last_unstale":"2024-05-08T21:49:44.756849+0000","last_undegraded":"2024-05-08T21:49:44.756849+0000","last_fullsized":"2024-05-08T21:49:44.756849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:01:16.682080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:48.755619+0000","last_change":"2024-05-08T21:49:43.230152+0000","last_active":"2024-05-08T21:49:48.755619+0000","last_peered":"2024-05-08T21:49:48.755619+0000","last_clean":"2024-05-08T21:49:48.755619+0000","last_became_active":"2024-05-08T21:49:43.229891+0000","last_became_peered":"2024-05-08T21:49:43.229891+0000","last_unstale":"2024-05-08T21:49:48.755619+0000","last_undegraded":"2024-05-08T21:49:48.755619+0000","last_fullsized":"2024-05-08T21:49:48.755619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:33:12.827218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757018+0000","last_change":"2024-05-08T21:49:43.771097+0000","last_active":"2024-05-08T21:49:44.757018+0000","last_peered":"2024-05-08T21:49:44.757018+0000","last_clean":"2024-05-08T21:49:44.757018+0000","last_became_active":"2024-05-08T21:49:43.770727+0000","last_became_peered":"2024-05-08T21:49:43.770727+0000","last_unstale":"2024-05-08T21:49:44.757018+0000","last_undegraded":"2024-05-08T21:49:44.757018+0000","last_fullsized":"2024-05-08T21:49:44.757018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:24:02.741766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927211+0000","last_change":"2024-05-08T21:49:43.220418+0000","last_active":"2024-05-08T21:49:44.927211+0000","last_peered":"2024-05-08T21:49:44.927211+0000","last_clean":"2024-05-08T21:49:44.927211+0000","last_became_active":"2024-05-08T21:49:43.220090+0000","last_became_peered":"2024-05-08T21:49:43.220090+0000","last_unstale":"2024-05-08T21:49:44.927211+0000","last_undegraded":"2024-05-08T21:49:44.927211+0000","last_fullsized":"2024-05-08T21:49:44.927211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:33:28.074468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927692+0000","last_change":"2024-05-08T21:49:43.762664+0000","last_active":"2024-05-08T21:49:44.927692+0000","last_peered":"2024-05-08T21:49:44.927692+0000","last_clean":"2024-05-08T21:49:44.927692+0000","last_became_active":"2024-05-08T21:49:43.762351+0000","last_became_peered":"2024-05-08T21:49:43.762351+0000","last_unstale":"2024-05-08T21:49:44.927692+0000","last_undegraded":"2024-05-08T21:49:44.927692+0000","last_fullsized":"2024-05-08T21:49:44.927692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:53.330614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756121+0000","last_change":"2024-05-08T21:49:43.220518+0000","last_active":"2024-05-08T21:49:44.756121+0000","last_peered":"2024-05-08T21:49:44.756121+0000","last_clean":"2024-05-08T21:49:44.756121+0000","last_became_active":"2024-05-08T21:49:43.218473+0000","last_became_peered":"2024-05-08T21:49:43.218473+0000","last_unstale":"2024-05-08T21:49:44.756121+0000","last_undegraded":"2024-05-08T21:49:44.756121+0000","last_fullsized":"2024-05-08T21:49:44.756121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:10.497167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927324+0000","last_change":"2024-05-08T21:49:43.770935+0000","last_active":"2024-05-08T21:49:44.927324+0000","last_peered":"2024-05-08T21:49:44.927324+0000","last_clean":"2024-05-08T21:49:44.927324+0000","last_became_active":"2024-05-08T21:49:43.770677+0000","last_became_peered":"2024-05-08T21:49:43.770677+0000","last_unstale":"2024-05-08T21:49:44.927324+0000","last_undegraded":"2024-05-08T21:49:44.927324+0000","last_fullsized":"2024-05-08T21:49:44.927324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:04:14.416894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.752777+0000","last_change":"2024-05-08T21:49:43.221027+0000","last_active":"2024-05-08T21:49:43.752777+0000","last_peered":"2024-05-08T21:49:43.752777+0000","last_clean":"2024-05-08T21:49:43.752777+0000","last_became_active":"2024-05-08T21:49:43.220780+0000","last_became_peered":"2024-05-08T21:49:43.220780+0000","last_unstale":"2024-05-08T21:49:43.752777+0000","last_undegraded":"2024-05-08T21:49:43.752777+0000","last_fullsized":"2024-05-08T21:49:43.752777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:20:34.123736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927461+0000","last_change":"2024-05-08T21:49:43.766815+0000","last_active":"2024-05-08T21:49:44.927461+0000","last_peered":"2024-05-08T21:49:44.927461+0000","last_clean":"2024-05-08T21:49:44.927461+0000","last_became_active":"2024-05-08T21:49:43.766568+0000","last_became_peered":"2024-05-08T21:49:43.766568+0000","last_unstale":"2024-05-08T21:49:44.927461+0000","last_undegraded":"2024-05-08T21:49:44.927461+0000","last_fullsized":"2024-05-08T21:49:44.927461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:41:45.602022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756625+0000","last_change":"2024-05-08T21:49:43.225299+0000","last_active":"2024-05-08T21:49:44.756625+0000","last_peered":"2024-05-08T21:49:44.756625+0000","last_clean":"2024-05-08T21:49:44.756625+0000","last_became_active":"2024-05-08T21:49:43.225057+0000","last_became_peered":"2024-05-08T21:49:43.225057+0000","last_unstale":"2024-05-08T21:49:44.756625+0000","last_undegraded":"2024-05-08T21:49:44.756625+0000","last_fullsized":"2024-05-08T21:49:44.756625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:38:43.069159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755021+0000","last_change":"2024-05-08T21:49:43.757361+0000","last_active":"2024-05-08T21:49:44.755021+0000","last_peered":"2024-05-08T21:49:44.755021+0000","last_clean":"2024-05-08T21:49:44.755021+0000","last_became_active":"2024-05-08T21:49:43.757092+0000","last_became_peered":"2024-05-08T21:49:43.757092+0000","last_unstale":"2024-05-08T21:49:44.755021+0000","last_undegraded":"2024-05-08T21:49:44.755021+0000","last_fullsized":"2024-05-08T21:49:44.755021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:24:02.741766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.756381+0000","last_change":"2024-05-08T21:49:43.229405+0000","last_active":"2024-05-08T21:49:43.756381+0000","last_peered":"2024-05-08T21:49:43.756381+0000","last_clean":"2024-05-08T21:49:43.756381+0000","last_became_active":"2024-05-08T21:49:43.229105+0000","last_became_peered":"2024-05-08T21:49:43.229105+0000","last_unstale":"2024-05-08T21:49:43.756381+0000","last_undegraded":"2024-05-08T21:49:43.756381+0000","last_fullsized":"2024-05-08T21:49:43.756381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:18:58.164159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757172+0000","last_change":"2024-05-08T21:49:43.773243+0000","last_active":"2024-05-08T21:49:44.757172+0000","last_peered":"2024-05-08T21:49:44.757172+0000","last_clean":"2024-05-08T21:49:44.757172+0000","last_became_active":"2024-05-08T21:49:43.772944+0000","last_became_peered":"2024-05-08T21:49:43.772944+0000","last_unstale":"2024-05-08T21:49:44.757172+0000","last_undegraded":"2024-05-08T21:49:44.757172+0000","last_fullsized":"2024-05-08T21:49:44.757172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:21:41.238890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757107+0000","last_change":"2024-05-08T21:49:43.224999+0000","last_active":"2024-05-08T21:49:44.757107+0000","last_peered":"2024-05-08T21:49:44.757107+0000","last_clean":"2024-05-08T21:49:44.757107+0000","last_became_active":"2024-05-08T21:49:43.223476+0000","last_became_peered":"2024-05-08T21:49:43.223476+0000","last_unstale":"2024-05-08T21:49:44.757107+0000","last_undegraded":"2024-05-08T21:49:44.757107+0000","last_fullsized":"2024-05-08T21:49:44.757107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:09:12.983430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927734+0000","last_change":"2024-05-08T21:49:43.771526+0000","last_active":"2024-05-08T21:49:44.927734+0000","last_peered":"2024-05-08T21:49:44.927734+0000","last_clean":"2024-05-08T21:49:44.927734+0000","last_became_active":"2024-05-08T21:49:43.771279+0000","last_became_peered":"2024-05-08T21:49:43.771279+0000","last_unstale":"2024-05-08T21:49:44.927734+0000","last_undegraded":"2024-05-08T21:49:44.927734+0000","last_fullsized":"2024-05-08T21:49:44.927734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:41:45.602022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:48.757392+0000","last_change":"2024-05-08T21:49:43.224378+0000","last_active":"2024-05-08T21:49:48.757392+0000","last_peered":"2024-05-08T21:49:48.757392+0000","last_clean":"2024-05-08T21:49:48.757392+0000","last_became_active":"2024-05-08T21:49:43.224164+0000","last_became_peered":"2024-05-08T21:49:43.224164+0000","last_unstale":"2024-05-08T21:49:48.757392+0000","last_undegraded":"2024-05-08T21:49:48.757392+0000","last_fullsized":"2024-05-08T21:49:48.757392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:06:10.276907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927552+0000","last_change":"2024-05-08T21:49:43.772948+0000","last_active":"2024-05-08T21:49:44.927552+0000","last_peered":"2024-05-08T21:49:44.927552+0000","last_clean":"2024-05-08T21:49:44.927552+0000","last_became_active":"2024-05-08T21:49:43.772685+0000","last_became_peered":"2024-05-08T21:49:43.772685+0000","last_unstale":"2024-05-08T21:49:44.927552+0000","last_undegraded":"2024-05-08T21:49:44.927552+0000","last_fullsized":"2024-05-08T21:49:44.927552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:02.850708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:48.760794+0000","last_change":"2024-05-08T21:49:43.222308+0000","last_active":"2024-05-08T21:49:48.760794+0000","last_peered":"2024-05-08T21:49:48.760794+0000","last_clean":"2024-05-08T21:49:48.760794+0000","last_became_active":"2024-05-08T21:49:43.221844+0000","last_became_peered":"2024-05-08T21:49:43.221844+0000","last_unstale":"2024-05-08T21:49:48.760794+0000","last_undegraded":"2024-05-08T21:49:48.760794+0000","last_fullsized":"2024-05-08T21:49:48.760794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:17.379362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927374+0000","last_change":"2024-05-08T21:49:43.773923+0000","last_active":"2024-05-08T21:49:44.927374+0000","last_peered":"2024-05-08T21:49:44.927374+0000","last_clean":"2024-05-08T21:49:44.927374+0000","last_became_active":"2024-05-08T21:49:43.772037+0000","last_became_peered":"2024-05-08T21:49:43.772037+0000","last_unstale":"2024-05-08T21:49:44.927374+0000","last_undegraded":"2024-05-08T21:49:44.927374+0000","last_fullsized":"2024-05-08T21:49:44.927374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:52:32.629407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:48.757374+0000","last_change":"2024-05-08T21:49:43.219473+0000","last_active":"2024-05-08T21:49:48.757374+0000","last_peered":"2024-05-08T21:49:48.757374+0000","last_clean":"2024-05-08T21:49:48.757374+0000","last_became_active":"2024-05-08T21:49:43.219186+0000","last_became_peered":"2024-05-08T21:49:43.219186+0000","last_unstale":"2024-05-08T21:49:48.757374+0000","last_undegraded":"2024-05-08T21:49:48.757374+0000","last_fullsized":"2024-05-08T21:49:48.757374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:20:34.123736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.926751+0000","last_change":"2024-05-08T21:49:43.775135+0000","last_active":"2024-05-08T21:49:44.926751+0000","last_peered":"2024-05-08T21:49:44.926751+0000","last_clean":"2024-05-08T21:49:44.926751+0000","last_became_active":"2024-05-08T21:49:43.774919+0000","last_became_peered":"2024-05-08T21:49:43.774919+0000","last_unstale":"2024-05-08T21:49:44.926751+0000","last_undegraded":"2024-05-08T21:49:44.926751+0000","last_fullsized":"2024-05-08T21:49:44.926751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:01:00.614249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757128+0000","last_change":"2024-05-08T21:49:43.227386+0000","last_active":"2024-05-08T21:49:44.757128+0000","last_peered":"2024-05-08T21:49:44.757128+0000","last_clean":"2024-05-08T21:49:44.757128+0000","last_became_active":"2024-05-08T21:49:43.227065+0000","last_became_peered":"2024-05-08T21:49:43.227065+0000","last_unstale":"2024-05-08T21:49:44.757128+0000","last_undegraded":"2024-05-08T21:49:44.757128+0000","last_fullsized":"2024-05-08T21:49:44.757128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:43:48.019170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927424+0000","last_change":"2024-05-08T21:49:43.770509+0000","last_active":"2024-05-08T21:49:44.927424+0000","last_peered":"2024-05-08T21:49:44.927424+0000","last_clean":"2024-05-08T21:49:44.927424+0000","last_became_active":"2024-05-08T21:49:43.770180+0000","last_became_peered":"2024-05-08T21:49:43.770180+0000","last_unstale":"2024-05-08T21:49:44.927424+0000","last_undegraded":"2024-05-08T21:49:44.927424+0000","last_fullsized":"2024-05-08T21:49:44.927424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:00:38.941899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.756153+0000","last_change":"2024-05-08T21:49:43.220942+0000","last_active":"2024-05-08T21:49:43.756153+0000","last_peered":"2024-05-08T21:49:43.756153+0000","last_clean":"2024-05-08T21:49:43.756153+0000","last_became_active":"2024-05-08T21:49:43.220641+0000","last_became_peered":"2024-05-08T21:49:43.220641+0000","last_unstale":"2024-05-08T21:49:43.756153+0000","last_undegraded":"2024-05-08T21:49:43.756153+0000","last_fullsized":"2024-05-08T21:49:43.756153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:52.323917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755763+0000","last_change":"2024-05-08T21:49:43.766269+0000","last_active":"2024-05-08T21:49:44.755763+0000","last_peered":"2024-05-08T21:49:44.755763+0000","last_clean":"2024-05-08T21:49:44.755763+0000","last_became_active":"2024-05-08T21:49:43.765945+0000","last_became_peered":"2024-05-08T21:49:43.765945+0000","last_unstale":"2024-05-08T21:49:44.755763+0000","last_undegraded":"2024-05-08T21:49:44.755763+0000","last_fullsized":"2024-05-08T21:49:44.755763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:17:34.570817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:48.763472+0000","last_change":"2024-05-08T21:49:43.208328+0000","last_active":"2024-05-08T21:49:48.763472+0000","last_peered":"2024-05-08T21:49:48.763472+0000","last_clean":"2024-05-08T21:49:48.763472+0000","last_became_active":"2024-05-08T21:49:43.208013+0000","last_became_peered":"2024-05-08T21:49:43.208013+0000","last_unstale":"2024-05-08T21:49:48.763472+0000","last_undegraded":"2024-05-08T21:49:48.763472+0000","last_fullsized":"2024-05-08T21:49:48.763472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:10.497167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.928099+0000","last_change":"2024-05-08T21:49:43.774210+0000","last_active":"2024-05-08T21:49:44.928099+0000","last_peered":"2024-05-08T21:49:44.928099+0000","last_clean":"2024-05-08T21:49:44.928099+0000","last_became_active":"2024-05-08T21:49:43.773933+0000","last_became_peered":"2024-05-08T21:49:43.773933+0000","last_unstale":"2024-05-08T21:49:44.928099+0000","last_undegraded":"2024-05-08T21:49:44.928099+0000","last_fullsized":"2024-05-08T21:49:44.928099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:10:25.398535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927899+0000","last_change":"2024-05-08T21:49:43.217456+0000","last_active":"2024-05-08T21:49:44.927899+0000","last_peered":"2024-05-08T21:49:44.927899+0000","last_clean":"2024-05-08T21:49:44.927899+0000","last_became_active":"2024-05-08T21:49:43.216822+0000","last_became_peered":"2024-05-08T21:49:43.216822+0000","last_unstale":"2024-05-08T21:49:44.927899+0000","last_undegraded":"2024-05-08T21:49:44.927899+0000","last_fullsized":"2024-05-08T21:49:44.927899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:41:35.881003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927764+0000","last_change":"2024-05-08T21:49:43.770066+0000","last_active":"2024-05-08T21:49:44.927764+0000","last_peered":"2024-05-08T21:49:44.927764+0000","last_clean":"2024-05-08T21:49:44.927764+0000","last_became_active":"2024-05-08T21:49:43.769762+0000","last_became_peered":"2024-05-08T21:49:43.769762+0000","last_unstale":"2024-05-08T21:49:44.927764+0000","last_undegraded":"2024-05-08T21:49:44.927764+0000","last_fullsized":"2024-05-08T21:49:44.927764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:40:20.301747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755188+0000","last_change":"2024-05-08T21:49:43.215293+0000","last_active":"2024-05-08T21:49:44.755188+0000","last_peered":"2024-05-08T21:49:44.755188+0000","last_clean":"2024-05-08T21:49:44.755188+0000","last_became_active":"2024-05-08T21:49:43.215048+0000","last_became_peered":"2024-05-08T21:49:43.215048+0000","last_unstale":"2024-05-08T21:49:44.755188+0000","last_undegraded":"2024-05-08T21:49:44.755188+0000","last_fullsized":"2024-05-08T21:49:44.755188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:43:48.019170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757129+0000","last_change":"2024-05-08T21:49:43.770326+0000","last_active":"2024-05-08T21:49:44.757129+0000","last_peered":"2024-05-08T21:49:44.757129+0000","last_clean":"2024-05-08T21:49:44.757129+0000","last_became_active":"2024-05-08T21:49:43.770029+0000","last_became_peered":"2024-05-08T21:49:43.770029+0000","last_unstale":"2024-05-08T21:49:44.757129+0000","last_undegraded":"2024-05-08T21:49:44.757129+0000","last_fullsized":"2024-05-08T21:49:44.757129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:33:33.642847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757017+0000","last_change":"2024-05-08T21:49:43.227710+0000","last_active":"2024-05-08T21:49:44.757017+0000","last_peered":"2024-05-08T21:49:44.757017+0000","last_clean":"2024-05-08T21:49:44.757017+0000","last_became_active":"2024-05-08T21:49:43.227430+0000","last_became_peered":"2024-05-08T21:49:43.227430+0000","last_unstale":"2024-05-08T21:49:44.757017+0000","last_undegraded":"2024-05-08T21:49:44.757017+0000","last_fullsized":"2024-05-08T21:49:44.757017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:05:58.875400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.928131+0000","last_change":"2024-05-08T21:49:43.768588+0000","last_active":"2024-05-08T21:49:44.928131+0000","last_peered":"2024-05-08T21:49:44.928131+0000","last_clean":"2024-05-08T21:49:44.928131+0000","last_became_active":"2024-05-08T21:49:43.768307+0000","last_became_peered":"2024-05-08T21:49:43.768307+0000","last_unstale":"2024-05-08T21:49:44.928131+0000","last_undegraded":"2024-05-08T21:49:44.928131+0000","last_fullsized":"2024-05-08T21:49:44.928131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:04.968184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.754953+0000","last_change":"2024-05-08T21:49:43.758618+0000","last_active":"2024-05-08T21:49:44.754953+0000","last_peered":"2024-05-08T21:49:44.754953+0000","last_clean":"2024-05-08T21:49:44.754953+0000","last_became_active":"2024-05-08T21:49:43.758367+0000","last_became_peered":"2024-05-08T21:49:43.758367+0000","last_unstale":"2024-05-08T21:49:44.754953+0000","last_undegraded":"2024-05-08T21:49:44.754953+0000","last_fullsized":"2024-05-08T21:49:44.754953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:30:06.569971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.751866+0000","last_change":"2024-05-08T21:49:43.217410+0000","last_active":"2024-05-08T21:49:43.751866+0000","last_peered":"2024-05-08T21:49:43.751866+0000","last_clean":"2024-05-08T21:49:43.751866+0000","last_became_active":"2024-05-08T21:49:43.217133+0000","last_became_peered":"2024-05-08T21:49:43.217133+0000","last_unstale":"2024-05-08T21:49:43.751866+0000","last_undegraded":"2024-05-08T21:49:43.751866+0000","last_fullsized":"2024-05-08T21:49:43.751866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:17.379362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.926897+0000","last_change":"2024-05-08T21:49:43.771651+0000","last_active":"2024-05-08T21:49:44.926897+0000","last_peered":"2024-05-08T21:49:44.926897+0000","last_clean":"2024-05-08T21:49:44.926897+0000","last_became_active":"2024-05-08T21:49:43.771451+0000","last_became_peered":"2024-05-08T21:49:43.771451+0000","last_unstale":"2024-05-08T21:49:44.926897+0000","last_undegraded":"2024-05-08T21:49:44.926897+0000","last_fullsized":"2024-05-08T21:49:44.926897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:00:38.941899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756759+0000","last_change":"2024-05-08T21:49:43.224929+0000","last_active":"2024-05-08T21:49:44.756759+0000","last_peered":"2024-05-08T21:49:44.756759+0000","last_clean":"2024-05-08T21:49:44.756759+0000","last_became_active":"2024-05-08T21:49:43.223469+0000","last_became_peered":"2024-05-08T21:49:43.223469+0000","last_unstale":"2024-05-08T21:49:44.756759+0000","last_undegraded":"2024-05-08T21:49:44.756759+0000","last_fullsized":"2024-05-08T21:49:44.756759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:27.504127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":164,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.756621+0000","last_change":"2024-05-08T21:49:38.626519+0000","last_active":"2024-05-08T21:49:43.756621+0000","last_peered":"2024-05-08T21:49:43.756621+0000","last_clean":"2024-05-08T21:49:43.756621+0000","last_became_active":"2024-05-08T21:49:38.626159+0000","last_became_peered":"2024-05-08T21:49:38.626159+0000","last_unstale":"2024-05-08T21:49:43.756621+0000","last_undegraded":"2024-05-08T21:49:43.756621+0000","last_fullsized":"2024-05-08T21:49:43.756621+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:36.031649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:36.031649+0000","last_clean_scrub_stamp":"2024-05-08T21:49:36.031649+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:12:04.846500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.926994+0000","last_change":"2024-05-08T21:49:43.770966+0000","last_active":"2024-05-08T21:49:44.926994+0000","last_peered":"2024-05-08T21:49:44.926994+0000","last_clean":"2024-05-08T21:49:44.926994+0000","last_became_active":"2024-05-08T21:49:43.770711+0000","last_became_peered":"2024-05-08T21:49:43.770711+0000","last_unstale":"2024-05-08T21:49:44.926994+0000","last_undegraded":"2024-05-08T21:49:44.926994+0000","last_fullsized":"2024-05-08T21:49:44.926994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:17:34.570817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.756729+0000","last_change":"2024-05-08T21:49:43.221086+0000","last_active":"2024-05-08T21:49:43.756729+0000","last_peered":"2024-05-08T21:49:43.756729+0000","last_clean":"2024-05-08T21:49:43.756729+0000","last_became_active":"2024-05-08T21:49:43.220539+0000","last_became_peered":"2024-05-08T21:49:43.220539+0000","last_unstale":"2024-05-08T21:49:43.756729+0000","last_undegraded":"2024-05-08T21:49:43.756729+0000","last_fullsized":"2024-05-08T21:49:43.756729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:52.323917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.765742+0000","last_change":"2024-05-08T21:49:43.222410+0000","last_active":"2024-05-08T21:49:43.765742+0000","last_peered":"2024-05-08T21:49:43.765742+0000","last_clean":"2024-05-08T21:49:43.765742+0000","last_became_active":"2024-05-08T21:49:43.222131+0000","last_became_peered":"2024-05-08T21:49:43.222131+0000","last_unstale":"2024-05-08T21:49:43.765742+0000","last_undegraded":"2024-05-08T21:49:43.765742+0000","last_fullsized":"2024-05-08T21:49:43.765742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:18:58.164159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755021+0000","last_change":"2024-05-08T21:49:43.758424+0000","last_active":"2024-05-08T21:49:44.755021+0000","last_peered":"2024-05-08T21:49:44.755021+0000","last_clean":"2024-05-08T21:49:44.755021+0000","last_became_active":"2024-05-08T21:49:43.758140+0000","last_became_peered":"2024-05-08T21:49:43.758140+0000","last_unstale":"2024-05-08T21:49:44.755021+0000","last_undegraded":"2024-05-08T21:49:44.755021+0000","last_fullsized":"2024-05-08T21:49:44.755021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:10.795540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:46.015958+0000","last_change":"2024-05-08T21:49:43.218241+0000","last_active":"2024-05-08T21:49:46.015958+0000","last_peered":"2024-05-08T21:49:46.015958+0000","last_clean":"2024-05-08T21:49:46.015958+0000","last_became_active":"2024-05-08T21:49:43.217780+0000","last_became_peered":"2024-05-08T21:49:43.217780+0000","last_unstale":"2024-05-08T21:49:46.015958+0000","last_undegraded":"2024-05-08T21:49:46.015958+0000","last_fullsized":"2024-05-08T21:49:46.015958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:27.504127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927830+0000","last_change":"2024-05-08T21:49:43.770491+0000","last_active":"2024-05-08T21:49:44.927830+0000","last_peered":"2024-05-08T21:49:44.927830+0000","last_clean":"2024-05-08T21:49:44.927830+0000","last_became_active":"2024-05-08T21:49:43.770221+0000","last_became_peered":"2024-05-08T21:49:43.770221+0000","last_unstale":"2024-05-08T21:49:44.927830+0000","last_undegraded":"2024-05-08T21:49:44.927830+0000","last_fullsized":"2024-05-08T21:49:44.927830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:25.661350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:48.755985+0000","last_change":"2024-05-08T21:49:43.221345+0000","last_active":"2024-05-08T21:49:48.755985+0000","last_peered":"2024-05-08T21:49:48.755985+0000","last_clean":"2024-05-08T21:49:48.755985+0000","last_became_active":"2024-05-08T21:49:43.220953+0000","last_became_peered":"2024-05-08T21:49:43.220953+0000","last_unstale":"2024-05-08T21:49:48.755985+0000","last_undegraded":"2024-05-08T21:49:48.755985+0000","last_fullsized":"2024-05-08T21:49:48.755985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:33:28.074468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927636+0000","last_change":"2024-05-08T21:49:43.765001+0000","last_active":"2024-05-08T21:49:44.927636+0000","last_peered":"2024-05-08T21:49:44.927636+0000","last_clean":"2024-05-08T21:49:44.927636+0000","last_became_active":"2024-05-08T21:49:43.764740+0000","last_became_peered":"2024-05-08T21:49:43.764740+0000","last_unstale":"2024-05-08T21:49:44.927636+0000","last_undegraded":"2024-05-08T21:49:44.927636+0000","last_fullsized":"2024-05-08T21:49:44.927636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:18:58.836430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.756521+0000","last_change":"2024-05-08T21:49:43.221251+0000","last_active":"2024-05-08T21:49:43.756521+0000","last_peered":"2024-05-08T21:49:43.756521+0000","last_clean":"2024-05-08T21:49:43.756521+0000","last_became_active":"2024-05-08T21:49:43.220839+0000","last_became_peered":"2024-05-08T21:49:43.220839+0000","last_unstale":"2024-05-08T21:49:43.756521+0000","last_undegraded":"2024-05-08T21:49:43.756521+0000","last_fullsized":"2024-05-08T21:49:43.756521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:10.497167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927485+0000","last_change":"2024-05-08T21:49:43.762511+0000","last_active":"2024-05-08T21:49:44.927485+0000","last_peered":"2024-05-08T21:49:44.927485+0000","last_clean":"2024-05-08T21:49:44.927485+0000","last_became_active":"2024-05-08T21:49:43.762170+0000","last_became_peered":"2024-05-08T21:49:43.762170+0000","last_unstale":"2024-05-08T21:49:44.927485+0000","last_undegraded":"2024-05-08T21:49:44.927485+0000","last_fullsized":"2024-05-08T21:49:44.927485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:11.503864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.754925+0000","last_change":"2024-05-08T21:49:43.215361+0000","last_active":"2024-05-08T21:49:44.754925+0000","last_peered":"2024-05-08T21:49:44.754925+0000","last_clean":"2024-05-08T21:49:44.754925+0000","last_became_active":"2024-05-08T21:49:43.215162+0000","last_became_peered":"2024-05-08T21:49:43.215162+0000","last_unstale":"2024-05-08T21:49:44.754925+0000","last_undegraded":"2024-05-08T21:49:44.754925+0000","last_fullsized":"2024-05-08T21:49:44.754925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:05:58.875400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927416+0000","last_change":"2024-05-08T21:49:43.757512+0000","last_active":"2024-05-08T21:49:44.927416+0000","last_peered":"2024-05-08T21:49:44.927416+0000","last_clean":"2024-05-08T21:49:44.927416+0000","last_became_active":"2024-05-08T21:49:43.757233+0000","last_became_peered":"2024-05-08T21:49:43.757233+0000","last_unstale":"2024-05-08T21:49:44.927416+0000","last_undegraded":"2024-05-08T21:49:44.927416+0000","last_fullsized":"2024-05-08T21:49:44.927416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:53:14.774835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755100+0000","last_change":"2024-05-08T21:49:43.217935+0000","last_active":"2024-05-08T21:49:44.755100+0000","last_peered":"2024-05-08T21:49:44.755100+0000","last_clean":"2024-05-08T21:49:44.755100+0000","last_became_active":"2024-05-08T21:49:43.217595+0000","last_became_peered":"2024-05-08T21:49:43.217595+0000","last_unstale":"2024-05-08T21:49:44.755100+0000","last_undegraded":"2024-05-08T21:49:44.755100+0000","last_fullsized":"2024-05-08T21:49:44.755100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:38:43.069159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927301+0000","last_change":"2024-05-08T21:49:43.766816+0000","last_active":"2024-05-08T21:49:44.927301+0000","last_peered":"2024-05-08T21:49:44.927301+0000","last_clean":"2024-05-08T21:49:44.927301+0000","last_became_active":"2024-05-08T21:49:43.766596+0000","last_became_peered":"2024-05-08T21:49:43.766596+0000","last_unstale":"2024-05-08T21:49:44.927301+0000","last_undegraded":"2024-05-08T21:49:44.927301+0000","last_fullsized":"2024-05-08T21:49:44.927301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:01:00.614249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:48.756361+0000","last_change":"2024-05-08T21:49:43.224243+0000","last_active":"2024-05-08T21:49:48.756361+0000","last_peered":"2024-05-08T21:49:48.756361+0000","last_clean":"2024-05-08T21:49:48.756361+0000","last_became_active":"2024-05-08T21:49:43.223974+0000","last_became_peered":"2024-05-08T21:49:43.223974+0000","last_unstale":"2024-05-08T21:49:48.756361+0000","last_undegraded":"2024-05-08T21:49:48.756361+0000","last_fullsized":"2024-05-08T21:49:48.756361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:03.961487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755912+0000","last_change":"2024-05-08T21:49:43.764377+0000","last_active":"2024-05-08T21:49:44.755912+0000","last_peered":"2024-05-08T21:49:44.755912+0000","last_clean":"2024-05-08T21:49:44.755912+0000","last_became_active":"2024-05-08T21:49:43.764075+0000","last_became_peered":"2024-05-08T21:49:43.764075+0000","last_unstale":"2024-05-08T21:49:44.755912+0000","last_undegraded":"2024-05-08T21:49:44.755912+0000","last_fullsized":"2024-05-08T21:49:44.755912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:41:45.602022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.752001+0000","last_change":"2024-05-08T21:49:43.229414+0000","last_active":"2024-05-08T21:49:43.752001+0000","last_peered":"2024-05-08T21:49:43.752001+0000","last_clean":"2024-05-08T21:49:43.752001+0000","last_became_active":"2024-05-08T21:49:43.229121+0000","last_became_peered":"2024-05-08T21:49:43.229121+0000","last_unstale":"2024-05-08T21:49:43.752001+0000","last_undegraded":"2024-05-08T21:49:43.752001+0000","last_fullsized":"2024-05-08T21:49:43.752001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:33:28.074468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927480+0000","last_change":"2024-05-08T21:49:43.774111+0000","last_active":"2024-05-08T21:49:44.927480+0000","last_peered":"2024-05-08T21:49:44.927480+0000","last_clean":"2024-05-08T21:49:44.927480+0000","last_became_active":"2024-05-08T21:49:43.772528+0000","last_became_peered":"2024-05-08T21:49:43.772528+0000","last_unstale":"2024-05-08T21:49:44.927480+0000","last_undegraded":"2024-05-08T21:49:44.927480+0000","last_fullsized":"2024-05-08T21:49:44.927480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:28.983476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:46.015933+0000","last_change":"2024-05-08T21:49:43.208581+0000","last_active":"2024-05-08T21:49:46.015933+0000","last_peered":"2024-05-08T21:49:46.015933+0000","last_clean":"2024-05-08T21:49:46.015933+0000","last_became_active":"2024-05-08T21:49:43.208326+0000","last_became_peered":"2024-05-08T21:49:43.208326+0000","last_unstale":"2024-05-08T21:49:46.015933+0000","last_undegraded":"2024-05-08T21:49:46.015933+0000","last_fullsized":"2024-05-08T21:49:46.015933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:13:35.461791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756911+0000","last_change":"2024-05-08T21:49:43.766519+0000","last_active":"2024-05-08T21:49:44.756911+0000","last_peered":"2024-05-08T21:49:44.756911+0000","last_clean":"2024-05-08T21:49:44.756911+0000","last_became_active":"2024-05-08T21:49:43.765789+0000","last_became_peered":"2024-05-08T21:49:43.765789+0000","last_unstale":"2024-05-08T21:49:44.756911+0000","last_undegraded":"2024-05-08T21:49:44.756911+0000","last_fullsized":"2024-05-08T21:49:44.756911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:23.674986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:48.757658+0000","last_change":"2024-05-08T21:49:43.218079+0000","last_active":"2024-05-08T21:49:48.757658+0000","last_peered":"2024-05-08T21:49:48.757658+0000","last_clean":"2024-05-08T21:49:48.757658+0000","last_became_active":"2024-05-08T21:49:43.217814+0000","last_became_peered":"2024-05-08T21:49:43.217814+0000","last_unstale":"2024-05-08T21:49:48.757658+0000","last_undegraded":"2024-05-08T21:49:48.757658+0000","last_fullsized":"2024-05-08T21:49:48.757658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:18:58.164159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.928456+0000","last_change":"2024-05-08T21:49:43.775713+0000","last_active":"2024-05-08T21:49:44.928456+0000","last_peered":"2024-05-08T21:49:44.928456+0000","last_clean":"2024-05-08T21:49:44.928456+0000","last_became_active":"2024-05-08T21:49:43.775361+0000","last_became_peered":"2024-05-08T21:49:43.775361+0000","last_unstale":"2024-05-08T21:49:44.928456+0000","last_undegraded":"2024-05-08T21:49:44.928456+0000","last_fullsized":"2024-05-08T21:49:44.928456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:48:24.482146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755727+0000","last_change":"2024-05-08T21:49:43.767129+0000","last_active":"2024-05-08T21:49:44.755727+0000","last_peered":"2024-05-08T21:49:44.755727+0000","last_clean":"2024-05-08T21:49:44.755727+0000","last_became_active":"2024-05-08T21:49:43.766789+0000","last_became_peered":"2024-05-08T21:49:43.766789+0000","last_unstale":"2024-05-08T21:49:44.755727+0000","last_undegraded":"2024-05-08T21:49:44.755727+0000","last_fullsized":"2024-05-08T21:49:44.755727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:39.954320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927246+0000","last_change":"2024-05-08T21:49:43.766157+0000","last_active":"2024-05-08T21:49:44.927246+0000","last_peered":"2024-05-08T21:49:44.927246+0000","last_clean":"2024-05-08T21:49:44.927246+0000","last_became_active":"2024-05-08T21:49:43.765843+0000","last_became_peered":"2024-05-08T21:49:43.765843+0000","last_unstale":"2024-05-08T21:49:44.927246+0000","last_undegraded":"2024-05-08T21:49:44.927246+0000","last_fullsized":"2024-05-08T21:49:44.927246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:04.968184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757080+0000","last_change":"2024-05-08T21:49:43.768929+0000","last_active":"2024-05-08T21:49:44.757080+0000","last_peered":"2024-05-08T21:49:44.757080+0000","last_clean":"2024-05-08T21:49:44.757080+0000","last_became_active":"2024-05-08T21:49:43.767606+0000","last_became_peered":"2024-05-08T21:49:43.767606+0000","last_unstale":"2024-05-08T21:49:44.757080+0000","last_undegraded":"2024-05-08T21:49:44.757080+0000","last_fullsized":"2024-05-08T21:49:44.757080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:13:06.426154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927158+0000","last_change":"2024-05-08T21:49:43.774673+0000","last_active":"2024-05-08T21:49:44.927158+0000","last_peered":"2024-05-08T21:49:44.927158+0000","last_clean":"2024-05-08T21:49:44.927158+0000","last_became_active":"2024-05-08T21:49:43.774406+0000","last_became_peered":"2024-05-08T21:49:43.774406+0000","last_unstale":"2024-05-08T21:49:44.927158+0000","last_undegraded":"2024-05-08T21:49:44.927158+0000","last_fullsized":"2024-05-08T21:49:44.927158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:43.798909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927659+0000","last_change":"2024-05-08T21:49:43.764222+0000","last_active":"2024-05-08T21:49:44.927659+0000","last_peered":"2024-05-08T21:49:44.927659+0000","last_clean":"2024-05-08T21:49:44.927659+0000","last_became_active":"2024-05-08T21:49:43.763937+0000","last_became_peered":"2024-05-08T21:49:43.763937+0000","last_unstale":"2024-05-08T21:49:44.927659+0000","last_undegraded":"2024-05-08T21:49:44.927659+0000","last_fullsized":"2024-05-08T21:49:44.927659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:04:14.416894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755114+0000","last_change":"2024-05-08T21:49:43.757318+0000","last_active":"2024-05-08T21:49:44.755114+0000","last_peered":"2024-05-08T21:49:44.755114+0000","last_clean":"2024-05-08T21:49:44.755114+0000","last_became_active":"2024-05-08T21:49:43.757083+0000","last_became_peered":"2024-05-08T21:49:43.757083+0000","last_unstale":"2024-05-08T21:49:44.755114+0000","last_undegraded":"2024-05-08T21:49:44.755114+0000","last_fullsized":"2024-05-08T21:49:44.755114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:47.551474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756302+0000","last_change":"2024-05-08T21:49:43.773491+0000","last_active":"2024-05-08T21:49:44.756302+0000","last_peered":"2024-05-08T21:49:44.756302+0000","last_clean":"2024-05-08T21:49:44.756302+0000","last_became_active":"2024-05-08T21:49:43.773203+0000","last_became_peered":"2024-05-08T21:49:43.773203+0000","last_unstale":"2024-05-08T21:49:44.756302+0000","last_undegraded":"2024-05-08T21:49:44.756302+0000","last_fullsized":"2024-05-08T21:49:44.756302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:53:14.774835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927776+0000","last_change":"2024-05-08T21:49:43.761926+0000","last_active":"2024-05-08T21:49:44.927776+0000","last_peered":"2024-05-08T21:49:44.927776+0000","last_clean":"2024-05-08T21:49:44.927776+0000","last_became_active":"2024-05-08T21:49:43.761645+0000","last_became_peered":"2024-05-08T21:49:43.761645+0000","last_unstale":"2024-05-08T21:49:44.927776+0000","last_undegraded":"2024-05-08T21:49:44.927776+0000","last_fullsized":"2024-05-08T21:49:44.927776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:10:07.209965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756761+0000","last_change":"2024-05-08T21:49:43.768942+0000","last_active":"2024-05-08T21:49:44.756761+0000","last_peered":"2024-05-08T21:49:44.756761+0000","last_clean":"2024-05-08T21:49:44.756761+0000","last_became_active":"2024-05-08T21:49:43.768673+0000","last_became_peered":"2024-05-08T21:49:43.768673+0000","last_unstale":"2024-05-08T21:49:44.756761+0000","last_undegraded":"2024-05-08T21:49:44.756761+0000","last_fullsized":"2024-05-08T21:49:44.756761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:15:41.869107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927592+0000","last_change":"2024-05-08T21:49:43.766452+0000","last_active":"2024-05-08T21:49:44.927592+0000","last_peered":"2024-05-08T21:49:44.927592+0000","last_clean":"2024-05-08T21:49:44.927592+0000","last_became_active":"2024-05-08T21:49:43.765723+0000","last_became_peered":"2024-05-08T21:49:43.765723+0000","last_unstale":"2024-05-08T21:49:44.927592+0000","last_undegraded":"2024-05-08T21:49:44.927592+0000","last_fullsized":"2024-05-08T21:49:44.927592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:19:28.925404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756863+0000","last_change":"2024-05-08T21:49:43.775098+0000","last_active":"2024-05-08T21:49:44.756863+0000","last_peered":"2024-05-08T21:49:44.756863+0000","last_clean":"2024-05-08T21:49:44.756863+0000","last_became_active":"2024-05-08T21:49:43.774808+0000","last_became_peered":"2024-05-08T21:49:43.774808+0000","last_unstale":"2024-05-08T21:49:44.756863+0000","last_undegraded":"2024-05-08T21:49:44.756863+0000","last_fullsized":"2024-05-08T21:49:44.756863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:51:15.152611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927076+0000","last_change":"2024-05-08T21:49:43.775129+0000","last_active":"2024-05-08T21:49:44.927076+0000","last_peered":"2024-05-08T21:49:44.927076+0000","last_clean":"2024-05-08T21:49:44.927076+0000","last_became_active":"2024-05-08T21:49:43.774881+0000","last_became_peered":"2024-05-08T21:49:43.774881+0000","last_unstale":"2024-05-08T21:49:44.927076+0000","last_undegraded":"2024-05-08T21:49:44.927076+0000","last_fullsized":"2024-05-08T21:49:44.927076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:19:28.925404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756057+0000","last_change":"2024-05-08T21:49:43.764163+0000","last_active":"2024-05-08T21:49:44.756057+0000","last_peered":"2024-05-08T21:49:44.756057+0000","last_clean":"2024-05-08T21:49:44.756057+0000","last_became_active":"2024-05-08T21:49:43.763907+0000","last_became_peered":"2024-05-08T21:49:43.763907+0000","last_unstale":"2024-05-08T21:49:44.756057+0000","last_undegraded":"2024-05-08T21:49:44.756057+0000","last_fullsized":"2024-05-08T21:49:44.756057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:01:00.614249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509450,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":806912,"data_stored":664039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]}]},{"osd":6,"up_from":15,"seq":64424509450,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":221184,"data_stored":74653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":212992,"data_stored":73179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":217088,"data_stored":73249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.313}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509449,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":815104,"data_stored":664095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.254}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]}]},{"osd":2,"up_from":15,"seq":64424509450,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":208896,"data_stored":73089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.222}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":221184,"data_stored":74653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]}]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":221184,"data_stored":73215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T21:50:09.666 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T21:50:09.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.822+0000 7fa0eb811700 1 Processor -- start 2024-05-08T21:50:09.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.822+0000 7fa0eb811700 1 -- start start 2024-05-08T21:50:09.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.823+0000 7fa0eb811700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa0e41540b0 0x7fa0e406afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:09.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.823+0000 7fa0eb811700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa0e4071d70 0x7fa0e40724e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:09.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.823+0000 7fa0eb811700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0e4154490 con 0x7fa0e4072a20 2024-05-08T21:50:09.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.823+0000 7fa0eb811700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0e40c79b0 con 0x7fa0e4071d70 2024-05-08T21:50:09.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.823+0000 7fa0eb811700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e40c7c90 con 0x7fa0e41540b0 2024-05-08T21:50:09.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.823+0000 7fa0e9dae700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fa0e4072a20 0x7fa0e415d530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:58472/0 (socket says 172.21.15.73:58472) 2024-05-08T21:50:09.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.823+0000 7fa0e9dae700 1 -- 172.21.15.73:0/1461102844 learned_addr learned my addr 172.21.15.73:0/1461102844 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:50:09.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.823+0000 7fa0e95ad700 1 --2- 172.21.15.73:0/1461102844 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa0e41540b0 0x7fa0e406afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:09.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.823+0000 7fa0dbfff700 1 -- 172.21.15.73:0/1461102844 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1307763510 0 0) 0x7fa0e4154490 con 0x7fa0e4072a20 2024-05-08T21:50:09.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.823+0000 7fa0e8dac700 1 --2- 172.21.15.73:0/1461102844 >> v2:172.21.15.115:3300/0 conn(0x7fa0e4071d70 0x7fa0e40724e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:09.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.823+0000 7fa0dbfff700 1 -- 172.21.15.73:0/1461102844 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0d00035b0 con 0x7fa0e4072a20 2024-05-08T21:50:09.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.824+0000 7fa0dbfff700 1 -- 172.21.15.73:0/1461102844 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3510214636 0 0) 0x7fa0d00035b0 con 0x7fa0e4072a20 2024-05-08T21:50:09.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.824+0000 7fa0dbfff700 1 -- 172.21.15.73:0/1461102844 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa0e41540b0 msgr2=0x7fa0e406afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:50:09.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.824+0000 7fa0dbfff700 1 --2- 172.21.15.73:0/1461102844 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa0e41540b0 0x7fa0e406afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:09.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.824+0000 7fa0dbfff700 1 -- 172.21.15.73:0/1461102844 >> v2:172.21.15.115:3300/0 conn(0x7fa0e4071d70 msgr2=0x7fa0e40724e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:50:09.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.824+0000 7fa0dbfff700 1 --2- 172.21.15.73:0/1461102844 >> v2:172.21.15.115:3300/0 conn(0x7fa0e4071d70 0x7fa0e40724e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:09.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.824+0000 7fa0dbfff700 1 -- 172.21.15.73:0/1461102844 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e40c7f70 con 0x7fa0e4072a20 2024-05-08T21:50:09.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.824+0000 7fa0dbfff700 1 -- 172.21.15.73:0/1461102844 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 953298616 0 0) 0x7fa0dc0019f0 con 0x7fa0e4072a20 2024-05-08T21:50:09.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.824+0000 7fa0dbfff700 1 -- 172.21.15.73:0/1461102844 >> v1:172.21.15.73:6789/0 conn(0x7fa0e4072a20 legacy=0x7fa0e415d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:09.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.824+0000 7fa0dbfff700 1 --2- 172.21.15.73:0/1461102844 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0d0003a00 0x7fa0d0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:09.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.824+0000 7fa0dbfff700 1 --2- 172.21.15.73:0/1461102844 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa0e41540b0 0x7fa0d0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:09.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.824+0000 7fa0dbfff700 1 --2- 172.21.15.73:0/1461102844 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0d0004d90 0x7fa0d0005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:09.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.824+0000 7fa0dbfff700 1 -- 172.21.15.73:0/1461102844 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e40c79b0 con 0x7fa0d0004d90 2024-05-08T21:50:09.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.824+0000 7fa0dbfff700 1 -- 172.21.15.73:0/1461102844 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e40c7c90 con 0x7fa0d0003a00 2024-05-08T21:50:09.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.824+0000 7fa0dbfff700 1 -- 172.21.15.73:0/1461102844 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d000ba10 con 0x7fa0e41540b0 2024-05-08T21:50:09.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.824+0000 7fa0e9dae700 1 --2- 172.21.15.73:0/1461102844 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0d0004d90 0x7fa0d0005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:09.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.824+0000 7fa0e95ad700 1 --2- 172.21.15.73:0/1461102844 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0d0003a00 0x7fa0d0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:09.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.824+0000 7fa0e8dac700 1 --2- 172.21.15.73:0/1461102844 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa0e41540b0 0x7fa0d0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:09.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.824+0000 7fa0e9dae700 1 -- 172.21.15.73:0/1461102844 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa0e41540b0 msgr2=0x7fa0d0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:50:09.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.824+0000 7fa0e9dae700 1 --2- 172.21.15.73:0/1461102844 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa0e41540b0 0x7fa0d0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:09.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.824+0000 7fa0e9dae700 1 -- 172.21.15.73:0/1461102844 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0d0003a00 msgr2=0x7fa0d0003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:50:09.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.824+0000 7fa0e9dae700 1 --2- 172.21.15.73:0/1461102844 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0d0003a00 0x7fa0d0003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:09.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.824+0000 7fa0e9dae700 1 -- 172.21.15.73:0/1461102844 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0d00035b0 con 0x7fa0d0004d90 2024-05-08T21:50:09.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.824+0000 7fa0e9dae700 1 --2- 172.21.15.73:0/1461102844 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0d0004d90 0x7fa0d0005210 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc00a8d0 tx=0x7fa0d0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37ccc3e6e970924f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:09.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.825+0000 7fa0dbfff700 1 -- 172.21.15.73:0/1461102844 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0dc00a340 con 0x7fa0d0004d90 2024-05-08T21:50:09.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.825+0000 7fa0dbfff700 1 -- 172.21.15.73:0/1461102844 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0dc012600 con 0x7fa0d0004d90 2024-05-08T21:50:09.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.825+0000 7fa0dbfff700 1 -- 172.21.15.73:0/1461102844 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0dc0129b0 con 0x7fa0d0004d90 2024-05-08T21:50:09.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.825+0000 7fa0eb811700 1 -- 172.21.15.73:0/1461102844 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0d0004d90 msgr2=0x7fa0d0005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:09.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.825+0000 7fa0eb811700 1 --2- 172.21.15.73:0/1461102844 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0d0004d90 0x7fa0d0005210 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc00a8d0 tx=0x7fa0d0005880 comp rx=0 tx=0).stop 2024-05-08T21:50:09.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.825+0000 7fa0e9dae700 1 -- 172.21.15.73:0/1461102844 reap_dead start 2024-05-08T21:50:09.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.825+0000 7fa0eb811700 1 -- 172.21.15.73:0/1461102844 shutdown_connections 2024-05-08T21:50:09.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.825+0000 7fa0eb811700 1 -- 172.21.15.73:0/1461102844 >> 172.21.15.73:0/1461102844 conn(0x7fa0e4066d70 msgr2=0x7fa0e40cc500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:50:09.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.825+0000 7fa0eb811700 1 -- 172.21.15.73:0/1461102844 shutdown_connections 2024-05-08T21:50:09.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.825+0000 7fa0eb811700 1 -- 172.21.15.73:0/1461102844 wait complete. 2024-05-08T21:50:09.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.826+0000 7fa0eb811700 1 Processor -- start 2024-05-08T21:50:09.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.826+0000 7fa0eb811700 1 -- start start 2024-05-08T21:50:09.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.827+0000 7fa0eb811700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0e40c6530 0x7fa0e415cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:09.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.827+0000 7fa0eb811700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa0e40c6910 0x7fa0e41f0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:09.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.827+0000 7fa0eb811700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0e4157c00 0x7fa0e41f12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:09.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.827+0000 7fa0eb811700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e41558c0 con 0x7fa0e4157c00 2024-05-08T21:50:09.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.827+0000 7fa0eb811700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e41581d0 con 0x7fa0e40c6530 2024-05-08T21:50:09.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.827+0000 7fa0eb811700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e4156650 con 0x7fa0e40c6910 2024-05-08T21:50:09.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.827+0000 7fa0e9dae700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0e4157c00 0x7fa0e41f12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:09.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.827+0000 7fa0e9dae700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0e4157c00 0x7fa0e41f12c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36452/0 (socket says 172.21.15.73:36452) 2024-05-08T21:50:09.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.827+0000 7fa0e9dae700 1 -- 172.21.15.73:0/1959587511 learned_addr learned my addr 172.21.15.73:0/1959587511 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:50:09.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.827+0000 7fa0e95ad700 1 --2- 172.21.15.73:0/1959587511 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0e40c6530 0x7fa0e415cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:09.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.827+0000 7fa0e8dac700 1 --2- 172.21.15.73:0/1959587511 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa0e40c6910 0x7fa0e41f0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:09.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.828+0000 7fa0e9dae700 1 -- 172.21.15.73:0/1959587511 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa0e40c6910 msgr2=0x7fa0e41f0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:09.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.828+0000 7fa0e9dae700 1 --2- 172.21.15.73:0/1959587511 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa0e40c6910 0x7fa0e41f0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:09.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.828+0000 7fa0e9dae700 1 -- 172.21.15.73:0/1959587511 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0e40c6530 msgr2=0x7fa0e415cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:09.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.828+0000 7fa0e9dae700 1 --2- 172.21.15.73:0/1959587511 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0e40c6530 0x7fa0e415cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:09.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.828+0000 7fa0e9dae700 1 -- 172.21.15.73:0/1959587511 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e4156930 con 0x7fa0e4157c00 2024-05-08T21:50:09.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.828+0000 7fa0e8dac700 1 --2- 172.21.15.73:0/1959587511 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa0e40c6910 0x7fa0e41f0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:50:09.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.828+0000 7fa0e95ad700 1 --2- 172.21.15.73:0/1959587511 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0e40c6530 0x7fa0e415cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:50:09.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.828+0000 7fa0e9dae700 1 --2- 172.21.15.73:0/1959587511 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0e4157c00 0x7fa0e41f12c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc012000 tx=0x7fa0dc001360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:09.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.828+0000 7fa0d9ffb700 1 -- 172.21.15.73:0/1959587511 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0dc00a340 con 0x7fa0e4157c00 2024-05-08T21:50:09.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.828+0000 7fa0d9ffb700 1 -- 172.21.15.73:0/1959587511 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0dc0019c0 con 0x7fa0e4157c00 2024-05-08T21:50:09.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.828+0000 7fa0eb811700 1 -- 172.21.15.73:0/1959587511 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0e4156c10 con 0x7fa0e4157c00 2024-05-08T21:50:09.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.828+0000 7fa0d9ffb700 1 -- 172.21.15.73:0/1959587511 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0dc027410 con 0x7fa0e4157c00 2024-05-08T21:50:09.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.828+0000 7fa0eb811700 1 -- 172.21.15.73:0/1959587511 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0e41571d0 con 0x7fa0e4157c00 2024-05-08T21:50:09.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.829+0000 7fa0eb811700 1 -- 172.21.15.73:0/1959587511 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0e41573f0 con 0x7fa0e4157c00 2024-05-08T21:50:09.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.829+0000 7fa0d9ffb700 1 -- 172.21.15.73:0/1959587511 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa0dc019070 con 0x7fa0e4157c00 2024-05-08T21:50:09.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.830+0000 7fa0d9ffb700 1 --2- 172.21.15.73:0/1959587511 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fa0c806acc0 0x7fa0c806d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:09.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.830+0000 7fa0d9ffb700 1 -- 172.21.15.73:0/1959587511 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa0dc08a740 con 0x7fa0e4157c00 2024-05-08T21:50:09.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.830+0000 7fa0e95ad700 1 --2- 172.21.15.73:0/1959587511 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fa0c806acc0 0x7fa0c806d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:09.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.830+0000 7fa0e95ad700 1 --2- 172.21.15.73:0/1959587511 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fa0c806acc0 0x7fa0c806d180 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4009be0 tx=0x7fa0d4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:09.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:09.834+0000 7fa0d9ffb700 1 -- 172.21.15.73:0/1959587511 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fa0dc0559b0 con 0x7fa0e4157c00 2024-05-08T21:50:10.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.027+0000 7fa0eb811700 1 -- 172.21.15.73:0/1959587511 --> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa0e40c8530 con 0x7fa0c806acc0 2024-05-08T21:50:10.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.034+0000 7fa0d9ffb700 1 -- 172.21.15.73:0/1959587511 <== mgr.4104 v2:172.21.15.73:6832/46949 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264543 (secure 0 0 0) 0x7fa0d4009830 con 0x7fa0c806acc0 2024-05-08T21:50:10.038 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:50:10.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.037+0000 7fa0eb811700 1 -- 172.21.15.73:0/1959587511 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fa0c806acc0 msgr2=0x7fa0c806d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:10.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.037+0000 7fa0eb811700 1 --2- 172.21.15.73:0/1959587511 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fa0c806acc0 0x7fa0c806d180 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4009be0 tx=0x7fa0d4008040 comp rx=0 tx=0).stop 2024-05-08T21:50:10.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.037+0000 7fa0eb811700 1 -- 172.21.15.73:0/1959587511 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0e4157c00 msgr2=0x7fa0e41f12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:10.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.037+0000 7fa0eb811700 1 --2- 172.21.15.73:0/1959587511 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0e4157c00 0x7fa0e41f12c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc012000 tx=0x7fa0dc001360 comp rx=0 tx=0).stop 2024-05-08T21:50:10.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.037+0000 7fa0eb811700 1 -- 172.21.15.73:0/1959587511 shutdown_connections 2024-05-08T21:50:10.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.037+0000 7fa0eb811700 1 --2- 172.21.15.73:0/1959587511 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fa0c806acc0 0x7fa0c806d180 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:10.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.037+0000 7fa0eb811700 1 --2- 172.21.15.73:0/1959587511 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0e4157c00 0x7fa0e41f12c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:10.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.037+0000 7fa0eb811700 1 --2- 172.21.15.73:0/1959587511 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0e40c6530 0x7fa0e415cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:10.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.037+0000 7fa0eb811700 1 --2- 172.21.15.73:0/1959587511 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa0e40c6910 0x7fa0e41f0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:10.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.037+0000 7fa0eb811700 1 -- 172.21.15.73:0/1959587511 >> 172.21.15.73:0/1959587511 conn(0x7fa0e4066d70 msgr2=0x7fa0e406ad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:50:10.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.037+0000 7fa0eb811700 1 -- 172.21.15.73:0/1959587511 shutdown_connections 2024-05-08T21:50:10.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.037+0000 7fa0eb811700 1 -- 172.21.15.73:0/1959587511 wait complete. 2024-05-08T21:50:10.041 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-05-08T21:50:10.051 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2024-05-08T21:50:09.960950+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592992,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218984,"kb_used_data":2856,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755736,"statfs":{"total":773094113280,"available":772869873664,"internally_reserved":0,"allocated":2924544,"data_stored":1770696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":262,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002423"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.928360+0000","last_change":"2024-05-08T21:49:43.775912+0000","last_active":"2024-05-08T21:49:44.928360+0000","last_peered":"2024-05-08T21:49:44.928360+0000","last_clean":"2024-05-08T21:49:44.928360+0000","last_became_active":"2024-05-08T21:49:43.775657+0000","last_became_peered":"2024-05-08T21:49:43.775657+0000","last_unstale":"2024-05-08T21:49:44.928360+0000","last_undegraded":"2024-05-08T21:49:44.928360+0000","last_fullsized":"2024-05-08T21:49:44.928360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:10:07.209965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755108+0000","last_change":"2024-05-08T21:49:43.766984+0000","last_active":"2024-05-08T21:49:44.755108+0000","last_peered":"2024-05-08T21:49:44.755108+0000","last_clean":"2024-05-08T21:49:44.755108+0000","last_became_active":"2024-05-08T21:49:43.765995+0000","last_became_peered":"2024-05-08T21:49:43.765995+0000","last_unstale":"2024-05-08T21:49:44.755108+0000","last_undegraded":"2024-05-08T21:49:44.755108+0000","last_fullsized":"2024-05-08T21:49:44.755108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:21:41.238890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.926947+0000","last_change":"2024-05-08T21:49:43.766107+0000","last_active":"2024-05-08T21:49:44.926947+0000","last_peered":"2024-05-08T21:49:44.926947+0000","last_clean":"2024-05-08T21:49:44.926947+0000","last_became_active":"2024-05-08T21:49:43.765874+0000","last_became_peered":"2024-05-08T21:49:43.765874+0000","last_unstale":"2024-05-08T21:49:44.926947+0000","last_undegraded":"2024-05-08T21:49:44.926947+0000","last_fullsized":"2024-05-08T21:49:44.926947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:06:50.769169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757017+0000","last_change":"2024-05-08T21:49:43.766355+0000","last_active":"2024-05-08T21:49:44.757017+0000","last_peered":"2024-05-08T21:49:44.757017+0000","last_clean":"2024-05-08T21:49:44.757017+0000","last_became_active":"2024-05-08T21:49:43.765507+0000","last_became_peered":"2024-05-08T21:49:43.765507+0000","last_unstale":"2024-05-08T21:49:44.757017+0000","last_undegraded":"2024-05-08T21:49:44.757017+0000","last_fullsized":"2024-05-08T21:49:44.757017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:09:09.676078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927361+0000","last_change":"2024-05-08T21:49:43.770346+0000","last_active":"2024-05-08T21:49:44.927361+0000","last_peered":"2024-05-08T21:49:44.927361+0000","last_clean":"2024-05-08T21:49:44.927361+0000","last_became_active":"2024-05-08T21:49:43.770067+0000","last_became_peered":"2024-05-08T21:49:43.770067+0000","last_unstale":"2024-05-08T21:49:44.927361+0000","last_undegraded":"2024-05-08T21:49:44.927361+0000","last_fullsized":"2024-05-08T21:49:44.927361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:04:14.416894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756907+0000","last_change":"2024-05-08T21:49:43.771390+0000","last_active":"2024-05-08T21:49:44.756907+0000","last_peered":"2024-05-08T21:49:44.756907+0000","last_clean":"2024-05-08T21:49:44.756907+0000","last_became_active":"2024-05-08T21:49:43.770893+0000","last_became_peered":"2024-05-08T21:49:43.770893+0000","last_unstale":"2024-05-08T21:49:44.756907+0000","last_undegraded":"2024-05-08T21:49:44.756907+0000","last_fullsized":"2024-05-08T21:49:44.756907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:28.979468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927055+0000","last_change":"2024-05-08T21:49:43.769981+0000","last_active":"2024-05-08T21:49:44.927055+0000","last_peered":"2024-05-08T21:49:44.927055+0000","last_clean":"2024-05-08T21:49:44.927055+0000","last_became_active":"2024-05-08T21:49:43.769667+0000","last_became_peered":"2024-05-08T21:49:43.769667+0000","last_unstale":"2024-05-08T21:49:44.927055+0000","last_undegraded":"2024-05-08T21:49:44.927055+0000","last_fullsized":"2024-05-08T21:49:44.927055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:12:00.381761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927368+0000","last_change":"2024-05-08T21:49:43.771078+0000","last_active":"2024-05-08T21:49:44.927368+0000","last_peered":"2024-05-08T21:49:44.927368+0000","last_clean":"2024-05-08T21:49:44.927368+0000","last_became_active":"2024-05-08T21:49:43.770912+0000","last_became_peered":"2024-05-08T21:49:43.770912+0000","last_unstale":"2024-05-08T21:49:44.927368+0000","last_undegraded":"2024-05-08T21:49:44.927368+0000","last_fullsized":"2024-05-08T21:49:44.927368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:12:00.381761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.928368+0000","last_change":"2024-05-08T21:49:43.775880+0000","last_active":"2024-05-08T21:49:44.928368+0000","last_peered":"2024-05-08T21:49:44.928368+0000","last_clean":"2024-05-08T21:49:44.928368+0000","last_became_active":"2024-05-08T21:49:43.775404+0000","last_became_peered":"2024-05-08T21:49:43.775404+0000","last_unstale":"2024-05-08T21:49:44.928368+0000","last_undegraded":"2024-05-08T21:49:44.928368+0000","last_fullsized":"2024-05-08T21:49:44.928368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:23:24.559669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756369+0000","last_change":"2024-05-08T21:49:43.772784+0000","last_active":"2024-05-08T21:49:44.756369+0000","last_peered":"2024-05-08T21:49:44.756369+0000","last_clean":"2024-05-08T21:49:44.756369+0000","last_became_active":"2024-05-08T21:49:43.772505+0000","last_became_peered":"2024-05-08T21:49:43.772505+0000","last_unstale":"2024-05-08T21:49:44.756369+0000","last_undegraded":"2024-05-08T21:49:44.756369+0000","last_fullsized":"2024-05-08T21:49:44.756369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:19:28.925404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756079+0000","last_change":"2024-05-08T21:49:43.771781+0000","last_active":"2024-05-08T21:49:44.756079+0000","last_peered":"2024-05-08T21:49:44.756079+0000","last_clean":"2024-05-08T21:49:44.756079+0000","last_became_active":"2024-05-08T21:49:43.771457+0000","last_became_peered":"2024-05-08T21:49:43.771457+0000","last_unstale":"2024-05-08T21:49:44.756079+0000","last_undegraded":"2024-05-08T21:49:44.756079+0000","last_fullsized":"2024-05-08T21:49:44.756079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:43.798909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927611+0000","last_change":"2024-05-08T21:49:43.764249+0000","last_active":"2024-05-08T21:49:44.927611+0000","last_peered":"2024-05-08T21:49:44.927611+0000","last_clean":"2024-05-08T21:49:44.927611+0000","last_became_active":"2024-05-08T21:49:43.763986+0000","last_became_peered":"2024-05-08T21:49:43.763986+0000","last_unstale":"2024-05-08T21:49:44.927611+0000","last_undegraded":"2024-05-08T21:49:44.927611+0000","last_fullsized":"2024-05-08T21:49:44.927611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:33:13.833915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927054+0000","last_change":"2024-05-08T21:49:43.761127+0000","last_active":"2024-05-08T21:49:44.927054+0000","last_peered":"2024-05-08T21:49:44.927054+0000","last_clean":"2024-05-08T21:49:44.927054+0000","last_became_active":"2024-05-08T21:49:43.760874+0000","last_became_peered":"2024-05-08T21:49:43.760874+0000","last_unstale":"2024-05-08T21:49:44.927054+0000","last_undegraded":"2024-05-08T21:49:44.927054+0000","last_fullsized":"2024-05-08T21:49:44.927054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:17:34.570817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.926846+0000","last_change":"2024-05-08T21:49:43.765829+0000","last_active":"2024-05-08T21:49:44.926846+0000","last_peered":"2024-05-08T21:49:44.926846+0000","last_clean":"2024-05-08T21:49:44.926846+0000","last_became_active":"2024-05-08T21:49:43.765566+0000","last_became_peered":"2024-05-08T21:49:43.765566+0000","last_unstale":"2024-05-08T21:49:44.926846+0000","last_undegraded":"2024-05-08T21:49:44.926846+0000","last_fullsized":"2024-05-08T21:49:44.926846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:39.954320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.754916+0000","last_change":"2024-05-08T21:49:43.765080+0000","last_active":"2024-05-08T21:49:44.754916+0000","last_peered":"2024-05-08T21:49:44.754916+0000","last_clean":"2024-05-08T21:49:44.754916+0000","last_became_active":"2024-05-08T21:49:43.764810+0000","last_became_peered":"2024-05-08T21:49:43.764810+0000","last_unstale":"2024-05-08T21:49:44.754916+0000","last_undegraded":"2024-05-08T21:49:44.754916+0000","last_fullsized":"2024-05-08T21:49:44.754916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:24:11.223913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756634+0000","last_change":"2024-05-08T21:49:43.766717+0000","last_active":"2024-05-08T21:49:44.756634+0000","last_peered":"2024-05-08T21:49:44.756634+0000","last_clean":"2024-05-08T21:49:44.756634+0000","last_became_active":"2024-05-08T21:49:43.766427+0000","last_became_peered":"2024-05-08T21:49:43.766427+0000","last_unstale":"2024-05-08T21:49:44.756634+0000","last_undegraded":"2024-05-08T21:49:44.756634+0000","last_fullsized":"2024-05-08T21:49:44.756634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:49:22.833820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757256+0000","last_change":"2024-05-08T21:49:43.776929+0000","last_active":"2024-05-08T21:49:44.757256+0000","last_peered":"2024-05-08T21:49:44.757256+0000","last_clean":"2024-05-08T21:49:44.757256+0000","last_became_active":"2024-05-08T21:49:43.776509+0000","last_became_peered":"2024-05-08T21:49:43.776509+0000","last_unstale":"2024-05-08T21:49:44.757256+0000","last_undegraded":"2024-05-08T21:49:44.757256+0000","last_fullsized":"2024-05-08T21:49:44.757256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:26.199459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.926679+0000","last_change":"2024-05-08T21:49:43.762646+0000","last_active":"2024-05-08T21:49:44.926679+0000","last_peered":"2024-05-08T21:49:44.926679+0000","last_clean":"2024-05-08T21:49:44.926679+0000","last_became_active":"2024-05-08T21:49:43.762237+0000","last_became_peered":"2024-05-08T21:49:43.762237+0000","last_unstale":"2024-05-08T21:49:44.926679+0000","last_undegraded":"2024-05-08T21:49:44.926679+0000","last_fullsized":"2024-05-08T21:49:44.926679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:46:08.821947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927249+0000","last_change":"2024-05-08T21:49:43.774729+0000","last_active":"2024-05-08T21:49:44.927249+0000","last_peered":"2024-05-08T21:49:44.927249+0000","last_clean":"2024-05-08T21:49:44.927249+0000","last_became_active":"2024-05-08T21:49:43.774450+0000","last_became_peered":"2024-05-08T21:49:43.774450+0000","last_unstale":"2024-05-08T21:49:44.927249+0000","last_undegraded":"2024-05-08T21:49:44.927249+0000","last_fullsized":"2024-05-08T21:49:44.927249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:25.661350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:48.760475+0000","last_change":"2024-05-08T21:49:43.219461+0000","last_active":"2024-05-08T21:49:48.760475+0000","last_peered":"2024-05-08T21:49:48.760475+0000","last_clean":"2024-05-08T21:49:48.760475+0000","last_became_active":"2024-05-08T21:49:43.219161+0000","last_became_peered":"2024-05-08T21:49:43.219161+0000","last_unstale":"2024-05-08T21:49:48.760475+0000","last_undegraded":"2024-05-08T21:49:48.760475+0000","last_fullsized":"2024-05-08T21:49:48.760475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:02:45.778415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927036+0000","last_change":"2024-05-08T21:49:43.764252+0000","last_active":"2024-05-08T21:49:44.927036+0000","last_peered":"2024-05-08T21:49:44.927036+0000","last_clean":"2024-05-08T21:49:44.927036+0000","last_became_active":"2024-05-08T21:49:43.764045+0000","last_became_peered":"2024-05-08T21:49:43.764045+0000","last_unstale":"2024-05-08T21:49:44.927036+0000","last_undegraded":"2024-05-08T21:49:44.927036+0000","last_fullsized":"2024-05-08T21:49:44.927036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:43.798909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927120+0000","last_change":"2024-05-08T21:49:43.221599+0000","last_active":"2024-05-08T21:49:44.927120+0000","last_peered":"2024-05-08T21:49:44.927120+0000","last_clean":"2024-05-08T21:49:44.927120+0000","last_became_active":"2024-05-08T21:49:43.221309+0000","last_became_peered":"2024-05-08T21:49:43.221309+0000","last_unstale":"2024-05-08T21:49:44.927120+0000","last_undegraded":"2024-05-08T21:49:44.927120+0000","last_fullsized":"2024-05-08T21:49:44.927120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:17.379362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927796+0000","last_change":"2024-05-08T21:49:43.771523+0000","last_active":"2024-05-08T21:49:44.927796+0000","last_peered":"2024-05-08T21:49:44.927796+0000","last_clean":"2024-05-08T21:49:44.927796+0000","last_became_active":"2024-05-08T21:49:43.771295+0000","last_became_peered":"2024-05-08T21:49:43.771295+0000","last_unstale":"2024-05-08T21:49:44.927796+0000","last_undegraded":"2024-05-08T21:49:44.927796+0000","last_fullsized":"2024-05-08T21:49:44.927796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:53:14.774835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:48.755678+0000","last_change":"2024-05-08T21:49:43.226637+0000","last_active":"2024-05-08T21:49:48.755678+0000","last_peered":"2024-05-08T21:49:48.755678+0000","last_clean":"2024-05-08T21:49:48.755678+0000","last_became_active":"2024-05-08T21:49:43.226284+0000","last_became_peered":"2024-05-08T21:49:43.226284+0000","last_unstale":"2024-05-08T21:49:48.755678+0000","last_undegraded":"2024-05-08T21:49:48.755678+0000","last_fullsized":"2024-05-08T21:49:48.755678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:01.844011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756849+0000","last_change":"2024-05-08T21:49:43.766694+0000","last_active":"2024-05-08T21:49:44.756849+0000","last_peered":"2024-05-08T21:49:44.756849+0000","last_clean":"2024-05-08T21:49:44.756849+0000","last_became_active":"2024-05-08T21:49:43.766079+0000","last_became_peered":"2024-05-08T21:49:43.766079+0000","last_unstale":"2024-05-08T21:49:44.756849+0000","last_undegraded":"2024-05-08T21:49:44.756849+0000","last_fullsized":"2024-05-08T21:49:44.756849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:01:16.682080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:48.755619+0000","last_change":"2024-05-08T21:49:43.230152+0000","last_active":"2024-05-08T21:49:48.755619+0000","last_peered":"2024-05-08T21:49:48.755619+0000","last_clean":"2024-05-08T21:49:48.755619+0000","last_became_active":"2024-05-08T21:49:43.229891+0000","last_became_peered":"2024-05-08T21:49:43.229891+0000","last_unstale":"2024-05-08T21:49:48.755619+0000","last_undegraded":"2024-05-08T21:49:48.755619+0000","last_fullsized":"2024-05-08T21:49:48.755619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:33:12.827218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757018+0000","last_change":"2024-05-08T21:49:43.771097+0000","last_active":"2024-05-08T21:49:44.757018+0000","last_peered":"2024-05-08T21:49:44.757018+0000","last_clean":"2024-05-08T21:49:44.757018+0000","last_became_active":"2024-05-08T21:49:43.770727+0000","last_became_peered":"2024-05-08T21:49:43.770727+0000","last_unstale":"2024-05-08T21:49:44.757018+0000","last_undegraded":"2024-05-08T21:49:44.757018+0000","last_fullsized":"2024-05-08T21:49:44.757018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:24:02.741766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927211+0000","last_change":"2024-05-08T21:49:43.220418+0000","last_active":"2024-05-08T21:49:44.927211+0000","last_peered":"2024-05-08T21:49:44.927211+0000","last_clean":"2024-05-08T21:49:44.927211+0000","last_became_active":"2024-05-08T21:49:43.220090+0000","last_became_peered":"2024-05-08T21:49:43.220090+0000","last_unstale":"2024-05-08T21:49:44.927211+0000","last_undegraded":"2024-05-08T21:49:44.927211+0000","last_fullsized":"2024-05-08T21:49:44.927211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:33:28.074468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927692+0000","last_change":"2024-05-08T21:49:43.762664+0000","last_active":"2024-05-08T21:49:44.927692+0000","last_peered":"2024-05-08T21:49:44.927692+0000","last_clean":"2024-05-08T21:49:44.927692+0000","last_became_active":"2024-05-08T21:49:43.762351+0000","last_became_peered":"2024-05-08T21:49:43.762351+0000","last_unstale":"2024-05-08T21:49:44.927692+0000","last_undegraded":"2024-05-08T21:49:44.927692+0000","last_fullsized":"2024-05-08T21:49:44.927692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:53.330614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756121+0000","last_change":"2024-05-08T21:49:43.220518+0000","last_active":"2024-05-08T21:49:44.756121+0000","last_peered":"2024-05-08T21:49:44.756121+0000","last_clean":"2024-05-08T21:49:44.756121+0000","last_became_active":"2024-05-08T21:49:43.218473+0000","last_became_peered":"2024-05-08T21:49:43.218473+0000","last_unstale":"2024-05-08T21:49:44.756121+0000","last_undegraded":"2024-05-08T21:49:44.756121+0000","last_fullsized":"2024-05-08T21:49:44.756121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:10.497167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927324+0000","last_change":"2024-05-08T21:49:43.770935+0000","last_active":"2024-05-08T21:49:44.927324+0000","last_peered":"2024-05-08T21:49:44.927324+0000","last_clean":"2024-05-08T21:49:44.927324+0000","last_became_active":"2024-05-08T21:49:43.770677+0000","last_became_peered":"2024-05-08T21:49:43.770677+0000","last_unstale":"2024-05-08T21:49:44.927324+0000","last_undegraded":"2024-05-08T21:49:44.927324+0000","last_fullsized":"2024-05-08T21:49:44.927324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:04:14.416894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.752777+0000","last_change":"2024-05-08T21:49:43.221027+0000","last_active":"2024-05-08T21:49:43.752777+0000","last_peered":"2024-05-08T21:49:43.752777+0000","last_clean":"2024-05-08T21:49:43.752777+0000","last_became_active":"2024-05-08T21:49:43.220780+0000","last_became_peered":"2024-05-08T21:49:43.220780+0000","last_unstale":"2024-05-08T21:49:43.752777+0000","last_undegraded":"2024-05-08T21:49:43.752777+0000","last_fullsized":"2024-05-08T21:49:43.752777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:20:34.123736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927461+0000","last_change":"2024-05-08T21:49:43.766815+0000","last_active":"2024-05-08T21:49:44.927461+0000","last_peered":"2024-05-08T21:49:44.927461+0000","last_clean":"2024-05-08T21:49:44.927461+0000","last_became_active":"2024-05-08T21:49:43.766568+0000","last_became_peered":"2024-05-08T21:49:43.766568+0000","last_unstale":"2024-05-08T21:49:44.927461+0000","last_undegraded":"2024-05-08T21:49:44.927461+0000","last_fullsized":"2024-05-08T21:49:44.927461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:41:45.602022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756625+0000","last_change":"2024-05-08T21:49:43.225299+0000","last_active":"2024-05-08T21:49:44.756625+0000","last_peered":"2024-05-08T21:49:44.756625+0000","last_clean":"2024-05-08T21:49:44.756625+0000","last_became_active":"2024-05-08T21:49:43.225057+0000","last_became_peered":"2024-05-08T21:49:43.225057+0000","last_unstale":"2024-05-08T21:49:44.756625+0000","last_undegraded":"2024-05-08T21:49:44.756625+0000","last_fullsized":"2024-05-08T21:49:44.756625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:38:43.069159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755021+0000","last_change":"2024-05-08T21:49:43.757361+0000","last_active":"2024-05-08T21:49:44.755021+0000","last_peered":"2024-05-08T21:49:44.755021+0000","last_clean":"2024-05-08T21:49:44.755021+0000","last_became_active":"2024-05-08T21:49:43.757092+0000","last_became_peered":"2024-05-08T21:49:43.757092+0000","last_unstale":"2024-05-08T21:49:44.755021+0000","last_undegraded":"2024-05-08T21:49:44.755021+0000","last_fullsized":"2024-05-08T21:49:44.755021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:24:02.741766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.756381+0000","last_change":"2024-05-08T21:49:43.229405+0000","last_active":"2024-05-08T21:49:43.756381+0000","last_peered":"2024-05-08T21:49:43.756381+0000","last_clean":"2024-05-08T21:49:43.756381+0000","last_became_active":"2024-05-08T21:49:43.229105+0000","last_became_peered":"2024-05-08T21:49:43.229105+0000","last_unstale":"2024-05-08T21:49:43.756381+0000","last_undegraded":"2024-05-08T21:49:43.756381+0000","last_fullsized":"2024-05-08T21:49:43.756381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:18:58.164159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757172+0000","last_change":"2024-05-08T21:49:43.773243+0000","last_active":"2024-05-08T21:49:44.757172+0000","last_peered":"2024-05-08T21:49:44.757172+0000","last_clean":"2024-05-08T21:49:44.757172+0000","last_became_active":"2024-05-08T21:49:43.772944+0000","last_became_peered":"2024-05-08T21:49:43.772944+0000","last_unstale":"2024-05-08T21:49:44.757172+0000","last_undegraded":"2024-05-08T21:49:44.757172+0000","last_fullsized":"2024-05-08T21:49:44.757172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:21:41.238890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757107+0000","last_change":"2024-05-08T21:49:43.224999+0000","last_active":"2024-05-08T21:49:44.757107+0000","last_peered":"2024-05-08T21:49:44.757107+0000","last_clean":"2024-05-08T21:49:44.757107+0000","last_became_active":"2024-05-08T21:49:43.223476+0000","last_became_peered":"2024-05-08T21:49:43.223476+0000","last_unstale":"2024-05-08T21:49:44.757107+0000","last_undegraded":"2024-05-08T21:49:44.757107+0000","last_fullsized":"2024-05-08T21:49:44.757107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:09:12.983430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927734+0000","last_change":"2024-05-08T21:49:43.771526+0000","last_active":"2024-05-08T21:49:44.927734+0000","last_peered":"2024-05-08T21:49:44.927734+0000","last_clean":"2024-05-08T21:49:44.927734+0000","last_became_active":"2024-05-08T21:49:43.771279+0000","last_became_peered":"2024-05-08T21:49:43.771279+0000","last_unstale":"2024-05-08T21:49:44.927734+0000","last_undegraded":"2024-05-08T21:49:44.927734+0000","last_fullsized":"2024-05-08T21:49:44.927734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:41:45.602022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:48.757392+0000","last_change":"2024-05-08T21:49:43.224378+0000","last_active":"2024-05-08T21:49:48.757392+0000","last_peered":"2024-05-08T21:49:48.757392+0000","last_clean":"2024-05-08T21:49:48.757392+0000","last_became_active":"2024-05-08T21:49:43.224164+0000","last_became_peered":"2024-05-08T21:49:43.224164+0000","last_unstale":"2024-05-08T21:49:48.757392+0000","last_undegraded":"2024-05-08T21:49:48.757392+0000","last_fullsized":"2024-05-08T21:49:48.757392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:06:10.276907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927552+0000","last_change":"2024-05-08T21:49:43.772948+0000","last_active":"2024-05-08T21:49:44.927552+0000","last_peered":"2024-05-08T21:49:44.927552+0000","last_clean":"2024-05-08T21:49:44.927552+0000","last_became_active":"2024-05-08T21:49:43.772685+0000","last_became_peered":"2024-05-08T21:49:43.772685+0000","last_unstale":"2024-05-08T21:49:44.927552+0000","last_undegraded":"2024-05-08T21:49:44.927552+0000","last_fullsized":"2024-05-08T21:49:44.927552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:02.850708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'8","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:50:05.715264+0000","last_change":"2024-05-08T21:49:43.222308+0000","last_active":"2024-05-08T21:50:05.715264+0000","last_peered":"2024-05-08T21:50:05.715264+0000","last_clean":"2024-05-08T21:50:05.715264+0000","last_became_active":"2024-05-08T21:49:43.221844+0000","last_became_peered":"2024-05-08T21:49:43.221844+0000","last_unstale":"2024-05-08T21:50:05.715264+0000","last_undegraded":"2024-05-08T21:50:05.715264+0000","last_fullsized":"2024-05-08T21:50:05.715264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:17.379362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1826,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927374+0000","last_change":"2024-05-08T21:49:43.773923+0000","last_active":"2024-05-08T21:49:44.927374+0000","last_peered":"2024-05-08T21:49:44.927374+0000","last_clean":"2024-05-08T21:49:44.927374+0000","last_became_active":"2024-05-08T21:49:43.772037+0000","last_became_peered":"2024-05-08T21:49:43.772037+0000","last_unstale":"2024-05-08T21:49:44.927374+0000","last_undegraded":"2024-05-08T21:49:44.927374+0000","last_fullsized":"2024-05-08T21:49:44.927374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:52:32.629407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:48.757374+0000","last_change":"2024-05-08T21:49:43.219473+0000","last_active":"2024-05-08T21:49:48.757374+0000","last_peered":"2024-05-08T21:49:48.757374+0000","last_clean":"2024-05-08T21:49:48.757374+0000","last_became_active":"2024-05-08T21:49:43.219186+0000","last_became_peered":"2024-05-08T21:49:43.219186+0000","last_unstale":"2024-05-08T21:49:48.757374+0000","last_undegraded":"2024-05-08T21:49:48.757374+0000","last_fullsized":"2024-05-08T21:49:48.757374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:20:34.123736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.926751+0000","last_change":"2024-05-08T21:49:43.775135+0000","last_active":"2024-05-08T21:49:44.926751+0000","last_peered":"2024-05-08T21:49:44.926751+0000","last_clean":"2024-05-08T21:49:44.926751+0000","last_became_active":"2024-05-08T21:49:43.774919+0000","last_became_peered":"2024-05-08T21:49:43.774919+0000","last_unstale":"2024-05-08T21:49:44.926751+0000","last_undegraded":"2024-05-08T21:49:44.926751+0000","last_fullsized":"2024-05-08T21:49:44.926751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:01:00.614249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757128+0000","last_change":"2024-05-08T21:49:43.227386+0000","last_active":"2024-05-08T21:49:44.757128+0000","last_peered":"2024-05-08T21:49:44.757128+0000","last_clean":"2024-05-08T21:49:44.757128+0000","last_became_active":"2024-05-08T21:49:43.227065+0000","last_became_peered":"2024-05-08T21:49:43.227065+0000","last_unstale":"2024-05-08T21:49:44.757128+0000","last_undegraded":"2024-05-08T21:49:44.757128+0000","last_fullsized":"2024-05-08T21:49:44.757128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:43:48.019170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927424+0000","last_change":"2024-05-08T21:49:43.770509+0000","last_active":"2024-05-08T21:49:44.927424+0000","last_peered":"2024-05-08T21:49:44.927424+0000","last_clean":"2024-05-08T21:49:44.927424+0000","last_became_active":"2024-05-08T21:49:43.770180+0000","last_became_peered":"2024-05-08T21:49:43.770180+0000","last_unstale":"2024-05-08T21:49:44.927424+0000","last_undegraded":"2024-05-08T21:49:44.927424+0000","last_fullsized":"2024-05-08T21:49:44.927424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:00:38.941899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.756153+0000","last_change":"2024-05-08T21:49:43.220942+0000","last_active":"2024-05-08T21:49:43.756153+0000","last_peered":"2024-05-08T21:49:43.756153+0000","last_clean":"2024-05-08T21:49:43.756153+0000","last_became_active":"2024-05-08T21:49:43.220641+0000","last_became_peered":"2024-05-08T21:49:43.220641+0000","last_unstale":"2024-05-08T21:49:43.756153+0000","last_undegraded":"2024-05-08T21:49:43.756153+0000","last_fullsized":"2024-05-08T21:49:43.756153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:52.323917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755763+0000","last_change":"2024-05-08T21:49:43.766269+0000","last_active":"2024-05-08T21:49:44.755763+0000","last_peered":"2024-05-08T21:49:44.755763+0000","last_clean":"2024-05-08T21:49:44.755763+0000","last_became_active":"2024-05-08T21:49:43.765945+0000","last_became_peered":"2024-05-08T21:49:43.765945+0000","last_unstale":"2024-05-08T21:49:44.755763+0000","last_undegraded":"2024-05-08T21:49:44.755763+0000","last_fullsized":"2024-05-08T21:49:44.755763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:17:34.570817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:48.763472+0000","last_change":"2024-05-08T21:49:43.208328+0000","last_active":"2024-05-08T21:49:48.763472+0000","last_peered":"2024-05-08T21:49:48.763472+0000","last_clean":"2024-05-08T21:49:48.763472+0000","last_became_active":"2024-05-08T21:49:43.208013+0000","last_became_peered":"2024-05-08T21:49:43.208013+0000","last_unstale":"2024-05-08T21:49:48.763472+0000","last_undegraded":"2024-05-08T21:49:48.763472+0000","last_fullsized":"2024-05-08T21:49:48.763472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:10.497167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.928099+0000","last_change":"2024-05-08T21:49:43.774210+0000","last_active":"2024-05-08T21:49:44.928099+0000","last_peered":"2024-05-08T21:49:44.928099+0000","last_clean":"2024-05-08T21:49:44.928099+0000","last_became_active":"2024-05-08T21:49:43.773933+0000","last_became_peered":"2024-05-08T21:49:43.773933+0000","last_unstale":"2024-05-08T21:49:44.928099+0000","last_undegraded":"2024-05-08T21:49:44.928099+0000","last_fullsized":"2024-05-08T21:49:44.928099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:10:25.398535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927899+0000","last_change":"2024-05-08T21:49:43.217456+0000","last_active":"2024-05-08T21:49:44.927899+0000","last_peered":"2024-05-08T21:49:44.927899+0000","last_clean":"2024-05-08T21:49:44.927899+0000","last_became_active":"2024-05-08T21:49:43.216822+0000","last_became_peered":"2024-05-08T21:49:43.216822+0000","last_unstale":"2024-05-08T21:49:44.927899+0000","last_undegraded":"2024-05-08T21:49:44.927899+0000","last_fullsized":"2024-05-08T21:49:44.927899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:41:35.881003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927764+0000","last_change":"2024-05-08T21:49:43.770066+0000","last_active":"2024-05-08T21:49:44.927764+0000","last_peered":"2024-05-08T21:49:44.927764+0000","last_clean":"2024-05-08T21:49:44.927764+0000","last_became_active":"2024-05-08T21:49:43.769762+0000","last_became_peered":"2024-05-08T21:49:43.769762+0000","last_unstale":"2024-05-08T21:49:44.927764+0000","last_undegraded":"2024-05-08T21:49:44.927764+0000","last_fullsized":"2024-05-08T21:49:44.927764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:40:20.301747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755188+0000","last_change":"2024-05-08T21:49:43.215293+0000","last_active":"2024-05-08T21:49:44.755188+0000","last_peered":"2024-05-08T21:49:44.755188+0000","last_clean":"2024-05-08T21:49:44.755188+0000","last_became_active":"2024-05-08T21:49:43.215048+0000","last_became_peered":"2024-05-08T21:49:43.215048+0000","last_unstale":"2024-05-08T21:49:44.755188+0000","last_undegraded":"2024-05-08T21:49:44.755188+0000","last_fullsized":"2024-05-08T21:49:44.755188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:43:48.019170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757129+0000","last_change":"2024-05-08T21:49:43.770326+0000","last_active":"2024-05-08T21:49:44.757129+0000","last_peered":"2024-05-08T21:49:44.757129+0000","last_clean":"2024-05-08T21:49:44.757129+0000","last_became_active":"2024-05-08T21:49:43.770029+0000","last_became_peered":"2024-05-08T21:49:43.770029+0000","last_unstale":"2024-05-08T21:49:44.757129+0000","last_undegraded":"2024-05-08T21:49:44.757129+0000","last_fullsized":"2024-05-08T21:49:44.757129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:33:33.642847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757017+0000","last_change":"2024-05-08T21:49:43.227710+0000","last_active":"2024-05-08T21:49:44.757017+0000","last_peered":"2024-05-08T21:49:44.757017+0000","last_clean":"2024-05-08T21:49:44.757017+0000","last_became_active":"2024-05-08T21:49:43.227430+0000","last_became_peered":"2024-05-08T21:49:43.227430+0000","last_unstale":"2024-05-08T21:49:44.757017+0000","last_undegraded":"2024-05-08T21:49:44.757017+0000","last_fullsized":"2024-05-08T21:49:44.757017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:05:58.875400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.928131+0000","last_change":"2024-05-08T21:49:43.768588+0000","last_active":"2024-05-08T21:49:44.928131+0000","last_peered":"2024-05-08T21:49:44.928131+0000","last_clean":"2024-05-08T21:49:44.928131+0000","last_became_active":"2024-05-08T21:49:43.768307+0000","last_became_peered":"2024-05-08T21:49:43.768307+0000","last_unstale":"2024-05-08T21:49:44.928131+0000","last_undegraded":"2024-05-08T21:49:44.928131+0000","last_fullsized":"2024-05-08T21:49:44.928131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:04.968184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.754953+0000","last_change":"2024-05-08T21:49:43.758618+0000","last_active":"2024-05-08T21:49:44.754953+0000","last_peered":"2024-05-08T21:49:44.754953+0000","last_clean":"2024-05-08T21:49:44.754953+0000","last_became_active":"2024-05-08T21:49:43.758367+0000","last_became_peered":"2024-05-08T21:49:43.758367+0000","last_unstale":"2024-05-08T21:49:44.754953+0000","last_undegraded":"2024-05-08T21:49:44.754953+0000","last_fullsized":"2024-05-08T21:49:44.754953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:30:06.569971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.751866+0000","last_change":"2024-05-08T21:49:43.217410+0000","last_active":"2024-05-08T21:49:43.751866+0000","last_peered":"2024-05-08T21:49:43.751866+0000","last_clean":"2024-05-08T21:49:43.751866+0000","last_became_active":"2024-05-08T21:49:43.217133+0000","last_became_peered":"2024-05-08T21:49:43.217133+0000","last_unstale":"2024-05-08T21:49:43.751866+0000","last_undegraded":"2024-05-08T21:49:43.751866+0000","last_fullsized":"2024-05-08T21:49:43.751866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:17.379362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.926897+0000","last_change":"2024-05-08T21:49:43.771651+0000","last_active":"2024-05-08T21:49:44.926897+0000","last_peered":"2024-05-08T21:49:44.926897+0000","last_clean":"2024-05-08T21:49:44.926897+0000","last_became_active":"2024-05-08T21:49:43.771451+0000","last_became_peered":"2024-05-08T21:49:43.771451+0000","last_unstale":"2024-05-08T21:49:44.926897+0000","last_undegraded":"2024-05-08T21:49:44.926897+0000","last_fullsized":"2024-05-08T21:49:44.926897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:00:38.941899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756759+0000","last_change":"2024-05-08T21:49:43.224929+0000","last_active":"2024-05-08T21:49:44.756759+0000","last_peered":"2024-05-08T21:49:44.756759+0000","last_clean":"2024-05-08T21:49:44.756759+0000","last_became_active":"2024-05-08T21:49:43.223469+0000","last_became_peered":"2024-05-08T21:49:43.223469+0000","last_unstale":"2024-05-08T21:49:44.756759+0000","last_undegraded":"2024-05-08T21:49:44.756759+0000","last_fullsized":"2024-05-08T21:49:44.756759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:27.504127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":164,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.756621+0000","last_change":"2024-05-08T21:49:38.626519+0000","last_active":"2024-05-08T21:49:43.756621+0000","last_peered":"2024-05-08T21:49:43.756621+0000","last_clean":"2024-05-08T21:49:43.756621+0000","last_became_active":"2024-05-08T21:49:38.626159+0000","last_became_peered":"2024-05-08T21:49:38.626159+0000","last_unstale":"2024-05-08T21:49:43.756621+0000","last_undegraded":"2024-05-08T21:49:43.756621+0000","last_fullsized":"2024-05-08T21:49:43.756621+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:36.031649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:36.031649+0000","last_clean_scrub_stamp":"2024-05-08T21:49:36.031649+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:12:04.846500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.926994+0000","last_change":"2024-05-08T21:49:43.770966+0000","last_active":"2024-05-08T21:49:44.926994+0000","last_peered":"2024-05-08T21:49:44.926994+0000","last_clean":"2024-05-08T21:49:44.926994+0000","last_became_active":"2024-05-08T21:49:43.770711+0000","last_became_peered":"2024-05-08T21:49:43.770711+0000","last_unstale":"2024-05-08T21:49:44.926994+0000","last_undegraded":"2024-05-08T21:49:44.926994+0000","last_fullsized":"2024-05-08T21:49:44.926994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:17:34.570817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.756729+0000","last_change":"2024-05-08T21:49:43.221086+0000","last_active":"2024-05-08T21:49:43.756729+0000","last_peered":"2024-05-08T21:49:43.756729+0000","last_clean":"2024-05-08T21:49:43.756729+0000","last_became_active":"2024-05-08T21:49:43.220539+0000","last_became_peered":"2024-05-08T21:49:43.220539+0000","last_unstale":"2024-05-08T21:49:43.756729+0000","last_undegraded":"2024-05-08T21:49:43.756729+0000","last_fullsized":"2024-05-08T21:49:43.756729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:52.323917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.765742+0000","last_change":"2024-05-08T21:49:43.222410+0000","last_active":"2024-05-08T21:49:43.765742+0000","last_peered":"2024-05-08T21:49:43.765742+0000","last_clean":"2024-05-08T21:49:43.765742+0000","last_became_active":"2024-05-08T21:49:43.222131+0000","last_became_peered":"2024-05-08T21:49:43.222131+0000","last_unstale":"2024-05-08T21:49:43.765742+0000","last_undegraded":"2024-05-08T21:49:43.765742+0000","last_fullsized":"2024-05-08T21:49:43.765742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:18:58.164159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755021+0000","last_change":"2024-05-08T21:49:43.758424+0000","last_active":"2024-05-08T21:49:44.755021+0000","last_peered":"2024-05-08T21:49:44.755021+0000","last_clean":"2024-05-08T21:49:44.755021+0000","last_became_active":"2024-05-08T21:49:43.758140+0000","last_became_peered":"2024-05-08T21:49:43.758140+0000","last_unstale":"2024-05-08T21:49:44.755021+0000","last_undegraded":"2024-05-08T21:49:44.755021+0000","last_fullsized":"2024-05-08T21:49:44.755021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:10.795540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:46.015958+0000","last_change":"2024-05-08T21:49:43.218241+0000","last_active":"2024-05-08T21:49:46.015958+0000","last_peered":"2024-05-08T21:49:46.015958+0000","last_clean":"2024-05-08T21:49:46.015958+0000","last_became_active":"2024-05-08T21:49:43.217780+0000","last_became_peered":"2024-05-08T21:49:43.217780+0000","last_unstale":"2024-05-08T21:49:46.015958+0000","last_undegraded":"2024-05-08T21:49:46.015958+0000","last_fullsized":"2024-05-08T21:49:46.015958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:27.504127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927830+0000","last_change":"2024-05-08T21:49:43.770491+0000","last_active":"2024-05-08T21:49:44.927830+0000","last_peered":"2024-05-08T21:49:44.927830+0000","last_clean":"2024-05-08T21:49:44.927830+0000","last_became_active":"2024-05-08T21:49:43.770221+0000","last_became_peered":"2024-05-08T21:49:43.770221+0000","last_unstale":"2024-05-08T21:49:44.927830+0000","last_undegraded":"2024-05-08T21:49:44.927830+0000","last_fullsized":"2024-05-08T21:49:44.927830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:25.661350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:48.755985+0000","last_change":"2024-05-08T21:49:43.221345+0000","last_active":"2024-05-08T21:49:48.755985+0000","last_peered":"2024-05-08T21:49:48.755985+0000","last_clean":"2024-05-08T21:49:48.755985+0000","last_became_active":"2024-05-08T21:49:43.220953+0000","last_became_peered":"2024-05-08T21:49:43.220953+0000","last_unstale":"2024-05-08T21:49:48.755985+0000","last_undegraded":"2024-05-08T21:49:48.755985+0000","last_fullsized":"2024-05-08T21:49:48.755985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:33:28.074468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927636+0000","last_change":"2024-05-08T21:49:43.765001+0000","last_active":"2024-05-08T21:49:44.927636+0000","last_peered":"2024-05-08T21:49:44.927636+0000","last_clean":"2024-05-08T21:49:44.927636+0000","last_became_active":"2024-05-08T21:49:43.764740+0000","last_became_peered":"2024-05-08T21:49:43.764740+0000","last_unstale":"2024-05-08T21:49:44.927636+0000","last_undegraded":"2024-05-08T21:49:44.927636+0000","last_fullsized":"2024-05-08T21:49:44.927636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:18:58.836430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.756521+0000","last_change":"2024-05-08T21:49:43.221251+0000","last_active":"2024-05-08T21:49:43.756521+0000","last_peered":"2024-05-08T21:49:43.756521+0000","last_clean":"2024-05-08T21:49:43.756521+0000","last_became_active":"2024-05-08T21:49:43.220839+0000","last_became_peered":"2024-05-08T21:49:43.220839+0000","last_unstale":"2024-05-08T21:49:43.756521+0000","last_undegraded":"2024-05-08T21:49:43.756521+0000","last_fullsized":"2024-05-08T21:49:43.756521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:10.497167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927485+0000","last_change":"2024-05-08T21:49:43.762511+0000","last_active":"2024-05-08T21:49:44.927485+0000","last_peered":"2024-05-08T21:49:44.927485+0000","last_clean":"2024-05-08T21:49:44.927485+0000","last_became_active":"2024-05-08T21:49:43.762170+0000","last_became_peered":"2024-05-08T21:49:43.762170+0000","last_unstale":"2024-05-08T21:49:44.927485+0000","last_undegraded":"2024-05-08T21:49:44.927485+0000","last_fullsized":"2024-05-08T21:49:44.927485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:11.503864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.754925+0000","last_change":"2024-05-08T21:49:43.215361+0000","last_active":"2024-05-08T21:49:44.754925+0000","last_peered":"2024-05-08T21:49:44.754925+0000","last_clean":"2024-05-08T21:49:44.754925+0000","last_became_active":"2024-05-08T21:49:43.215162+0000","last_became_peered":"2024-05-08T21:49:43.215162+0000","last_unstale":"2024-05-08T21:49:44.754925+0000","last_undegraded":"2024-05-08T21:49:44.754925+0000","last_fullsized":"2024-05-08T21:49:44.754925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:05:58.875400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927416+0000","last_change":"2024-05-08T21:49:43.757512+0000","last_active":"2024-05-08T21:49:44.927416+0000","last_peered":"2024-05-08T21:49:44.927416+0000","last_clean":"2024-05-08T21:49:44.927416+0000","last_became_active":"2024-05-08T21:49:43.757233+0000","last_became_peered":"2024-05-08T21:49:43.757233+0000","last_unstale":"2024-05-08T21:49:44.927416+0000","last_undegraded":"2024-05-08T21:49:44.927416+0000","last_fullsized":"2024-05-08T21:49:44.927416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:53:14.774835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755100+0000","last_change":"2024-05-08T21:49:43.217935+0000","last_active":"2024-05-08T21:49:44.755100+0000","last_peered":"2024-05-08T21:49:44.755100+0000","last_clean":"2024-05-08T21:49:44.755100+0000","last_became_active":"2024-05-08T21:49:43.217595+0000","last_became_peered":"2024-05-08T21:49:43.217595+0000","last_unstale":"2024-05-08T21:49:44.755100+0000","last_undegraded":"2024-05-08T21:49:44.755100+0000","last_fullsized":"2024-05-08T21:49:44.755100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:38:43.069159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927301+0000","last_change":"2024-05-08T21:49:43.766816+0000","last_active":"2024-05-08T21:49:44.927301+0000","last_peered":"2024-05-08T21:49:44.927301+0000","last_clean":"2024-05-08T21:49:44.927301+0000","last_became_active":"2024-05-08T21:49:43.766596+0000","last_became_peered":"2024-05-08T21:49:43.766596+0000","last_unstale":"2024-05-08T21:49:44.927301+0000","last_undegraded":"2024-05-08T21:49:44.927301+0000","last_fullsized":"2024-05-08T21:49:44.927301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:01:00.614249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:48.756361+0000","last_change":"2024-05-08T21:49:43.224243+0000","last_active":"2024-05-08T21:49:48.756361+0000","last_peered":"2024-05-08T21:49:48.756361+0000","last_clean":"2024-05-08T21:49:48.756361+0000","last_became_active":"2024-05-08T21:49:43.223974+0000","last_became_peered":"2024-05-08T21:49:43.223974+0000","last_unstale":"2024-05-08T21:49:48.756361+0000","last_undegraded":"2024-05-08T21:49:48.756361+0000","last_fullsized":"2024-05-08T21:49:48.756361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:03.961487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755912+0000","last_change":"2024-05-08T21:49:43.764377+0000","last_active":"2024-05-08T21:49:44.755912+0000","last_peered":"2024-05-08T21:49:44.755912+0000","last_clean":"2024-05-08T21:49:44.755912+0000","last_became_active":"2024-05-08T21:49:43.764075+0000","last_became_peered":"2024-05-08T21:49:43.764075+0000","last_unstale":"2024-05-08T21:49:44.755912+0000","last_undegraded":"2024-05-08T21:49:44.755912+0000","last_fullsized":"2024-05-08T21:49:44.755912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:41:45.602022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.752001+0000","last_change":"2024-05-08T21:49:43.229414+0000","last_active":"2024-05-08T21:49:43.752001+0000","last_peered":"2024-05-08T21:49:43.752001+0000","last_clean":"2024-05-08T21:49:43.752001+0000","last_became_active":"2024-05-08T21:49:43.229121+0000","last_became_peered":"2024-05-08T21:49:43.229121+0000","last_unstale":"2024-05-08T21:49:43.752001+0000","last_undegraded":"2024-05-08T21:49:43.752001+0000","last_fullsized":"2024-05-08T21:49:43.752001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:33:28.074468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927480+0000","last_change":"2024-05-08T21:49:43.774111+0000","last_active":"2024-05-08T21:49:44.927480+0000","last_peered":"2024-05-08T21:49:44.927480+0000","last_clean":"2024-05-08T21:49:44.927480+0000","last_became_active":"2024-05-08T21:49:43.772528+0000","last_became_peered":"2024-05-08T21:49:43.772528+0000","last_unstale":"2024-05-08T21:49:44.927480+0000","last_undegraded":"2024-05-08T21:49:44.927480+0000","last_fullsized":"2024-05-08T21:49:44.927480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:28.983476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:46.015933+0000","last_change":"2024-05-08T21:49:43.208581+0000","last_active":"2024-05-08T21:49:46.015933+0000","last_peered":"2024-05-08T21:49:46.015933+0000","last_clean":"2024-05-08T21:49:46.015933+0000","last_became_active":"2024-05-08T21:49:43.208326+0000","last_became_peered":"2024-05-08T21:49:43.208326+0000","last_unstale":"2024-05-08T21:49:46.015933+0000","last_undegraded":"2024-05-08T21:49:46.015933+0000","last_fullsized":"2024-05-08T21:49:46.015933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:13:35.461791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756911+0000","last_change":"2024-05-08T21:49:43.766519+0000","last_active":"2024-05-08T21:49:44.756911+0000","last_peered":"2024-05-08T21:49:44.756911+0000","last_clean":"2024-05-08T21:49:44.756911+0000","last_became_active":"2024-05-08T21:49:43.765789+0000","last_became_peered":"2024-05-08T21:49:43.765789+0000","last_unstale":"2024-05-08T21:49:44.756911+0000","last_undegraded":"2024-05-08T21:49:44.756911+0000","last_fullsized":"2024-05-08T21:49:44.756911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:23.674986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:48.757658+0000","last_change":"2024-05-08T21:49:43.218079+0000","last_active":"2024-05-08T21:49:48.757658+0000","last_peered":"2024-05-08T21:49:48.757658+0000","last_clean":"2024-05-08T21:49:48.757658+0000","last_became_active":"2024-05-08T21:49:43.217814+0000","last_became_peered":"2024-05-08T21:49:43.217814+0000","last_unstale":"2024-05-08T21:49:48.757658+0000","last_undegraded":"2024-05-08T21:49:48.757658+0000","last_fullsized":"2024-05-08T21:49:48.757658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:18:58.164159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.928456+0000","last_change":"2024-05-08T21:49:43.775713+0000","last_active":"2024-05-08T21:49:44.928456+0000","last_peered":"2024-05-08T21:49:44.928456+0000","last_clean":"2024-05-08T21:49:44.928456+0000","last_became_active":"2024-05-08T21:49:43.775361+0000","last_became_peered":"2024-05-08T21:49:43.775361+0000","last_unstale":"2024-05-08T21:49:44.928456+0000","last_undegraded":"2024-05-08T21:49:44.928456+0000","last_fullsized":"2024-05-08T21:49:44.928456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:48:24.482146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755727+0000","last_change":"2024-05-08T21:49:43.767129+0000","last_active":"2024-05-08T21:49:44.755727+0000","last_peered":"2024-05-08T21:49:44.755727+0000","last_clean":"2024-05-08T21:49:44.755727+0000","last_became_active":"2024-05-08T21:49:43.766789+0000","last_became_peered":"2024-05-08T21:49:43.766789+0000","last_unstale":"2024-05-08T21:49:44.755727+0000","last_undegraded":"2024-05-08T21:49:44.755727+0000","last_fullsized":"2024-05-08T21:49:44.755727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:39.954320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927246+0000","last_change":"2024-05-08T21:49:43.766157+0000","last_active":"2024-05-08T21:49:44.927246+0000","last_peered":"2024-05-08T21:49:44.927246+0000","last_clean":"2024-05-08T21:49:44.927246+0000","last_became_active":"2024-05-08T21:49:43.765843+0000","last_became_peered":"2024-05-08T21:49:43.765843+0000","last_unstale":"2024-05-08T21:49:44.927246+0000","last_undegraded":"2024-05-08T21:49:44.927246+0000","last_fullsized":"2024-05-08T21:49:44.927246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:04.968184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757080+0000","last_change":"2024-05-08T21:49:43.768929+0000","last_active":"2024-05-08T21:49:44.757080+0000","last_peered":"2024-05-08T21:49:44.757080+0000","last_clean":"2024-05-08T21:49:44.757080+0000","last_became_active":"2024-05-08T21:49:43.767606+0000","last_became_peered":"2024-05-08T21:49:43.767606+0000","last_unstale":"2024-05-08T21:49:44.757080+0000","last_undegraded":"2024-05-08T21:49:44.757080+0000","last_fullsized":"2024-05-08T21:49:44.757080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:13:06.426154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927158+0000","last_change":"2024-05-08T21:49:43.774673+0000","last_active":"2024-05-08T21:49:44.927158+0000","last_peered":"2024-05-08T21:49:44.927158+0000","last_clean":"2024-05-08T21:49:44.927158+0000","last_became_active":"2024-05-08T21:49:43.774406+0000","last_became_peered":"2024-05-08T21:49:43.774406+0000","last_unstale":"2024-05-08T21:49:44.927158+0000","last_undegraded":"2024-05-08T21:49:44.927158+0000","last_fullsized":"2024-05-08T21:49:44.927158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:43.798909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927659+0000","last_change":"2024-05-08T21:49:43.764222+0000","last_active":"2024-05-08T21:49:44.927659+0000","last_peered":"2024-05-08T21:49:44.927659+0000","last_clean":"2024-05-08T21:49:44.927659+0000","last_became_active":"2024-05-08T21:49:43.763937+0000","last_became_peered":"2024-05-08T21:49:43.763937+0000","last_unstale":"2024-05-08T21:49:44.927659+0000","last_undegraded":"2024-05-08T21:49:44.927659+0000","last_fullsized":"2024-05-08T21:49:44.927659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:04:14.416894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755114+0000","last_change":"2024-05-08T21:49:43.757318+0000","last_active":"2024-05-08T21:49:44.755114+0000","last_peered":"2024-05-08T21:49:44.755114+0000","last_clean":"2024-05-08T21:49:44.755114+0000","last_became_active":"2024-05-08T21:49:43.757083+0000","last_became_peered":"2024-05-08T21:49:43.757083+0000","last_unstale":"2024-05-08T21:49:44.755114+0000","last_undegraded":"2024-05-08T21:49:44.755114+0000","last_fullsized":"2024-05-08T21:49:44.755114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:47.551474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756302+0000","last_change":"2024-05-08T21:49:43.773491+0000","last_active":"2024-05-08T21:49:44.756302+0000","last_peered":"2024-05-08T21:49:44.756302+0000","last_clean":"2024-05-08T21:49:44.756302+0000","last_became_active":"2024-05-08T21:49:43.773203+0000","last_became_peered":"2024-05-08T21:49:43.773203+0000","last_unstale":"2024-05-08T21:49:44.756302+0000","last_undegraded":"2024-05-08T21:49:44.756302+0000","last_fullsized":"2024-05-08T21:49:44.756302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:53:14.774835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927776+0000","last_change":"2024-05-08T21:49:43.761926+0000","last_active":"2024-05-08T21:49:44.927776+0000","last_peered":"2024-05-08T21:49:44.927776+0000","last_clean":"2024-05-08T21:49:44.927776+0000","last_became_active":"2024-05-08T21:49:43.761645+0000","last_became_peered":"2024-05-08T21:49:43.761645+0000","last_unstale":"2024-05-08T21:49:44.927776+0000","last_undegraded":"2024-05-08T21:49:44.927776+0000","last_fullsized":"2024-05-08T21:49:44.927776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:10:07.209965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756761+0000","last_change":"2024-05-08T21:49:43.768942+0000","last_active":"2024-05-08T21:49:44.756761+0000","last_peered":"2024-05-08T21:49:44.756761+0000","last_clean":"2024-05-08T21:49:44.756761+0000","last_became_active":"2024-05-08T21:49:43.768673+0000","last_became_peered":"2024-05-08T21:49:43.768673+0000","last_unstale":"2024-05-08T21:49:44.756761+0000","last_undegraded":"2024-05-08T21:49:44.756761+0000","last_fullsized":"2024-05-08T21:49:44.756761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:15:41.869107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927592+0000","last_change":"2024-05-08T21:49:43.766452+0000","last_active":"2024-05-08T21:49:44.927592+0000","last_peered":"2024-05-08T21:49:44.927592+0000","last_clean":"2024-05-08T21:49:44.927592+0000","last_became_active":"2024-05-08T21:49:43.765723+0000","last_became_peered":"2024-05-08T21:49:43.765723+0000","last_unstale":"2024-05-08T21:49:44.927592+0000","last_undegraded":"2024-05-08T21:49:44.927592+0000","last_fullsized":"2024-05-08T21:49:44.927592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:19:28.925404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756863+0000","last_change":"2024-05-08T21:49:43.775098+0000","last_active":"2024-05-08T21:49:44.756863+0000","last_peered":"2024-05-08T21:49:44.756863+0000","last_clean":"2024-05-08T21:49:44.756863+0000","last_became_active":"2024-05-08T21:49:43.774808+0000","last_became_peered":"2024-05-08T21:49:43.774808+0000","last_unstale":"2024-05-08T21:49:44.756863+0000","last_undegraded":"2024-05-08T21:49:44.756863+0000","last_fullsized":"2024-05-08T21:49:44.756863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:51:15.152611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927076+0000","last_change":"2024-05-08T21:49:43.775129+0000","last_active":"2024-05-08T21:49:44.927076+0000","last_peered":"2024-05-08T21:49:44.927076+0000","last_clean":"2024-05-08T21:49:44.927076+0000","last_became_active":"2024-05-08T21:49:43.774881+0000","last_became_peered":"2024-05-08T21:49:43.774881+0000","last_unstale":"2024-05-08T21:49:44.927076+0000","last_undegraded":"2024-05-08T21:49:44.927076+0000","last_fullsized":"2024-05-08T21:49:44.927076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:19:28.925404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756057+0000","last_change":"2024-05-08T21:49:43.764163+0000","last_active":"2024-05-08T21:49:44.756057+0000","last_peered":"2024-05-08T21:49:44.756057+0000","last_clean":"2024-05-08T21:49:44.756057+0000","last_became_active":"2024-05-08T21:49:43.763907+0000","last_became_peered":"2024-05-08T21:49:43.763907+0000","last_unstale":"2024-05-08T21:49:44.756057+0000","last_undegraded":"2024-05-08T21:49:44.756057+0000","last_fullsized":"2024-05-08T21:49:44.756057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:01:00.614249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2624,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":5248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509451,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":806912,"data_stored":664039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509451,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":221184,"data_stored":74915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":212992,"data_stored":73179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":217088,"data_stored":73249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.313}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509450,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":815104,"data_stored":664095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]}]},{"osd":2,"up_from":15,"seq":64424509451,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":208896,"data_stored":73089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]}]},{"osd":3,"up_from":15,"seq":64424509450,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":221184,"data_stored":74915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]}]},{"osd":4,"up_from":15,"seq":64424509450,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":221184,"data_stored":73215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T21:50:10.055 INFO:tasks.mds_thrash.ceph_manager:clean! 2024-05-08T21:50:10.056 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T21:50:10.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.212+0000 7f21679d1700 1 Processor -- start 2024-05-08T21:50:10.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.212+0000 7f21679d1700 1 -- start start 2024-05-08T21:50:10.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.213+0000 7f21679d1700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2160072260 0x7f2160159d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:10.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.213+0000 7f21679d1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2160072d60 0x7f216015a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:10.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.213+0000 7f21679d1700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f216015dfc0 con 0x7f2160072980 2024-05-08T21:50:10.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.213+0000 7f21679d1700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2160070120 con 0x7f2160072260 2024-05-08T21:50:10.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.213+0000 7f21679d1700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f216015d3b0 con 0x7f2160072d60 2024-05-08T21:50:10.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.213+0000 7f2164f6c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2160072260 0x7f2160159d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:10.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.213+0000 7f2165f6e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2160072d60 0x7f216015a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:10.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.213+0000 7f216576d700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f2160072980 0x7f216006f970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.73:46168/0 (socket says 172.21.15.73:46168) 2024-05-08T21:50:10.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.213+0000 7f216576d700 1 -- 172.21.15.73:0/1234868152 learned_addr learned my addr 172.21.15.73:0/1234868152 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:50:10.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.213+0000 7f2164f6c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2160072260 0x7f2160159d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.73:56342/0 (socket says 172.21.15.73:56342) 2024-05-08T21:50:10.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.213+0000 7f2165f6e700 1 -- 172.21.15.73:0/1234868152 >> v2:172.21.15.115:3300/0 conn(0x7f2160072260 msgr2=0x7f2160159d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:50:10.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.213+0000 7f2165f6e700 1 --2- 172.21.15.73:0/1234868152 >> v2:172.21.15.115:3300/0 conn(0x7f2160072260 0x7f2160159d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:10.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.213+0000 7f2165f6e700 1 -- 172.21.15.73:0/1234868152 >> v1:172.21.15.115:6789/0 conn(0x7f2160072980 legacy=0x7f216006f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:10.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.213+0000 7f2165f6e700 1 -- 172.21.15.73:0/1234868152 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f216015d690 con 0x7f2160072d60 2024-05-08T21:50:10.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.214+0000 7f2165f6e700 1 --2- 172.21.15.73:0/1234868152 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2160072d60 0x7f216015a2d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2158009d90 tx=0x7f215800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dff2c0ba74ce9b9d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:10.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.214+0000 7f2157fff700 1 -- 172.21.15.73:0/1234868152 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215800e070 con 0x7f2160072d60 2024-05-08T21:50:10.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.214+0000 7f2157fff700 1 -- 172.21.15.73:0/1234868152 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f215800bb20 con 0x7f2160072d60 2024-05-08T21:50:10.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.214+0000 7f2157fff700 1 -- 172.21.15.73:0/1234868152 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2158012430 con 0x7f2160072d60 2024-05-08T21:50:10.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.214+0000 7f21679d1700 1 -- 172.21.15.73:0/1234868152 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2160072d60 msgr2=0x7f216015a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:10.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.214+0000 7f21679d1700 1 --2- 172.21.15.73:0/1234868152 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2160072d60 0x7f216015a2d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2158009d90 tx=0x7f215800b330 comp rx=0 tx=0).stop 2024-05-08T21:50:10.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.214+0000 7f21679d1700 1 -- 172.21.15.73:0/1234868152 shutdown_connections 2024-05-08T21:50:10.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.214+0000 7f21679d1700 1 --2- 172.21.15.73:0/1234868152 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2160072d60 0x7f216015a2d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:10.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.214+0000 7f21679d1700 1 --2- 172.21.15.73:0/1234868152 >> v2:172.21.15.115:3300/0 conn(0x7f2160072260 0x7f2160159d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:10.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.214+0000 7f21679d1700 1 -- 172.21.15.73:0/1234868152 >> 172.21.15.73:0/1234868152 conn(0x7f2160066cf0 msgr2=0x7f216006bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:50:10.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.214+0000 7f21679d1700 1 -- 172.21.15.73:0/1234868152 shutdown_connections 2024-05-08T21:50:10.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.214+0000 7f21679d1700 1 -- 172.21.15.73:0/1234868152 wait complete. 2024-05-08T21:50:10.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.215+0000 7f21679d1700 1 Processor -- start 2024-05-08T21:50:10.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.215+0000 7f21679d1700 1 -- start start 2024-05-08T21:50:10.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.216+0000 7f21679d1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2160072260 0x7f2160157150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:10.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.216+0000 7f21679d1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2160072980 0x7f21600cc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:10.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.216+0000 7f21679d1700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2160072d60 0x7f216015c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:10.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.216+0000 7f21679d1700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21600cbf40 con 0x7f2160072980 2024-05-08T21:50:10.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.216+0000 7f21679d1700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21600cb260 con 0x7f2160072d60 2024-05-08T21:50:10.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.216+0000 7f21679d1700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21600ccb20 con 0x7f2160072260 2024-05-08T21:50:10.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.216+0000 7f2164f6c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2160072980 0x7f21600cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:10.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.216+0000 7f2164f6c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2160072980 0x7f21600cc3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36460/0 (socket says 172.21.15.73:36460) 2024-05-08T21:50:10.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.216+0000 7f2164f6c700 1 -- 172.21.15.73:0/605312845 learned_addr learned my addr 172.21.15.73:0/605312845 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:50:10.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.216+0000 7f216576d700 1 --2- 172.21.15.73:0/605312845 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2160072260 0x7f2160157150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:10.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.216+0000 7f2165f6e700 1 --2- 172.21.15.73:0/605312845 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2160072d60 0x7f216015c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:10.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.217+0000 7f2164f6c700 1 -- 172.21.15.73:0/605312845 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2160072260 msgr2=0x7f2160157150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:10.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.217+0000 7f2164f6c700 1 --2- 172.21.15.73:0/605312845 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2160072260 0x7f2160157150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:10.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.217+0000 7f2164f6c700 1 -- 172.21.15.73:0/605312845 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2160072d60 msgr2=0x7f216015c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:10.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.217+0000 7f2164f6c700 1 --2- 172.21.15.73:0/605312845 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2160072d60 0x7f216015c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:10.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.217+0000 7f2164f6c700 1 -- 172.21.15.73:0/605312845 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2158009a70 con 0x7f2160072980 2024-05-08T21:50:10.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.217+0000 7f2164f6c700 1 --2- 172.21.15.73:0/605312845 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2160072980 0x7f21600cc3d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f215000e9e0 tx=0x7f215000ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:10.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.217+0000 7f2155ffb700 1 -- 172.21.15.73:0/605312845 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2150009710 con 0x7f2160072980 2024-05-08T21:50:10.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.217+0000 7f21679d1700 1 -- 172.21.15.73:0/605312845 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21600ccdc0 con 0x7f2160072980 2024-05-08T21:50:10.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.217+0000 7f2155ffb700 1 -- 172.21.15.73:0/605312845 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f215000ee80 con 0x7f2160072980 2024-05-08T21:50:10.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.217+0000 7f2155ffb700 1 -- 172.21.15.73:0/605312845 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215000ca50 con 0x7f2160072980 2024-05-08T21:50:10.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.217+0000 7f21679d1700 1 -- 172.21.15.73:0/605312845 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21600caf80 con 0x7f2160072980 2024-05-08T21:50:10.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.218+0000 7f21679d1700 1 -- 172.21.15.73:0/605312845 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21600cc910 con 0x7f2160072980 2024-05-08T21:50:10.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.218+0000 7f2155ffb700 1 -- 172.21.15.73:0/605312845 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f215000cbb0 con 0x7f2160072980 2024-05-08T21:50:10.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.219+0000 7f2155ffb700 1 --2- 172.21.15.73:0/605312845 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f214406acc0 0x7f214406d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:10.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.219+0000 7f216576d700 1 --2- 172.21.15.73:0/605312845 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f214406acc0 0x7f214406d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:10.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.219+0000 7f2155ffb700 1 -- 172.21.15.73:0/605312845 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2150089680 con 0x7f2160072980 2024-05-08T21:50:10.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.219+0000 7f216576d700 1 --2- 172.21.15.73:0/605312845 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f214406acc0 0x7f214406d180 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f215c005910 tx=0x7f215c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:10.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.224+0000 7f2155ffb700 1 -- 172.21.15.73:0/605312845 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f2150054860 con 0x7f2160072980 2024-05-08T21:50:10.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.414+0000 7f21679d1700 1 -- 172.21.15.73:0/605312845 --> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f216015dc50 con 0x7f214406acc0 2024-05-08T21:50:10.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.421+0000 7f2155ffb700 1 -- 172.21.15.73:0/605312845 <== mgr.4104 v2:172.21.15.73:6832/46949 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264543 (secure 0 0 0) 0x7f215c001580 con 0x7f214406acc0 2024-05-08T21:50:10.425 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:50:10.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.424+0000 7f21679d1700 1 -- 172.21.15.73:0/605312845 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f214406acc0 msgr2=0x7f214406d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:10.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.424+0000 7f21679d1700 1 --2- 172.21.15.73:0/605312845 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f214406acc0 0x7f214406d180 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f215c005910 tx=0x7f215c009040 comp rx=0 tx=0).stop 2024-05-08T21:50:10.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.424+0000 7f21679d1700 1 -- 172.21.15.73:0/605312845 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2160072980 msgr2=0x7f21600cc3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:10.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.424+0000 7f21679d1700 1 --2- 172.21.15.73:0/605312845 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2160072980 0x7f21600cc3d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f215000e9e0 tx=0x7f215000ecf0 comp rx=0 tx=0).stop 2024-05-08T21:50:10.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.425+0000 7f21679d1700 1 -- 172.21.15.73:0/605312845 shutdown_connections 2024-05-08T21:50:10.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.425+0000 7f21679d1700 1 --2- 172.21.15.73:0/605312845 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f214406acc0 0x7f214406d180 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:10.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.425+0000 7f21679d1700 1 --2- 172.21.15.73:0/605312845 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2160072d60 0x7f216015c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:10.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.425+0000 7f21679d1700 1 --2- 172.21.15.73:0/605312845 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2160072260 0x7f2160157150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:10.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.425+0000 7f21679d1700 1 --2- 172.21.15.73:0/605312845 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2160072980 0x7f21600cc3d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:10.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.425+0000 7f21679d1700 1 -- 172.21.15.73:0/605312845 >> 172.21.15.73:0/605312845 conn(0x7f2160066cf0 msgr2=0x7f216006bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:50:10.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.425+0000 7f21679d1700 1 -- 172.21.15.73:0/605312845 shutdown_connections 2024-05-08T21:50:10.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.425+0000 7f21679d1700 1 -- 172.21.15.73:0/605312845 wait complete. 2024-05-08T21:50:10.429 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-05-08T21:50:10.438 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2024-05-08T21:50:09.960950+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592992,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218984,"kb_used_data":2856,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755736,"statfs":{"total":773094113280,"available":772869873664,"internally_reserved":0,"allocated":2924544,"data_stored":1770696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":262,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002423"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.928360+0000","last_change":"2024-05-08T21:49:43.775912+0000","last_active":"2024-05-08T21:49:44.928360+0000","last_peered":"2024-05-08T21:49:44.928360+0000","last_clean":"2024-05-08T21:49:44.928360+0000","last_became_active":"2024-05-08T21:49:43.775657+0000","last_became_peered":"2024-05-08T21:49:43.775657+0000","last_unstale":"2024-05-08T21:49:44.928360+0000","last_undegraded":"2024-05-08T21:49:44.928360+0000","last_fullsized":"2024-05-08T21:49:44.928360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:10:07.209965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755108+0000","last_change":"2024-05-08T21:49:43.766984+0000","last_active":"2024-05-08T21:49:44.755108+0000","last_peered":"2024-05-08T21:49:44.755108+0000","last_clean":"2024-05-08T21:49:44.755108+0000","last_became_active":"2024-05-08T21:49:43.765995+0000","last_became_peered":"2024-05-08T21:49:43.765995+0000","last_unstale":"2024-05-08T21:49:44.755108+0000","last_undegraded":"2024-05-08T21:49:44.755108+0000","last_fullsized":"2024-05-08T21:49:44.755108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:21:41.238890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.926947+0000","last_change":"2024-05-08T21:49:43.766107+0000","last_active":"2024-05-08T21:49:44.926947+0000","last_peered":"2024-05-08T21:49:44.926947+0000","last_clean":"2024-05-08T21:49:44.926947+0000","last_became_active":"2024-05-08T21:49:43.765874+0000","last_became_peered":"2024-05-08T21:49:43.765874+0000","last_unstale":"2024-05-08T21:49:44.926947+0000","last_undegraded":"2024-05-08T21:49:44.926947+0000","last_fullsized":"2024-05-08T21:49:44.926947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:06:50.769169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757017+0000","last_change":"2024-05-08T21:49:43.766355+0000","last_active":"2024-05-08T21:49:44.757017+0000","last_peered":"2024-05-08T21:49:44.757017+0000","last_clean":"2024-05-08T21:49:44.757017+0000","last_became_active":"2024-05-08T21:49:43.765507+0000","last_became_peered":"2024-05-08T21:49:43.765507+0000","last_unstale":"2024-05-08T21:49:44.757017+0000","last_undegraded":"2024-05-08T21:49:44.757017+0000","last_fullsized":"2024-05-08T21:49:44.757017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:09:09.676078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927361+0000","last_change":"2024-05-08T21:49:43.770346+0000","last_active":"2024-05-08T21:49:44.927361+0000","last_peered":"2024-05-08T21:49:44.927361+0000","last_clean":"2024-05-08T21:49:44.927361+0000","last_became_active":"2024-05-08T21:49:43.770067+0000","last_became_peered":"2024-05-08T21:49:43.770067+0000","last_unstale":"2024-05-08T21:49:44.927361+0000","last_undegraded":"2024-05-08T21:49:44.927361+0000","last_fullsized":"2024-05-08T21:49:44.927361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:04:14.416894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756907+0000","last_change":"2024-05-08T21:49:43.771390+0000","last_active":"2024-05-08T21:49:44.756907+0000","last_peered":"2024-05-08T21:49:44.756907+0000","last_clean":"2024-05-08T21:49:44.756907+0000","last_became_active":"2024-05-08T21:49:43.770893+0000","last_became_peered":"2024-05-08T21:49:43.770893+0000","last_unstale":"2024-05-08T21:49:44.756907+0000","last_undegraded":"2024-05-08T21:49:44.756907+0000","last_fullsized":"2024-05-08T21:49:44.756907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:28.979468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927055+0000","last_change":"2024-05-08T21:49:43.769981+0000","last_active":"2024-05-08T21:49:44.927055+0000","last_peered":"2024-05-08T21:49:44.927055+0000","last_clean":"2024-05-08T21:49:44.927055+0000","last_became_active":"2024-05-08T21:49:43.769667+0000","last_became_peered":"2024-05-08T21:49:43.769667+0000","last_unstale":"2024-05-08T21:49:44.927055+0000","last_undegraded":"2024-05-08T21:49:44.927055+0000","last_fullsized":"2024-05-08T21:49:44.927055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:12:00.381761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927368+0000","last_change":"2024-05-08T21:49:43.771078+0000","last_active":"2024-05-08T21:49:44.927368+0000","last_peered":"2024-05-08T21:49:44.927368+0000","last_clean":"2024-05-08T21:49:44.927368+0000","last_became_active":"2024-05-08T21:49:43.770912+0000","last_became_peered":"2024-05-08T21:49:43.770912+0000","last_unstale":"2024-05-08T21:49:44.927368+0000","last_undegraded":"2024-05-08T21:49:44.927368+0000","last_fullsized":"2024-05-08T21:49:44.927368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:12:00.381761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.928368+0000","last_change":"2024-05-08T21:49:43.775880+0000","last_active":"2024-05-08T21:49:44.928368+0000","last_peered":"2024-05-08T21:49:44.928368+0000","last_clean":"2024-05-08T21:49:44.928368+0000","last_became_active":"2024-05-08T21:49:43.775404+0000","last_became_peered":"2024-05-08T21:49:43.775404+0000","last_unstale":"2024-05-08T21:49:44.928368+0000","last_undegraded":"2024-05-08T21:49:44.928368+0000","last_fullsized":"2024-05-08T21:49:44.928368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:23:24.559669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756369+0000","last_change":"2024-05-08T21:49:43.772784+0000","last_active":"2024-05-08T21:49:44.756369+0000","last_peered":"2024-05-08T21:49:44.756369+0000","last_clean":"2024-05-08T21:49:44.756369+0000","last_became_active":"2024-05-08T21:49:43.772505+0000","last_became_peered":"2024-05-08T21:49:43.772505+0000","last_unstale":"2024-05-08T21:49:44.756369+0000","last_undegraded":"2024-05-08T21:49:44.756369+0000","last_fullsized":"2024-05-08T21:49:44.756369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:19:28.925404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756079+0000","last_change":"2024-05-08T21:49:43.771781+0000","last_active":"2024-05-08T21:49:44.756079+0000","last_peered":"2024-05-08T21:49:44.756079+0000","last_clean":"2024-05-08T21:49:44.756079+0000","last_became_active":"2024-05-08T21:49:43.771457+0000","last_became_peered":"2024-05-08T21:49:43.771457+0000","last_unstale":"2024-05-08T21:49:44.756079+0000","last_undegraded":"2024-05-08T21:49:44.756079+0000","last_fullsized":"2024-05-08T21:49:44.756079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:43.798909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927611+0000","last_change":"2024-05-08T21:49:43.764249+0000","last_active":"2024-05-08T21:49:44.927611+0000","last_peered":"2024-05-08T21:49:44.927611+0000","last_clean":"2024-05-08T21:49:44.927611+0000","last_became_active":"2024-05-08T21:49:43.763986+0000","last_became_peered":"2024-05-08T21:49:43.763986+0000","last_unstale":"2024-05-08T21:49:44.927611+0000","last_undegraded":"2024-05-08T21:49:44.927611+0000","last_fullsized":"2024-05-08T21:49:44.927611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:33:13.833915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927054+0000","last_change":"2024-05-08T21:49:43.761127+0000","last_active":"2024-05-08T21:49:44.927054+0000","last_peered":"2024-05-08T21:49:44.927054+0000","last_clean":"2024-05-08T21:49:44.927054+0000","last_became_active":"2024-05-08T21:49:43.760874+0000","last_became_peered":"2024-05-08T21:49:43.760874+0000","last_unstale":"2024-05-08T21:49:44.927054+0000","last_undegraded":"2024-05-08T21:49:44.927054+0000","last_fullsized":"2024-05-08T21:49:44.927054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:17:34.570817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.926846+0000","last_change":"2024-05-08T21:49:43.765829+0000","last_active":"2024-05-08T21:49:44.926846+0000","last_peered":"2024-05-08T21:49:44.926846+0000","last_clean":"2024-05-08T21:49:44.926846+0000","last_became_active":"2024-05-08T21:49:43.765566+0000","last_became_peered":"2024-05-08T21:49:43.765566+0000","last_unstale":"2024-05-08T21:49:44.926846+0000","last_undegraded":"2024-05-08T21:49:44.926846+0000","last_fullsized":"2024-05-08T21:49:44.926846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:39.954320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.754916+0000","last_change":"2024-05-08T21:49:43.765080+0000","last_active":"2024-05-08T21:49:44.754916+0000","last_peered":"2024-05-08T21:49:44.754916+0000","last_clean":"2024-05-08T21:49:44.754916+0000","last_became_active":"2024-05-08T21:49:43.764810+0000","last_became_peered":"2024-05-08T21:49:43.764810+0000","last_unstale":"2024-05-08T21:49:44.754916+0000","last_undegraded":"2024-05-08T21:49:44.754916+0000","last_fullsized":"2024-05-08T21:49:44.754916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:24:11.223913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756634+0000","last_change":"2024-05-08T21:49:43.766717+0000","last_active":"2024-05-08T21:49:44.756634+0000","last_peered":"2024-05-08T21:49:44.756634+0000","last_clean":"2024-05-08T21:49:44.756634+0000","last_became_active":"2024-05-08T21:49:43.766427+0000","last_became_peered":"2024-05-08T21:49:43.766427+0000","last_unstale":"2024-05-08T21:49:44.756634+0000","last_undegraded":"2024-05-08T21:49:44.756634+0000","last_fullsized":"2024-05-08T21:49:44.756634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:49:22.833820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757256+0000","last_change":"2024-05-08T21:49:43.776929+0000","last_active":"2024-05-08T21:49:44.757256+0000","last_peered":"2024-05-08T21:49:44.757256+0000","last_clean":"2024-05-08T21:49:44.757256+0000","last_became_active":"2024-05-08T21:49:43.776509+0000","last_became_peered":"2024-05-08T21:49:43.776509+0000","last_unstale":"2024-05-08T21:49:44.757256+0000","last_undegraded":"2024-05-08T21:49:44.757256+0000","last_fullsized":"2024-05-08T21:49:44.757256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:26.199459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.926679+0000","last_change":"2024-05-08T21:49:43.762646+0000","last_active":"2024-05-08T21:49:44.926679+0000","last_peered":"2024-05-08T21:49:44.926679+0000","last_clean":"2024-05-08T21:49:44.926679+0000","last_became_active":"2024-05-08T21:49:43.762237+0000","last_became_peered":"2024-05-08T21:49:43.762237+0000","last_unstale":"2024-05-08T21:49:44.926679+0000","last_undegraded":"2024-05-08T21:49:44.926679+0000","last_fullsized":"2024-05-08T21:49:44.926679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:46:08.821947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927249+0000","last_change":"2024-05-08T21:49:43.774729+0000","last_active":"2024-05-08T21:49:44.927249+0000","last_peered":"2024-05-08T21:49:44.927249+0000","last_clean":"2024-05-08T21:49:44.927249+0000","last_became_active":"2024-05-08T21:49:43.774450+0000","last_became_peered":"2024-05-08T21:49:43.774450+0000","last_unstale":"2024-05-08T21:49:44.927249+0000","last_undegraded":"2024-05-08T21:49:44.927249+0000","last_fullsized":"2024-05-08T21:49:44.927249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:25.661350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:48.760475+0000","last_change":"2024-05-08T21:49:43.219461+0000","last_active":"2024-05-08T21:49:48.760475+0000","last_peered":"2024-05-08T21:49:48.760475+0000","last_clean":"2024-05-08T21:49:48.760475+0000","last_became_active":"2024-05-08T21:49:43.219161+0000","last_became_peered":"2024-05-08T21:49:43.219161+0000","last_unstale":"2024-05-08T21:49:48.760475+0000","last_undegraded":"2024-05-08T21:49:48.760475+0000","last_fullsized":"2024-05-08T21:49:48.760475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:02:45.778415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927036+0000","last_change":"2024-05-08T21:49:43.764252+0000","last_active":"2024-05-08T21:49:44.927036+0000","last_peered":"2024-05-08T21:49:44.927036+0000","last_clean":"2024-05-08T21:49:44.927036+0000","last_became_active":"2024-05-08T21:49:43.764045+0000","last_became_peered":"2024-05-08T21:49:43.764045+0000","last_unstale":"2024-05-08T21:49:44.927036+0000","last_undegraded":"2024-05-08T21:49:44.927036+0000","last_fullsized":"2024-05-08T21:49:44.927036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:43.798909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927120+0000","last_change":"2024-05-08T21:49:43.221599+0000","last_active":"2024-05-08T21:49:44.927120+0000","last_peered":"2024-05-08T21:49:44.927120+0000","last_clean":"2024-05-08T21:49:44.927120+0000","last_became_active":"2024-05-08T21:49:43.221309+0000","last_became_peered":"2024-05-08T21:49:43.221309+0000","last_unstale":"2024-05-08T21:49:44.927120+0000","last_undegraded":"2024-05-08T21:49:44.927120+0000","last_fullsized":"2024-05-08T21:49:44.927120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:17.379362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927796+0000","last_change":"2024-05-08T21:49:43.771523+0000","last_active":"2024-05-08T21:49:44.927796+0000","last_peered":"2024-05-08T21:49:44.927796+0000","last_clean":"2024-05-08T21:49:44.927796+0000","last_became_active":"2024-05-08T21:49:43.771295+0000","last_became_peered":"2024-05-08T21:49:43.771295+0000","last_unstale":"2024-05-08T21:49:44.927796+0000","last_undegraded":"2024-05-08T21:49:44.927796+0000","last_fullsized":"2024-05-08T21:49:44.927796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:53:14.774835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:48.755678+0000","last_change":"2024-05-08T21:49:43.226637+0000","last_active":"2024-05-08T21:49:48.755678+0000","last_peered":"2024-05-08T21:49:48.755678+0000","last_clean":"2024-05-08T21:49:48.755678+0000","last_became_active":"2024-05-08T21:49:43.226284+0000","last_became_peered":"2024-05-08T21:49:43.226284+0000","last_unstale":"2024-05-08T21:49:48.755678+0000","last_undegraded":"2024-05-08T21:49:48.755678+0000","last_fullsized":"2024-05-08T21:49:48.755678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:01.844011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756849+0000","last_change":"2024-05-08T21:49:43.766694+0000","last_active":"2024-05-08T21:49:44.756849+0000","last_peered":"2024-05-08T21:49:44.756849+0000","last_clean":"2024-05-08T21:49:44.756849+0000","last_became_active":"2024-05-08T21:49:43.766079+0000","last_became_peered":"2024-05-08T21:49:43.766079+0000","last_unstale":"2024-05-08T21:49:44.756849+0000","last_undegraded":"2024-05-08T21:49:44.756849+0000","last_fullsized":"2024-05-08T21:49:44.756849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:01:16.682080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:48.755619+0000","last_change":"2024-05-08T21:49:43.230152+0000","last_active":"2024-05-08T21:49:48.755619+0000","last_peered":"2024-05-08T21:49:48.755619+0000","last_clean":"2024-05-08T21:49:48.755619+0000","last_became_active":"2024-05-08T21:49:43.229891+0000","last_became_peered":"2024-05-08T21:49:43.229891+0000","last_unstale":"2024-05-08T21:49:48.755619+0000","last_undegraded":"2024-05-08T21:49:48.755619+0000","last_fullsized":"2024-05-08T21:49:48.755619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:33:12.827218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757018+0000","last_change":"2024-05-08T21:49:43.771097+0000","last_active":"2024-05-08T21:49:44.757018+0000","last_peered":"2024-05-08T21:49:44.757018+0000","last_clean":"2024-05-08T21:49:44.757018+0000","last_became_active":"2024-05-08T21:49:43.770727+0000","last_became_peered":"2024-05-08T21:49:43.770727+0000","last_unstale":"2024-05-08T21:49:44.757018+0000","last_undegraded":"2024-05-08T21:49:44.757018+0000","last_fullsized":"2024-05-08T21:49:44.757018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:24:02.741766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927211+0000","last_change":"2024-05-08T21:49:43.220418+0000","last_active":"2024-05-08T21:49:44.927211+0000","last_peered":"2024-05-08T21:49:44.927211+0000","last_clean":"2024-05-08T21:49:44.927211+0000","last_became_active":"2024-05-08T21:49:43.220090+0000","last_became_peered":"2024-05-08T21:49:43.220090+0000","last_unstale":"2024-05-08T21:49:44.927211+0000","last_undegraded":"2024-05-08T21:49:44.927211+0000","last_fullsized":"2024-05-08T21:49:44.927211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:33:28.074468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927692+0000","last_change":"2024-05-08T21:49:43.762664+0000","last_active":"2024-05-08T21:49:44.927692+0000","last_peered":"2024-05-08T21:49:44.927692+0000","last_clean":"2024-05-08T21:49:44.927692+0000","last_became_active":"2024-05-08T21:49:43.762351+0000","last_became_peered":"2024-05-08T21:49:43.762351+0000","last_unstale":"2024-05-08T21:49:44.927692+0000","last_undegraded":"2024-05-08T21:49:44.927692+0000","last_fullsized":"2024-05-08T21:49:44.927692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:53.330614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756121+0000","last_change":"2024-05-08T21:49:43.220518+0000","last_active":"2024-05-08T21:49:44.756121+0000","last_peered":"2024-05-08T21:49:44.756121+0000","last_clean":"2024-05-08T21:49:44.756121+0000","last_became_active":"2024-05-08T21:49:43.218473+0000","last_became_peered":"2024-05-08T21:49:43.218473+0000","last_unstale":"2024-05-08T21:49:44.756121+0000","last_undegraded":"2024-05-08T21:49:44.756121+0000","last_fullsized":"2024-05-08T21:49:44.756121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:10.497167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927324+0000","last_change":"2024-05-08T21:49:43.770935+0000","last_active":"2024-05-08T21:49:44.927324+0000","last_peered":"2024-05-08T21:49:44.927324+0000","last_clean":"2024-05-08T21:49:44.927324+0000","last_became_active":"2024-05-08T21:49:43.770677+0000","last_became_peered":"2024-05-08T21:49:43.770677+0000","last_unstale":"2024-05-08T21:49:44.927324+0000","last_undegraded":"2024-05-08T21:49:44.927324+0000","last_fullsized":"2024-05-08T21:49:44.927324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:04:14.416894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.752777+0000","last_change":"2024-05-08T21:49:43.221027+0000","last_active":"2024-05-08T21:49:43.752777+0000","last_peered":"2024-05-08T21:49:43.752777+0000","last_clean":"2024-05-08T21:49:43.752777+0000","last_became_active":"2024-05-08T21:49:43.220780+0000","last_became_peered":"2024-05-08T21:49:43.220780+0000","last_unstale":"2024-05-08T21:49:43.752777+0000","last_undegraded":"2024-05-08T21:49:43.752777+0000","last_fullsized":"2024-05-08T21:49:43.752777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:20:34.123736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927461+0000","last_change":"2024-05-08T21:49:43.766815+0000","last_active":"2024-05-08T21:49:44.927461+0000","last_peered":"2024-05-08T21:49:44.927461+0000","last_clean":"2024-05-08T21:49:44.927461+0000","last_became_active":"2024-05-08T21:49:43.766568+0000","last_became_peered":"2024-05-08T21:49:43.766568+0000","last_unstale":"2024-05-08T21:49:44.927461+0000","last_undegraded":"2024-05-08T21:49:44.927461+0000","last_fullsized":"2024-05-08T21:49:44.927461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:41:45.602022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756625+0000","last_change":"2024-05-08T21:49:43.225299+0000","last_active":"2024-05-08T21:49:44.756625+0000","last_peered":"2024-05-08T21:49:44.756625+0000","last_clean":"2024-05-08T21:49:44.756625+0000","last_became_active":"2024-05-08T21:49:43.225057+0000","last_became_peered":"2024-05-08T21:49:43.225057+0000","last_unstale":"2024-05-08T21:49:44.756625+0000","last_undegraded":"2024-05-08T21:49:44.756625+0000","last_fullsized":"2024-05-08T21:49:44.756625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:38:43.069159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755021+0000","last_change":"2024-05-08T21:49:43.757361+0000","last_active":"2024-05-08T21:49:44.755021+0000","last_peered":"2024-05-08T21:49:44.755021+0000","last_clean":"2024-05-08T21:49:44.755021+0000","last_became_active":"2024-05-08T21:49:43.757092+0000","last_became_peered":"2024-05-08T21:49:43.757092+0000","last_unstale":"2024-05-08T21:49:44.755021+0000","last_undegraded":"2024-05-08T21:49:44.755021+0000","last_fullsized":"2024-05-08T21:49:44.755021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:24:02.741766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.756381+0000","last_change":"2024-05-08T21:49:43.229405+0000","last_active":"2024-05-08T21:49:43.756381+0000","last_peered":"2024-05-08T21:49:43.756381+0000","last_clean":"2024-05-08T21:49:43.756381+0000","last_became_active":"2024-05-08T21:49:43.229105+0000","last_became_peered":"2024-05-08T21:49:43.229105+0000","last_unstale":"2024-05-08T21:49:43.756381+0000","last_undegraded":"2024-05-08T21:49:43.756381+0000","last_fullsized":"2024-05-08T21:49:43.756381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:18:58.164159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757172+0000","last_change":"2024-05-08T21:49:43.773243+0000","last_active":"2024-05-08T21:49:44.757172+0000","last_peered":"2024-05-08T21:49:44.757172+0000","last_clean":"2024-05-08T21:49:44.757172+0000","last_became_active":"2024-05-08T21:49:43.772944+0000","last_became_peered":"2024-05-08T21:49:43.772944+0000","last_unstale":"2024-05-08T21:49:44.757172+0000","last_undegraded":"2024-05-08T21:49:44.757172+0000","last_fullsized":"2024-05-08T21:49:44.757172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:21:41.238890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757107+0000","last_change":"2024-05-08T21:49:43.224999+0000","last_active":"2024-05-08T21:49:44.757107+0000","last_peered":"2024-05-08T21:49:44.757107+0000","last_clean":"2024-05-08T21:49:44.757107+0000","last_became_active":"2024-05-08T21:49:43.223476+0000","last_became_peered":"2024-05-08T21:49:43.223476+0000","last_unstale":"2024-05-08T21:49:44.757107+0000","last_undegraded":"2024-05-08T21:49:44.757107+0000","last_fullsized":"2024-05-08T21:49:44.757107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:09:12.983430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927734+0000","last_change":"2024-05-08T21:49:43.771526+0000","last_active":"2024-05-08T21:49:44.927734+0000","last_peered":"2024-05-08T21:49:44.927734+0000","last_clean":"2024-05-08T21:49:44.927734+0000","last_became_active":"2024-05-08T21:49:43.771279+0000","last_became_peered":"2024-05-08T21:49:43.771279+0000","last_unstale":"2024-05-08T21:49:44.927734+0000","last_undegraded":"2024-05-08T21:49:44.927734+0000","last_fullsized":"2024-05-08T21:49:44.927734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:41:45.602022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:48.757392+0000","last_change":"2024-05-08T21:49:43.224378+0000","last_active":"2024-05-08T21:49:48.757392+0000","last_peered":"2024-05-08T21:49:48.757392+0000","last_clean":"2024-05-08T21:49:48.757392+0000","last_became_active":"2024-05-08T21:49:43.224164+0000","last_became_peered":"2024-05-08T21:49:43.224164+0000","last_unstale":"2024-05-08T21:49:48.757392+0000","last_undegraded":"2024-05-08T21:49:48.757392+0000","last_fullsized":"2024-05-08T21:49:48.757392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:06:10.276907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927552+0000","last_change":"2024-05-08T21:49:43.772948+0000","last_active":"2024-05-08T21:49:44.927552+0000","last_peered":"2024-05-08T21:49:44.927552+0000","last_clean":"2024-05-08T21:49:44.927552+0000","last_became_active":"2024-05-08T21:49:43.772685+0000","last_became_peered":"2024-05-08T21:49:43.772685+0000","last_unstale":"2024-05-08T21:49:44.927552+0000","last_undegraded":"2024-05-08T21:49:44.927552+0000","last_fullsized":"2024-05-08T21:49:44.927552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:02.850708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'8","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:50:05.715264+0000","last_change":"2024-05-08T21:49:43.222308+0000","last_active":"2024-05-08T21:50:05.715264+0000","last_peered":"2024-05-08T21:50:05.715264+0000","last_clean":"2024-05-08T21:50:05.715264+0000","last_became_active":"2024-05-08T21:49:43.221844+0000","last_became_peered":"2024-05-08T21:49:43.221844+0000","last_unstale":"2024-05-08T21:50:05.715264+0000","last_undegraded":"2024-05-08T21:50:05.715264+0000","last_fullsized":"2024-05-08T21:50:05.715264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:17.379362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1826,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927374+0000","last_change":"2024-05-08T21:49:43.773923+0000","last_active":"2024-05-08T21:49:44.927374+0000","last_peered":"2024-05-08T21:49:44.927374+0000","last_clean":"2024-05-08T21:49:44.927374+0000","last_became_active":"2024-05-08T21:49:43.772037+0000","last_became_peered":"2024-05-08T21:49:43.772037+0000","last_unstale":"2024-05-08T21:49:44.927374+0000","last_undegraded":"2024-05-08T21:49:44.927374+0000","last_fullsized":"2024-05-08T21:49:44.927374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:52:32.629407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:48.757374+0000","last_change":"2024-05-08T21:49:43.219473+0000","last_active":"2024-05-08T21:49:48.757374+0000","last_peered":"2024-05-08T21:49:48.757374+0000","last_clean":"2024-05-08T21:49:48.757374+0000","last_became_active":"2024-05-08T21:49:43.219186+0000","last_became_peered":"2024-05-08T21:49:43.219186+0000","last_unstale":"2024-05-08T21:49:48.757374+0000","last_undegraded":"2024-05-08T21:49:48.757374+0000","last_fullsized":"2024-05-08T21:49:48.757374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:20:34.123736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.926751+0000","last_change":"2024-05-08T21:49:43.775135+0000","last_active":"2024-05-08T21:49:44.926751+0000","last_peered":"2024-05-08T21:49:44.926751+0000","last_clean":"2024-05-08T21:49:44.926751+0000","last_became_active":"2024-05-08T21:49:43.774919+0000","last_became_peered":"2024-05-08T21:49:43.774919+0000","last_unstale":"2024-05-08T21:49:44.926751+0000","last_undegraded":"2024-05-08T21:49:44.926751+0000","last_fullsized":"2024-05-08T21:49:44.926751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:01:00.614249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757128+0000","last_change":"2024-05-08T21:49:43.227386+0000","last_active":"2024-05-08T21:49:44.757128+0000","last_peered":"2024-05-08T21:49:44.757128+0000","last_clean":"2024-05-08T21:49:44.757128+0000","last_became_active":"2024-05-08T21:49:43.227065+0000","last_became_peered":"2024-05-08T21:49:43.227065+0000","last_unstale":"2024-05-08T21:49:44.757128+0000","last_undegraded":"2024-05-08T21:49:44.757128+0000","last_fullsized":"2024-05-08T21:49:44.757128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:43:48.019170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927424+0000","last_change":"2024-05-08T21:49:43.770509+0000","last_active":"2024-05-08T21:49:44.927424+0000","last_peered":"2024-05-08T21:49:44.927424+0000","last_clean":"2024-05-08T21:49:44.927424+0000","last_became_active":"2024-05-08T21:49:43.770180+0000","last_became_peered":"2024-05-08T21:49:43.770180+0000","last_unstale":"2024-05-08T21:49:44.927424+0000","last_undegraded":"2024-05-08T21:49:44.927424+0000","last_fullsized":"2024-05-08T21:49:44.927424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:00:38.941899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.756153+0000","last_change":"2024-05-08T21:49:43.220942+0000","last_active":"2024-05-08T21:49:43.756153+0000","last_peered":"2024-05-08T21:49:43.756153+0000","last_clean":"2024-05-08T21:49:43.756153+0000","last_became_active":"2024-05-08T21:49:43.220641+0000","last_became_peered":"2024-05-08T21:49:43.220641+0000","last_unstale":"2024-05-08T21:49:43.756153+0000","last_undegraded":"2024-05-08T21:49:43.756153+0000","last_fullsized":"2024-05-08T21:49:43.756153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:52.323917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755763+0000","last_change":"2024-05-08T21:49:43.766269+0000","last_active":"2024-05-08T21:49:44.755763+0000","last_peered":"2024-05-08T21:49:44.755763+0000","last_clean":"2024-05-08T21:49:44.755763+0000","last_became_active":"2024-05-08T21:49:43.765945+0000","last_became_peered":"2024-05-08T21:49:43.765945+0000","last_unstale":"2024-05-08T21:49:44.755763+0000","last_undegraded":"2024-05-08T21:49:44.755763+0000","last_fullsized":"2024-05-08T21:49:44.755763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:17:34.570817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:48.763472+0000","last_change":"2024-05-08T21:49:43.208328+0000","last_active":"2024-05-08T21:49:48.763472+0000","last_peered":"2024-05-08T21:49:48.763472+0000","last_clean":"2024-05-08T21:49:48.763472+0000","last_became_active":"2024-05-08T21:49:43.208013+0000","last_became_peered":"2024-05-08T21:49:43.208013+0000","last_unstale":"2024-05-08T21:49:48.763472+0000","last_undegraded":"2024-05-08T21:49:48.763472+0000","last_fullsized":"2024-05-08T21:49:48.763472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:10.497167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.928099+0000","last_change":"2024-05-08T21:49:43.774210+0000","last_active":"2024-05-08T21:49:44.928099+0000","last_peered":"2024-05-08T21:49:44.928099+0000","last_clean":"2024-05-08T21:49:44.928099+0000","last_became_active":"2024-05-08T21:49:43.773933+0000","last_became_peered":"2024-05-08T21:49:43.773933+0000","last_unstale":"2024-05-08T21:49:44.928099+0000","last_undegraded":"2024-05-08T21:49:44.928099+0000","last_fullsized":"2024-05-08T21:49:44.928099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:10:25.398535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927899+0000","last_change":"2024-05-08T21:49:43.217456+0000","last_active":"2024-05-08T21:49:44.927899+0000","last_peered":"2024-05-08T21:49:44.927899+0000","last_clean":"2024-05-08T21:49:44.927899+0000","last_became_active":"2024-05-08T21:49:43.216822+0000","last_became_peered":"2024-05-08T21:49:43.216822+0000","last_unstale":"2024-05-08T21:49:44.927899+0000","last_undegraded":"2024-05-08T21:49:44.927899+0000","last_fullsized":"2024-05-08T21:49:44.927899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:41:35.881003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927764+0000","last_change":"2024-05-08T21:49:43.770066+0000","last_active":"2024-05-08T21:49:44.927764+0000","last_peered":"2024-05-08T21:49:44.927764+0000","last_clean":"2024-05-08T21:49:44.927764+0000","last_became_active":"2024-05-08T21:49:43.769762+0000","last_became_peered":"2024-05-08T21:49:43.769762+0000","last_unstale":"2024-05-08T21:49:44.927764+0000","last_undegraded":"2024-05-08T21:49:44.927764+0000","last_fullsized":"2024-05-08T21:49:44.927764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:40:20.301747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755188+0000","last_change":"2024-05-08T21:49:43.215293+0000","last_active":"2024-05-08T21:49:44.755188+0000","last_peered":"2024-05-08T21:49:44.755188+0000","last_clean":"2024-05-08T21:49:44.755188+0000","last_became_active":"2024-05-08T21:49:43.215048+0000","last_became_peered":"2024-05-08T21:49:43.215048+0000","last_unstale":"2024-05-08T21:49:44.755188+0000","last_undegraded":"2024-05-08T21:49:44.755188+0000","last_fullsized":"2024-05-08T21:49:44.755188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:43:48.019170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757129+0000","last_change":"2024-05-08T21:49:43.770326+0000","last_active":"2024-05-08T21:49:44.757129+0000","last_peered":"2024-05-08T21:49:44.757129+0000","last_clean":"2024-05-08T21:49:44.757129+0000","last_became_active":"2024-05-08T21:49:43.770029+0000","last_became_peered":"2024-05-08T21:49:43.770029+0000","last_unstale":"2024-05-08T21:49:44.757129+0000","last_undegraded":"2024-05-08T21:49:44.757129+0000","last_fullsized":"2024-05-08T21:49:44.757129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:33:33.642847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757017+0000","last_change":"2024-05-08T21:49:43.227710+0000","last_active":"2024-05-08T21:49:44.757017+0000","last_peered":"2024-05-08T21:49:44.757017+0000","last_clean":"2024-05-08T21:49:44.757017+0000","last_became_active":"2024-05-08T21:49:43.227430+0000","last_became_peered":"2024-05-08T21:49:43.227430+0000","last_unstale":"2024-05-08T21:49:44.757017+0000","last_undegraded":"2024-05-08T21:49:44.757017+0000","last_fullsized":"2024-05-08T21:49:44.757017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:05:58.875400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.928131+0000","last_change":"2024-05-08T21:49:43.768588+0000","last_active":"2024-05-08T21:49:44.928131+0000","last_peered":"2024-05-08T21:49:44.928131+0000","last_clean":"2024-05-08T21:49:44.928131+0000","last_became_active":"2024-05-08T21:49:43.768307+0000","last_became_peered":"2024-05-08T21:49:43.768307+0000","last_unstale":"2024-05-08T21:49:44.928131+0000","last_undegraded":"2024-05-08T21:49:44.928131+0000","last_fullsized":"2024-05-08T21:49:44.928131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:04.968184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.754953+0000","last_change":"2024-05-08T21:49:43.758618+0000","last_active":"2024-05-08T21:49:44.754953+0000","last_peered":"2024-05-08T21:49:44.754953+0000","last_clean":"2024-05-08T21:49:44.754953+0000","last_became_active":"2024-05-08T21:49:43.758367+0000","last_became_peered":"2024-05-08T21:49:43.758367+0000","last_unstale":"2024-05-08T21:49:44.754953+0000","last_undegraded":"2024-05-08T21:49:44.754953+0000","last_fullsized":"2024-05-08T21:49:44.754953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:30:06.569971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.751866+0000","last_change":"2024-05-08T21:49:43.217410+0000","last_active":"2024-05-08T21:49:43.751866+0000","last_peered":"2024-05-08T21:49:43.751866+0000","last_clean":"2024-05-08T21:49:43.751866+0000","last_became_active":"2024-05-08T21:49:43.217133+0000","last_became_peered":"2024-05-08T21:49:43.217133+0000","last_unstale":"2024-05-08T21:49:43.751866+0000","last_undegraded":"2024-05-08T21:49:43.751866+0000","last_fullsized":"2024-05-08T21:49:43.751866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:17.379362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.926897+0000","last_change":"2024-05-08T21:49:43.771651+0000","last_active":"2024-05-08T21:49:44.926897+0000","last_peered":"2024-05-08T21:49:44.926897+0000","last_clean":"2024-05-08T21:49:44.926897+0000","last_became_active":"2024-05-08T21:49:43.771451+0000","last_became_peered":"2024-05-08T21:49:43.771451+0000","last_unstale":"2024-05-08T21:49:44.926897+0000","last_undegraded":"2024-05-08T21:49:44.926897+0000","last_fullsized":"2024-05-08T21:49:44.926897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:00:38.941899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756759+0000","last_change":"2024-05-08T21:49:43.224929+0000","last_active":"2024-05-08T21:49:44.756759+0000","last_peered":"2024-05-08T21:49:44.756759+0000","last_clean":"2024-05-08T21:49:44.756759+0000","last_became_active":"2024-05-08T21:49:43.223469+0000","last_became_peered":"2024-05-08T21:49:43.223469+0000","last_unstale":"2024-05-08T21:49:44.756759+0000","last_undegraded":"2024-05-08T21:49:44.756759+0000","last_fullsized":"2024-05-08T21:49:44.756759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:27.504127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":164,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.756621+0000","last_change":"2024-05-08T21:49:38.626519+0000","last_active":"2024-05-08T21:49:43.756621+0000","last_peered":"2024-05-08T21:49:43.756621+0000","last_clean":"2024-05-08T21:49:43.756621+0000","last_became_active":"2024-05-08T21:49:38.626159+0000","last_became_peered":"2024-05-08T21:49:38.626159+0000","last_unstale":"2024-05-08T21:49:43.756621+0000","last_undegraded":"2024-05-08T21:49:43.756621+0000","last_fullsized":"2024-05-08T21:49:43.756621+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:36.031649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:36.031649+0000","last_clean_scrub_stamp":"2024-05-08T21:49:36.031649+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:12:04.846500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.926994+0000","last_change":"2024-05-08T21:49:43.770966+0000","last_active":"2024-05-08T21:49:44.926994+0000","last_peered":"2024-05-08T21:49:44.926994+0000","last_clean":"2024-05-08T21:49:44.926994+0000","last_became_active":"2024-05-08T21:49:43.770711+0000","last_became_peered":"2024-05-08T21:49:43.770711+0000","last_unstale":"2024-05-08T21:49:44.926994+0000","last_undegraded":"2024-05-08T21:49:44.926994+0000","last_fullsized":"2024-05-08T21:49:44.926994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:17:34.570817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.756729+0000","last_change":"2024-05-08T21:49:43.221086+0000","last_active":"2024-05-08T21:49:43.756729+0000","last_peered":"2024-05-08T21:49:43.756729+0000","last_clean":"2024-05-08T21:49:43.756729+0000","last_became_active":"2024-05-08T21:49:43.220539+0000","last_became_peered":"2024-05-08T21:49:43.220539+0000","last_unstale":"2024-05-08T21:49:43.756729+0000","last_undegraded":"2024-05-08T21:49:43.756729+0000","last_fullsized":"2024-05-08T21:49:43.756729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:52.323917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.765742+0000","last_change":"2024-05-08T21:49:43.222410+0000","last_active":"2024-05-08T21:49:43.765742+0000","last_peered":"2024-05-08T21:49:43.765742+0000","last_clean":"2024-05-08T21:49:43.765742+0000","last_became_active":"2024-05-08T21:49:43.222131+0000","last_became_peered":"2024-05-08T21:49:43.222131+0000","last_unstale":"2024-05-08T21:49:43.765742+0000","last_undegraded":"2024-05-08T21:49:43.765742+0000","last_fullsized":"2024-05-08T21:49:43.765742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:18:58.164159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755021+0000","last_change":"2024-05-08T21:49:43.758424+0000","last_active":"2024-05-08T21:49:44.755021+0000","last_peered":"2024-05-08T21:49:44.755021+0000","last_clean":"2024-05-08T21:49:44.755021+0000","last_became_active":"2024-05-08T21:49:43.758140+0000","last_became_peered":"2024-05-08T21:49:43.758140+0000","last_unstale":"2024-05-08T21:49:44.755021+0000","last_undegraded":"2024-05-08T21:49:44.755021+0000","last_fullsized":"2024-05-08T21:49:44.755021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:10.795540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:46.015958+0000","last_change":"2024-05-08T21:49:43.218241+0000","last_active":"2024-05-08T21:49:46.015958+0000","last_peered":"2024-05-08T21:49:46.015958+0000","last_clean":"2024-05-08T21:49:46.015958+0000","last_became_active":"2024-05-08T21:49:43.217780+0000","last_became_peered":"2024-05-08T21:49:43.217780+0000","last_unstale":"2024-05-08T21:49:46.015958+0000","last_undegraded":"2024-05-08T21:49:46.015958+0000","last_fullsized":"2024-05-08T21:49:46.015958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:27.504127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927830+0000","last_change":"2024-05-08T21:49:43.770491+0000","last_active":"2024-05-08T21:49:44.927830+0000","last_peered":"2024-05-08T21:49:44.927830+0000","last_clean":"2024-05-08T21:49:44.927830+0000","last_became_active":"2024-05-08T21:49:43.770221+0000","last_became_peered":"2024-05-08T21:49:43.770221+0000","last_unstale":"2024-05-08T21:49:44.927830+0000","last_undegraded":"2024-05-08T21:49:44.927830+0000","last_fullsized":"2024-05-08T21:49:44.927830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:25.661350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:48.755985+0000","last_change":"2024-05-08T21:49:43.221345+0000","last_active":"2024-05-08T21:49:48.755985+0000","last_peered":"2024-05-08T21:49:48.755985+0000","last_clean":"2024-05-08T21:49:48.755985+0000","last_became_active":"2024-05-08T21:49:43.220953+0000","last_became_peered":"2024-05-08T21:49:43.220953+0000","last_unstale":"2024-05-08T21:49:48.755985+0000","last_undegraded":"2024-05-08T21:49:48.755985+0000","last_fullsized":"2024-05-08T21:49:48.755985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:33:28.074468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927636+0000","last_change":"2024-05-08T21:49:43.765001+0000","last_active":"2024-05-08T21:49:44.927636+0000","last_peered":"2024-05-08T21:49:44.927636+0000","last_clean":"2024-05-08T21:49:44.927636+0000","last_became_active":"2024-05-08T21:49:43.764740+0000","last_became_peered":"2024-05-08T21:49:43.764740+0000","last_unstale":"2024-05-08T21:49:44.927636+0000","last_undegraded":"2024-05-08T21:49:44.927636+0000","last_fullsized":"2024-05-08T21:49:44.927636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:18:58.836430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.756521+0000","last_change":"2024-05-08T21:49:43.221251+0000","last_active":"2024-05-08T21:49:43.756521+0000","last_peered":"2024-05-08T21:49:43.756521+0000","last_clean":"2024-05-08T21:49:43.756521+0000","last_became_active":"2024-05-08T21:49:43.220839+0000","last_became_peered":"2024-05-08T21:49:43.220839+0000","last_unstale":"2024-05-08T21:49:43.756521+0000","last_undegraded":"2024-05-08T21:49:43.756521+0000","last_fullsized":"2024-05-08T21:49:43.756521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:10.497167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927485+0000","last_change":"2024-05-08T21:49:43.762511+0000","last_active":"2024-05-08T21:49:44.927485+0000","last_peered":"2024-05-08T21:49:44.927485+0000","last_clean":"2024-05-08T21:49:44.927485+0000","last_became_active":"2024-05-08T21:49:43.762170+0000","last_became_peered":"2024-05-08T21:49:43.762170+0000","last_unstale":"2024-05-08T21:49:44.927485+0000","last_undegraded":"2024-05-08T21:49:44.927485+0000","last_fullsized":"2024-05-08T21:49:44.927485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:11.503864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.754925+0000","last_change":"2024-05-08T21:49:43.215361+0000","last_active":"2024-05-08T21:49:44.754925+0000","last_peered":"2024-05-08T21:49:44.754925+0000","last_clean":"2024-05-08T21:49:44.754925+0000","last_became_active":"2024-05-08T21:49:43.215162+0000","last_became_peered":"2024-05-08T21:49:43.215162+0000","last_unstale":"2024-05-08T21:49:44.754925+0000","last_undegraded":"2024-05-08T21:49:44.754925+0000","last_fullsized":"2024-05-08T21:49:44.754925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:05:58.875400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927416+0000","last_change":"2024-05-08T21:49:43.757512+0000","last_active":"2024-05-08T21:49:44.927416+0000","last_peered":"2024-05-08T21:49:44.927416+0000","last_clean":"2024-05-08T21:49:44.927416+0000","last_became_active":"2024-05-08T21:49:43.757233+0000","last_became_peered":"2024-05-08T21:49:43.757233+0000","last_unstale":"2024-05-08T21:49:44.927416+0000","last_undegraded":"2024-05-08T21:49:44.927416+0000","last_fullsized":"2024-05-08T21:49:44.927416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:53:14.774835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755100+0000","last_change":"2024-05-08T21:49:43.217935+0000","last_active":"2024-05-08T21:49:44.755100+0000","last_peered":"2024-05-08T21:49:44.755100+0000","last_clean":"2024-05-08T21:49:44.755100+0000","last_became_active":"2024-05-08T21:49:43.217595+0000","last_became_peered":"2024-05-08T21:49:43.217595+0000","last_unstale":"2024-05-08T21:49:44.755100+0000","last_undegraded":"2024-05-08T21:49:44.755100+0000","last_fullsized":"2024-05-08T21:49:44.755100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:38:43.069159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927301+0000","last_change":"2024-05-08T21:49:43.766816+0000","last_active":"2024-05-08T21:49:44.927301+0000","last_peered":"2024-05-08T21:49:44.927301+0000","last_clean":"2024-05-08T21:49:44.927301+0000","last_became_active":"2024-05-08T21:49:43.766596+0000","last_became_peered":"2024-05-08T21:49:43.766596+0000","last_unstale":"2024-05-08T21:49:44.927301+0000","last_undegraded":"2024-05-08T21:49:44.927301+0000","last_fullsized":"2024-05-08T21:49:44.927301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:01:00.614249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:48.756361+0000","last_change":"2024-05-08T21:49:43.224243+0000","last_active":"2024-05-08T21:49:48.756361+0000","last_peered":"2024-05-08T21:49:48.756361+0000","last_clean":"2024-05-08T21:49:48.756361+0000","last_became_active":"2024-05-08T21:49:43.223974+0000","last_became_peered":"2024-05-08T21:49:43.223974+0000","last_unstale":"2024-05-08T21:49:48.756361+0000","last_undegraded":"2024-05-08T21:49:48.756361+0000","last_fullsized":"2024-05-08T21:49:48.756361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:03.961487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755912+0000","last_change":"2024-05-08T21:49:43.764377+0000","last_active":"2024-05-08T21:49:44.755912+0000","last_peered":"2024-05-08T21:49:44.755912+0000","last_clean":"2024-05-08T21:49:44.755912+0000","last_became_active":"2024-05-08T21:49:43.764075+0000","last_became_peered":"2024-05-08T21:49:43.764075+0000","last_unstale":"2024-05-08T21:49:44.755912+0000","last_undegraded":"2024-05-08T21:49:44.755912+0000","last_fullsized":"2024-05-08T21:49:44.755912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:41:45.602022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T21:49:43.752001+0000","last_change":"2024-05-08T21:49:43.229414+0000","last_active":"2024-05-08T21:49:43.752001+0000","last_peered":"2024-05-08T21:49:43.752001+0000","last_clean":"2024-05-08T21:49:43.752001+0000","last_became_active":"2024-05-08T21:49:43.229121+0000","last_became_peered":"2024-05-08T21:49:43.229121+0000","last_unstale":"2024-05-08T21:49:43.752001+0000","last_undegraded":"2024-05-08T21:49:43.752001+0000","last_fullsized":"2024-05-08T21:49:43.752001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:33:28.074468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927480+0000","last_change":"2024-05-08T21:49:43.774111+0000","last_active":"2024-05-08T21:49:44.927480+0000","last_peered":"2024-05-08T21:49:44.927480+0000","last_clean":"2024-05-08T21:49:44.927480+0000","last_became_active":"2024-05-08T21:49:43.772528+0000","last_became_peered":"2024-05-08T21:49:43.772528+0000","last_unstale":"2024-05-08T21:49:44.927480+0000","last_undegraded":"2024-05-08T21:49:44.927480+0000","last_fullsized":"2024-05-08T21:49:44.927480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:28.983476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:46.015933+0000","last_change":"2024-05-08T21:49:43.208581+0000","last_active":"2024-05-08T21:49:46.015933+0000","last_peered":"2024-05-08T21:49:46.015933+0000","last_clean":"2024-05-08T21:49:46.015933+0000","last_became_active":"2024-05-08T21:49:43.208326+0000","last_became_peered":"2024-05-08T21:49:43.208326+0000","last_unstale":"2024-05-08T21:49:46.015933+0000","last_undegraded":"2024-05-08T21:49:46.015933+0000","last_fullsized":"2024-05-08T21:49:46.015933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:13:35.461791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756911+0000","last_change":"2024-05-08T21:49:43.766519+0000","last_active":"2024-05-08T21:49:44.756911+0000","last_peered":"2024-05-08T21:49:44.756911+0000","last_clean":"2024-05-08T21:49:44.756911+0000","last_became_active":"2024-05-08T21:49:43.765789+0000","last_became_peered":"2024-05-08T21:49:43.765789+0000","last_unstale":"2024-05-08T21:49:44.756911+0000","last_undegraded":"2024-05-08T21:49:44.756911+0000","last_fullsized":"2024-05-08T21:49:44.756911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:23.674986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:48.757658+0000","last_change":"2024-05-08T21:49:43.218079+0000","last_active":"2024-05-08T21:49:48.757658+0000","last_peered":"2024-05-08T21:49:48.757658+0000","last_clean":"2024-05-08T21:49:48.757658+0000","last_became_active":"2024-05-08T21:49:43.217814+0000","last_became_peered":"2024-05-08T21:49:43.217814+0000","last_unstale":"2024-05-08T21:49:48.757658+0000","last_undegraded":"2024-05-08T21:49:48.757658+0000","last_fullsized":"2024-05-08T21:49:48.757658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:18:58.164159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.928456+0000","last_change":"2024-05-08T21:49:43.775713+0000","last_active":"2024-05-08T21:49:44.928456+0000","last_peered":"2024-05-08T21:49:44.928456+0000","last_clean":"2024-05-08T21:49:44.928456+0000","last_became_active":"2024-05-08T21:49:43.775361+0000","last_became_peered":"2024-05-08T21:49:43.775361+0000","last_unstale":"2024-05-08T21:49:44.928456+0000","last_undegraded":"2024-05-08T21:49:44.928456+0000","last_fullsized":"2024-05-08T21:49:44.928456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:48:24.482146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755727+0000","last_change":"2024-05-08T21:49:43.767129+0000","last_active":"2024-05-08T21:49:44.755727+0000","last_peered":"2024-05-08T21:49:44.755727+0000","last_clean":"2024-05-08T21:49:44.755727+0000","last_became_active":"2024-05-08T21:49:43.766789+0000","last_became_peered":"2024-05-08T21:49:43.766789+0000","last_unstale":"2024-05-08T21:49:44.755727+0000","last_undegraded":"2024-05-08T21:49:44.755727+0000","last_fullsized":"2024-05-08T21:49:44.755727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:39.954320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927246+0000","last_change":"2024-05-08T21:49:43.766157+0000","last_active":"2024-05-08T21:49:44.927246+0000","last_peered":"2024-05-08T21:49:44.927246+0000","last_clean":"2024-05-08T21:49:44.927246+0000","last_became_active":"2024-05-08T21:49:43.765843+0000","last_became_peered":"2024-05-08T21:49:43.765843+0000","last_unstale":"2024-05-08T21:49:44.927246+0000","last_undegraded":"2024-05-08T21:49:44.927246+0000","last_fullsized":"2024-05-08T21:49:44.927246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:04.968184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.757080+0000","last_change":"2024-05-08T21:49:43.768929+0000","last_active":"2024-05-08T21:49:44.757080+0000","last_peered":"2024-05-08T21:49:44.757080+0000","last_clean":"2024-05-08T21:49:44.757080+0000","last_became_active":"2024-05-08T21:49:43.767606+0000","last_became_peered":"2024-05-08T21:49:43.767606+0000","last_unstale":"2024-05-08T21:49:44.757080+0000","last_undegraded":"2024-05-08T21:49:44.757080+0000","last_fullsized":"2024-05-08T21:49:44.757080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:13:06.426154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927158+0000","last_change":"2024-05-08T21:49:43.774673+0000","last_active":"2024-05-08T21:49:44.927158+0000","last_peered":"2024-05-08T21:49:44.927158+0000","last_clean":"2024-05-08T21:49:44.927158+0000","last_became_active":"2024-05-08T21:49:43.774406+0000","last_became_peered":"2024-05-08T21:49:43.774406+0000","last_unstale":"2024-05-08T21:49:44.927158+0000","last_undegraded":"2024-05-08T21:49:44.927158+0000","last_fullsized":"2024-05-08T21:49:44.927158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:43.798909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927659+0000","last_change":"2024-05-08T21:49:43.764222+0000","last_active":"2024-05-08T21:49:44.927659+0000","last_peered":"2024-05-08T21:49:44.927659+0000","last_clean":"2024-05-08T21:49:44.927659+0000","last_became_active":"2024-05-08T21:49:43.763937+0000","last_became_peered":"2024-05-08T21:49:43.763937+0000","last_unstale":"2024-05-08T21:49:44.927659+0000","last_undegraded":"2024-05-08T21:49:44.927659+0000","last_fullsized":"2024-05-08T21:49:44.927659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:04:14.416894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.755114+0000","last_change":"2024-05-08T21:49:43.757318+0000","last_active":"2024-05-08T21:49:44.755114+0000","last_peered":"2024-05-08T21:49:44.755114+0000","last_clean":"2024-05-08T21:49:44.755114+0000","last_became_active":"2024-05-08T21:49:43.757083+0000","last_became_peered":"2024-05-08T21:49:43.757083+0000","last_unstale":"2024-05-08T21:49:44.755114+0000","last_undegraded":"2024-05-08T21:49:44.755114+0000","last_fullsized":"2024-05-08T21:49:44.755114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:47.551474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756302+0000","last_change":"2024-05-08T21:49:43.773491+0000","last_active":"2024-05-08T21:49:44.756302+0000","last_peered":"2024-05-08T21:49:44.756302+0000","last_clean":"2024-05-08T21:49:44.756302+0000","last_became_active":"2024-05-08T21:49:43.773203+0000","last_became_peered":"2024-05-08T21:49:43.773203+0000","last_unstale":"2024-05-08T21:49:44.756302+0000","last_undegraded":"2024-05-08T21:49:44.756302+0000","last_fullsized":"2024-05-08T21:49:44.756302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:53:14.774835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927776+0000","last_change":"2024-05-08T21:49:43.761926+0000","last_active":"2024-05-08T21:49:44.927776+0000","last_peered":"2024-05-08T21:49:44.927776+0000","last_clean":"2024-05-08T21:49:44.927776+0000","last_became_active":"2024-05-08T21:49:43.761645+0000","last_became_peered":"2024-05-08T21:49:43.761645+0000","last_unstale":"2024-05-08T21:49:44.927776+0000","last_undegraded":"2024-05-08T21:49:44.927776+0000","last_fullsized":"2024-05-08T21:49:44.927776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:10:07.209965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756761+0000","last_change":"2024-05-08T21:49:43.768942+0000","last_active":"2024-05-08T21:49:44.756761+0000","last_peered":"2024-05-08T21:49:44.756761+0000","last_clean":"2024-05-08T21:49:44.756761+0000","last_became_active":"2024-05-08T21:49:43.768673+0000","last_became_peered":"2024-05-08T21:49:43.768673+0000","last_unstale":"2024-05-08T21:49:44.756761+0000","last_undegraded":"2024-05-08T21:49:44.756761+0000","last_fullsized":"2024-05-08T21:49:44.756761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:15:41.869107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927592+0000","last_change":"2024-05-08T21:49:43.766452+0000","last_active":"2024-05-08T21:49:44.927592+0000","last_peered":"2024-05-08T21:49:44.927592+0000","last_clean":"2024-05-08T21:49:44.927592+0000","last_became_active":"2024-05-08T21:49:43.765723+0000","last_became_peered":"2024-05-08T21:49:43.765723+0000","last_unstale":"2024-05-08T21:49:44.927592+0000","last_undegraded":"2024-05-08T21:49:44.927592+0000","last_fullsized":"2024-05-08T21:49:44.927592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:19:28.925404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756863+0000","last_change":"2024-05-08T21:49:43.775098+0000","last_active":"2024-05-08T21:49:44.756863+0000","last_peered":"2024-05-08T21:49:44.756863+0000","last_clean":"2024-05-08T21:49:44.756863+0000","last_became_active":"2024-05-08T21:49:43.774808+0000","last_became_peered":"2024-05-08T21:49:43.774808+0000","last_unstale":"2024-05-08T21:49:44.756863+0000","last_undegraded":"2024-05-08T21:49:44.756863+0000","last_fullsized":"2024-05-08T21:49:44.756863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:51:15.152611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.927076+0000","last_change":"2024-05-08T21:49:43.775129+0000","last_active":"2024-05-08T21:49:44.927076+0000","last_peered":"2024-05-08T21:49:44.927076+0000","last_clean":"2024-05-08T21:49:44.927076+0000","last_became_active":"2024-05-08T21:49:43.774881+0000","last_became_peered":"2024-05-08T21:49:43.774881+0000","last_unstale":"2024-05-08T21:49:44.927076+0000","last_undegraded":"2024-05-08T21:49:44.927076+0000","last_fullsized":"2024-05-08T21:49:44.927076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:19:28.925404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-08T21:49:44.756057+0000","last_change":"2024-05-08T21:49:43.764163+0000","last_active":"2024-05-08T21:49:44.756057+0000","last_peered":"2024-05-08T21:49:44.756057+0000","last_clean":"2024-05-08T21:49:44.756057+0000","last_became_active":"2024-05-08T21:49:43.763907+0000","last_became_peered":"2024-05-08T21:49:43.763907+0000","last_unstale":"2024-05-08T21:49:44.756057+0000","last_undegraded":"2024-05-08T21:49:44.756057+0000","last_fullsized":"2024-05-08T21:49:44.756057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:01:00.614249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2624,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":5248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509451,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":806912,"data_stored":664039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509451,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":221184,"data_stored":74915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":212992,"data_stored":73179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":217088,"data_stored":73249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.313}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509450,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":815104,"data_stored":664095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]}]},{"osd":2,"up_from":15,"seq":64424509451,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":208896,"data_stored":73089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]}]},{"osd":3,"up_from":15,"seq":64424509450,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":221184,"data_stored":74915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]}]},{"osd":4,"up_from":15,"seq":64424509450,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":221184,"data_stored":73215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T21:50:10.444 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T21:50:10.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.599+0000 7f863bec9700 1 Processor -- start 2024-05-08T21:50:10.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.599+0000 7f863bec9700 1 -- start start 2024-05-08T21:50:10.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.600+0000 7f863bec9700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f86340b28b0 0x7f8634163420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:10.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.600+0000 7f863bec9700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86340c2570 con 0x7f86340c4540 2024-05-08T21:50:10.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.600+0000 7f863bec9700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f863406f4e0 con 0x7f8634151bd0 2024-05-08T21:50:10.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.600+0000 7f863bec9700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86340c2e80 con 0x7f86340b28b0 2024-05-08T21:50:10.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.600+0000 7f8639464700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f86340c4540 0x7f86340c8100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:58474/0 (socket says 172.21.15.73:58474) 2024-05-08T21:50:10.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.600+0000 7f8639464700 1 -- 172.21.15.73:0/1978830197 learned_addr learned my addr 172.21.15.73:0/1978830197 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:50:10.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.600+0000 7f863a466700 1 --2- 172.21.15.73:0/1978830197 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f86340b28b0 0x7f8634163420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:10.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.600+0000 7f8638c63700 1 -- 172.21.15.73:0/1978830197 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1380649295 0 0) 0x7f86340c2570 con 0x7f86340c4540 2024-05-08T21:50:10.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.600+0000 7f8638c63700 1 -- 172.21.15.73:0/1978830197 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86200035b0 con 0x7f86340c4540 2024-05-08T21:50:10.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.600+0000 7f8638c63700 1 -- 172.21.15.73:0/1978830197 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1865081404 0 0) 0x7f86200035b0 con 0x7f86340c4540 2024-05-08T21:50:10.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.600+0000 7f8638c63700 1 -- 172.21.15.73:0/1978830197 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f86340b28b0 msgr2=0x7f8634163420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:50:10.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.600+0000 7f8638c63700 1 --2- 172.21.15.73:0/1978830197 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f86340b28b0 0x7f8634163420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:10.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.600+0000 7f8638c63700 1 -- 172.21.15.73:0/1978830197 >> v1:172.21.15.115:6789/0 conn(0x7f8634151bd0 legacy=0x7f86340cd4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:10.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.600+0000 7f8638c63700 1 -- 172.21.15.73:0/1978830197 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f863406f7c0 con 0x7f86340c4540 2024-05-08T21:50:10.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.600+0000 7f8638c63700 1 -- 172.21.15.73:0/1978830197 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 953298616 0 0) 0x7f8624001670 con 0x7f86340c4540 2024-05-08T21:50:10.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.600+0000 7f8638c63700 1 -- 172.21.15.73:0/1978830197 >> v1:172.21.15.73:6789/0 conn(0x7f86340c4540 legacy=0x7f86340c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:10.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.600+0000 7f8638c63700 1 --2- 172.21.15.73:0/1978830197 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8620003a30 0x7f8620003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:10.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.600+0000 7f8638c63700 1 --2- 172.21.15.73:0/1978830197 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8620004850 0x7f8620004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:10.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.600+0000 7f8638c63700 1 --2- 172.21.15.73:0/1978830197 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f86340b28b0 0x7f8620005270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:10.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.600+0000 7f8638c63700 1 -- 172.21.15.73:0/1978830197 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86340c2e80 con 0x7f8620004850 2024-05-08T21:50:10.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.600+0000 7f8638c63700 1 -- 172.21.15.73:0/1978830197 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f862000bba0 con 0x7f8620003a30 2024-05-08T21:50:10.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.600+0000 7f8638c63700 1 -- 172.21.15.73:0/1978830197 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f862000bd30 con 0x7f86340b28b0 2024-05-08T21:50:10.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.600+0000 7f8639464700 1 --2- 172.21.15.73:0/1978830197 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8620004850 0x7f8620004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:10.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.601+0000 7f8639c65700 1 --2- 172.21.15.73:0/1978830197 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8620003a30 0x7f8620003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:10.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.601+0000 7f863a466700 1 --2- 172.21.15.73:0/1978830197 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f86340b28b0 0x7f8620005270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:10.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.601+0000 7f8639464700 1 -- 172.21.15.73:0/1978830197 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f86340b28b0 msgr2=0x7f8620005270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:50:10.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.601+0000 7f8639464700 1 --2- 172.21.15.73:0/1978830197 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f86340b28b0 0x7f8620005270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:10.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.601+0000 7f8639464700 1 -- 172.21.15.73:0/1978830197 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8620003a30 msgr2=0x7f8620003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:50:10.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.601+0000 7f8639464700 1 --2- 172.21.15.73:0/1978830197 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8620003a30 0x7f8620003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:10.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.601+0000 7f8639464700 1 -- 172.21.15.73:0/1978830197 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86200035b0 con 0x7f8620004850 2024-05-08T21:50:10.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.601+0000 7f8639464700 1 --2- 172.21.15.73:0/1978830197 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8620004850 0x7f8620004cd0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f862400c240 tx=0x7f8620005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=844b57d64bbc391a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:10.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.601+0000 7f8638c63700 1 -- 172.21.15.73:0/1978830197 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8624007c10 con 0x7f8620004850 2024-05-08T21:50:10.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.601+0000 7f8638c63700 1 -- 172.21.15.73:0/1978830197 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f862400cdc0 con 0x7f8620004850 2024-05-08T21:50:10.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.601+0000 7f8638c63700 1 -- 172.21.15.73:0/1978830197 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8624005ba0 con 0x7f8620004850 2024-05-08T21:50:10.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.601+0000 7f863bec9700 1 -- 172.21.15.73:0/1978830197 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8620004850 msgr2=0x7f8620004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:10.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.601+0000 7f863bec9700 1 --2- 172.21.15.73:0/1978830197 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8620004850 0x7f8620004cd0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f862400c240 tx=0x7f8620005880 comp rx=0 tx=0).stop 2024-05-08T21:50:10.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.601+0000 7f863a466700 1 -- 172.21.15.73:0/1978830197 reap_dead start 2024-05-08T21:50:10.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.602+0000 7f863bec9700 1 -- 172.21.15.73:0/1978830197 shutdown_connections 2024-05-08T21:50:10.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.602+0000 7f863bec9700 1 -- 172.21.15.73:0/1978830197 >> 172.21.15.73:0/1978830197 conn(0x7f863406ae10 msgr2=0x7f86340666c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:50:10.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.602+0000 7f863bec9700 1 -- 172.21.15.73:0/1978830197 shutdown_connections 2024-05-08T21:50:10.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.602+0000 7f863bec9700 1 -- 172.21.15.73:0/1978830197 wait complete. 2024-05-08T21:50:10.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.603+0000 7f863bec9700 1 Processor -- start 2024-05-08T21:50:10.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.603+0000 7f863bec9700 1 -- start start 2024-05-08T21:50:10.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.604+0000 7f863bec9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8620004850 0x7f86340b1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:10.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.604+0000 7f863bec9700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8634150af0 0x7f8634152ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:10.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.604+0000 7f863bec9700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f863414eda0 0x7f8634153010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:10.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.604+0000 7f863bec9700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86341f0910 con 0x7f8620004850 2024-05-08T21:50:10.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.604+0000 7f863bec9700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8634154530 con 0x7f8634150af0 2024-05-08T21:50:10.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.604+0000 7f863bec9700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86341525d0 con 0x7f863414eda0 2024-05-08T21:50:10.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.604+0000 7f8639c65700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8620004850 0x7f86340b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:10.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.604+0000 7f8639c65700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8620004850 0x7f86340b1460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36466/0 (socket says 172.21.15.73:36466) 2024-05-08T21:50:10.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.604+0000 7f8639c65700 1 -- 172.21.15.73:0/514035094 learned_addr learned my addr 172.21.15.73:0/514035094 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:50:10.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.604+0000 7f8639c65700 1 -- 172.21.15.73:0/514035094 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f863414eda0 msgr2=0x7f8634153010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:10.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.604+0000 7f8639c65700 1 --2- 172.21.15.73:0/514035094 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f863414eda0 0x7f8634153010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:10.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.604+0000 7f8639c65700 1 -- 172.21.15.73:0/514035094 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8634150af0 msgr2=0x7f8634152ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:10.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.604+0000 7f8639c65700 1 --2- 172.21.15.73:0/514035094 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8634150af0 0x7f8634152ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:10.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.604+0000 7f8639c65700 1 -- 172.21.15.73:0/514035094 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86341547d0 con 0x7f8620004850 2024-05-08T21:50:10.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.605+0000 7f8639c65700 1 --2- 172.21.15.73:0/514035094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8620004850 0x7f86340b1460 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f863000f770 tx=0x7f863000fb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:10.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.605+0000 7f862a7fc700 1 -- 172.21.15.73:0/514035094 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86300052e0 con 0x7f8620004850 2024-05-08T21:50:10.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.605+0000 7f862a7fc700 1 -- 172.21.15.73:0/514035094 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8630005440 con 0x7f8620004850 2024-05-08T21:50:10.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.605+0000 7f863bec9700 1 -- 172.21.15.73:0/514035094 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86341f0b00 con 0x7f8620004850 2024-05-08T21:50:10.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.605+0000 7f862a7fc700 1 -- 172.21.15.73:0/514035094 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86300038c0 con 0x7f8620004850 2024-05-08T21:50:10.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.605+0000 7f863bec9700 1 -- 172.21.15.73:0/514035094 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86340ad8c0 con 0x7f8620004850 2024-05-08T21:50:10.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.606+0000 7f863bec9700 1 -- 172.21.15.73:0/514035094 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8634074270 con 0x7f8620004850 2024-05-08T21:50:10.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.606+0000 7f862a7fc700 1 -- 172.21.15.73:0/514035094 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8630003a20 con 0x7f8620004850 2024-05-08T21:50:10.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.607+0000 7f862a7fc700 1 --2- 172.21.15.73:0/514035094 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f861806acc0 0x7f861806d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:10.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.607+0000 7f862a7fc700 1 -- 172.21.15.73:0/514035094 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8630089050 con 0x7f8620004850 2024-05-08T21:50:10.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.607+0000 7f8639464700 1 --2- 172.21.15.73:0/514035094 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f861806acc0 0x7f861806d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:10.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.607+0000 7f8639464700 1 --2- 172.21.15.73:0/514035094 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f861806acc0 0x7f861806d180 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f86340c7ce0 tx=0x7f862400a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:10.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.611+0000 7f862a7fc700 1 -- 172.21.15.73:0/514035094 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f8630054230 con 0x7f8620004850 2024-05-08T21:50:10.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.807+0000 7f863bec9700 1 -- 172.21.15.73:0/514035094 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8634068b80 con 0x7f8620004850 2024-05-08T21:50:10.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.808+0000 7f862a7fc700 1 -- 172.21.15.73:0/514035094 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16037 (secure 0 0 0) 0x7f8630057850 con 0x7f8620004850 2024-05-08T21:50:10.809 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:50:10.809 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":21,"fsid":"143164b7-c9c7-4737-a494-7dafa5a3320c","created":"2024-05-08T21:49:26.221909+0000","modified":"2024-05-08T21:49:44.748794+0000","last_up_change":"2024-05-08T21:49:37.118386+0000","last_in_change":"2024-05-08T21:49:28.836944+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T21:49:35.998578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T21:49:42.171760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T21:49:42.576293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6b7439c1-daaa-44af-8333-a455f9e9dc67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":47228},{"type":"v1","addr":"172.21.15.73:6809","nonce":47228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":47228},{"type":"v1","addr":"172.21.15.73:6811","nonce":47228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":47228},{"type":"v1","addr":"172.21.15.73:6815","nonce":47228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":47228},{"type":"v1","addr":"172.21.15.73:6813","nonce":47228}]},"public_addr":"172.21.15.73:6809/47228","cluster_addr":"172.21.15.73:6811/47228","heartbeat_back_addr":"172.21.15.73:6815/47228","heartbeat_front_addr":"172.21.15.73:6813/47228","state":["exists","up"]},{"osd":1,"uuid":"fb67886a-d7f7-45ac-832f-36c871c8a208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":47227},{"type":"v1","addr":"172.21.15.73:6801","nonce":47227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":47227},{"type":"v1","addr":"172.21.15.73:6803","nonce":47227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":47227},{"type":"v1","addr":"172.21.15.73:6807","nonce":47227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":47227},{"type":"v1","addr":"172.21.15.73:6805","nonce":47227}]},"public_addr":"172.21.15.73:6801/47227","cluster_addr":"172.21.15.73:6803/47227","heartbeat_back_addr":"172.21.15.73:6807/47227","heartbeat_front_addr":"172.21.15.73:6805/47227","state":["exists","up"]},{"osd":2,"uuid":"a5cd6e98-6621-473a-bfb8-5c648abbb563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":47229},{"type":"v1","addr":"172.21.15.73:6817","nonce":47229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":47229},{"type":"v1","addr":"172.21.15.73:6819","nonce":47229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":47229},{"type":"v1","addr":"172.21.15.73:6823","nonce":47229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":47229},{"type":"v1","addr":"172.21.15.73:6821","nonce":47229}]},"public_addr":"172.21.15.73:6817/47229","cluster_addr":"172.21.15.73:6819/47229","heartbeat_back_addr":"172.21.15.73:6823/47229","heartbeat_front_addr":"172.21.15.73:6821/47229","state":["exists","up"]},{"osd":3,"uuid":"36927c20-4241-4f3b-91b5-a6a6f27598e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":47232},{"type":"v1","addr":"172.21.15.73:6825","nonce":47232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":47232},{"type":"v1","addr":"172.21.15.73:6827","nonce":47232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":47232},{"type":"v1","addr":"172.21.15.73:6831","nonce":47232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":47232},{"type":"v1","addr":"172.21.15.73:6829","nonce":47232}]},"public_addr":"172.21.15.73:6825/47232","cluster_addr":"172.21.15.73:6827/47232","heartbeat_back_addr":"172.21.15.73:6831/47232","heartbeat_front_addr":"172.21.15.73:6829/47232","state":["exists","up"]},{"osd":4,"uuid":"4ebe0a18-8216-4815-878a-39c39a6cd3fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":47200},{"type":"v1","addr":"172.21.15.115:6801","nonce":47200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":47200},{"type":"v1","addr":"172.21.15.115:6803","nonce":47200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":47200},{"type":"v1","addr":"172.21.15.115:6807","nonce":47200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":47200},{"type":"v1","addr":"172.21.15.115:6805","nonce":47200}]},"public_addr":"172.21.15.115:6801/47200","cluster_addr":"172.21.15.115:6803/47200","heartbeat_back_addr":"172.21.15.115:6807/47200","heartbeat_front_addr":"172.21.15.115:6805/47200","state":["exists","up"]},{"osd":5,"uuid":"957f0ac1-5f26-4f02-8c05-488e6b67ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":47201},{"type":"v1","addr":"172.21.15.115:6809","nonce":47201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":47201},{"type":"v1","addr":"172.21.15.115:6811","nonce":47201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":47201},{"type":"v1","addr":"172.21.15.115:6815","nonce":47201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":47201},{"type":"v1","addr":"172.21.15.115:6813","nonce":47201}]},"public_addr":"172.21.15.115:6809/47201","cluster_addr":"172.21.15.115:6811/47201","heartbeat_back_addr":"172.21.15.115:6815/47201","heartbeat_front_addr":"172.21.15.115:6813/47201","state":["exists","up"]},{"osd":6,"uuid":"f5a6768f-ba7f-4f66-b335-0c303b158e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":47202},{"type":"v1","addr":"172.21.15.115:6817","nonce":47202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":47202},{"type":"v1","addr":"172.21.15.115:6819","nonce":47202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":47202},{"type":"v1","addr":"172.21.15.115:6823","nonce":47202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":47202},{"type":"v1","addr":"172.21.15.115:6821","nonce":47202}]},"public_addr":"172.21.15.115:6817/47202","cluster_addr":"172.21.15.115:6819/47202","heartbeat_back_addr":"172.21.15.115:6823/47202","heartbeat_front_addr":"172.21.15.115:6821/47202","state":["exists","up"]},{"osd":7,"uuid":"f4187743-f9e6-42e6-aca9-0604a58db1ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":47211},{"type":"v1","addr":"172.21.15.115:6825","nonce":47211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":47211},{"type":"v1","addr":"172.21.15.115:6827","nonce":47211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":47211},{"type":"v1","addr":"172.21.15.115:6831","nonce":47211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":47211},{"type":"v1","addr":"172.21.15.115:6829","nonce":47211}]},"public_addr":"172.21.15.115:6825/47211","cluster_addr":"172.21.15.115:6827/47211","heartbeat_back_addr":"172.21.15.115:6831/47211","heartbeat_front_addr":"172.21.15.115:6829/47211","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:33.996335+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:33.687451+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:34.072549+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:33.997588+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:34.047260+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:34.876272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:33.965472+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:34.038637+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T21:50:10.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.810+0000 7f863bec9700 1 -- 172.21.15.73:0/514035094 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f861806acc0 msgr2=0x7f861806d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:10.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.810+0000 7f863bec9700 1 --2- 172.21.15.73:0/514035094 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f861806acc0 0x7f861806d180 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f86340c7ce0 tx=0x7f862400a000 comp rx=0 tx=0).stop 2024-05-08T21:50:10.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.810+0000 7f863bec9700 1 -- 172.21.15.73:0/514035094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8620004850 msgr2=0x7f86340b1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:10.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.810+0000 7f863bec9700 1 --2- 172.21.15.73:0/514035094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8620004850 0x7f86340b1460 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f863000f770 tx=0x7f863000fb30 comp rx=0 tx=0).stop 2024-05-08T21:50:10.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.810+0000 7f863bec9700 1 -- 172.21.15.73:0/514035094 shutdown_connections 2024-05-08T21:50:10.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.810+0000 7f863bec9700 1 --2- 172.21.15.73:0/514035094 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f861806acc0 0x7f861806d180 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:10.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.810+0000 7f863bec9700 1 --2- 172.21.15.73:0/514035094 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f863414eda0 0x7f8634153010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:10.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.810+0000 7f863bec9700 1 --2- 172.21.15.73:0/514035094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8620004850 0x7f86340b1460 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:10.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.810+0000 7f863bec9700 1 --2- 172.21.15.73:0/514035094 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8634150af0 0x7f8634152ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:10.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.810+0000 7f863bec9700 1 -- 172.21.15.73:0/514035094 >> 172.21.15.73:0/514035094 conn(0x7f863406ae10 msgr2=0x7f8634156e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:50:10.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.810+0000 7f863bec9700 1 -- 172.21.15.73:0/514035094 shutdown_connections 2024-05-08T21:50:10.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.810+0000 7f863bec9700 1 -- 172.21.15.73:0/514035094 wait complete. 2024-05-08T21:50:10.823 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T21:49:35.998578+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T21:49:42.171760+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T21:49:42.576293+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T21:50:10.824 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T21:50:10.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.946+0000 7f323a5a4700 1 Processor -- start 2024-05-08T21:50:10.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.946+0000 7f323a5a4700 1 -- start start 2024-05-08T21:50:10.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.947+0000 7f323a5a4700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f323415de50 0x7f32340cd9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:10.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.947+0000 7f323a5a4700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f323415d2a0 0x7f3234164620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:10.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.947+0000 7f323a5a4700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32340cd550 con 0x7f323406d820 2024-05-08T21:50:10.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.947+0000 7f323a5a4700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f323415e230 con 0x7f323415d2a0 2024-05-08T21:50:10.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.947+0000 7f323a5a4700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f323406f2f0 con 0x7f323415de50 2024-05-08T21:50:10.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.947+0000 7f32337fe700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f323406d820 0x7f32340c8750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:58480/0 (socket says 172.21.15.73:58480) 2024-05-08T21:50:10.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.947+0000 7f32337fe700 1 -- 172.21.15.73:0/1704982201 learned_addr learned my addr 172.21.15.73:0/1704982201 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:50:10.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.947+0000 7f3238b41700 1 --2- 172.21.15.73:0/1704982201 >> v2:172.21.15.115:3300/0 conn(0x7f323415d2a0 0x7f3234164620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:10.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.947+0000 7f3233fff700 1 --2- 172.21.15.73:0/1704982201 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f323415de50 0x7f32340cd9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:10.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.947+0000 7f3232ffd700 1 -- 172.21.15.73:0/1704982201 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4034267046 0 0) 0x7f32340cd550 con 0x7f323406d820 2024-05-08T21:50:10.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.947+0000 7f3232ffd700 1 -- 172.21.15.73:0/1704982201 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f321c0035b0 con 0x7f323406d820 2024-05-08T21:50:10.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.947+0000 7f3238b41700 1 -- 172.21.15.73:0/1704982201 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f323415de50 msgr2=0x7f32340cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:50:10.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.947+0000 7f3238b41700 1 --2- 172.21.15.73:0/1704982201 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f323415de50 0x7f32340cd9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:10.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.947+0000 7f3238b41700 1 -- 172.21.15.73:0/1704982201 >> v1:172.21.15.73:6789/0 conn(0x7f323406d820 legacy=0x7f32340c8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:10.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.947+0000 7f3238b41700 1 -- 172.21.15.73:0/1704982201 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32340c4470 con 0x7f323415d2a0 2024-05-08T21:50:10.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.947+0000 7f3233fff700 1 --2- 172.21.15.73:0/1704982201 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f323415de50 0x7f32340cd9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:50:10.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.947+0000 7f3238b41700 1 --2- 172.21.15.73:0/1704982201 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f323415d2a0 0x7f3234164620 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f322c009d90 tx=0x7f322c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79cabfb374b6098f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:10.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.948+0000 7f3232ffd700 1 -- 172.21.15.73:0/1704982201 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322c00e070 con 0x7f323415d2a0 2024-05-08T21:50:10.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.948+0000 7f3232ffd700 1 -- 172.21.15.73:0/1704982201 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f322c00bb20 con 0x7f323415d2a0 2024-05-08T21:50:10.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.948+0000 7f3232ffd700 1 -- 172.21.15.73:0/1704982201 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322c00be90 con 0x7f323415d2a0 2024-05-08T21:50:10.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.948+0000 7f323a5a4700 1 -- 172.21.15.73:0/1704982201 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f323415d2a0 msgr2=0x7f3234164620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:10.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.948+0000 7f323a5a4700 1 --2- 172.21.15.73:0/1704982201 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f323415d2a0 0x7f3234164620 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f322c009d90 tx=0x7f322c00b330 comp rx=0 tx=0).stop 2024-05-08T21:50:10.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.948+0000 7f323a5a4700 1 -- 172.21.15.73:0/1704982201 shutdown_connections 2024-05-08T21:50:10.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.948+0000 7f323a5a4700 1 --2- 172.21.15.73:0/1704982201 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f323415d2a0 0x7f3234164620 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:10.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.948+0000 7f323a5a4700 1 --2- 172.21.15.73:0/1704982201 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f323415de50 0x7f32340cd9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:10.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.948+0000 7f323a5a4700 1 -- 172.21.15.73:0/1704982201 >> 172.21.15.73:0/1704982201 conn(0x7f323406aff0 msgr2=0x7f32340666c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:50:10.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.948+0000 7f323a5a4700 1 -- 172.21.15.73:0/1704982201 shutdown_connections 2024-05-08T21:50:10.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.948+0000 7f323a5a4700 1 -- 172.21.15.73:0/1704982201 wait complete. 2024-05-08T21:50:10.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.949+0000 7f323a5a4700 1 Processor -- start 2024-05-08T21:50:10.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.950+0000 7f323a5a4700 1 -- start start 2024-05-08T21:50:10.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.950+0000 7f323a5a4700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f323406d820 0x7f32340ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:10.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.950+0000 7f323a5a4700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f323415de50 0x7f32340c74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:10.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.950+0000 7f323a5a4700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32341f0270 0x7f32341520e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:10.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.950+0000 7f323a5a4700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32340c60d0 con 0x7f323406d820 2024-05-08T21:50:10.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.950+0000 7f323a5a4700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32341efde0 con 0x7f32341f0270 2024-05-08T21:50:10.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.950+0000 7f323a5a4700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32340c53d0 con 0x7f323415de50 2024-05-08T21:50:10.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.950+0000 7f3233fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f323406d820 0x7f32340ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:10.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.950+0000 7f3233fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f323406d820 0x7f32340ae8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36470/0 (socket says 172.21.15.73:36470) 2024-05-08T21:50:10.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.950+0000 7f3233fff700 1 -- 172.21.15.73:0/3891651104 learned_addr learned my addr 172.21.15.73:0/3891651104 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:50:10.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.950+0000 7f3238b41700 1 --2- 172.21.15.73:0/3891651104 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32341f0270 0x7f32341520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:10.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.950+0000 7f32337fe700 1 --2- 172.21.15.73:0/3891651104 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f323415de50 0x7f32340c74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:10.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.951+0000 7f3233fff700 1 -- 172.21.15.73:0/3891651104 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f323415de50 msgr2=0x7f32340c74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:10.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.951+0000 7f3233fff700 1 --2- 172.21.15.73:0/3891651104 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f323415de50 0x7f32340c74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:10.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.951+0000 7f3233fff700 1 -- 172.21.15.73:0/3891651104 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32341f0270 msgr2=0x7f32341520e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:10.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.951+0000 7f3233fff700 1 --2- 172.21.15.73:0/3891651104 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32341f0270 0x7f32341520e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:10.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.951+0000 7f3233fff700 1 -- 172.21.15.73:0/3891651104 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32240094a0 con 0x7f323406d820 2024-05-08T21:50:10.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.951+0000 7f3233fff700 1 --2- 172.21.15.73:0/3891651104 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f323406d820 0x7f32340ae8a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f322400ebe0 tx=0x7f322400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:10.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.951+0000 7f3230ff9700 1 -- 172.21.15.73:0/3891651104 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3224009760 con 0x7f323406d820 2024-05-08T21:50:10.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.951+0000 7f3230ff9700 1 -- 172.21.15.73:0/3891651104 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f322400c850 con 0x7f323406d820 2024-05-08T21:50:10.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.951+0000 7f323a5a4700 1 -- 172.21.15.73:0/3891651104 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f322c009a70 con 0x7f323406d820 2024-05-08T21:50:10.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.951+0000 7f3230ff9700 1 -- 172.21.15.73:0/3891651104 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322400cbe0 con 0x7f323406d820 2024-05-08T21:50:10.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.951+0000 7f323a5a4700 1 -- 172.21.15.73:0/3891651104 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32340c5970 con 0x7f323406d820 2024-05-08T21:50:10.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.952+0000 7f323a5a4700 1 -- 172.21.15.73:0/3891651104 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32340b3960 con 0x7f323406d820 2024-05-08T21:50:10.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.952+0000 7f3230ff9700 1 -- 172.21.15.73:0/3891651104 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f322400cd40 con 0x7f323406d820 2024-05-08T21:50:10.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.953+0000 7f3230ff9700 1 --2- 172.21.15.73:0/3891651104 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f322006acc0 0x7f322006d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:10.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.953+0000 7f3230ff9700 1 -- 172.21.15.73:0/3891651104 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3224089220 con 0x7f323406d820 2024-05-08T21:50:10.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.953+0000 7f32337fe700 1 --2- 172.21.15.73:0/3891651104 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f322006acc0 0x7f322006d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:10.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.953+0000 7f32337fe700 1 --2- 172.21.15.73:0/3891651104 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f322006acc0 0x7f322006d180 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3234073c70 tx=0x7f3228009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:10.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:10.957+0000 7f3230ff9700 1 -- 172.21.15.73:0/3891651104 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f3224054490 con 0x7f323406d820 2024-05-08T21:50:11.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.152+0000 7f323a5a4700 1 -- 172.21.15.73:0/3891651104 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f323415bea0 con 0x7f323406d820 2024-05-08T21:50:11.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.152+0000 7f3230ff9700 1 -- 172.21.15.73:0/3891651104 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3224057ab0 con 0x7f323406d820 2024-05-08T21:50:11.153 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-05-08T21:50:11.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.154+0000 7f323a5a4700 1 -- 172.21.15.73:0/3891651104 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f322006acc0 msgr2=0x7f322006d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:11.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.154+0000 7f323a5a4700 1 --2- 172.21.15.73:0/3891651104 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f322006acc0 0x7f322006d180 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3234073c70 tx=0x7f3228009040 comp rx=0 tx=0).stop 2024-05-08T21:50:11.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.154+0000 7f323a5a4700 1 -- 172.21.15.73:0/3891651104 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f323406d820 msgr2=0x7f32340ae8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:11.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.154+0000 7f323a5a4700 1 --2- 172.21.15.73:0/3891651104 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f323406d820 0x7f32340ae8a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f322400ebe0 tx=0x7f322400eef0 comp rx=0 tx=0).stop 2024-05-08T21:50:11.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.154+0000 7f323a5a4700 1 -- 172.21.15.73:0/3891651104 shutdown_connections 2024-05-08T21:50:11.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.154+0000 7f323a5a4700 1 --2- 172.21.15.73:0/3891651104 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f322006acc0 0x7f322006d180 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:11.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.154+0000 7f323a5a4700 1 --2- 172.21.15.73:0/3891651104 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32341f0270 0x7f32341520e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:11.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.154+0000 7f323a5a4700 1 --2- 172.21.15.73:0/3891651104 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f323406d820 0x7f32340ae8a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:11.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.154+0000 7f323a5a4700 1 --2- 172.21.15.73:0/3891651104 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f323415de50 0x7f32340c74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:11.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.154+0000 7f323a5a4700 1 -- 172.21.15.73:0/3891651104 >> 172.21.15.73:0/3891651104 conn(0x7f323406aff0 msgr2=0x7f32340666c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:50:11.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.154+0000 7f323a5a4700 1 -- 172.21.15.73:0/3891651104 shutdown_connections 2024-05-08T21:50:11.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.154+0000 7f323a5a4700 1 -- 172.21.15.73:0/3891651104 wait complete. 2024-05-08T21:50:11.167 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T21:50:11.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.291+0000 7f62793c9700 1 Processor -- start 2024-05-08T21:50:11.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.291+0000 7f62793c9700 1 -- start start 2024-05-08T21:50:11.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.292+0000 7f62793c9700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6274153f90 0x7f62740c9f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:11.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.292+0000 7f62793c9700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f62740cba40 0x7f627415a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:11.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.292+0000 7f62793c9700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f627415d1a0 con 0x7f62740cb620 2024-05-08T21:50:11.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.292+0000 7f62793c9700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62740ca4a0 con 0x7f62740cba40 2024-05-08T21:50:11.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.292+0000 7f62793c9700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f627415d3d0 con 0x7f6274153f90 2024-05-08T21:50:11.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.292+0000 7f62727fc700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f62740cb620 0x7f62740720f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:58482/0 (socket says 172.21.15.73:58482) 2024-05-08T21:50:11.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.292+0000 7f62727fc700 1 -- 172.21.15.73:0/1798322961 learned_addr learned my addr 172.21.15.73:0/1798322961 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:50:11.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.292+0000 7f62737fe700 1 --2- 172.21.15.73:0/1798322961 >> v2:172.21.15.115:3300/0 conn(0x7f62740cba40 0x7f627415a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:11.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.292+0000 7f6272ffd700 1 --2- 172.21.15.73:0/1798322961 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6274153f90 0x7f62740c9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:11.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.292+0000 7f6271ffb700 1 -- 172.21.15.73:0/1798322961 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 930271285 0 0) 0x7f627415d1a0 con 0x7f62740cb620 2024-05-08T21:50:11.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.292+0000 7f6271ffb700 1 -- 172.21.15.73:0/1798322961 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f625c0035b0 con 0x7f62740cb620 2024-05-08T21:50:11.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.292+0000 7f62737fe700 1 -- 172.21.15.73:0/1798322961 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6274153f90 msgr2=0x7f62740c9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:50:11.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.292+0000 7f62737fe700 1 --2- 172.21.15.73:0/1798322961 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6274153f90 0x7f62740c9f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:11.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.292+0000 7f62737fe700 1 -- 172.21.15.73:0/1798322961 >> v1:172.21.15.73:6789/0 conn(0x7f62740cb620 legacy=0x7f62740720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:11.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.292+0000 7f62737fe700 1 -- 172.21.15.73:0/1798322961 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6274159bb0 con 0x7f62740cba40 2024-05-08T21:50:11.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.292+0000 7f6272ffd700 1 --2- 172.21.15.73:0/1798322961 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6274153f90 0x7f62740c9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:50:11.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.292+0000 7f62737fe700 1 --2- 172.21.15.73:0/1798322961 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62740cba40 0x7f627415a0b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f626c009d90 tx=0x7f626c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c31b37d75386f88 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:11.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.293+0000 7f6271ffb700 1 -- 172.21.15.73:0/1798322961 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626c00e070 con 0x7f62740cba40 2024-05-08T21:50:11.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.293+0000 7f6271ffb700 1 -- 172.21.15.73:0/1798322961 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f626c00bb20 con 0x7f62740cba40 2024-05-08T21:50:11.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.293+0000 7f6271ffb700 1 -- 172.21.15.73:0/1798322961 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626c00be90 con 0x7f62740cba40 2024-05-08T21:50:11.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.293+0000 7f62793c9700 1 -- 172.21.15.73:0/1798322961 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62740cba40 msgr2=0x7f627415a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:11.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.293+0000 7f62793c9700 1 --2- 172.21.15.73:0/1798322961 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62740cba40 0x7f627415a0b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f626c009d90 tx=0x7f626c00b330 comp rx=0 tx=0).stop 2024-05-08T21:50:11.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.293+0000 7f62793c9700 1 -- 172.21.15.73:0/1798322961 shutdown_connections 2024-05-08T21:50:11.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.293+0000 7f62793c9700 1 --2- 172.21.15.73:0/1798322961 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62740cba40 0x7f627415a0b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:11.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.293+0000 7f62793c9700 1 --2- 172.21.15.73:0/1798322961 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6274153f90 0x7f62740c9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:11.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.293+0000 7f62793c9700 1 -- 172.21.15.73:0/1798322961 >> 172.21.15.73:0/1798322961 conn(0x7f627406be70 msgr2=0x7f627406c380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:50:11.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.293+0000 7f62793c9700 1 -- 172.21.15.73:0/1798322961 shutdown_connections 2024-05-08T21:50:11.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.293+0000 7f62793c9700 1 -- 172.21.15.73:0/1798322961 wait complete. 2024-05-08T21:50:11.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.295+0000 7f62793c9700 1 Processor -- start 2024-05-08T21:50:11.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.295+0000 7f62793c9700 1 -- start start 2024-05-08T21:50:11.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.296+0000 7f62793c9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62740cb620 0x7f62740b3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:11.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.296+0000 7f62793c9700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62740cba40 0x7f62741efc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:11.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.296+0000 7f62793c9700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6274153f90 0x7f6274145c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:11.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.296+0000 7f62793c9700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62740cd310 con 0x7f62740cb620 2024-05-08T21:50:11.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.296+0000 7f62793c9700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62741ef540 con 0x7f62740cba40 2024-05-08T21:50:11.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.296+0000 7f62793c9700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62740b41b0 con 0x7f6274153f90 2024-05-08T21:50:11.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.296+0000 7f6272ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62740cb620 0x7f62740b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:11.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.296+0000 7f6272ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62740cb620 0x7f62740b3930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36486/0 (socket says 172.21.15.73:36486) 2024-05-08T21:50:11.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.296+0000 7f6272ffd700 1 -- 172.21.15.73:0/2341434090 learned_addr learned my addr 172.21.15.73:0/2341434090 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:50:11.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.296+0000 7f62727fc700 1 --2- 172.21.15.73:0/2341434090 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62740cba40 0x7f62741efc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:11.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.296+0000 7f62737fe700 1 --2- 172.21.15.73:0/2341434090 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6274153f90 0x7f6274145c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:11.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.296+0000 7f6272ffd700 1 -- 172.21.15.73:0/2341434090 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6274153f90 msgr2=0x7f6274145c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:11.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.296+0000 7f6272ffd700 1 --2- 172.21.15.73:0/2341434090 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6274153f90 0x7f6274145c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:11.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.296+0000 7f6272ffd700 1 -- 172.21.15.73:0/2341434090 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62740cba40 msgr2=0x7f62741efc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:11.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.296+0000 7f6272ffd700 1 --2- 172.21.15.73:0/2341434090 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62740cba40 0x7f62741efc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:11.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.296+0000 7f6272ffd700 1 -- 172.21.15.73:0/2341434090 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62640094a0 con 0x7f62740cb620 2024-05-08T21:50:11.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.296+0000 7f62727fc700 1 --2- 172.21.15.73:0/2341434090 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62740cba40 0x7f62741efc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:50:11.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.296+0000 7f6272ffd700 1 --2- 172.21.15.73:0/2341434090 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62740cb620 0x7f62740b3930 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f626400ebe0 tx=0x7f6264009e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:11.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.297+0000 7f625b7fe700 1 -- 172.21.15.73:0/2341434090 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626400c8b0 con 0x7f62740cb620 2024-05-08T21:50:11.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.297+0000 7f625b7fe700 1 -- 172.21.15.73:0/2341434090 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f626400ca10 con 0x7f62740cb620 2024-05-08T21:50:11.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.297+0000 7f62793c9700 1 -- 172.21.15.73:0/2341434090 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f626c009a70 con 0x7f62740cb620 2024-05-08T21:50:11.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.297+0000 7f625b7fe700 1 -- 172.21.15.73:0/2341434090 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626400cda0 con 0x7f62740cb620 2024-05-08T21:50:11.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.297+0000 7f62793c9700 1 -- 172.21.15.73:0/2341434090 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62741ef7e0 con 0x7f62740cb620 2024-05-08T21:50:11.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.298+0000 7f62793c9700 1 -- 172.21.15.73:0/2341434090 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62741efac0 con 0x7f62740cb620 2024-05-08T21:50:11.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.298+0000 7f625b7fe700 1 -- 172.21.15.73:0/2341434090 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6264013470 con 0x7f62740cb620 2024-05-08T21:50:11.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.298+0000 7f625b7fe700 1 --2- 172.21.15.73:0/2341434090 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f626006ac90 0x7f626006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:11.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.298+0000 7f625b7fe700 1 -- 172.21.15.73:0/2341434090 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6264089440 con 0x7f62740cb620 2024-05-08T21:50:11.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.298+0000 7f62727fc700 1 --2- 172.21.15.73:0/2341434090 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f626006ac90 0x7f626006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:11.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.299+0000 7f62727fc700 1 --2- 172.21.15.73:0/2341434090 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f626006ac90 0x7f626006d150 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f62740b2060 tx=0x7f6268009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:11.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.303+0000 7f625b7fe700 1 -- 172.21.15.73:0/2341434090 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f6264054620 con 0x7f62740cb620 2024-05-08T21:50:11.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.499+0000 7f62793c9700 1 -- 172.21.15.73:0/2341434090 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6274067a20 con 0x7f62740cb620 2024-05-08T21:50:11.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.500+0000 7f625b7fe700 1 -- 172.21.15.73:0/2341434090 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6264057c40 con 0x7f62740cb620 2024-05-08T21:50:11.501 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-05-08T21:50:11.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.502+0000 7f62793c9700 1 -- 172.21.15.73:0/2341434090 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f626006ac90 msgr2=0x7f626006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:11.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.502+0000 7f62793c9700 1 --2- 172.21.15.73:0/2341434090 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f626006ac90 0x7f626006d150 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f62740b2060 tx=0x7f6268009040 comp rx=0 tx=0).stop 2024-05-08T21:50:11.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.502+0000 7f62793c9700 1 -- 172.21.15.73:0/2341434090 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62740cb620 msgr2=0x7f62740b3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:11.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.502+0000 7f62793c9700 1 --2- 172.21.15.73:0/2341434090 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62740cb620 0x7f62740b3930 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f626400ebe0 tx=0x7f6264009e20 comp rx=0 tx=0).stop 2024-05-08T21:50:11.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.502+0000 7f62793c9700 1 -- 172.21.15.73:0/2341434090 shutdown_connections 2024-05-08T21:50:11.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.502+0000 7f62793c9700 1 --2- 172.21.15.73:0/2341434090 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f626006ac90 0x7f626006d150 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:11.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.502+0000 7f62793c9700 1 --2- 172.21.15.73:0/2341434090 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6274153f90 0x7f6274145c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:11.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.502+0000 7f62793c9700 1 --2- 172.21.15.73:0/2341434090 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62740cb620 0x7f62740b3930 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:11.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.502+0000 7f62793c9700 1 --2- 172.21.15.73:0/2341434090 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62740cba40 0x7f62741efc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:11.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.503+0000 7f62793c9700 1 -- 172.21.15.73:0/2341434090 >> 172.21.15.73:0/2341434090 conn(0x7f627406be70 msgr2=0x7f62740720f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:50:11.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.503+0000 7f62793c9700 1 -- 172.21.15.73:0/2341434090 shutdown_connections 2024-05-08T21:50:11.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.503+0000 7f62793c9700 1 -- 172.21.15.73:0/2341434090 wait complete. 2024-05-08T21:50:11.516 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T21:50:11.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.639+0000 7fe89d2a6700 1 Processor -- start 2024-05-08T21:50:11.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.639+0000 7fe89d2a6700 1 -- start start 2024-05-08T21:50:11.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.639+0000 7fe89d2a6700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe8980b0050 0x7fe89806bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:11.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.639+0000 7fe89d2a6700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe898154420 con 0x7fe898154040 2024-05-08T21:50:11.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.639+0000 7fe89d2a6700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8980c7fc0 con 0x7fe89815a990 2024-05-08T21:50:11.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.639+0000 7fe89d2a6700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe898159cc0 con 0x7fe8980b0050 2024-05-08T21:50:11.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.640+0000 7fe896ffd700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fe898154040 0x7fe8980c8fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:58490/0 (socket says 172.21.15.73:58490) 2024-05-08T21:50:11.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.640+0000 7fe8977fe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe8980b0050 0x7fe89806bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:11.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.640+0000 7fe896ffd700 1 -- 172.21.15.73:0/3759775040 learned_addr learned my addr 172.21.15.73:0/3759775040 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:50:11.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.640+0000 7fe8977fe700 1 -- 172.21.15.73:0/3759775040 >> v1:172.21.15.115:6789/0 conn(0x7fe89815a990 legacy=0x7fe8980706a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:11.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.640+0000 7fe8977fe700 1 -- 172.21.15.73:0/3759775040 >> v1:172.21.15.73:6789/0 conn(0x7fe898154040 legacy=0x7fe8980c8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:11.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.640+0000 7fe895ffb700 1 -- 172.21.15.73:0/3759775040 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 815972351 0 0) 0x7fe898154420 con 0x7fe898154040 2024-05-08T21:50:11.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.640+0000 7fe8977fe700 1 -- 172.21.15.73:0/3759775040 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8980c82a0 con 0x7fe8980b0050 2024-05-08T21:50:11.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.640+0000 7fe8977fe700 1 --2- 172.21.15.73:0/3759775040 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8980b0050 0x7fe89806bad0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe890009d90 tx=0x7fe89000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dde6b4dfb3425cdb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:11.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.640+0000 7fe895ffb700 1 -- 172.21.15.73:0/3759775040 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89000e070 con 0x7fe8980b0050 2024-05-08T21:50:11.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.640+0000 7fe895ffb700 1 -- 172.21.15.73:0/3759775040 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe89000bbd0 con 0x7fe8980b0050 2024-05-08T21:50:11.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.640+0000 7fe895ffb700 1 -- 172.21.15.73:0/3759775040 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe890012430 con 0x7fe8980b0050 2024-05-08T21:50:11.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.641+0000 7fe89d2a6700 1 -- 172.21.15.73:0/3759775040 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8980b0050 msgr2=0x7fe89806bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:11.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.641+0000 7fe89d2a6700 1 --2- 172.21.15.73:0/3759775040 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8980b0050 0x7fe89806bad0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe890009d90 tx=0x7fe89000b330 comp rx=0 tx=0).stop 2024-05-08T21:50:11.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.641+0000 7fe89d2a6700 1 -- 172.21.15.73:0/3759775040 shutdown_connections 2024-05-08T21:50:11.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.641+0000 7fe89d2a6700 1 --2- 172.21.15.73:0/3759775040 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8980b0050 0x7fe89806bad0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:11.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.641+0000 7fe89d2a6700 1 -- 172.21.15.73:0/3759775040 >> 172.21.15.73:0/3759775040 conn(0x7fe89806fd40 msgr2=0x7fe89806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:50:11.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.641+0000 7fe89d2a6700 1 -- 172.21.15.73:0/3759775040 shutdown_connections 2024-05-08T21:50:11.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.641+0000 7fe89d2a6700 1 -- 172.21.15.73:0/3759775040 wait complete. 2024-05-08T21:50:11.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.642+0000 7fe89d2a6700 1 Processor -- start 2024-05-08T21:50:11.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.642+0000 7fe89d2a6700 1 -- start start 2024-05-08T21:50:11.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.643+0000 7fe89d2a6700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8980b0050 0x7fe8980cb660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:11.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.643+0000 7fe89d2a6700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe898154040 0x7fe8980c49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:11.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.643+0000 7fe89d2a6700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe89815a990 0x7fe89814fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:11.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.643+0000 7fe89d2a6700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8980cbba0 con 0x7fe8980b0050 2024-05-08T21:50:11.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.643+0000 7fe89d2a6700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8980c4f00 con 0x7fe89815a990 2024-05-08T21:50:11.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.643+0000 7fe89d2a6700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8980c54e0 con 0x7fe898154040 2024-05-08T21:50:11.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.643+0000 7fe896ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8980b0050 0x7fe8980cb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:11.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.643+0000 7fe896ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8980b0050 0x7fe8980cb660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36504/0 (socket says 172.21.15.73:36504) 2024-05-08T21:50:11.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.643+0000 7fe896ffd700 1 -- 172.21.15.73:0/2605387242 learned_addr learned my addr 172.21.15.73:0/2605387242 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:50:11.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.643+0000 7fe8967fc700 1 --2- 172.21.15.73:0/2605387242 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe898154040 0x7fe8980c49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:11.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.643+0000 7fe8977fe700 1 --2- 172.21.15.73:0/2605387242 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe89815a990 0x7fe89814fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:11.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.643+0000 7fe896ffd700 1 -- 172.21.15.73:0/2605387242 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe898154040 msgr2=0x7fe8980c49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:11.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.643+0000 7fe896ffd700 1 --2- 172.21.15.73:0/2605387242 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe898154040 0x7fe8980c49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:11.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.643+0000 7fe896ffd700 1 -- 172.21.15.73:0/2605387242 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe89815a990 msgr2=0x7fe89814fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:11.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.643+0000 7fe896ffd700 1 --2- 172.21.15.73:0/2605387242 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe89815a990 0x7fe89814fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:11.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.643+0000 7fe896ffd700 1 -- 172.21.15.73:0/2605387242 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe890009a70 con 0x7fe8980b0050 2024-05-08T21:50:11.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.643+0000 7fe896ffd700 1 --2- 172.21.15.73:0/2605387242 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8980b0050 0x7fe8980cb660 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe88800c520 tx=0x7fe88800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:11.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.644+0000 7fe87f7fe700 1 -- 172.21.15.73:0/2605387242 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe888004c80 con 0x7fe8980b0050 2024-05-08T21:50:11.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.644+0000 7fe87f7fe700 1 -- 172.21.15.73:0/2605387242 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe888004e00 con 0x7fe8980b0050 2024-05-08T21:50:11.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.644+0000 7fe89d2a6700 1 -- 172.21.15.73:0/2605387242 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8980c6060 con 0x7fe8980b0050 2024-05-08T21:50:11.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.644+0000 7fe87f7fe700 1 -- 172.21.15.73:0/2605387242 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe888007310 con 0x7fe8980b0050 2024-05-08T21:50:11.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.644+0000 7fe89d2a6700 1 -- 172.21.15.73:0/2605387242 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8980c5100 con 0x7fe8980b0050 2024-05-08T21:50:11.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.645+0000 7fe89d2a6700 1 -- 172.21.15.73:0/2605387242 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe898067a20 con 0x7fe8980b0050 2024-05-08T21:50:11.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.645+0000 7fe87f7fe700 1 -- 172.21.15.73:0/2605387242 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe888007470 con 0x7fe8980b0050 2024-05-08T21:50:11.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.645+0000 7fe87f7fe700 1 --2- 172.21.15.73:0/2605387242 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fe88406ac90 0x7fe88406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:11.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.645+0000 7fe87f7fe700 1 -- 172.21.15.73:0/2605387242 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe888089030 con 0x7fe8980b0050 2024-05-08T21:50:11.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.645+0000 7fe8967fc700 1 --2- 172.21.15.73:0/2605387242 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fe88406ac90 0x7fe88406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:11.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.646+0000 7fe8967fc700 1 --2- 172.21.15.73:0/2605387242 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fe88406ac90 0x7fe88406d150 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe8981f3d50 tx=0x7fe88c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:11.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.650+0000 7fe87f7fe700 1 -- 172.21.15.73:0/2605387242 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fe8880542a0 con 0x7fe8980b0050 2024-05-08T21:50:11.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.843+0000 7fe89d2a6700 1 -- 172.21.15.73:0/2605387242 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe8980c86a0 con 0x7fe8980b0050 2024-05-08T21:50:11.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.844+0000 7fe87f7fe700 1 -- 172.21.15.73:0/2605387242 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe8880578c0 con 0x7fe8980b0050 2024-05-08T21:50:11.845 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-05-08T21:50:11.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.846+0000 7fe89d2a6700 1 -- 172.21.15.73:0/2605387242 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fe88406ac90 msgr2=0x7fe88406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:11.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.846+0000 7fe89d2a6700 1 --2- 172.21.15.73:0/2605387242 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fe88406ac90 0x7fe88406d150 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe8981f3d50 tx=0x7fe88c009040 comp rx=0 tx=0).stop 2024-05-08T21:50:11.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.846+0000 7fe89d2a6700 1 -- 172.21.15.73:0/2605387242 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8980b0050 msgr2=0x7fe8980cb660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:11.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.846+0000 7fe89d2a6700 1 --2- 172.21.15.73:0/2605387242 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8980b0050 0x7fe8980cb660 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe88800c520 tx=0x7fe88800c8e0 comp rx=0 tx=0).stop 2024-05-08T21:50:11.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.846+0000 7fe89d2a6700 1 -- 172.21.15.73:0/2605387242 shutdown_connections 2024-05-08T21:50:11.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.846+0000 7fe89d2a6700 1 --2- 172.21.15.73:0/2605387242 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fe88406ac90 0x7fe88406d150 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:11.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.846+0000 7fe89d2a6700 1 --2- 172.21.15.73:0/2605387242 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe89815a990 0x7fe89814fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:11.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.846+0000 7fe89d2a6700 1 --2- 172.21.15.73:0/2605387242 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8980b0050 0x7fe8980cb660 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:11.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.846+0000 7fe89d2a6700 1 --2- 172.21.15.73:0/2605387242 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe898154040 0x7fe8980c49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:11.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.846+0000 7fe89d2a6700 1 -- 172.21.15.73:0/2605387242 >> 172.21.15.73:0/2605387242 conn(0x7fe89806fd40 msgr2=0x7fe8980adc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:50:11.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.846+0000 7fe89d2a6700 1 -- 172.21.15.73:0/2605387242 shutdown_connections 2024-05-08T21:50:11.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.846+0000 7fe89d2a6700 1 -- 172.21.15.73:0/2605387242 wait complete. 2024-05-08T21:50:11.859 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:50:11.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.979+0000 7fdb216b8700 1 Processor -- start 2024-05-08T21:50:11.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.979+0000 7fdb216b8700 1 -- start start 2024-05-08T21:50:11.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.980+0000 7fdb216b8700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fdb1c0c80f0 0x7fdb1c0c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:11.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.980+0000 7fdb216b8700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdb1c071100 0x7fdb1c0ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:11.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.980+0000 7fdb216b8700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb1c15e0b0 con 0x7fdb1c154160 2024-05-08T21:50:11.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.980+0000 7fdb216b8700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb1c066d90 con 0x7fdb1c071100 2024-05-08T21:50:11.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.980+0000 7fdb216b8700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb1c071ef0 con 0x7fdb1c0c80f0 2024-05-08T21:50:11.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.980+0000 7fdb1b7fe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdb1c071100 0x7fdb1c0ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:11.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.980+0000 7fdb1b7fe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdb1c071100 0x7fdb1c0ca0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36510/0 (socket says 172.21.15.73:36510) 2024-05-08T21:50:11.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.980+0000 7fdb1affd700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fdb1c154160 0x7fdb1c0c6fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:58494/0 (socket says 172.21.15.73:58494) 2024-05-08T21:50:11.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.980+0000 7fdb1b7fe700 1 -- 172.21.15.73:0/2954603588 learned_addr learned my addr 172.21.15.73:0/2954603588 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:50:11.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.980+0000 7fdb1a7fc700 1 --2- 172.21.15.73:0/2954603588 >> v2:172.21.15.115:3300/0 conn(0x7fdb1c0c80f0 0x7fdb1c0c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:11.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.980+0000 7fdb1b7fe700 1 -- 172.21.15.73:0/2954603588 >> v2:172.21.15.115:3300/0 conn(0x7fdb1c0c80f0 msgr2=0x7fdb1c0c9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:50:11.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.980+0000 7fdb1b7fe700 1 --2- 172.21.15.73:0/2954603588 >> v2:172.21.15.115:3300/0 conn(0x7fdb1c0c80f0 0x7fdb1c0c9b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:11.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.980+0000 7fdb1b7fe700 1 -- 172.21.15.73:0/2954603588 >> v1:172.21.15.73:6789/0 conn(0x7fdb1c154160 legacy=0x7fdb1c0c6fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:11.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.980+0000 7fdb1b7fe700 1 -- 172.21.15.73:0/2954603588 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb1c15d4e0 con 0x7fdb1c071100 2024-05-08T21:50:11.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.980+0000 7fdb1b7fe700 1 --2- 172.21.15.73:0/2954603588 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb1c071100 0x7fdb1c0ca0d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c0709a0 tx=0x7fdb1400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=960bfc8601b1f630 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:11.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.980+0000 7fdb19ffb700 1 -- 172.21.15.73:0/2954603588 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1400e070 con 0x7fdb1c071100 2024-05-08T21:50:11.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.980+0000 7fdb19ffb700 1 -- 172.21.15.73:0/2954603588 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb1400b9c0 con 0x7fdb1c071100 2024-05-08T21:50:11.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.980+0000 7fdb19ffb700 1 -- 172.21.15.73:0/2954603588 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1400bd70 con 0x7fdb1c071100 2024-05-08T21:50:11.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.981+0000 7fdb216b8700 1 -- 172.21.15.73:0/2954603588 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb1c071100 msgr2=0x7fdb1c0ca0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:11.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.981+0000 7fdb216b8700 1 --2- 172.21.15.73:0/2954603588 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb1c071100 0x7fdb1c0ca0d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c0709a0 tx=0x7fdb1400b330 comp rx=0 tx=0).stop 2024-05-08T21:50:11.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.981+0000 7fdb216b8700 1 -- 172.21.15.73:0/2954603588 shutdown_connections 2024-05-08T21:50:11.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.981+0000 7fdb216b8700 1 --2- 172.21.15.73:0/2954603588 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb1c071100 0x7fdb1c0ca0d0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:11.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.981+0000 7fdb216b8700 1 --2- 172.21.15.73:0/2954603588 >> v2:172.21.15.115:3300/0 conn(0x7fdb1c0c80f0 0x7fdb1c0c9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:11.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.981+0000 7fdb216b8700 1 -- 172.21.15.73:0/2954603588 >> 172.21.15.73:0/2954603588 conn(0x7fdb1c0cba80 msgr2=0x7fdb1c0cbe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:50:11.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.981+0000 7fdb216b8700 1 -- 172.21.15.73:0/2954603588 shutdown_connections 2024-05-08T21:50:11.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.981+0000 7fdb216b8700 1 -- 172.21.15.73:0/2954603588 wait complete. 2024-05-08T21:50:11.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.983+0000 7fdb216b8700 1 Processor -- start 2024-05-08T21:50:11.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.983+0000 7fdb216b8700 1 -- start start 2024-05-08T21:50:11.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.983+0000 7fdb216b8700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb1c071100 0x7fdb1c1ef590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:11.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.983+0000 7fdb216b8700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb1c0c80f0 0x7fdb1c14f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:11.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.983+0000 7fdb216b8700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdb1c154160 0x7fdb1c14bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:11.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.983+0000 7fdb216b8700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1c1f3510 con 0x7fdb1c0c80f0 2024-05-08T21:50:11.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.983+0000 7fdb216b8700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1c1f37f0 con 0x7fdb1c071100 2024-05-08T21:50:11.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.983+0000 7fdb216b8700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1c1493a0 con 0x7fdb1c154160 2024-05-08T21:50:11.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.984+0000 7fdb1a7fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb1c0c80f0 0x7fdb1c14f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:11.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.984+0000 7fdb1a7fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb1c0c80f0 0x7fdb1c14f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36522/0 (socket says 172.21.15.73:36522) 2024-05-08T21:50:11.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.984+0000 7fdb1a7fc700 1 -- 172.21.15.73:0/4461060 learned_addr learned my addr 172.21.15.73:0/4461060 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:50:11.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.984+0000 7fdb1affd700 1 --2- 172.21.15.73:0/4461060 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb1c071100 0x7fdb1c1ef590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:11.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.984+0000 7fdb1a7fc700 1 -- 172.21.15.73:0/4461060 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdb1c154160 msgr2=0x7fdb1c14bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:11.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.984+0000 7fdb1a7fc700 1 --2- 172.21.15.73:0/4461060 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdb1c154160 0x7fdb1c14bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:11.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.984+0000 7fdb1a7fc700 1 -- 172.21.15.73:0/4461060 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb1c071100 msgr2=0x7fdb1c1ef590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:11.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.984+0000 7fdb1a7fc700 1 --2- 172.21.15.73:0/4461060 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb1c071100 0x7fdb1c1ef590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:11.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.984+0000 7fdb1a7fc700 1 -- 172.21.15.73:0/4461060 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb14009b30 con 0x7fdb1c0c80f0 2024-05-08T21:50:11.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.984+0000 7fdb1a7fc700 1 --2- 172.21.15.73:0/4461060 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb1c0c80f0 0x7fdb1c14f4b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fdb1000c7f0 tx=0x7fdb1000cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:11.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.984+0000 7fdb037fe700 1 -- 172.21.15.73:0/4461060 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb10011800 con 0x7fdb1c0c80f0 2024-05-08T21:50:11.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.984+0000 7fdb037fe700 1 -- 172.21.15.73:0/4461060 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb10011960 con 0x7fdb1c0c80f0 2024-05-08T21:50:11.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.984+0000 7fdb216b8700 1 -- 172.21.15.73:0/4461060 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb1c149680 con 0x7fdb1c0c80f0 2024-05-08T21:50:11.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.984+0000 7fdb037fe700 1 -- 172.21.15.73:0/4461060 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb10011cf0 con 0x7fdb1c0c80f0 2024-05-08T21:50:11.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.984+0000 7fdb216b8700 1 -- 172.21.15.73:0/4461060 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb1c1efad0 con 0x7fdb1c0c80f0 2024-05-08T21:50:11.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.985+0000 7fdb216b8700 1 -- 172.21.15.73:0/4461060 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb1c0c6ae0 con 0x7fdb1c0c80f0 2024-05-08T21:50:11.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.986+0000 7fdb037fe700 1 -- 172.21.15.73:0/4461060 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fdb10018360 con 0x7fdb1c0c80f0 2024-05-08T21:50:11.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.986+0000 7fdb037fe700 1 --2- 172.21.15.73:0/4461060 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fdb0806ac90 0x7fdb0806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:11.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.986+0000 7fdb037fe700 1 -- 172.21.15.73:0/4461060 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdb10089430 con 0x7fdb1c0c80f0 2024-05-08T21:50:11.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.986+0000 7fdb1affd700 1 --2- 172.21.15.73:0/4461060 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fdb0806ac90 0x7fdb0806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:11.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.987+0000 7fdb1affd700 1 --2- 172.21.15.73:0/4461060 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fdb0806ac90 0x7fdb0806d150 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c000f60 tx=0x7fdb0c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:11.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:11.991+0000 7fdb037fe700 1 -- 172.21.15.73:0/4461060 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fdb10054590 con 0x7fdb1c0c80f0 2024-05-08T21:50:12.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.236+0000 7fdb216b8700 1 -- 172.21.15.73:0/4461060 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdb1c067a20 con 0x7fdb1c0c80f0 2024-05-08T21:50:12.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.237+0000 7fdb037fe700 1 -- 172.21.15.73:0/4461060 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+6250 (secure 0 0 0) 0x7fdb10057bb0 con 0x7fdb1c0c80f0 2024-05-08T21:50:12.238 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:50:12.238 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3242319177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6833","nonce":3242319177},{"type":"v1","addr":"172.21.15.115:6835","nonce":3242319177}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6834/2136341349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2136341349},{"type":"v1","addr":"172.21.15.115:6834","nonce":2136341349}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4249,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1439647913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1439647913},{"type":"v1","addr":"172.21.15.115:6837","nonce":1439647913}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/2386382396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2386382396},{"type":"v1","addr":"172.21.15.73:6836","nonce":2386382396}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/1772457954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":1772457954},{"type":"v1","addr":"172.21.15.73:6837","nonce":1772457954}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:49:43.747162+0000","modified":"2024-05-08T21:49:48.814033+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.73:6839/1477468490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1477468490},{"type":"v1","addr":"172.21.15.73:6839","nonce":1477468490}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:50:12.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.239+0000 7fdb216b8700 1 -- 172.21.15.73:0/4461060 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fdb0806ac90 msgr2=0x7fdb0806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:12.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.239+0000 7fdb216b8700 1 --2- 172.21.15.73:0/4461060 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fdb0806ac90 0x7fdb0806d150 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c000f60 tx=0x7fdb0c009040 comp rx=0 tx=0).stop 2024-05-08T21:50:12.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.239+0000 7fdb216b8700 1 -- 172.21.15.73:0/4461060 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb1c0c80f0 msgr2=0x7fdb1c14f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:12.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.239+0000 7fdb216b8700 1 --2- 172.21.15.73:0/4461060 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb1c0c80f0 0x7fdb1c14f4b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fdb1000c7f0 tx=0x7fdb1000cbb0 comp rx=0 tx=0).stop 2024-05-08T21:50:12.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.239+0000 7fdb216b8700 1 -- 172.21.15.73:0/4461060 shutdown_connections 2024-05-08T21:50:12.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.239+0000 7fdb216b8700 1 --2- 172.21.15.73:0/4461060 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fdb0806ac90 0x7fdb0806d150 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:12.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.239+0000 7fdb216b8700 1 --2- 172.21.15.73:0/4461060 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdb1c154160 0x7fdb1c14bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:12.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.239+0000 7fdb216b8700 1 --2- 172.21.15.73:0/4461060 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb1c071100 0x7fdb1c1ef590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:12.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.239+0000 7fdb216b8700 1 --2- 172.21.15.73:0/4461060 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb1c0c80f0 0x7fdb1c14f4b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:12.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.239+0000 7fdb216b8700 1 -- 172.21.15.73:0/4461060 >> 172.21.15.73:0/4461060 conn(0x7fdb1c0cba80 msgr2=0x7fdb1c152170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:50:12.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.239+0000 7fdb216b8700 1 -- 172.21.15.73:0/4461060 shutdown_connections 2024-05-08T21:50:12.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.239+0000 7fdb216b8700 1 -- 172.21.15.73:0/4461060 wait complete. 2024-05-08T21:50:12.241 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 8 2024-05-08T21:50:12.252 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T21:50:12.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.372+0000 7fba2f0d0700 1 Processor -- start 2024-05-08T21:50:12.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.372+0000 7fba2f0d0700 1 -- start start 2024-05-08T21:50:12.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.373+0000 7fba2f0d0700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fba280c9990 0x7fba28072710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:12.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.373+0000 7fba2f0d0700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba28141600 con 0x7fba2815b5e0 2024-05-08T21:50:12.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.373+0000 7fba2f0d0700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba28072d50 con 0x7fba28141220 2024-05-08T21:50:12.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.373+0000 7fba2f0d0700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba28073030 con 0x7fba280c9990 2024-05-08T21:50:12.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.373+0000 7fba27fff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fba280c9990 0x7fba28072710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:12.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.373+0000 7fba2d66d700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fba2815b5e0 0x7fba2815b9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:58504/0 (socket says 172.21.15.73:58504) 2024-05-08T21:50:12.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.373+0000 7fba2d66d700 1 -- 172.21.15.73:0/2063317294 learned_addr learned my addr 172.21.15.73:0/2063317294 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:50:12.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.373+0000 7fba27fff700 1 -- 172.21.15.73:0/2063317294 >> v1:172.21.15.115:6789/0 conn(0x7fba28141220 legacy=0x7fba280c5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:50:12.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.373+0000 7fba27fff700 1 -- 172.21.15.73:0/2063317294 >> v1:172.21.15.73:6789/0 conn(0x7fba2815b5e0 legacy=0x7fba2815b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:12.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.373+0000 7fba27fff700 1 -- 172.21.15.73:0/2063317294 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba2806af30 con 0x7fba280c9990 2024-05-08T21:50:12.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.373+0000 7fba277fe700 1 -- 172.21.15.73:0/2063317294 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3378176051 0 0) 0x7fba28141600 con 0x7fba2815b5e0 2024-05-08T21:50:12.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.373+0000 7fba27fff700 1 --2- 172.21.15.73:0/2063317294 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba280c9990 0x7fba28072710 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fba14009840 tx=0x7fba14009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7a572431f4e0985 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:12.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.373+0000 7fba277fe700 1 -- 172.21.15.73:0/2063317294 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba14004230 con 0x7fba280c9990 2024-05-08T21:50:12.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.373+0000 7fba277fe700 1 -- 172.21.15.73:0/2063317294 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba14004390 con 0x7fba280c9990 2024-05-08T21:50:12.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.373+0000 7fba277fe700 1 -- 172.21.15.73:0/2063317294 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba140036a0 con 0x7fba280c9990 2024-05-08T21:50:12.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.374+0000 7fba2f0d0700 1 -- 172.21.15.73:0/2063317294 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba280c9990 msgr2=0x7fba28072710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:12.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.374+0000 7fba2f0d0700 1 --2- 172.21.15.73:0/2063317294 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba280c9990 0x7fba28072710 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fba14009840 tx=0x7fba14009b50 comp rx=0 tx=0).stop 2024-05-08T21:50:12.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.374+0000 7fba2f0d0700 1 -- 172.21.15.73:0/2063317294 shutdown_connections 2024-05-08T21:50:12.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.374+0000 7fba2f0d0700 1 --2- 172.21.15.73:0/2063317294 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba280c9990 0x7fba28072710 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:12.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.374+0000 7fba2f0d0700 1 -- 172.21.15.73:0/2063317294 >> 172.21.15.73:0/2063317294 conn(0x7fba28066d70 msgr2=0x7fba280cc500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:50:12.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.374+0000 7fba2f0d0700 1 -- 172.21.15.73:0/2063317294 shutdown_connections 2024-05-08T21:50:12.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.374+0000 7fba2f0d0700 1 -- 172.21.15.73:0/2063317294 wait complete. 2024-05-08T21:50:12.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.375+0000 7fba2f0d0700 1 Processor -- start 2024-05-08T21:50:12.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.375+0000 7fba2f0d0700 1 -- start start 2024-05-08T21:50:12.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.376+0000 7fba2f0d0700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fba280c9990 0x7fba28154aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:12.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.376+0000 7fba2f0d0700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fba28141220 0x7fba281e0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:12.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.376+0000 7fba2f0d0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba2815b5e0 0x7fba2815a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:12.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.376+0000 7fba2f0d0700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba281e2bb0 con 0x7fba2815b5e0 2024-05-08T21:50:12.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.376+0000 7fba2f0d0700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba28154fe0 con 0x7fba280c9990 2024-05-08T21:50:12.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.376+0000 7fba2f0d0700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba281ee2a0 con 0x7fba28141220 2024-05-08T21:50:12.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.376+0000 7fba2d66d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba2815b5e0 0x7fba2815a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:12.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.376+0000 7fba2d66d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba2815b5e0 0x7fba2815a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36546/0 (socket says 172.21.15.73:36546) 2024-05-08T21:50:12.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.376+0000 7fba2d66d700 1 -- 172.21.15.73:0/3031807880 learned_addr learned my addr 172.21.15.73:0/3031807880 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:50:12.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.376+0000 7fba27fff700 1 --2- 172.21.15.73:0/3031807880 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fba28141220 0x7fba281e0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:12.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.376+0000 7fba2ce6c700 1 --2- 172.21.15.73:0/3031807880 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fba280c9990 0x7fba28154aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:12.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.376+0000 7fba2d66d700 1 -- 172.21.15.73:0/3031807880 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fba28141220 msgr2=0x7fba281e0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:12.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.376+0000 7fba2d66d700 1 --2- 172.21.15.73:0/3031807880 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fba28141220 0x7fba281e0fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:12.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.376+0000 7fba2d66d700 1 -- 172.21.15.73:0/3031807880 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fba280c9990 msgr2=0x7fba28154aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:12.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.376+0000 7fba2d66d700 1 --2- 172.21.15.73:0/3031807880 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fba280c9990 0x7fba28154aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:12.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.376+0000 7fba2d66d700 1 -- 172.21.15.73:0/3031807880 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba140094a0 con 0x7fba2815b5e0 2024-05-08T21:50:12.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.377+0000 7fba2ce6c700 1 --2- 172.21.15.73:0/3031807880 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fba280c9990 0x7fba28154aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:50:12.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.377+0000 7fba2d66d700 1 --2- 172.21.15.73:0/3031807880 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba2815b5e0 0x7fba2815a1c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fba2000cb60 tx=0x7fba2000ce70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:12.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.377+0000 7fba257fa700 1 -- 172.21.15.73:0/3031807880 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2000aaa0 con 0x7fba2815b5e0 2024-05-08T21:50:12.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.377+0000 7fba257fa700 1 -- 172.21.15.73:0/3031807880 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba2000ac00 con 0x7fba2815b5e0 2024-05-08T21:50:12.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.377+0000 7fba2f0d0700 1 -- 172.21.15.73:0/3031807880 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba281ee580 con 0x7fba2815b5e0 2024-05-08T21:50:12.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.377+0000 7fba257fa700 1 -- 172.21.15.73:0/3031807880 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba200070d0 con 0x7fba2815b5e0 2024-05-08T21:50:12.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.377+0000 7fba2f0d0700 1 -- 172.21.15.73:0/3031807880 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba281e3e70 con 0x7fba2815b5e0 2024-05-08T21:50:12.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.378+0000 7fba2f0d0700 1 -- 172.21.15.73:0/3031807880 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba28153ea0 con 0x7fba2815b5e0 2024-05-08T21:50:12.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.378+0000 7fba257fa700 1 -- 172.21.15.73:0/3031807880 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fba20007230 con 0x7fba2815b5e0 2024-05-08T21:50:12.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.378+0000 7fba257fa700 1 --2- 172.21.15.73:0/3031807880 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fba0c06ac90 0x7fba0c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:50:12.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.379+0000 7fba257fa700 1 -- 172.21.15.73:0/3031807880 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fba20089160 con 0x7fba2815b5e0 2024-05-08T21:50:12.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.379+0000 7fba2ce6c700 1 --2- 172.21.15.73:0/3031807880 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fba0c06ac90 0x7fba0c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:50:12.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.379+0000 7fba2ce6c700 1 --2- 172.21.15.73:0/3031807880 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fba0c06ac90 0x7fba0c06d150 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fba1c0017d0 tx=0x7fba1c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:50:12.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.383+0000 7fba257fa700 1 -- 172.21.15.73:0/3031807880 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fba28153ea0 con 0x7fba2815b5e0 2024-05-08T21:50:12.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.581+0000 7fba2f0d0700 1 -- 172.21.15.73:0/3031807880 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fba28153ea0 con 0x7fba2815b5e0 2024-05-08T21:50:12.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.583+0000 7fba257fa700 1 -- 172.21.15.73:0/3031807880 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16037 (secure 0 0 0) 0x7fba28153ea0 con 0x7fba2815b5e0 2024-05-08T21:50:12.584 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:50:12.584 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":21,"fsid":"143164b7-c9c7-4737-a494-7dafa5a3320c","created":"2024-05-08T21:49:26.221909+0000","modified":"2024-05-08T21:49:44.748794+0000","last_up_change":"2024-05-08T21:49:37.118386+0000","last_in_change":"2024-05-08T21:49:28.836944+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T21:49:35.998578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T21:49:42.171760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T21:49:42.576293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6b7439c1-daaa-44af-8333-a455f9e9dc67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":47228},{"type":"v1","addr":"172.21.15.73:6809","nonce":47228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":47228},{"type":"v1","addr":"172.21.15.73:6811","nonce":47228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":47228},{"type":"v1","addr":"172.21.15.73:6815","nonce":47228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":47228},{"type":"v1","addr":"172.21.15.73:6813","nonce":47228}]},"public_addr":"172.21.15.73:6809/47228","cluster_addr":"172.21.15.73:6811/47228","heartbeat_back_addr":"172.21.15.73:6815/47228","heartbeat_front_addr":"172.21.15.73:6813/47228","state":["exists","up"]},{"osd":1,"uuid":"fb67886a-d7f7-45ac-832f-36c871c8a208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":47227},{"type":"v1","addr":"172.21.15.73:6801","nonce":47227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":47227},{"type":"v1","addr":"172.21.15.73:6803","nonce":47227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":47227},{"type":"v1","addr":"172.21.15.73:6807","nonce":47227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":47227},{"type":"v1","addr":"172.21.15.73:6805","nonce":47227}]},"public_addr":"172.21.15.73:6801/47227","cluster_addr":"172.21.15.73:6803/47227","heartbeat_back_addr":"172.21.15.73:6807/47227","heartbeat_front_addr":"172.21.15.73:6805/47227","state":["exists","up"]},{"osd":2,"uuid":"a5cd6e98-6621-473a-bfb8-5c648abbb563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":47229},{"type":"v1","addr":"172.21.15.73:6817","nonce":47229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":47229},{"type":"v1","addr":"172.21.15.73:6819","nonce":47229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":47229},{"type":"v1","addr":"172.21.15.73:6823","nonce":47229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":47229},{"type":"v1","addr":"172.21.15.73:6821","nonce":47229}]},"public_addr":"172.21.15.73:6817/47229","cluster_addr":"172.21.15.73:6819/47229","heartbeat_back_addr":"172.21.15.73:6823/47229","heartbeat_front_addr":"172.21.15.73:6821/47229","state":["exists","up"]},{"osd":3,"uuid":"36927c20-4241-4f3b-91b5-a6a6f27598e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":47232},{"type":"v1","addr":"172.21.15.73:6825","nonce":47232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":47232},{"type":"v1","addr":"172.21.15.73:6827","nonce":47232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":47232},{"type":"v1","addr":"172.21.15.73:6831","nonce":47232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":47232},{"type":"v1","addr":"172.21.15.73:6829","nonce":47232}]},"public_addr":"172.21.15.73:6825/47232","cluster_addr":"172.21.15.73:6827/47232","heartbeat_back_addr":"172.21.15.73:6831/47232","heartbeat_front_addr":"172.21.15.73:6829/47232","state":["exists","up"]},{"osd":4,"uuid":"4ebe0a18-8216-4815-878a-39c39a6cd3fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":47200},{"type":"v1","addr":"172.21.15.115:6801","nonce":47200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":47200},{"type":"v1","addr":"172.21.15.115:6803","nonce":47200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":47200},{"type":"v1","addr":"172.21.15.115:6807","nonce":47200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":47200},{"type":"v1","addr":"172.21.15.115:6805","nonce":47200}]},"public_addr":"172.21.15.115:6801/47200","cluster_addr":"172.21.15.115:6803/47200","heartbeat_back_addr":"172.21.15.115:6807/47200","heartbeat_front_addr":"172.21.15.115:6805/47200","state":["exists","up"]},{"osd":5,"uuid":"957f0ac1-5f26-4f02-8c05-488e6b67ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":47201},{"type":"v1","addr":"172.21.15.115:6809","nonce":47201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":47201},{"type":"v1","addr":"172.21.15.115:6811","nonce":47201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":47201},{"type":"v1","addr":"172.21.15.115:6815","nonce":47201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":47201},{"type":"v1","addr":"172.21.15.115:6813","nonce":47201}]},"public_addr":"172.21.15.115:6809/47201","cluster_addr":"172.21.15.115:6811/47201","heartbeat_back_addr":"172.21.15.115:6815/47201","heartbeat_front_addr":"172.21.15.115:6813/47201","state":["exists","up"]},{"osd":6,"uuid":"f5a6768f-ba7f-4f66-b335-0c303b158e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":47202},{"type":"v1","addr":"172.21.15.115:6817","nonce":47202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":47202},{"type":"v1","addr":"172.21.15.115:6819","nonce":47202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":47202},{"type":"v1","addr":"172.21.15.115:6823","nonce":47202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":47202},{"type":"v1","addr":"172.21.15.115:6821","nonce":47202}]},"public_addr":"172.21.15.115:6817/47202","cluster_addr":"172.21.15.115:6819/47202","heartbeat_back_addr":"172.21.15.115:6823/47202","heartbeat_front_addr":"172.21.15.115:6821/47202","state":["exists","up"]},{"osd":7,"uuid":"f4187743-f9e6-42e6-aca9-0604a58db1ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":47211},{"type":"v1","addr":"172.21.15.115:6825","nonce":47211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":47211},{"type":"v1","addr":"172.21.15.115:6827","nonce":47211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":47211},{"type":"v1","addr":"172.21.15.115:6831","nonce":47211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":47211},{"type":"v1","addr":"172.21.15.115:6829","nonce":47211}]},"public_addr":"172.21.15.115:6825/47211","cluster_addr":"172.21.15.115:6827/47211","heartbeat_back_addr":"172.21.15.115:6831/47211","heartbeat_front_addr":"172.21.15.115:6829/47211","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:33.996335+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:33.687451+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:34.072549+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:33.997588+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:34.047260+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:34.876272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:33.965472+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:34.038637+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T21:50:12.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.584+0000 7fba2f0d0700 1 -- 172.21.15.73:0/3031807880 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fba0c06ac90 msgr2=0x7fba0c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:12.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.585+0000 7fba2f0d0700 1 --2- 172.21.15.73:0/3031807880 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fba0c06ac90 0x7fba0c06d150 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fba1c0017d0 tx=0x7fba1c009040 comp rx=0 tx=0).stop 2024-05-08T21:50:12.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.585+0000 7fba2f0d0700 1 -- 172.21.15.73:0/3031807880 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba2815b5e0 msgr2=0x7fba2815a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:50:12.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.585+0000 7fba2f0d0700 1 --2- 172.21.15.73:0/3031807880 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba2815b5e0 0x7fba2815a1c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fba2000cb60 tx=0x7fba2000ce70 comp rx=0 tx=0).stop 2024-05-08T21:50:12.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.585+0000 7fba2f0d0700 1 -- 172.21.15.73:0/3031807880 shutdown_connections 2024-05-08T21:50:12.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.585+0000 7fba2f0d0700 1 --2- 172.21.15.73:0/3031807880 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fba0c06ac90 0x7fba0c06d150 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:12.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.585+0000 7fba2f0d0700 1 --2- 172.21.15.73:0/3031807880 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba2815b5e0 0x7fba2815a1c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:12.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.585+0000 7fba2f0d0700 1 --2- 172.21.15.73:0/3031807880 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fba280c9990 0x7fba28154aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:12.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.585+0000 7fba2f0d0700 1 --2- 172.21.15.73:0/3031807880 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fba28141220 0x7fba281e0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:50:12.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.585+0000 7fba2f0d0700 1 -- 172.21.15.73:0/3031807880 >> 172.21.15.73:0/3031807880 conn(0x7fba28066d70 msgr2=0x7fba2813f9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:50:12.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.585+0000 7fba2f0d0700 1 -- 172.21.15.73:0/3031807880 shutdown_connections 2024-05-08T21:50:12.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:50:12.585+0000 7fba2f0d0700 1 -- 172.21.15.73:0/3031807880 wait complete. 2024-05-08T21:50:12.598 DEBUG:tasks.mds_thrash:Yielding 2024-05-08T21:50:12.598 INFO:teuthology.run_tasks:Running task workunit... 2024-05-08T21:50:12.610 INFO:tasks.workunit:Pulling workunits from ref d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T21:50:12.610 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-05-08T21:50:12.610 INFO:tasks.workunit:timeout=3h 2024-05-08T21:50:12.610 INFO:tasks.workunit:cleanup=True 2024-05-08T21:50:12.610 DEBUG:teuthology.orchestra.run.smithi073:> stat -- /home/ubuntu/cephtest/mnt.0 2024-05-08T21:50:12.611 INFO:tasks.mds_thrash.fs.[cephfs]:starting mds_do_thrash for fs cephfs 2024-05-08T21:50:12.611 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 96 secs before thrashing 2024-05-08T21:50:12.628 INFO:teuthology.orchestra.run.smithi073.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-05-08T21:50:12.628 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-05-08T21:50:12.629 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 2fh/47d Inode: 1 Links: 2 2024-05-08T21:50:12.629 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T21:50:12.629 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:cephfs_t:s0 2024-05-08T21:50:12.629 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-05-08T21:50:12.629 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-05-08 21:49:48.749527340 +0000 2024-05-08T21:50:12.629 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-05-08 21:50:05.742694583 +0000 2024-05-08T21:50:12.629 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2024-05-08 21:49:48.749527340 +0000 2024-05-08T21:50:12.629 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-05-08T21:50:12.629 DEBUG:teuthology.orchestra.run.smithi073:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-05-08T21:50:12.699 DEBUG:teuthology.orchestra.run.smithi073:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T21:50:12.756 INFO:tasks.workunit.client.0.smithi073.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-05-08T21:50:20.012 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:50:20.015 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:50:50.116 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:50:50.120 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:51:20.177 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:51:20.180 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:51:48.612 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:51:48.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:48.792+0000 7f9df7b87700 1 Processor -- start 2024-05-08T21:51:48.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:48.793+0000 7f9df7b87700 1 -- start start 2024-05-08T21:51:48.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:48.794+0000 7f9df7b87700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9df00cb630 0x7f9df00cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:51:48.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:48.794+0000 7f9df7b87700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9df00cafc0 0x7f9df00cc480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:51:48.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:48.794+0000 7f9df7b87700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9df015e1b0 con 0x7f9df0153ed0 2024-05-08T21:51:48.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:48.794+0000 7f9df7b87700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9df00ca930 con 0x7f9df00cb630 2024-05-08T21:51:48.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:48.794+0000 7f9df7b87700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9df006bc00 con 0x7f9df00cafc0 2024-05-08T21:51:48.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:48.794+0000 7f9df5122700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9df00cb630 0x7f9df00cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:51:48.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:48.794+0000 7f9df5122700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9df00cb630 0x7f9df00cbf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57104/0 (socket says 172.21.15.73:57104) 2024-05-08T21:51:48.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:48.794+0000 7f9df5122700 1 -- 172.21.15.73:0/2519292897 learned_addr learned my addr 172.21.15.73:0/2519292897 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:51:48.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:48.794+0000 7f9df6124700 1 --2- 172.21.15.73:0/2519292897 >> v2:172.21.15.115:3300/0 conn(0x7f9df00cafc0 0x7f9df00cc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:51:48.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:48.794+0000 7f9df5122700 1 -- 172.21.15.73:0/2519292897 >> v2:172.21.15.115:3300/0 conn(0x7f9df00cafc0 msgr2=0x7f9df00cc480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:51:48.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:48.794+0000 7f9df5122700 1 --2- 172.21.15.73:0/2519292897 >> v2:172.21.15.115:3300/0 conn(0x7f9df00cafc0 0x7f9df00cc480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:51:48.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:48.794+0000 7f9df5122700 1 -- 172.21.15.73:0/2519292897 >> v1:172.21.15.115:6789/0 conn(0x7f9df0153ed0 legacy=0x7f9df006c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:51:48.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:48.794+0000 7f9df5122700 1 -- 172.21.15.73:0/2519292897 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df00cbcc0 con 0x7f9df00cb630 2024-05-08T21:51:48.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:48.795+0000 7f9df5122700 1 --2- 172.21.15.73:0/2519292897 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9df00cb630 0x7f9df00cbf40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9df00c4690 tx=0x7f9de0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc3cee12977358c5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:51:48.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:48.795+0000 7f9df4921700 1 -- 172.21.15.73:0/2519292897 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de0011830 con 0x7f9df00cb630 2024-05-08T21:51:48.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:48.795+0000 7f9df4921700 1 -- 172.21.15.73:0/2519292897 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9de0011990 con 0x7f9df00cb630 2024-05-08T21:51:48.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:48.795+0000 7f9df4921700 1 -- 172.21.15.73:0/2519292897 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de0011d20 con 0x7f9df00cb630 2024-05-08T21:51:48.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:48.796+0000 7f9df7b87700 1 -- 172.21.15.73:0/2519292897 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9df00cb630 msgr2=0x7f9df00cbf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:51:48.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:48.796+0000 7f9df7b87700 1 --2- 172.21.15.73:0/2519292897 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9df00cb630 0x7f9df00cbf40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9df00c4690 tx=0x7f9de0009bd0 comp rx=0 tx=0).stop 2024-05-08T21:51:48.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:48.796+0000 7f9df7b87700 1 -- 172.21.15.73:0/2519292897 shutdown_connections 2024-05-08T21:51:48.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:48.796+0000 7f9df7b87700 1 --2- 172.21.15.73:0/2519292897 >> v2:172.21.15.115:3300/0 conn(0x7f9df00cafc0 0x7f9df00cc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:51:48.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:48.796+0000 7f9df7b87700 1 --2- 172.21.15.73:0/2519292897 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9df00cb630 0x7f9df00cbf40 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:51:48.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:48.796+0000 7f9df7b87700 1 -- 172.21.15.73:0/2519292897 >> 172.21.15.73:0/2519292897 conn(0x7f9df00666c0 msgr2=0x7f9df0066ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:51:48.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:48.796+0000 7f9df7b87700 1 -- 172.21.15.73:0/2519292897 shutdown_connections 2024-05-08T21:51:48.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:48.796+0000 7f9df7b87700 1 -- 172.21.15.73:0/2519292897 wait complete. 2024-05-08T21:51:48.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:48.798+0000 7f9df7b87700 1 Processor -- start 2024-05-08T21:51:48.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:48.798+0000 7f9df7b87700 1 -- start start 2024-05-08T21:51:48.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:48.799+0000 7f9df7b87700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9df00cafc0 0x7f9df0149660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:51:48.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:48.799+0000 7f9df7b87700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9df00cb630 0x7f9df0149ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:51:48.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:48.799+0000 7f9df7b87700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9df0153ed0 0x7f9df01e3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:51:48.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:48.799+0000 7f9df7b87700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df0150550 con 0x7f9df00cb630 2024-05-08T21:51:48.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:48.799+0000 7f9df7b87700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df0150830 con 0x7f9df00cafc0 2024-05-08T21:51:48.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:48.799+0000 7f9df7b87700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9df01e3160 con 0x7f9df0153ed0 2024-05-08T21:51:48.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:48.799+0000 7f9df5122700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9df00cb630 0x7f9df0149ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:51:48.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:48.799+0000 7f9df5122700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9df00cb630 0x7f9df0149ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57108/0 (socket says 172.21.15.73:57108) 2024-05-08T21:51:48.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:48.799+0000 7f9df5122700 1 -- 172.21.15.73:0/1305051001 learned_addr learned my addr 172.21.15.73:0/1305051001 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:51:48.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:48.799+0000 7f9df5923700 1 --2- 172.21.15.73:0/1305051001 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9df00cafc0 0x7f9df0149660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:51:48.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:48.799+0000 7f9df6124700 1 --2- 172.21.15.73:0/1305051001 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9df0153ed0 0x7f9df01e3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:51:48.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:48.799+0000 7f9df5122700 1 -- 172.21.15.73:0/1305051001 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9df0153ed0 msgr2=0x7f9df01e3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:51:48.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:48.799+0000 7f9df5122700 1 --2- 172.21.15.73:0/1305051001 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9df0153ed0 0x7f9df01e3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:51:48.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:48.799+0000 7f9df5122700 1 -- 172.21.15.73:0/1305051001 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9df00cafc0 msgr2=0x7f9df0149660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:51:48.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:48.799+0000 7f9df5122700 1 --2- 172.21.15.73:0/1305051001 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9df00cafc0 0x7f9df0149660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:51:48.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:48.799+0000 7f9df5122700 1 -- 172.21.15.73:0/1305051001 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9de0009550 con 0x7f9df00cb630 2024-05-08T21:51:48.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:48.799+0000 7f9df5122700 1 --2- 172.21.15.73:0/1305051001 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9df00cb630 0x7f9df0149ba0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9de0009c10 tx=0x7f9de0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:51:48.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:48.799+0000 7f9de67fc700 1 -- 172.21.15.73:0/1305051001 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de0004380 con 0x7f9df00cb630 2024-05-08T21:51:48.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:48.799+0000 7f9de67fc700 1 -- 172.21.15.73:0/1305051001 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9de001f070 con 0x7f9df00cb630 2024-05-08T21:51:48.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:48.799+0000 7f9df7b87700 1 -- 172.21.15.73:0/1305051001 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9df01e3440 con 0x7f9df00cb630 2024-05-08T21:51:48.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:48.800+0000 7f9de67fc700 1 -- 172.21.15.73:0/1305051001 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de00036a0 con 0x7f9df00cb630 2024-05-08T21:51:48.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:48.800+0000 7f9df7b87700 1 -- 172.21.15.73:0/1305051001 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9df01f3690 con 0x7f9df00cb630 2024-05-08T21:51:48.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:48.801+0000 7f9df7b87700 1 -- 172.21.15.73:0/1305051001 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9df00c46c0 con 0x7f9df00cb630 2024-05-08T21:51:48.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:48.801+0000 7f9de67fc700 1 -- 172.21.15.73:0/1305051001 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9de0021030 con 0x7f9df00cb630 2024-05-08T21:51:48.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:48.802+0000 7f9de67fc700 1 --2- 172.21.15.73:0/1305051001 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f9dd406acc0 0x7f9dd406d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:51:48.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:48.802+0000 7f9de67fc700 1 -- 172.21.15.73:0/1305051001 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5883+0+0 (secure 0 0 0) 0x7f9de008a6f0 con 0x7f9df00cb630 2024-05-08T21:51:48.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:48.802+0000 7f9df5923700 1 --2- 172.21.15.73:0/1305051001 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f9dd406acc0 0x7f9dd406d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:51:48.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:48.802+0000 7f9df5923700 1 --2- 172.21.15.73:0/1305051001 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f9dd406acc0 0x7f9dd406d180 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9dec007fd0 tx=0x7f9dec009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:51:48.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:48.810+0000 7f9de67fc700 1 -- 172.21.15.73:0/1305051001 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f9de0055820 con 0x7f9df00cb630 2024-05-08T21:51:49.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.062+0000 7f9df7b87700 1 -- 172.21.15.73:0/1305051001 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9df0068b80 con 0x7f9df00cb630 2024-05-08T21:51:49.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.062+0000 7f9de67fc700 1 -- 172.21.15.73:0/1305051001 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+6250 (secure 0 0 0) 0x7f9de0058e40 con 0x7f9df00cb630 2024-05-08T21:51:49.064 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:51:49.064 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3242319177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6833","nonce":3242319177},{"type":"v1","addr":"172.21.15.115:6835","nonce":3242319177}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6834/2136341349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2136341349},{"type":"v1","addr":"172.21.15.115:6834","nonce":2136341349}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4249,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1439647913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1439647913},{"type":"v1","addr":"172.21.15.115:6837","nonce":1439647913}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/2386382396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2386382396},{"type":"v1","addr":"172.21.15.73:6836","nonce":2386382396}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/1772457954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":1772457954},{"type":"v1","addr":"172.21.15.73:6837","nonce":1772457954}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:49:43.747162+0000","modified":"2024-05-08T21:49:48.814033+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.73:6839/1477468490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1477468490},{"type":"v1","addr":"172.21.15.73:6839","nonce":1477468490}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:51:49.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.065+0000 7f9df7b87700 1 -- 172.21.15.73:0/1305051001 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f9dd406acc0 msgr2=0x7f9dd406d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:51:49.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.065+0000 7f9df7b87700 1 --2- 172.21.15.73:0/1305051001 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f9dd406acc0 0x7f9dd406d180 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9dec007fd0 tx=0x7f9dec009040 comp rx=0 tx=0).stop 2024-05-08T21:51:49.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.065+0000 7f9df7b87700 1 -- 172.21.15.73:0/1305051001 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9df00cb630 msgr2=0x7f9df0149ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:51:49.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.065+0000 7f9df7b87700 1 --2- 172.21.15.73:0/1305051001 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9df00cb630 0x7f9df0149ba0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9de0009c10 tx=0x7f9de0004750 comp rx=0 tx=0).stop 2024-05-08T21:51:49.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.065+0000 7f9df7b87700 1 -- 172.21.15.73:0/1305051001 shutdown_connections 2024-05-08T21:51:49.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.065+0000 7f9df7b87700 1 --2- 172.21.15.73:0/1305051001 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f9dd406acc0 0x7f9dd406d180 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:51:49.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.065+0000 7f9df7b87700 1 --2- 172.21.15.73:0/1305051001 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9df0153ed0 0x7f9df01e3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:51:49.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.065+0000 7f9df7b87700 1 --2- 172.21.15.73:0/1305051001 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9df00cafc0 0x7f9df0149660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:51:49.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.065+0000 7f9df7b87700 1 --2- 172.21.15.73:0/1305051001 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9df00cb630 0x7f9df0149ba0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:51:49.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.065+0000 7f9df7b87700 1 -- 172.21.15.73:0/1305051001 >> 172.21.15.73:0/1305051001 conn(0x7f9df00666c0 msgr2=0x7f9df0066aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:51:49.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.065+0000 7f9df7b87700 1 -- 172.21.15.73:0/1305051001 shutdown_connections 2024-05-08T21:51:49.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.065+0000 7f9df7b87700 1 -- 172.21.15.73:0/1305051001 wait complete. 2024-05-08T21:51:49.067 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 8 2024-05-08T21:51:49.079 INFO:tasks.mds_thrash.fs.[cephfs]:kill mds.e (rank=0) 2024-05-08T21:51:49.079 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-05-08T21:51:49.079 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:51:49.097 INFO:tasks.ceph.mds.e:Stopped 2024-05-08T21:51:49.097 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:51:49.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.265+0000 7f79475ad700 1 Processor -- start 2024-05-08T21:51:49.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.265+0000 7f79475ad700 1 -- start start 2024-05-08T21:51:49.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.266+0000 7f79475ad700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f79400c6a10 0x7f794006c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:51:49.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.266+0000 7f79475ad700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f79401518e0 0x7f7940151d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:51:49.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.266+0000 7f79475ad700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7940158980 con 0x7f79400666c0 2024-05-08T21:51:49.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.266+0000 7f79475ad700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7940152290 con 0x7f79401518e0 2024-05-08T21:51:49.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.266+0000 7f79475ad700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7940072d20 con 0x7f79400c6a10 2024-05-08T21:51:49.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.266+0000 7f7945b4a700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f79401518e0 0x7f7940151d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:51:49.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.266+0000 7f7945b4a700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f79401518e0 0x7f7940151d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57122/0 (socket says 172.21.15.73:57122) 2024-05-08T21:51:49.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.266+0000 7f7945b4a700 1 -- 172.21.15.73:0/2125072284 learned_addr learned my addr 172.21.15.73:0/2125072284 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:51:49.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.266+0000 7f7945349700 1 --2- 172.21.15.73:0/2125072284 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f79400c6a10 0x7f794006c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:51:49.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.267+0000 7f7937fff700 1 -- 172.21.15.73:0/2125072284 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4063407269 0 0) 0x7f7940158980 con 0x7f79400666c0 2024-05-08T21:51:49.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.267+0000 7f7937fff700 1 -- 172.21.15.73:0/2125072284 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f792c0035b0 con 0x7f79400666c0 2024-05-08T21:51:49.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.267+0000 7f7945b4a700 1 -- 172.21.15.73:0/2125072284 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f79400c6a10 msgr2=0x7f794006c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:51:49.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.267+0000 7f7945b4a700 1 --2- 172.21.15.73:0/2125072284 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f79400c6a10 0x7f794006c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:51:49.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.267+0000 7f7945b4a700 1 -- 172.21.15.73:0/2125072284 >> v1:172.21.15.73:6789/0 conn(0x7f79400666c0 legacy=0x7f79400c6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:51:49.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.267+0000 7f7945b4a700 1 -- 172.21.15.73:0/2125072284 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7940157ab0 con 0x7f79401518e0 2024-05-08T21:51:49.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.267+0000 7f7945349700 1 --2- 172.21.15.73:0/2125072284 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f79400c6a10 0x7f794006c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:51:49.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.267+0000 7f7945b4a700 1 --2- 172.21.15.73:0/2125072284 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79401518e0 0x7f7940151d50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7938009e50 tx=0x7f793800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22e85b42fdde5179 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:51:49.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.267+0000 7f7937fff700 1 -- 172.21.15.73:0/2125072284 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793800e070 con 0x7f79401518e0 2024-05-08T21:51:49.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.267+0000 7f7937fff700 1 -- 172.21.15.73:0/2125072284 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7938003a20 con 0x7f79401518e0 2024-05-08T21:51:49.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.267+0000 7f7937fff700 1 -- 172.21.15.73:0/2125072284 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7938003d90 con 0x7f79401518e0 2024-05-08T21:51:49.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.268+0000 7f79475ad700 1 -- 172.21.15.73:0/2125072284 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79401518e0 msgr2=0x7f7940151d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:51:49.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.268+0000 7f79475ad700 1 --2- 172.21.15.73:0/2125072284 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79401518e0 0x7f7940151d50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7938009e50 tx=0x7f793800b330 comp rx=0 tx=0).stop 2024-05-08T21:51:49.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.268+0000 7f79475ad700 1 -- 172.21.15.73:0/2125072284 shutdown_connections 2024-05-08T21:51:49.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.268+0000 7f79475ad700 1 --2- 172.21.15.73:0/2125072284 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f79400c6a10 0x7f794006c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:51:49.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.268+0000 7f79475ad700 1 --2- 172.21.15.73:0/2125072284 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79401518e0 0x7f7940151d50 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:51:49.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.268+0000 7f79475ad700 1 -- 172.21.15.73:0/2125072284 >> 172.21.15.73:0/2125072284 conn(0x7f794006f9b0 msgr2=0x7f794006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:51:49.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.274+0000 7f79475ad700 1 -- 172.21.15.73:0/2125072284 shutdown_connections 2024-05-08T21:51:49.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.274+0000 7f79475ad700 1 -- 172.21.15.73:0/2125072284 wait complete. 2024-05-08T21:51:49.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.275+0000 7f79475ad700 1 Processor -- start 2024-05-08T21:51:49.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.275+0000 7f79475ad700 1 -- start start 2024-05-08T21:51:49.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.276+0000 7f79475ad700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79400666c0 0x7f7940154200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:51:49.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.276+0000 7f79475ad700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79400c6a10 0x7f7940159f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:51:49.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.276+0000 7f79475ad700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f79401518e0 0x7f794015a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:51:49.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.276+0000 7f79475ad700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7940158c70 con 0x7f79400666c0 2024-05-08T21:51:49.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.276+0000 7f79475ad700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7940159a90 con 0x7f79400c6a10 2024-05-08T21:51:49.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.276+0000 7f79475ad700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7940158e80 con 0x7f79401518e0 2024-05-08T21:51:49.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.276+0000 7f7945349700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79400666c0 0x7f7940154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:51:49.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.276+0000 7f7945349700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79400666c0 0x7f7940154200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57128/0 (socket says 172.21.15.73:57128) 2024-05-08T21:51:49.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.276+0000 7f7945349700 1 -- 172.21.15.73:0/1265098447 learned_addr learned my addr 172.21.15.73:0/1265098447 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:51:49.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.277+0000 7f7944b48700 1 --2- 172.21.15.73:0/1265098447 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79400c6a10 0x7f7940159f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:51:49.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.277+0000 7f7945b4a700 1 --2- 172.21.15.73:0/1265098447 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f79401518e0 0x7f794015a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:51:49.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.277+0000 7f7945349700 1 -- 172.21.15.73:0/1265098447 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f79401518e0 msgr2=0x7f794015a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:51:49.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.277+0000 7f7945349700 1 --2- 172.21.15.73:0/1265098447 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f79401518e0 0x7f794015a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:51:49.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.277+0000 7f7945349700 1 -- 172.21.15.73:0/1265098447 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79400c6a10 msgr2=0x7f7940159f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:51:49.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.277+0000 7f7945349700 1 --2- 172.21.15.73:0/1265098447 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79400c6a10 0x7f7940159f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:51:49.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.277+0000 7f7945349700 1 -- 172.21.15.73:0/1265098447 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7938009b30 con 0x7f79400666c0 2024-05-08T21:51:49.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.277+0000 7f7945349700 1 --2- 172.21.15.73:0/1265098447 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79400666c0 0x7f7940154200 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f793c00e810 tx=0x7f793c00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:51:49.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.277+0000 7f7935ffb700 1 -- 172.21.15.73:0/1265098447 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793c013610 con 0x7f79400666c0 2024-05-08T21:51:49.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.277+0000 7f7935ffb700 1 -- 172.21.15.73:0/1265098447 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f793c013770 con 0x7f79400666c0 2024-05-08T21:51:49.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.277+0000 7f7935ffb700 1 -- 172.21.15.73:0/1265098447 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793c013b20 con 0x7f79400666c0 2024-05-08T21:51:49.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.277+0000 7f79475ad700 1 -- 172.21.15.73:0/1265098447 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7940159160 con 0x7f79400666c0 2024-05-08T21:51:49.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.278+0000 7f79475ad700 1 -- 172.21.15.73:0/1265098447 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7940159720 con 0x7f79400666c0 2024-05-08T21:51:49.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.279+0000 7f79475ad700 1 -- 172.21.15.73:0/1265098447 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79401598b0 con 0x7f79400666c0 2024-05-08T21:51:49.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.281+0000 7f7935ffb700 1 -- 172.21.15.73:0/1265098447 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f793c013c80 con 0x7f79400666c0 2024-05-08T21:51:49.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.281+0000 7f7935ffb700 1 --2- 172.21.15.73:0/1265098447 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f792406ac90 0x7f792406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:51:49.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.281+0000 7f7935ffb700 1 -- 172.21.15.73:0/1265098447 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5883+0+0 (secure 0 0 0) 0x7f793c089490 con 0x7f79400666c0 2024-05-08T21:51:49.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.282+0000 7f7944b48700 1 --2- 172.21.15.73:0/1265098447 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f792406ac90 0x7f792406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:51:49.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.282+0000 7f7944b48700 1 --2- 172.21.15.73:0/1265098447 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f792406ac90 0x7f792406d150 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7940156590 tx=0x7f7930009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:51:49.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.285+0000 7f7935ffb700 1 -- 172.21.15.73:0/1265098447 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f793c054510 con 0x7f79400666c0 2024-05-08T21:51:49.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.537+0000 7f79475ad700 1 -- 172.21.15.73:0/1265098447 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7940159d70 con 0x7f79400666c0 2024-05-08T21:51:49.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.537+0000 7f7935ffb700 1 -- 172.21.15.73:0/1265098447 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+6250 (secure 0 0 0) 0x7f793c057b30 con 0x7f79400666c0 2024-05-08T21:51:49.538 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:51:49.539 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3242319177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6833","nonce":3242319177},{"type":"v1","addr":"172.21.15.115:6835","nonce":3242319177}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6834/2136341349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2136341349},{"type":"v1","addr":"172.21.15.115:6834","nonce":2136341349}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4249,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1439647913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1439647913},{"type":"v1","addr":"172.21.15.115:6837","nonce":1439647913}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/2386382396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2386382396},{"type":"v1","addr":"172.21.15.73:6836","nonce":2386382396}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/1772457954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":1772457954},{"type":"v1","addr":"172.21.15.73:6837","nonce":1772457954}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:49:43.747162+0000","modified":"2024-05-08T21:49:48.814033+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.73:6839/1477468490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1477468490},{"type":"v1","addr":"172.21.15.73:6839","nonce":1477468490}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:51:49.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.539+0000 7f79475ad700 1 -- 172.21.15.73:0/1265098447 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f792406ac90 msgr2=0x7f792406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:51:49.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.539+0000 7f79475ad700 1 --2- 172.21.15.73:0/1265098447 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f792406ac90 0x7f792406d150 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7940156590 tx=0x7f7930009040 comp rx=0 tx=0).stop 2024-05-08T21:51:49.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.539+0000 7f79475ad700 1 -- 172.21.15.73:0/1265098447 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79400666c0 msgr2=0x7f7940154200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:51:49.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.539+0000 7f79475ad700 1 --2- 172.21.15.73:0/1265098447 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79400666c0 0x7f7940154200 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f793c00e810 tx=0x7f793c00eb20 comp rx=0 tx=0).stop 2024-05-08T21:51:49.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.540+0000 7f79475ad700 1 -- 172.21.15.73:0/1265098447 shutdown_connections 2024-05-08T21:51:49.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.540+0000 7f79475ad700 1 --2- 172.21.15.73:0/1265098447 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f792406ac90 0x7f792406d150 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:51:49.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.540+0000 7f79475ad700 1 --2- 172.21.15.73:0/1265098447 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f79401518e0 0x7f794015a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:51:49.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.540+0000 7f79475ad700 1 --2- 172.21.15.73:0/1265098447 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79400666c0 0x7f7940154200 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:51:49.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.540+0000 7f79475ad700 1 --2- 172.21.15.73:0/1265098447 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79400c6a10 0x7f7940159f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:51:49.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.540+0000 7f79475ad700 1 -- 172.21.15.73:0/1265098447 >> 172.21.15.73:0/1265098447 conn(0x7f794006f9b0 msgr2=0x7f7940156ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:51:49.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.540+0000 7f79475ad700 1 -- 172.21.15.73:0/1265098447 shutdown_connections 2024-05-08T21:51:49.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:49.540+0000 7f79475ad700 1 -- 172.21.15.73:0/1265098447 wait complete. 2024-05-08T21:51:49.542 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 8 2024-05-08T21:51:49.554 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is laggy/crashed, in failed state, or mds.e is removed from mdsmap 2024-05-08T21:51:50.254 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:51:50.257 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:51:51.555 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:51:51.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:51.740+0000 7f1972eb0700 1 Processor -- start 2024-05-08T21:51:51.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:51.740+0000 7f1972eb0700 1 -- start start 2024-05-08T21:51:51.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:51.742+0000 7f1972eb0700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f196c157430 0x7f196c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:51:51.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:51.742+0000 7f1972eb0700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f196c06bb70 con 0x7f196c0cdf40 2024-05-08T21:51:51.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:51.742+0000 7f1972eb0700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f196c070030 con 0x7f196c15a5b0 2024-05-08T21:51:51.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:51.742+0000 7f1972eb0700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f196c06d1e0 con 0x7f196c157430 2024-05-08T21:51:51.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:51.742+0000 7f196bfff700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f196c0cdf40 0x7f196c159ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:44826/0 (socket says 172.21.15.73:44826) 2024-05-08T21:51:51.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:51.742+0000 7f196bfff700 1 -- 172.21.15.73:0/3676356863 learned_addr learned my addr 172.21.15.73:0/3676356863 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:51:51.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:51.742+0000 7f1970c4c700 1 --2- 172.21.15.73:0/3676356863 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f196c157430 0x7f196c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:51:51.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:51.742+0000 7f196b7fe700 1 -- 172.21.15.73:0/3676356863 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3393656097 0 0) 0x7f196c06bb70 con 0x7f196c0cdf40 2024-05-08T21:51:51.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:51.742+0000 7f196b7fe700 1 -- 172.21.15.73:0/3676356863 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f195c0035b0 con 0x7f196c0cdf40 2024-05-08T21:51:51.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:51.742+0000 7f196b7fe700 1 -- 172.21.15.73:0/3676356863 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3571996755 0 0) 0x7f196c070030 con 0x7f196c15a5b0 2024-05-08T21:51:51.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:51.742+0000 7f196b7fe700 1 -- 172.21.15.73:0/3676356863 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f196c06bb70 con 0x7f196c15a5b0 2024-05-08T21:51:51.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:51.743+0000 7f1970c4c700 1 -- 172.21.15.73:0/3676356863 >> v1:172.21.15.115:6789/0 conn(0x7f196c15a5b0 legacy=0x7f196c164540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:51:51.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:51.743+0000 7f196b7fe700 1 -- 172.21.15.73:0/3676356863 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1890003585 0 0) 0x7f195c0035b0 con 0x7f196c0cdf40 2024-05-08T21:51:51.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:51.743+0000 7f1970c4c700 1 -- 172.21.15.73:0/3676356863 >> v1:172.21.15.73:6789/0 conn(0x7f196c0cdf40 legacy=0x7f196c159ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:51:51.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:51.743+0000 7f1970c4c700 1 -- 172.21.15.73:0/3676356863 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f196c157810 con 0x7f196c157430 2024-05-08T21:51:51.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:51.743+0000 7f1970c4c700 1 --2- 172.21.15.73:0/3676356863 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f196c157430 0x7f196c06f110 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1960009870 tx=0x7f1960009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=464c30ba4ef69278 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:51:51.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:51.743+0000 7f196b7fe700 1 -- 172.21.15.73:0/3676356863 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1958001670 con 0x7f196c157430 2024-05-08T21:51:51.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:51.743+0000 7f196b7fe700 1 -- 172.21.15.73:0/3676356863 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1960004030 con 0x7f196c157430 2024-05-08T21:51:51.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:51.743+0000 7f196b7fe700 1 -- 172.21.15.73:0/3676356863 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19600043c0 con 0x7f196c157430 2024-05-08T21:51:51.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:51.744+0000 7f1972eb0700 1 -- 172.21.15.73:0/3676356863 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f196c157430 msgr2=0x7f196c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:51:51.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:51.744+0000 7f1972eb0700 1 --2- 172.21.15.73:0/3676356863 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f196c157430 0x7f196c06f110 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1960009870 tx=0x7f1960009b80 comp rx=0 tx=0).stop 2024-05-08T21:51:51.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:51.744+0000 7f1972eb0700 1 -- 172.21.15.73:0/3676356863 shutdown_connections 2024-05-08T21:51:51.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:51.744+0000 7f1972eb0700 1 --2- 172.21.15.73:0/3676356863 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f196c157430 0x7f196c06f110 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:51:51.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:51.744+0000 7f1972eb0700 1 -- 172.21.15.73:0/3676356863 >> 172.21.15.73:0/3676356863 conn(0x7f196c06aff0 msgr2=0x7f196c0666c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:51:51.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:51.744+0000 7f1972eb0700 1 -- 172.21.15.73:0/3676356863 shutdown_connections 2024-05-08T21:51:51.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:51.744+0000 7f1972eb0700 1 -- 172.21.15.73:0/3676356863 wait complete. 2024-05-08T21:51:51.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:51.745+0000 7f1972eb0700 1 Processor -- start 2024-05-08T21:51:51.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:51.745+0000 7f1972eb0700 1 -- start start 2024-05-08T21:51:51.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:51.746+0000 7f1972eb0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f196c0cdf40 0x7f196c1effc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:51:51.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:51.746+0000 7f1972eb0700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f196c157430 0x7f196c156520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:51:51.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:51.746+0000 7f1972eb0700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f196c15a5b0 0x7f196c151030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:51:51.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:51.746+0000 7f1972eb0700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f196c1f0500 con 0x7f196c0cdf40 2024-05-08T21:51:51.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:51.746+0000 7f1972eb0700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f196c150ba0 con 0x7f196c15a5b0 2024-05-08T21:51:51.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:51.746+0000 7f1972eb0700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f196c1531b0 con 0x7f196c157430 2024-05-08T21:51:51.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:51.747+0000 7f1970c4c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f196c0cdf40 0x7f196c1effc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:51:51.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:51.747+0000 7f1970c4c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f196c0cdf40 0x7f196c1effc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57134/0 (socket says 172.21.15.73:57134) 2024-05-08T21:51:51.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:51.747+0000 7f197144d700 1 --2- 172.21.15.73:0/3320424835 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f196c15a5b0 0x7f196c151030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:51:51.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:51.747+0000 7f1970c4c700 1 -- 172.21.15.73:0/3320424835 learned_addr learned my addr 172.21.15.73:0/3320424835 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:51:51.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:51.747+0000 7f196bfff700 1 --2- 172.21.15.73:0/3320424835 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f196c157430 0x7f196c156520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:51:51.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:51.747+0000 7f1970c4c700 1 -- 172.21.15.73:0/3320424835 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f196c157430 msgr2=0x7f196c156520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:51:51.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:51.747+0000 7f1970c4c700 1 --2- 172.21.15.73:0/3320424835 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f196c157430 0x7f196c156520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:51:51.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:51.747+0000 7f1970c4c700 1 -- 172.21.15.73:0/3320424835 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f196c15a5b0 msgr2=0x7f196c151030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:51:51.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:51.747+0000 7f1970c4c700 1 --2- 172.21.15.73:0/3320424835 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f196c15a5b0 0x7f196c151030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:51:51.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:51.747+0000 7f1970c4c700 1 -- 172.21.15.73:0/3320424835 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19600094a0 con 0x7f196c0cdf40 2024-05-08T21:51:51.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:51.747+0000 7f1970c4c700 1 --2- 172.21.15.73:0/3320424835 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f196c0cdf40 0x7f196c1effc0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1960000c00 tx=0x7f1960004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:51:51.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:51.751+0000 7f19697fa700 1 -- 172.21.15.73:0/3320424835 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1960003e60 con 0x7f196c0cdf40 2024-05-08T21:51:51.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:51.751+0000 7f1972eb0700 1 -- 172.21.15.73:0/3320424835 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f196c152670 con 0x7f196c0cdf40 2024-05-08T21:51:51.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:51.751+0000 7f1972eb0700 1 -- 172.21.15.73:0/3320424835 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f196c152bf0 con 0x7f196c0cdf40 2024-05-08T21:51:51.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:51.751+0000 7f19697fa700 1 -- 172.21.15.73:0/3320424835 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f196001f070 con 0x7f196c0cdf40 2024-05-08T21:51:51.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:51.751+0000 7f19697fa700 1 -- 172.21.15.73:0/3320424835 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1960011850 con 0x7f196c0cdf40 2024-05-08T21:51:51.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:51.752+0000 7f1972eb0700 1 -- 172.21.15.73:0/3320424835 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f194c0052f0 con 0x7f196c0cdf40 2024-05-08T21:51:51.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:51.753+0000 7f19697fa700 1 -- 172.21.15.73:0/3320424835 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f19600119b0 con 0x7f196c0cdf40 2024-05-08T21:51:51.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:51.753+0000 7f19697fa700 1 --2- 172.21.15.73:0/3320424835 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f195006ac90 0x7f195006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:51:51.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:51.753+0000 7f19697fa700 1 -- 172.21.15.73:0/3320424835 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5883+0+0 (secure 0 0 0) 0x7f1960021070 con 0x7f196c0cdf40 2024-05-08T21:51:51.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:51.755+0000 7f196bfff700 1 --2- 172.21.15.73:0/3320424835 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f195006ac90 0x7f195006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:51:51.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:51.755+0000 7f196bfff700 1 --2- 172.21.15.73:0/3320424835 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f195006ac90 0x7f195006d150 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f196c1524f0 tx=0x7f1958000f10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:51:51.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:51.761+0000 7f19697fa700 1 -- 172.21.15.73:0/3320424835 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f1960056220 con 0x7f196c0cdf40 2024-05-08T21:51:52.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:52.247+0000 7f1972eb0700 1 -- 172.21.15.73:0/3320424835 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f194c005160 con 0x7f196c0cdf40 2024-05-08T21:51:52.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:52.248+0000 7f19697fa700 1 -- 172.21.15.73:0/3320424835 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+6250 (secure 0 0 0) 0x7f1960059840 con 0x7f196c0cdf40 2024-05-08T21:51:52.249 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:51:52.249 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3242319177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6833","nonce":3242319177},{"type":"v1","addr":"172.21.15.115:6835","nonce":3242319177}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6834/2136341349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2136341349},{"type":"v1","addr":"172.21.15.115:6834","nonce":2136341349}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4249,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1439647913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1439647913},{"type":"v1","addr":"172.21.15.115:6837","nonce":1439647913}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/2386382396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2386382396},{"type":"v1","addr":"172.21.15.73:6836","nonce":2386382396}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/1772457954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":1772457954},{"type":"v1","addr":"172.21.15.73:6837","nonce":1772457954}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:49:43.747162+0000","modified":"2024-05-08T21:49:48.814033+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.73:6839/1477468490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1477468490},{"type":"v1","addr":"172.21.15.73:6839","nonce":1477468490}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:51:52.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:52.251+0000 7f1972eb0700 1 -- 172.21.15.73:0/3320424835 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f195006ac90 msgr2=0x7f195006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:51:52.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:52.251+0000 7f1972eb0700 1 --2- 172.21.15.73:0/3320424835 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f195006ac90 0x7f195006d150 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f196c1524f0 tx=0x7f1958000f10 comp rx=0 tx=0).stop 2024-05-08T21:51:52.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:52.251+0000 7f1972eb0700 1 -- 172.21.15.73:0/3320424835 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f196c0cdf40 msgr2=0x7f196c1effc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:51:52.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:52.251+0000 7f1972eb0700 1 --2- 172.21.15.73:0/3320424835 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f196c0cdf40 0x7f196c1effc0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1960000c00 tx=0x7f1960004750 comp rx=0 tx=0).stop 2024-05-08T21:51:52.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:52.253+0000 7f1972eb0700 1 -- 172.21.15.73:0/3320424835 shutdown_connections 2024-05-08T21:51:52.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:52.253+0000 7f1972eb0700 1 --2- 172.21.15.73:0/3320424835 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f195006ac90 0x7f195006d150 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:51:52.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:52.253+0000 7f1972eb0700 1 --2- 172.21.15.73:0/3320424835 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f196c15a5b0 0x7f196c151030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:51:52.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:52.253+0000 7f1972eb0700 1 --2- 172.21.15.73:0/3320424835 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f196c0cdf40 0x7f196c1effc0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:51:52.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:52.253+0000 7f1972eb0700 1 --2- 172.21.15.73:0/3320424835 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f196c157430 0x7f196c156520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:51:52.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:52.253+0000 7f1972eb0700 1 -- 172.21.15.73:0/3320424835 >> 172.21.15.73:0/3320424835 conn(0x7f196c06aff0 msgr2=0x7f196c1586f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:51:52.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:52.253+0000 7f1972eb0700 1 -- 172.21.15.73:0/3320424835 shutdown_connections 2024-05-08T21:51:52.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:52.253+0000 7f1972eb0700 1 -- 172.21.15.73:0/3320424835 wait complete. 2024-05-08T21:51:52.254 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 8 2024-05-08T21:51:52.270 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is laggy/crashed, in failed state, or mds.e is removed from mdsmap 2024-05-08T21:51:54.271 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:51:54.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.394+0000 7fc320324700 1 Processor -- start 2024-05-08T21:51:54.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.394+0000 7fc320324700 1 -- start start 2024-05-08T21:51:54.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.395+0000 7fc320324700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc3180c29c0 0x7fc3180c42d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:51:54.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.395+0000 7fc320324700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc3180c9170 0x7fc3180cd530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:51:54.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.395+0000 7fc320324700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3180c9600 con 0x7fc318151d00 2024-05-08T21:51:54.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.395+0000 7fc320324700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc31806fae0 con 0x7fc3180c9170 2024-05-08T21:51:54.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.395+0000 7fc320324700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3180c8620 con 0x7fc3180c29c0 2024-05-08T21:51:54.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.396+0000 7fc31e0c0700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fc318151d00 0x7fc318158310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:44832/0 (socket says 172.21.15.73:44832) 2024-05-08T21:51:54.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.396+0000 7fc31e0c0700 1 -- 172.21.15.73:0/3924454133 learned_addr learned my addr 172.21.15.73:0/3924454133 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:51:54.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.396+0000 7fc31d8bf700 1 --2- 172.21.15.73:0/3924454133 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc3180c29c0 0x7fc3180c42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:51:54.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.396+0000 7fc31e8c1700 1 --2- 172.21.15.73:0/3924454133 >> v2:172.21.15.115:3300/0 conn(0x7fc3180c9170 0x7fc3180cd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:51:54.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.396+0000 7fc31d0be700 1 -- 172.21.15.73:0/3924454133 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2929615452 0 0) 0x7fc3180c9600 con 0x7fc318151d00 2024-05-08T21:51:54.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.396+0000 7fc31d0be700 1 -- 172.21.15.73:0/3924454133 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3040035b0 con 0x7fc318151d00 2024-05-08T21:51:54.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.396+0000 7fc31d8bf700 1 -- 172.21.15.73:0/3924454133 >> v2:172.21.15.115:3300/0 conn(0x7fc3180c9170 msgr2=0x7fc3180cd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:51:54.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.396+0000 7fc31d8bf700 1 --2- 172.21.15.73:0/3924454133 >> v2:172.21.15.115:3300/0 conn(0x7fc3180c9170 0x7fc3180cd530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:51:54.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.396+0000 7fc31d8bf700 1 -- 172.21.15.73:0/3924454133 >> v1:172.21.15.73:6789/0 conn(0x7fc318151d00 legacy=0x7fc318158310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:51:54.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.396+0000 7fc31d8bf700 1 -- 172.21.15.73:0/3924454133 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3180c8060 con 0x7fc3180c29c0 2024-05-08T21:51:54.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.396+0000 7fc31d8bf700 1 --2- 172.21.15.73:0/3924454133 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc3180c29c0 0x7fc3180c42d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc308009840 tx=0x7fc308009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8345632cf3d10434 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:51:54.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.396+0000 7fc31d0be700 1 -- 172.21.15.73:0/3924454133 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc308011830 con 0x7fc3180c29c0 2024-05-08T21:51:54.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.397+0000 7fc31d0be700 1 -- 172.21.15.73:0/3924454133 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc308011990 con 0x7fc3180c29c0 2024-05-08T21:51:54.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.397+0000 7fc31d0be700 1 -- 172.21.15.73:0/3924454133 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc308011d00 con 0x7fc3180c29c0 2024-05-08T21:51:54.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.397+0000 7fc320324700 1 -- 172.21.15.73:0/3924454133 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc3180c29c0 msgr2=0x7fc3180c42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:51:54.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.397+0000 7fc320324700 1 --2- 172.21.15.73:0/3924454133 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc3180c29c0 0x7fc3180c42d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc308009840 tx=0x7fc308009b50 comp rx=0 tx=0).stop 2024-05-08T21:51:54.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.397+0000 7fc320324700 1 -- 172.21.15.73:0/3924454133 shutdown_connections 2024-05-08T21:51:54.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.397+0000 7fc320324700 1 --2- 172.21.15.73:0/3924454133 >> v2:172.21.15.115:3300/0 conn(0x7fc3180c9170 0x7fc3180cd530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:51:54.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.397+0000 7fc320324700 1 --2- 172.21.15.73:0/3924454133 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc3180c29c0 0x7fc3180c42d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:51:54.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.397+0000 7fc320324700 1 -- 172.21.15.73:0/3924454133 >> 172.21.15.73:0/3924454133 conn(0x7fc31806aff0 msgr2=0x7fc3180666c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:51:54.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.397+0000 7fc320324700 1 -- 172.21.15.73:0/3924454133 shutdown_connections 2024-05-08T21:51:54.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.397+0000 7fc320324700 1 -- 172.21.15.73:0/3924454133 wait complete. 2024-05-08T21:51:54.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.399+0000 7fc320324700 1 Processor -- start 2024-05-08T21:51:54.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.399+0000 7fc320324700 1 -- start start 2024-05-08T21:51:54.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.400+0000 7fc320324700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc3180c29c0 0x7fc318144290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:51:54.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.400+0000 7fc320324700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc3180c9170 0x7fc3180c62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:51:54.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.400+0000 7fc320324700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc318151d00 0x7fc3181e3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:51:54.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.400+0000 7fc320324700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3181447d0 con 0x7fc318151d00 2024-05-08T21:51:54.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.400+0000 7fc320324700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3181edfb0 con 0x7fc3180c9170 2024-05-08T21:51:54.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.400+0000 7fc320324700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3181e10a0 con 0x7fc3180c29c0 2024-05-08T21:51:54.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.400+0000 7fc31e8c1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc318151d00 0x7fc3181e3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:51:54.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.400+0000 7fc31d8bf700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc3180c9170 0x7fc3180c62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:51:54.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.400+0000 7fc31e8c1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc318151d00 0x7fc3181e3010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57138/0 (socket says 172.21.15.73:57138) 2024-05-08T21:51:54.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.400+0000 7fc31e8c1700 1 -- 172.21.15.73:0/2729483826 learned_addr learned my addr 172.21.15.73:0/2729483826 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:51:54.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.400+0000 7fc31e0c0700 1 --2- 172.21.15.73:0/2729483826 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc3180c29c0 0x7fc318144290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:51:54.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.400+0000 7fc31e8c1700 1 -- 172.21.15.73:0/2729483826 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc3180c29c0 msgr2=0x7fc318144290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:51:54.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.400+0000 7fc31e8c1700 1 --2- 172.21.15.73:0/2729483826 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc3180c29c0 0x7fc318144290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:51:54.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.400+0000 7fc31e8c1700 1 -- 172.21.15.73:0/2729483826 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc3180c9170 msgr2=0x7fc3180c62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:51:54.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.400+0000 7fc31e8c1700 1 --2- 172.21.15.73:0/2729483826 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc3180c9170 0x7fc3180c62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:51:54.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.400+0000 7fc31e8c1700 1 -- 172.21.15.73:0/2729483826 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3080094a0 con 0x7fc318151d00 2024-05-08T21:51:54.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.400+0000 7fc31e8c1700 1 --2- 172.21.15.73:0/2729483826 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc318151d00 0x7fc3181e3010 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc31000efc0 tx=0x7fc31000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:51:54.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.400+0000 7fc30effd700 1 -- 172.21.15.73:0/2729483826 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc310009ea0 con 0x7fc318151d00 2024-05-08T21:51:54.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.400+0000 7fc320324700 1 -- 172.21.15.73:0/2729483826 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3181e1380 con 0x7fc318151d00 2024-05-08T21:51:54.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.400+0000 7fc30effd700 1 -- 172.21.15.73:0/2729483826 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc31000f040 con 0x7fc318151d00 2024-05-08T21:51:54.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.400+0000 7fc30effd700 1 -- 172.21.15.73:0/2729483826 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31000ced0 con 0x7fc318151d00 2024-05-08T21:51:54.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.401+0000 7fc320324700 1 -- 172.21.15.73:0/2729483826 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3181e1940 con 0x7fc318151d00 2024-05-08T21:51:54.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.402+0000 7fc320324700 1 -- 172.21.15.73:0/2729483826 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc318068b80 con 0x7fc318151d00 2024-05-08T21:51:54.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.402+0000 7fc30effd700 1 -- 172.21.15.73:0/2729483826 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc310014480 con 0x7fc318151d00 2024-05-08T21:51:54.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.403+0000 7fc30effd700 1 --2- 172.21.15.73:0/2729483826 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fc2fc06ac90 0x7fc2fc06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:51:54.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.403+0000 7fc30effd700 1 -- 172.21.15.73:0/2729483826 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5883+0+0 (secure 0 0 0) 0x7fc310089c60 con 0x7fc318151d00 2024-05-08T21:51:54.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.404+0000 7fc31e0c0700 1 --2- 172.21.15.73:0/2729483826 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fc2fc06ac90 0x7fc2fc06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:51:54.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.404+0000 7fc31e0c0700 1 --2- 172.21.15.73:0/2729483826 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fc2fc06ac90 0x7fc2fc06d150 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc314005910 tx=0x7fc314000bc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:51:54.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.407+0000 7fc30effd700 1 -- 172.21.15.73:0/2729483826 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fc310054d00 con 0x7fc318151d00 2024-05-08T21:51:54.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.659+0000 7fc320324700 1 -- 172.21.15.73:0/2729483826 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc3180b2b70 con 0x7fc318151d00 2024-05-08T21:51:54.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.659+0000 7fc30effd700 1 -- 172.21.15.73:0/2729483826 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+6250 (secure 0 0 0) 0x7fc310018070 con 0x7fc318151d00 2024-05-08T21:51:54.660 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:51:54.660 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3242319177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6833","nonce":3242319177},{"type":"v1","addr":"172.21.15.115:6835","nonce":3242319177}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6834/2136341349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2136341349},{"type":"v1","addr":"172.21.15.115:6834","nonce":2136341349}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4249,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1439647913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1439647913},{"type":"v1","addr":"172.21.15.115:6837","nonce":1439647913}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/2386382396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2386382396},{"type":"v1","addr":"172.21.15.73:6836","nonce":2386382396}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/1772457954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":1772457954},{"type":"v1","addr":"172.21.15.73:6837","nonce":1772457954}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:49:43.747162+0000","modified":"2024-05-08T21:49:48.814033+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.73:6839/1477468490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1477468490},{"type":"v1","addr":"172.21.15.73:6839","nonce":1477468490}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:51:54.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.661+0000 7fc320324700 1 -- 172.21.15.73:0/2729483826 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fc2fc06ac90 msgr2=0x7fc2fc06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:51:54.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.661+0000 7fc320324700 1 --2- 172.21.15.73:0/2729483826 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fc2fc06ac90 0x7fc2fc06d150 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc314005910 tx=0x7fc314000bc0 comp rx=0 tx=0).stop 2024-05-08T21:51:54.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.661+0000 7fc320324700 1 -- 172.21.15.73:0/2729483826 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc318151d00 msgr2=0x7fc3181e3010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:51:54.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.661+0000 7fc320324700 1 --2- 172.21.15.73:0/2729483826 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc318151d00 0x7fc3181e3010 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc31000efc0 tx=0x7fc31000c3a0 comp rx=0 tx=0).stop 2024-05-08T21:51:54.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.661+0000 7fc320324700 1 -- 172.21.15.73:0/2729483826 shutdown_connections 2024-05-08T21:51:54.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.661+0000 7fc320324700 1 --2- 172.21.15.73:0/2729483826 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fc2fc06ac90 0x7fc2fc06d150 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:51:54.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.661+0000 7fc320324700 1 --2- 172.21.15.73:0/2729483826 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc318151d00 0x7fc3181e3010 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:51:54.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.661+0000 7fc320324700 1 --2- 172.21.15.73:0/2729483826 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc3180c29c0 0x7fc318144290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:51:54.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.661+0000 7fc320324700 1 --2- 172.21.15.73:0/2729483826 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc3180c9170 0x7fc3180c62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:51:54.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.661+0000 7fc320324700 1 -- 172.21.15.73:0/2729483826 >> 172.21.15.73:0/2729483826 conn(0x7fc31806aff0 msgr2=0x7fc31814f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:51:54.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.661+0000 7fc320324700 1 -- 172.21.15.73:0/2729483826 shutdown_connections 2024-05-08T21:51:54.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:54.662+0000 7fc320324700 1 -- 172.21.15.73:0/2729483826 wait complete. 2024-05-08T21:51:54.664 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 8 2024-05-08T21:51:54.675 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is laggy/crashed, in failed state, or mds.e is removed from mdsmap 2024-05-08T21:51:56.676 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:51:56.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:56.800+0000 7f0d5f973700 1 Processor -- start 2024-05-08T21:51:56.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:56.801+0000 7f0d5f973700 1 -- start start 2024-05-08T21:51:56.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:56.801+0000 7f0d5f973700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0d580c6d70 0x7f0d580c1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:51:56.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:56.801+0000 7f0d5f973700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0d580c1dc0 0x7f0d580ca3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:51:56.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:56.801+0000 7f0d5f973700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d580c7690 con 0x7f0d581541d0 2024-05-08T21:51:56.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:56.801+0000 7f0d5f973700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d58159d70 con 0x7f0d580c6d70 2024-05-08T21:51:56.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:56.801+0000 7f0d5f973700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5815a050 con 0x7f0d580c1dc0 2024-05-08T21:51:56.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:56.802+0000 7f0d5df10700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0d580c1dc0 0x7f0d580ca3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:51:56.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:56.802+0000 7f0d5cf0e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0d580c6d70 0x7f0d580c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:51:56.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:56.802+0000 7f0d5cf0e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0d580c6d70 0x7f0d580c1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.73:34270/0 (socket says 172.21.15.73:34270) 2024-05-08T21:51:56.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:56.802+0000 7f0d5df10700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0d580c1dc0 0x7f0d580ca3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.73:60958/0 (socket says 172.21.15.73:60958) 2024-05-08T21:51:56.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:56.802+0000 7f0d5d70f700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f0d581541d0 0x7f0d580c99f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.73:42774/0 (socket says 172.21.15.73:42774) 2024-05-08T21:51:56.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:56.802+0000 7f0d5cf0e700 1 -- 172.21.15.73:0/117632048 learned_addr learned my addr 172.21.15.73:0/117632048 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:51:56.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:56.802+0000 7f0d5cf0e700 1 -- 172.21.15.73:0/117632048 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0d580c1dc0 msgr2=0x7f0d580ca3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:51:56.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:56.802+0000 7f0d5cf0e700 1 --2- 172.21.15.73:0/117632048 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0d580c1dc0 0x7f0d580ca3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:51:56.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:56.802+0000 7f0d5cf0e700 1 -- 172.21.15.73:0/117632048 >> v1:172.21.15.115:6789/0 conn(0x7f0d581541d0 legacy=0x7f0d580c99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:51:56.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:56.802+0000 7f0d5cf0e700 1 -- 172.21.15.73:0/117632048 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d5815a330 con 0x7f0d580c6d70 2024-05-08T21:51:56.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:56.802+0000 7f0d4ffff700 1 -- 172.21.15.73:0/117632048 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 14143259 0 0) 0x7f0d580c7690 con 0x7f0d581541d0 2024-05-08T21:51:56.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:56.802+0000 7f0d5df10700 1 --2- 172.21.15.73:0/117632048 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0d580c1dc0 0x7f0d580ca3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:51:56.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:56.802+0000 7f0d5cf0e700 1 --2- 172.21.15.73:0/117632048 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d580c6d70 0x7f0d580c1880 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0d480098f0 tx=0x7f0d48009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ace89681005a5dd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:51:56.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:56.803+0000 7f0d4ffff700 1 -- 172.21.15.73:0/117632048 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d48011830 con 0x7f0d580c6d70 2024-05-08T21:51:56.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:56.803+0000 7f0d4ffff700 1 -- 172.21.15.73:0/117632048 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d48011990 con 0x7f0d580c6d70 2024-05-08T21:51:56.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:56.803+0000 7f0d4ffff700 1 -- 172.21.15.73:0/117632048 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d48011d20 con 0x7f0d580c6d70 2024-05-08T21:51:56.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:56.803+0000 7f0d5f973700 1 -- 172.21.15.73:0/117632048 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d580c6d70 msgr2=0x7f0d580c1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:51:56.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:56.803+0000 7f0d5f973700 1 --2- 172.21.15.73:0/117632048 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d580c6d70 0x7f0d580c1880 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0d480098f0 tx=0x7f0d48009c00 comp rx=0 tx=0).stop 2024-05-08T21:51:56.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:56.803+0000 7f0d5f973700 1 -- 172.21.15.73:0/117632048 shutdown_connections 2024-05-08T21:51:56.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:56.803+0000 7f0d5f973700 1 --2- 172.21.15.73:0/117632048 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0d580c1dc0 0x7f0d580ca3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:51:56.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:56.803+0000 7f0d5f973700 1 --2- 172.21.15.73:0/117632048 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d580c6d70 0x7f0d580c1880 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:51:56.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:56.803+0000 7f0d5f973700 1 -- 172.21.15.73:0/117632048 >> 172.21.15.73:0/117632048 conn(0x7f0d580cbaf0 msgr2=0x7f0d580cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:51:56.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:56.803+0000 7f0d5f973700 1 -- 172.21.15.73:0/117632048 shutdown_connections 2024-05-08T21:51:56.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:56.803+0000 7f0d5f973700 1 -- 172.21.15.73:0/117632048 wait complete. 2024-05-08T21:51:56.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:56.804+0000 7f0d5f973700 1 Processor -- start 2024-05-08T21:51:56.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:56.804+0000 7f0d5f973700 1 -- start start 2024-05-08T21:51:56.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:56.805+0000 7f0d5f973700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d580c1dc0 0x7f0d581f0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:51:56.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:56.805+0000 7f0d5f973700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d580c6d70 0x7f0d581e4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:51:56.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:56.805+0000 7f0d5f973700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0d581541d0 0x7f0d58071be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:51:56.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:56.805+0000 7f0d5f973700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d581e4210 con 0x7f0d580c1dc0 2024-05-08T21:51:56.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:56.805+0000 7f0d5f973700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d581e47d0 con 0x7f0d580c6d70 2024-05-08T21:51:56.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:56.805+0000 7f0d5f973700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d581e51a0 con 0x7f0d581541d0 2024-05-08T21:51:56.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:56.805+0000 7f0d5d70f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d580c1dc0 0x7f0d581f0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:51:56.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:56.805+0000 7f0d5d70f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d580c1dc0 0x7f0d581f0140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57152/0 (socket says 172.21.15.73:57152) 2024-05-08T21:51:56.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:56.805+0000 7f0d5d70f700 1 -- 172.21.15.73:0/4286097512 learned_addr learned my addr 172.21.15.73:0/4286097512 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:51:56.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:56.805+0000 7f0d5cf0e700 1 --2- 172.21.15.73:0/4286097512 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d580c6d70 0x7f0d581e4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:51:56.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:56.805+0000 7f0d5df10700 1 --2- 172.21.15.73:0/4286097512 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0d581541d0 0x7f0d58071be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:51:56.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:56.805+0000 7f0d5d70f700 1 -- 172.21.15.73:0/4286097512 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0d581541d0 msgr2=0x7f0d58071be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:51:56.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:56.805+0000 7f0d5d70f700 1 --2- 172.21.15.73:0/4286097512 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0d581541d0 0x7f0d58071be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:51:56.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:56.805+0000 7f0d5d70f700 1 -- 172.21.15.73:0/4286097512 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d580c6d70 msgr2=0x7f0d581e4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:51:56.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:56.805+0000 7f0d5d70f700 1 --2- 172.21.15.73:0/4286097512 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d580c6d70 0x7f0d581e4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:51:56.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:56.805+0000 7f0d5d70f700 1 -- 172.21.15.73:0/4286097512 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d50009a70 con 0x7f0d580c1dc0 2024-05-08T21:51:56.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:56.805+0000 7f0d5df10700 1 --2- 172.21.15.73:0/4286097512 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0d581541d0 0x7f0d58071be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:51:56.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:56.805+0000 7f0d5cf0e700 1 --2- 172.21.15.73:0/4286097512 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d580c6d70 0x7f0d581e4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:51:56.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:56.806+0000 7f0d5d70f700 1 --2- 172.21.15.73:0/4286097512 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d580c1dc0 0x7f0d581f0140 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0d5400c550 tx=0x7f0d5400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:51:56.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:56.806+0000 7f0d4dffb700 1 -- 172.21.15.73:0/4286097512 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d54004c80 con 0x7f0d580c1dc0 2024-05-08T21:51:56.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:56.806+0000 7f0d4dffb700 1 -- 172.21.15.73:0/4286097512 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d54004e00 con 0x7f0d580c1dc0 2024-05-08T21:51:56.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:56.806+0000 7f0d5f973700 1 -- 172.21.15.73:0/4286097512 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d48009550 con 0x7f0d580c1dc0 2024-05-08T21:51:56.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:56.806+0000 7f0d4dffb700 1 -- 172.21.15.73:0/4286097512 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d54007310 con 0x7f0d580c1dc0 2024-05-08T21:51:56.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:56.806+0000 7f0d5f973700 1 -- 172.21.15.73:0/4286097512 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d5815b100 con 0x7f0d580c1dc0 2024-05-08T21:51:56.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:56.807+0000 7f0d5f973700 1 -- 172.21.15.73:0/4286097512 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d58068b80 con 0x7f0d580c1dc0 2024-05-08T21:51:56.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:56.807+0000 7f0d4dffb700 1 -- 172.21.15.73:0/4286097512 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0d54007470 con 0x7f0d580c1dc0 2024-05-08T21:51:56.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:56.807+0000 7f0d4dffb700 1 --2- 172.21.15.73:0/4286097512 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f0d3c06ac90 0x7f0d3c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:51:56.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:56.808+0000 7f0d4dffb700 1 -- 172.21.15.73:0/4286097512 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5883+0+0 (secure 0 0 0) 0x7f0d540891f0 con 0x7f0d580c1dc0 2024-05-08T21:51:56.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:56.808+0000 7f0d5cf0e700 1 --2- 172.21.15.73:0/4286097512 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f0d3c06ac90 0x7f0d3c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:51:56.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:56.808+0000 7f0d5cf0e700 1 --2- 172.21.15.73:0/4286097512 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f0d3c06ac90 0x7f0d3c06d150 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0d580cae20 tx=0x7f0d48008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:51:56.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:56.813+0000 7f0d4dffb700 1 -- 172.21.15.73:0/4286097512 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f0d54054290 con 0x7f0d580c1dc0 2024-05-08T21:51:57.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:57.061+0000 7f0d5f973700 1 -- 172.21.15.73:0/4286097512 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0d580b21c0 con 0x7f0d580c1dc0 2024-05-08T21:51:57.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:57.062+0000 7f0d4dffb700 1 -- 172.21.15.73:0/4286097512 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+6250 (secure 0 0 0) 0x7f0d540578b0 con 0x7f0d580c1dc0 2024-05-08T21:51:57.063 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:51:57.063 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3242319177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6833","nonce":3242319177},{"type":"v1","addr":"172.21.15.115:6835","nonce":3242319177}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6834/2136341349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2136341349},{"type":"v1","addr":"172.21.15.115:6834","nonce":2136341349}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4249,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1439647913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1439647913},{"type":"v1","addr":"172.21.15.115:6837","nonce":1439647913}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/2386382396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2386382396},{"type":"v1","addr":"172.21.15.73:6836","nonce":2386382396}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/1772457954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":1772457954},{"type":"v1","addr":"172.21.15.73:6837","nonce":1772457954}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:49:43.747162+0000","modified":"2024-05-08T21:49:48.814033+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.73:6839/1477468490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1477468490},{"type":"v1","addr":"172.21.15.73:6839","nonce":1477468490}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:51:57.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:57.064+0000 7f0d5f973700 1 -- 172.21.15.73:0/4286097512 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f0d3c06ac90 msgr2=0x7f0d3c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:51:57.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:57.064+0000 7f0d5f973700 1 --2- 172.21.15.73:0/4286097512 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f0d3c06ac90 0x7f0d3c06d150 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0d580cae20 tx=0x7f0d48008030 comp rx=0 tx=0).stop 2024-05-08T21:51:57.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:57.064+0000 7f0d5f973700 1 -- 172.21.15.73:0/4286097512 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d580c1dc0 msgr2=0x7f0d581f0140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:51:57.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:57.064+0000 7f0d5f973700 1 --2- 172.21.15.73:0/4286097512 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d580c1dc0 0x7f0d581f0140 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0d5400c550 tx=0x7f0d5400c910 comp rx=0 tx=0).stop 2024-05-08T21:51:57.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:57.064+0000 7f0d5f973700 1 -- 172.21.15.73:0/4286097512 shutdown_connections 2024-05-08T21:51:57.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:57.064+0000 7f0d5f973700 1 --2- 172.21.15.73:0/4286097512 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f0d3c06ac90 0x7f0d3c06d150 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:51:57.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:57.064+0000 7f0d5f973700 1 --2- 172.21.15.73:0/4286097512 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0d581541d0 0x7f0d58071be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:51:57.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:57.064+0000 7f0d5f973700 1 --2- 172.21.15.73:0/4286097512 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d580c1dc0 0x7f0d581f0140 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:51:57.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:57.064+0000 7f0d5f973700 1 --2- 172.21.15.73:0/4286097512 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d580c6d70 0x7f0d581e4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:51:57.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:57.064+0000 7f0d5f973700 1 -- 172.21.15.73:0/4286097512 >> 172.21.15.73:0/4286097512 conn(0x7f0d580cbaf0 msgr2=0x7f0d580c61e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:51:57.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:57.065+0000 7f0d5f973700 1 -- 172.21.15.73:0/4286097512 shutdown_connections 2024-05-08T21:51:57.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:57.065+0000 7f0d5f973700 1 -- 172.21.15.73:0/4286097512 wait complete. 2024-05-08T21:51:57.067 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 8 2024-05-08T21:51:57.079 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is laggy/crashed, in failed state, or mds.e is removed from mdsmap 2024-05-08T21:51:57.430 INFO:tasks.workunit.client.0.smithi073.stderr:Updating files: 96% (11825/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-05-08T21:51:58.142 INFO:tasks.workunit.client.0.smithi073.stderr:Note: switching to 'd21e4f961318b56f0d915caa2490c3711bf13c34'. 2024-05-08T21:51:58.142 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-05-08T21:51:58.142 INFO:tasks.workunit.client.0.smithi073.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-05-08T21:51:58.143 INFO:tasks.workunit.client.0.smithi073.stderr:changes and commit them, and you can discard any commits you make in this 2024-05-08T21:51:58.143 INFO:tasks.workunit.client.0.smithi073.stderr:state without impacting any branches by switching back to a branch. 2024-05-08T21:51:58.143 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-05-08T21:51:58.143 INFO:tasks.workunit.client.0.smithi073.stderr:If you want to create a new branch to retain commits you create, you may 2024-05-08T21:51:58.143 INFO:tasks.workunit.client.0.smithi073.stderr:do so (now or later) by using -c with the switch command. Example: 2024-05-08T21:51:58.143 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-05-08T21:51:58.143 INFO:tasks.workunit.client.0.smithi073.stderr: git switch -c 2024-05-08T21:51:58.143 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-05-08T21:51:58.143 INFO:tasks.workunit.client.0.smithi073.stderr:Or undo this operation with: 2024-05-08T21:51:58.143 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-05-08T21:51:58.143 INFO:tasks.workunit.client.0.smithi073.stderr: git switch - 2024-05-08T21:51:58.143 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-05-08T21:51:58.143 INFO:tasks.workunit.client.0.smithi073.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-05-08T21:51:58.143 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-05-08T21:51:58.144 INFO:tasks.workunit.client.0.smithi073.stderr:HEAD is now at d21e4f96131 Merge PR #57343 into wip-pdonnell-testing-20240508.150423-reef 2024-05-08T21:51:58.148 DEBUG:teuthology.orchestra.run.smithi073:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-05-08T21:51:58.176 INFO:tasks.workunit.client.0.smithi073.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-05-08T21:51:58.178 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-08T21:51:58.178 INFO:tasks.workunit.client.0.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-05-08T21:51:58.641 INFO:tasks.workunit.client.0.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-05-08T21:51:58.700 INFO:tasks.workunit.client.0.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-05-08T21:51:58.737 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-08T21:51:58.739 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-08T21:51:58.739 INFO:tasks.workunit.client.0.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-05-08T21:51:58.776 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-08T21:51:58.781 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-05-08T21:51:58.781 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-05-08T21:51:58.836 INFO:tasks.workunit:Running workunits matching suites/iozone.sh on client.0... 2024-05-08T21:51:58.837 INFO:tasks.workunit:Running workunit suites/iozone.sh... 2024-05-08T21:51:58.838 DEBUG:teuthology.orchestra.run.smithi073:workunit test suites/iozone.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d21e4f961318b56f0d915caa2490c3711bf13c34 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/iozone.sh 2024-05-08T21:51:59.080 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:51:59.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.202+0000 7f5b1cba5700 1 Processor -- start 2024-05-08T21:51:59.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.202+0000 7f5b1cba5700 1 -- start start 2024-05-08T21:51:59.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.203+0000 7f5b1cba5700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5b18151c20 0x7f5b1815af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:51:59.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.203+0000 7f5b1cba5700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b180c7340 con 0x7f5b1815b4c0 2024-05-08T21:51:59.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.203+0000 7f5b1cba5700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b180c6b80 con 0x7f5b180c64f0 2024-05-08T21:51:59.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.203+0000 7f5b1cba5700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b1806c3e0 con 0x7f5b18151c20 2024-05-08T21:51:59.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.203+0000 7f5b1659c700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5b18151c20 0x7f5b1815af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:51:59.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.203+0000 7f5b15d9b700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f5b1815b4c0 0x7f5b180c5200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:51368/0 (socket says 172.21.15.73:51368) 2024-05-08T21:51:59.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.203+0000 7f5b15d9b700 1 -- 172.21.15.73:0/350566679 learned_addr learned my addr 172.21.15.73:0/350566679 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:51:59.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.203+0000 7f5b1659c700 1 --2- 172.21.15.73:0/350566679 >> v2:172.21.15.73:3300/0 conn(0x7f5b18151c20 0x7f5b1815af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41296/0 (socket says 172.21.15.73:41296) 2024-05-08T21:51:59.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.203+0000 7f5b1659c700 1 -- 172.21.15.73:0/350566679 >> v1:172.21.15.115:6789/0 conn(0x7f5b180c64f0 legacy=0x7f5b18162360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:51:59.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.203+0000 7f5b1659c700 1 -- 172.21.15.73:0/350566679 >> v1:172.21.15.73:6789/0 conn(0x7f5b1815b4c0 legacy=0x7f5b180c5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:51:59.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.203+0000 7f5b1659c700 1 -- 172.21.15.73:0/350566679 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b180c1290 con 0x7f5b18151c20 2024-05-08T21:51:59.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.203+0000 7f5b1559a700 1 -- 172.21.15.73:0/350566679 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3561644994 0 0) 0x7f5b180c7340 con 0x7f5b1815b4c0 2024-05-08T21:51:59.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.204+0000 7f5b1659c700 1 --2- 172.21.15.73:0/350566679 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b18151c20 0x7f5b1815af80 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c009840 tx=0x7f5b0c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e80290e6e0e7d7e5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:51:59.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.204+0000 7f5b1559a700 1 -- 172.21.15.73:0/350566679 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c004230 con 0x7f5b18151c20 2024-05-08T21:51:59.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.204+0000 7f5b1559a700 1 -- 172.21.15.73:0/350566679 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b0c004390 con 0x7f5b18151c20 2024-05-08T21:51:59.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.204+0000 7f5b1559a700 1 -- 172.21.15.73:0/350566679 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c0036a0 con 0x7f5b18151c20 2024-05-08T21:51:59.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.204+0000 7f5b1cba5700 1 -- 172.21.15.73:0/350566679 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b18151c20 msgr2=0x7f5b1815af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:51:59.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.204+0000 7f5b1cba5700 1 --2- 172.21.15.73:0/350566679 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b18151c20 0x7f5b1815af80 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c009840 tx=0x7f5b0c009b50 comp rx=0 tx=0).stop 2024-05-08T21:51:59.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.204+0000 7f5b1cba5700 1 -- 172.21.15.73:0/350566679 shutdown_connections 2024-05-08T21:51:59.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.204+0000 7f5b1cba5700 1 --2- 172.21.15.73:0/350566679 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b18151c20 0x7f5b1815af80 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:51:59.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.204+0000 7f5b1cba5700 1 -- 172.21.15.73:0/350566679 >> 172.21.15.73:0/350566679 conn(0x7f5b180c85f0 msgr2=0x7f5b180c89d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:51:59.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.204+0000 7f5b1cba5700 1 -- 172.21.15.73:0/350566679 shutdown_connections 2024-05-08T21:51:59.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.204+0000 7f5b1cba5700 1 -- 172.21.15.73:0/350566679 wait complete. 2024-05-08T21:51:59.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.206+0000 7f5b1cba5700 1 Processor -- start 2024-05-08T21:51:59.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.206+0000 7f5b1cba5700 1 -- start start 2024-05-08T21:51:59.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.206+0000 7f5b1cba5700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b180c64f0 0x7f5b181f1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:51:59.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.206+0000 7f5b1cba5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b18151c20 0x7f5b18159580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:51:59.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.206+0000 7f5b1cba5700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b1815b4c0 0x7f5b18148280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:51:59.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.206+0000 7f5b1cba5700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1815b2f0 con 0x7f5b18151c20 2024-05-08T21:51:59.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.206+0000 7f5b1cba5700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b18155d20 con 0x7f5b180c64f0 2024-05-08T21:51:59.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.206+0000 7f5b1cba5700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b181557a0 con 0x7f5b1815b4c0 2024-05-08T21:51:59.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.207+0000 7f5b15d9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b18151c20 0x7f5b18159580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:51:59.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.207+0000 7f5b15d9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b18151c20 0x7f5b18159580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41302/0 (socket says 172.21.15.73:41302) 2024-05-08T21:51:59.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.207+0000 7f5b15d9b700 1 -- 172.21.15.73:0/2415874546 learned_addr learned my addr 172.21.15.73:0/2415874546 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:51:59.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.207+0000 7f5b1659c700 1 --2- 172.21.15.73:0/2415874546 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b180c64f0 0x7f5b181f1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:51:59.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.207+0000 7f5b16d9d700 1 --2- 172.21.15.73:0/2415874546 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b1815b4c0 0x7f5b18148280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:51:59.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.207+0000 7f5b15d9b700 1 -- 172.21.15.73:0/2415874546 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b1815b4c0 msgr2=0x7f5b18148280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:51:59.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.207+0000 7f5b15d9b700 1 --2- 172.21.15.73:0/2415874546 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b1815b4c0 0x7f5b18148280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:51:59.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.207+0000 7f5b15d9b700 1 -- 172.21.15.73:0/2415874546 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b180c64f0 msgr2=0x7f5b181f1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:51:59.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.207+0000 7f5b15d9b700 1 --2- 172.21.15.73:0/2415874546 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b180c64f0 0x7f5b181f1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:51:59.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.207+0000 7f5b15d9b700 1 -- 172.21.15.73:0/2415874546 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b0c0094a0 con 0x7f5b18151c20 2024-05-08T21:51:59.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.207+0000 7f5b16d9d700 1 --2- 172.21.15.73:0/2415874546 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b1815b4c0 0x7f5b18148280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:51:59.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.207+0000 7f5b15d9b700 1 --2- 172.21.15.73:0/2415874546 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b18151c20 0x7f5b18159580 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5b0800c460 tx=0x7f5b0800c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:51:59.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.207+0000 7f5b06ffd700 1 -- 172.21.15.73:0/2415874546 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b08004c80 con 0x7f5b18151c20 2024-05-08T21:51:59.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.207+0000 7f5b06ffd700 1 -- 172.21.15.73:0/2415874546 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b08004e00 con 0x7f5b18151c20 2024-05-08T21:51:59.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.207+0000 7f5b1cba5700 1 -- 172.21.15.73:0/2415874546 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b18155a40 con 0x7f5b18151c20 2024-05-08T21:51:59.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.207+0000 7f5b06ffd700 1 -- 172.21.15.73:0/2415874546 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b08007310 con 0x7f5b18151c20 2024-05-08T21:51:59.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.207+0000 7f5b1cba5700 1 -- 172.21.15.73:0/2415874546 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b181f1170 con 0x7f5b18151c20 2024-05-08T21:51:59.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.208+0000 7f5b1cba5700 1 -- 172.21.15.73:0/2415874546 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b18072500 con 0x7f5b18151c20 2024-05-08T21:51:59.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.209+0000 7f5b06ffd700 1 -- 172.21.15.73:0/2415874546 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5b08007470 con 0x7f5b18151c20 2024-05-08T21:51:59.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.209+0000 7f5b06ffd700 1 --2- 172.21.15.73:0/2415874546 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f5af806ac90 0x7f5af806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:51:59.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.209+0000 7f5b06ffd700 1 -- 172.21.15.73:0/2415874546 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5883+0+0 (secure 0 0 0) 0x7f5b08089110 con 0x7f5b18151c20 2024-05-08T21:51:59.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.209+0000 7f5b1659c700 1 --2- 172.21.15.73:0/2415874546 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f5af806ac90 0x7f5af806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:51:59.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.209+0000 7f5b1659c700 1 --2- 172.21.15.73:0/2415874546 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f5af806ac90 0x7f5af806d150 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c000c00 tx=0x7f5b0c01c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:51:59.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.213+0000 7f5b06ffd700 1 -- 172.21.15.73:0/2415874546 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f5b080541b0 con 0x7f5b18151c20 2024-05-08T21:51:59.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.454+0000 7f5b1cba5700 1 -- 172.21.15.73:0/2415874546 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5b18068b80 con 0x7f5b18151c20 2024-05-08T21:51:59.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.454+0000 7f5b06ffd700 1 -- 172.21.15.73:0/2415874546 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+6250 (secure 0 0 0) 0x7f5b080577d0 con 0x7f5b18151c20 2024-05-08T21:51:59.454 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:51:59.454 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3242319177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6833","nonce":3242319177},{"type":"v1","addr":"172.21.15.115:6835","nonce":3242319177}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6834/2136341349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2136341349},{"type":"v1","addr":"172.21.15.115:6834","nonce":2136341349}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4249,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1439647913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1439647913},{"type":"v1","addr":"172.21.15.115:6837","nonce":1439647913}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/2386382396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2386382396},{"type":"v1","addr":"172.21.15.73:6836","nonce":2386382396}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/1772457954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":1772457954},{"type":"v1","addr":"172.21.15.73:6837","nonce":1772457954}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:49:43.747162+0000","modified":"2024-05-08T21:49:48.814033+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.73:6839/1477468490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1477468490},{"type":"v1","addr":"172.21.15.73:6839","nonce":1477468490}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:51:59.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.456+0000 7f5b1cba5700 1 -- 172.21.15.73:0/2415874546 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f5af806ac90 msgr2=0x7f5af806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:51:59.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.456+0000 7f5b1cba5700 1 --2- 172.21.15.73:0/2415874546 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f5af806ac90 0x7f5af806d150 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c000c00 tx=0x7f5b0c01c040 comp rx=0 tx=0).stop 2024-05-08T21:51:59.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.456+0000 7f5b1cba5700 1 -- 172.21.15.73:0/2415874546 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b18151c20 msgr2=0x7f5b18159580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:51:59.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.456+0000 7f5b1cba5700 1 --2- 172.21.15.73:0/2415874546 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b18151c20 0x7f5b18159580 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5b0800c460 tx=0x7f5b0800c820 comp rx=0 tx=0).stop 2024-05-08T21:51:59.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.456+0000 7f5b1cba5700 1 -- 172.21.15.73:0/2415874546 shutdown_connections 2024-05-08T21:51:59.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.456+0000 7f5b1cba5700 1 --2- 172.21.15.73:0/2415874546 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f5af806ac90 0x7f5af806d150 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:51:59.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.456+0000 7f5b1cba5700 1 --2- 172.21.15.73:0/2415874546 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b1815b4c0 0x7f5b18148280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:51:59.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.456+0000 7f5b1cba5700 1 --2- 172.21.15.73:0/2415874546 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b180c64f0 0x7f5b181f1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:51:59.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.456+0000 7f5b1cba5700 1 --2- 172.21.15.73:0/2415874546 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b18151c20 0x7f5b18159580 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:51:59.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.456+0000 7f5b1cba5700 1 -- 172.21.15.73:0/2415874546 >> 172.21.15.73:0/2415874546 conn(0x7f5b180c85f0 msgr2=0x7f5b1806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:51:59.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.456+0000 7f5b1cba5700 1 -- 172.21.15.73:0/2415874546 shutdown_connections 2024-05-08T21:51:59.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:51:59.456+0000 7f5b1cba5700 1 -- 172.21.15.73:0/2415874546 wait complete. 2024-05-08T21:51:59.457 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 8 2024-05-08T21:51:59.468 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is laggy/crashed, in failed state, or mds.e is removed from mdsmap 2024-05-08T21:52:01.469 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:52:01.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.603+0000 7f2fd513f700 1 Processor -- start 2024-05-08T21:52:01.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.603+0000 7f2fd513f700 1 -- start start 2024-05-08T21:52:01.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.604+0000 7f2fd513f700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2fd006afc0 0x7f2fd00724e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:01.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.604+0000 7f2fd513f700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fd0154490 con 0x7f2fd01540b0 2024-05-08T21:52:01.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.604+0000 7f2fd513f700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fd00c79b0 con 0x7f2fd0072a20 2024-05-08T21:52:01.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.604+0000 7f2fd513f700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fd006b430 con 0x7f2fd006afc0 2024-05-08T21:52:01.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.604+0000 7f2fced9d700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f2fd01540b0 0x7f2fd0071d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:51370/0 (socket says 172.21.15.73:51370) 2024-05-08T21:52:01.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.604+0000 7f2fced9d700 1 -- 172.21.15.73:0/1647640630 learned_addr learned my addr 172.21.15.73:0/1647640630 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:52:01.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.604+0000 7f2fce59c700 1 --2- 172.21.15.73:0/1647640630 >> v2:172.21.15.115:3300/0 conn(0x7f2fd006afc0 0x7f2fd00724e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:01.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.604+0000 7f2fcdd9b700 1 -- 172.21.15.73:0/1647640630 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 239473323 0 0) 0x7f2fd0154490 con 0x7f2fd01540b0 2024-05-08T21:52:01.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.604+0000 7f2fcdd9b700 1 -- 172.21.15.73:0/1647640630 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fb80035b0 con 0x7f2fd01540b0 2024-05-08T21:52:01.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.605+0000 7f2fcdd9b700 1 -- 172.21.15.73:0/1647640630 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3706731566 0 0) 0x7f2fb80035b0 con 0x7f2fd01540b0 2024-05-08T21:52:01.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.605+0000 7f2fcdd9b700 1 -- 172.21.15.73:0/1647640630 >> v2:172.21.15.115:3300/0 conn(0x7f2fd006afc0 msgr2=0x7f2fd00724e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:52:01.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.605+0000 7f2fcdd9b700 1 --2- 172.21.15.73:0/1647640630 >> v2:172.21.15.115:3300/0 conn(0x7f2fd006afc0 0x7f2fd00724e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:01.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.605+0000 7f2fcdd9b700 1 -- 172.21.15.73:0/1647640630 >> v1:172.21.15.115:6789/0 conn(0x7f2fd0072a20 legacy=0x7f2fd015d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:01.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.605+0000 7f2fcdd9b700 1 -- 172.21.15.73:0/1647640630 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd00c7c90 con 0x7f2fd01540b0 2024-05-08T21:52:01.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.605+0000 7f2fcdd9b700 1 -- 172.21.15.73:0/1647640630 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 953298616 0 0) 0x7f2fc4001670 con 0x7f2fd01540b0 2024-05-08T21:52:01.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.605+0000 7f2fcdd9b700 1 -- 172.21.15.73:0/1647640630 >> v1:172.21.15.73:6789/0 conn(0x7f2fd01540b0 legacy=0x7f2fd0071d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:01.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.605+0000 7f2fcdd9b700 1 --2- 172.21.15.73:0/1647640630 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2fb8003a00 0x7f2fb8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:01.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.605+0000 7f2fcdd9b700 1 --2- 172.21.15.73:0/1647640630 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2fb8004850 0x7f2fb8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:01.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.605+0000 7f2fcdd9b700 1 --2- 172.21.15.73:0/1647640630 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fb8005210 0x7f2fb800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:01.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.605+0000 7f2fcdd9b700 1 -- 172.21.15.73:0/1647640630 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd006b430 con 0x7f2fb8004850 2024-05-08T21:52:01.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.605+0000 7f2fcdd9b700 1 -- 172.21.15.73:0/1647640630 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb800c0c0 con 0x7f2fb8005210 2024-05-08T21:52:01.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.605+0000 7f2fcdd9b700 1 -- 172.21.15.73:0/1647640630 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb800c280 con 0x7f2fb8003a00 2024-05-08T21:52:01.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.605+0000 7f2fce59c700 1 --2- 172.21.15.73:0/1647640630 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2fb8004850 0x7f2fb8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:01.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.605+0000 7f2fced9d700 1 --2- 172.21.15.73:0/1647640630 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2fb8003a00 0x7f2fb8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:01.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.605+0000 7f2fcf59e700 1 --2- 172.21.15.73:0/1647640630 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fb8005210 0x7f2fb800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:01.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.605+0000 7f2fce59c700 1 -- 172.21.15.73:0/1647640630 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2fb8003a00 msgr2=0x7f2fb8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:52:01.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.605+0000 7f2fce59c700 1 --2- 172.21.15.73:0/1647640630 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2fb8003a00 0x7f2fb8003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:01.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.605+0000 7f2fce59c700 1 -- 172.21.15.73:0/1647640630 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fb8005210 msgr2=0x7f2fb800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:52:01.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.605+0000 7f2fce59c700 1 --2- 172.21.15.73:0/1647640630 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fb8005210 0x7f2fb800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:01.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.605+0000 7f2fce59c700 1 -- 172.21.15.73:0/1647640630 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb80035b0 con 0x7f2fb8004850 2024-05-08T21:52:01.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.605+0000 7f2fcf59e700 1 --2- 172.21.15.73:0/1647640630 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fb8005210 0x7f2fb800ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:52:01.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.605+0000 7f2fcf59e700 1 -- 172.21.15.73:0/1647640630 reap_dead start 2024-05-08T21:52:01.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.605+0000 7f2fce59c700 1 --2- 172.21.15.73:0/1647640630 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2fb8004850 0x7f2fb8004cd0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2fc0009b60 tx=0x7f2fb8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f25bc6d5054a434e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:52:01.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.605+0000 7f2fcdd9b700 1 -- 172.21.15.73:0/1647640630 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc000e6c0 con 0x7f2fb8004850 2024-05-08T21:52:01.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.605+0000 7f2fcdd9b700 1 -- 172.21.15.73:0/1647640630 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fc000e820 con 0x7f2fb8004850 2024-05-08T21:52:01.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.605+0000 7f2fcdd9b700 1 -- 172.21.15.73:0/1647640630 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc000eb90 con 0x7f2fb8004850 2024-05-08T21:52:01.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.606+0000 7f2fd513f700 1 -- 172.21.15.73:0/1647640630 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2fb8004850 msgr2=0x7f2fb8004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:01.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.606+0000 7f2fd513f700 1 --2- 172.21.15.73:0/1647640630 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2fb8004850 0x7f2fb8004cd0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2fc0009b60 tx=0x7f2fb8005880 comp rx=0 tx=0).stop 2024-05-08T21:52:01.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.606+0000 7f2fd513f700 1 -- 172.21.15.73:0/1647640630 shutdown_connections 2024-05-08T21:52:01.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.606+0000 7f2fd513f700 1 --2- 172.21.15.73:0/1647640630 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2fb8004850 0x7f2fb8004cd0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:01.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.606+0000 7f2fd513f700 1 -- 172.21.15.73:0/1647640630 >> 172.21.15.73:0/1647640630 conn(0x7f2fd0066d70 msgr2=0x7f2fd00cc500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:52:01.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.606+0000 7f2fd513f700 1 -- 172.21.15.73:0/1647640630 shutdown_connections 2024-05-08T21:52:01.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.606+0000 7f2fd513f700 1 -- 172.21.15.73:0/1647640630 wait complete. 2024-05-08T21:52:01.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.607+0000 7f2fd513f700 1 Processor -- start 2024-05-08T21:52:01.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.608+0000 7f2fd513f700 1 -- start start 2024-05-08T21:52:01.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.608+0000 7f2fd513f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2fb8004850 0x7f2fd00cb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:01.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.608+0000 7f2fd513f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2fd0154b00 0x7f2fd014def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:01.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.608+0000 7f2fd513f700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fd00c4c90 0x7f2fd014bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:01.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.608+0000 7f2fd513f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd01f0870 con 0x7f2fb8004850 2024-05-08T21:52:01.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.608+0000 7f2fd513f700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd01f0da0 con 0x7f2fd00c4c90 2024-05-08T21:52:01.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.608+0000 7f2fd513f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd00cae60 con 0x7f2fd0154b00 2024-05-08T21:52:01.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.608+0000 7f2fced9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2fb8004850 0x7f2fd00cb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:01.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.608+0000 7f2fced9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2fb8004850 0x7f2fd00cb2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41326/0 (socket says 172.21.15.73:41326) 2024-05-08T21:52:01.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.608+0000 7f2fced9d700 1 -- 172.21.15.73:0/1104457337 learned_addr learned my addr 172.21.15.73:0/1104457337 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:52:01.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.608+0000 7f2fce59c700 1 --2- 172.21.15.73:0/1104457337 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2fd0154b00 0x7f2fd014def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:01.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.608+0000 7f2fcf59e700 1 --2- 172.21.15.73:0/1104457337 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fd00c4c90 0x7f2fd014bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:01.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.609+0000 7f2fced9d700 1 -- 172.21.15.73:0/1104457337 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2fd0154b00 msgr2=0x7f2fd014def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:01.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.609+0000 7f2fced9d700 1 --2- 172.21.15.73:0/1104457337 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2fd0154b00 0x7f2fd014def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:01.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.609+0000 7f2fced9d700 1 -- 172.21.15.73:0/1104457337 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fd00c4c90 msgr2=0x7f2fd014bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:01.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.609+0000 7f2fced9d700 1 --2- 172.21.15.73:0/1104457337 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fd00c4c90 0x7f2fd014bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:01.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.609+0000 7f2fced9d700 1 -- 172.21.15.73:0/1104457337 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd00cbaf0 con 0x7f2fb8004850 2024-05-08T21:52:01.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.609+0000 7f2fced9d700 1 --2- 172.21.15.73:0/1104457337 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2fb8004850 0x7f2fd00cb2f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2fc40072f0 tx=0x7f2fc4007600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:52:01.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.609+0000 7f2fb77fe700 1 -- 172.21.15.73:0/1104457337 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc400f5e0 con 0x7f2fb8004850 2024-05-08T21:52:01.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.609+0000 7f2fb77fe700 1 -- 172.21.15.73:0/1104457337 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fc400f740 con 0x7f2fb8004850 2024-05-08T21:52:01.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.609+0000 7f2fd513f700 1 -- 172.21.15.73:0/1104457337 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fd00cb830 con 0x7f2fb8004850 2024-05-08T21:52:01.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.609+0000 7f2fb77fe700 1 -- 172.21.15.73:0/1104457337 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc400faf0 con 0x7f2fb8004850 2024-05-08T21:52:01.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.609+0000 7f2fd513f700 1 -- 172.21.15.73:0/1104457337 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fd00ca530 con 0x7f2fb8004850 2024-05-08T21:52:01.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.610+0000 7f2fd513f700 1 -- 172.21.15.73:0/1104457337 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fd00cb140 con 0x7f2fb8004850 2024-05-08T21:52:01.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.610+0000 7f2fb77fe700 1 -- 172.21.15.73:0/1104457337 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2fc401e3b0 con 0x7f2fb8004850 2024-05-08T21:52:01.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.611+0000 7f2fb77fe700 1 --2- 172.21.15.73:0/1104457337 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f2fbc06ac90 0x7f2fbc06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:01.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.611+0000 7f2fb77fe700 1 -- 172.21.15.73:0/1104457337 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5883+0+0 (secure 0 0 0) 0x7f2fc4088f60 con 0x7f2fb8004850 2024-05-08T21:52:01.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.611+0000 7f2fce59c700 1 --2- 172.21.15.73:0/1104457337 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f2fbc06ac90 0x7f2fbc06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:01.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.611+0000 7f2fce59c700 1 --2- 172.21.15.73:0/1104457337 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f2fbc06ac90 0x7f2fbc06d150 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2fc00090b0 tx=0x7f2fc001e040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:52:01.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.615+0000 7f2fb77fe700 1 -- 172.21.15.73:0/1104457337 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f2fc4054120 con 0x7f2fb8004850 2024-05-08T21:52:01.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.853+0000 7f2fd513f700 1 -- 172.21.15.73:0/1104457337 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2fd0068b80 con 0x7f2fb8004850 2024-05-08T21:52:01.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.853+0000 7f2fb77fe700 1 -- 172.21.15.73:0/1104457337 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+6250 (secure 0 0 0) 0x7f2fc4057740 con 0x7f2fb8004850 2024-05-08T21:52:01.854 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:52:01.854 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3242319177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6833","nonce":3242319177},{"type":"v1","addr":"172.21.15.115:6835","nonce":3242319177}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6834/2136341349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2136341349},{"type":"v1","addr":"172.21.15.115:6834","nonce":2136341349}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4249,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1439647913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1439647913},{"type":"v1","addr":"172.21.15.115:6837","nonce":1439647913}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/2386382396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2386382396},{"type":"v1","addr":"172.21.15.73:6836","nonce":2386382396}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/1772457954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":1772457954},{"type":"v1","addr":"172.21.15.73:6837","nonce":1772457954}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:49:43.747162+0000","modified":"2024-05-08T21:49:48.814033+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.73:6839/1477468490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1477468490},{"type":"v1","addr":"172.21.15.73:6839","nonce":1477468490}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:52:01.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.855+0000 7f2fd513f700 1 -- 172.21.15.73:0/1104457337 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f2fbc06ac90 msgr2=0x7f2fbc06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:01.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.855+0000 7f2fd513f700 1 --2- 172.21.15.73:0/1104457337 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f2fbc06ac90 0x7f2fbc06d150 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2fc00090b0 tx=0x7f2fc001e040 comp rx=0 tx=0).stop 2024-05-08T21:52:01.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.855+0000 7f2fd513f700 1 -- 172.21.15.73:0/1104457337 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2fb8004850 msgr2=0x7f2fd00cb2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:01.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.855+0000 7f2fd513f700 1 --2- 172.21.15.73:0/1104457337 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2fb8004850 0x7f2fd00cb2f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2fc40072f0 tx=0x7f2fc4007600 comp rx=0 tx=0).stop 2024-05-08T21:52:01.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.856+0000 7f2fd513f700 1 -- 172.21.15.73:0/1104457337 shutdown_connections 2024-05-08T21:52:01.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.856+0000 7f2fd513f700 1 --2- 172.21.15.73:0/1104457337 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f2fbc06ac90 0x7f2fbc06d150 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:01.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.856+0000 7f2fd513f700 1 --2- 172.21.15.73:0/1104457337 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fd00c4c90 0x7f2fd014bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:01.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.856+0000 7f2fd513f700 1 --2- 172.21.15.73:0/1104457337 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2fb8004850 0x7f2fd00cb2f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:01.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.856+0000 7f2fd513f700 1 --2- 172.21.15.73:0/1104457337 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2fd0154b00 0x7f2fd014def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:01.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.856+0000 7f2fd513f700 1 -- 172.21.15.73:0/1104457337 >> 172.21.15.73:0/1104457337 conn(0x7f2fd0066d70 msgr2=0x7f2fd0071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:52:01.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.856+0000 7f2fd513f700 1 -- 172.21.15.73:0/1104457337 shutdown_connections 2024-05-08T21:52:01.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:01.856+0000 7f2fd513f700 1 -- 172.21.15.73:0/1104457337 wait complete. 2024-05-08T21:52:01.857 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 8 2024-05-08T21:52:01.868 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is laggy/crashed, in failed state, or mds.e is removed from mdsmap 2024-05-08T21:52:03.869 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:52:04.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.007+0000 7ff461e59700 1 Processor -- start 2024-05-08T21:52:04.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.007+0000 7ff461e59700 1 -- start start 2024-05-08T21:52:04.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.008+0000 7ff461e59700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff45c153ed0 0x7ff45c06c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:04.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.008+0000 7ff461e59700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff45c0cafc0 0x7ff45c1645d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:04.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.008+0000 7ff461e59700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff45c15e1b0 con 0x7ff45c0cb630 2024-05-08T21:52:04.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.008+0000 7ff461e59700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff45c0ca930 con 0x7ff45c0cafc0 2024-05-08T21:52:04.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.008+0000 7ff461e59700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff45c06bc00 con 0x7ff45c153ed0 2024-05-08T21:52:04.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.008+0000 7ff45bfff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff45c0cafc0 0x7ff45c1645d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:04.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.008+0000 7ff45affd700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7ff45c0cb630 0x7ff45c0cbf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:51380/0 (socket says 172.21.15.73:51380) 2024-05-08T21:52:04.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.008+0000 7ff45affd700 1 -- 172.21.15.73:0/1680030615 learned_addr learned my addr 172.21.15.73:0/1680030615 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:52:04.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.008+0000 7ff45b7fe700 1 --2- 172.21.15.73:0/1680030615 >> v2:172.21.15.115:3300/0 conn(0x7ff45c153ed0 0x7ff45c06c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:04.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.008+0000 7ff45bfff700 1 -- 172.21.15.73:0/1680030615 >> v2:172.21.15.115:3300/0 conn(0x7ff45c153ed0 msgr2=0x7ff45c06c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:52:04.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.008+0000 7ff45bfff700 1 --2- 172.21.15.73:0/1680030615 >> v2:172.21.15.115:3300/0 conn(0x7ff45c153ed0 0x7ff45c06c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:04.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.008+0000 7ff45bfff700 1 -- 172.21.15.73:0/1680030615 >> v1:172.21.15.73:6789/0 conn(0x7ff45c0cb630 legacy=0x7ff45c0cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:04.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.008+0000 7ff45bfff700 1 -- 172.21.15.73:0/1680030615 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff45c0cbcc0 con 0x7ff45c0cafc0 2024-05-08T21:52:04.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.008+0000 7ff45bfff700 1 --2- 172.21.15.73:0/1680030615 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff45c0cafc0 0x7ff45c1645d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff45c0cce10 tx=0x7ff45400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aba61b0a1ddcac26 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:52:04.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.009+0000 7ff45a7fc700 1 -- 172.21.15.73:0/1680030615 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff45400e070 con 0x7ff45c0cafc0 2024-05-08T21:52:04.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.009+0000 7ff45a7fc700 1 -- 172.21.15.73:0/1680030615 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff45400bbd0 con 0x7ff45c0cafc0 2024-05-08T21:52:04.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.009+0000 7ff45a7fc700 1 -- 172.21.15.73:0/1680030615 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff454012430 con 0x7ff45c0cafc0 2024-05-08T21:52:04.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.009+0000 7ff461e59700 1 -- 172.21.15.73:0/1680030615 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff45c0cafc0 msgr2=0x7ff45c1645d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:04.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.009+0000 7ff461e59700 1 --2- 172.21.15.73:0/1680030615 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff45c0cafc0 0x7ff45c1645d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff45c0cce10 tx=0x7ff45400b330 comp rx=0 tx=0).stop 2024-05-08T21:52:04.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.009+0000 7ff461e59700 1 -- 172.21.15.73:0/1680030615 shutdown_connections 2024-05-08T21:52:04.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.009+0000 7ff461e59700 1 --2- 172.21.15.73:0/1680030615 >> v2:172.21.15.115:3300/0 conn(0x7ff45c153ed0 0x7ff45c06c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:04.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.009+0000 7ff461e59700 1 --2- 172.21.15.73:0/1680030615 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff45c0cafc0 0x7ff45c1645d0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:04.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.009+0000 7ff461e59700 1 -- 172.21.15.73:0/1680030615 >> 172.21.15.73:0/1680030615 conn(0x7ff45c0666c0 msgr2=0x7ff45c066ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:52:04.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.009+0000 7ff461e59700 1 -- 172.21.15.73:0/1680030615 shutdown_connections 2024-05-08T21:52:04.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.009+0000 7ff461e59700 1 -- 172.21.15.73:0/1680030615 wait complete. 2024-05-08T21:52:04.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.011+0000 7ff461e59700 1 Processor -- start 2024-05-08T21:52:04.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.011+0000 7ff461e59700 1 -- start start 2024-05-08T21:52:04.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.011+0000 7ff461e59700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff45c0cafc0 0x7ff45c1516d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:04.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.011+0000 7ff461e59700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff45c0cb630 0x7ff45c0c8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:04.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.012+0000 7ff461e59700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff45c153ed0 0x7ff45c158f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:04.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.012+0000 7ff461e59700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff45c1ef860 con 0x7ff45c153ed0 2024-05-08T21:52:04.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.012+0000 7ff461e59700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff45c1efa50 con 0x7ff45c0cb630 2024-05-08T21:52:04.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.012+0000 7ff461e59700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff45c1efd30 con 0x7ff45c0cafc0 2024-05-08T21:52:04.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.012+0000 7ff45bfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff45c153ed0 0x7ff45c158f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:04.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.012+0000 7ff45bfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff45c153ed0 0x7ff45c158f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41354/0 (socket says 172.21.15.73:41354) 2024-05-08T21:52:04.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.012+0000 7ff45bfff700 1 -- 172.21.15.73:0/3411367117 learned_addr learned my addr 172.21.15.73:0/3411367117 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:52:04.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.012+0000 7ff45affd700 1 --2- 172.21.15.73:0/3411367117 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff45c0cb630 0x7ff45c0c8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:04.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.012+0000 7ff45b7fe700 1 --2- 172.21.15.73:0/3411367117 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff45c0cafc0 0x7ff45c1516d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:04.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.012+0000 7ff45bfff700 1 -- 172.21.15.73:0/3411367117 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff45c0cafc0 msgr2=0x7ff45c1516d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:04.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.012+0000 7ff45bfff700 1 --2- 172.21.15.73:0/3411367117 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff45c0cafc0 0x7ff45c1516d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:04.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.012+0000 7ff45bfff700 1 -- 172.21.15.73:0/3411367117 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff45c0cb630 msgr2=0x7ff45c0c8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:04.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.012+0000 7ff45bfff700 1 --2- 172.21.15.73:0/3411367117 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff45c0cb630 0x7ff45c0c8cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:04.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.012+0000 7ff45bfff700 1 -- 172.21.15.73:0/3411367117 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff454009a70 con 0x7ff45c153ed0 2024-05-08T21:52:04.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.012+0000 7ff45b7fe700 1 --2- 172.21.15.73:0/3411367117 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff45c0cafc0 0x7ff45c1516d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:52:04.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.012+0000 7ff45bfff700 1 --2- 172.21.15.73:0/3411367117 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff45c153ed0 0x7ff45c158f10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff454014040 tx=0x7ff454004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:52:04.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.012+0000 7ff453fff700 1 -- 172.21.15.73:0/3411367117 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff454012430 con 0x7ff45c153ed0 2024-05-08T21:52:04.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.012+0000 7ff453fff700 1 -- 172.21.15.73:0/3411367117 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff454020070 con 0x7ff45c153ed0 2024-05-08T21:52:04.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.012+0000 7ff461e59700 1 -- 172.21.15.73:0/3411367117 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff45c1f0010 con 0x7ff45c153ed0 2024-05-08T21:52:04.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.012+0000 7ff453fff700 1 -- 172.21.15.73:0/3411367117 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff454004280 con 0x7ff45c153ed0 2024-05-08T21:52:04.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.012+0000 7ff461e59700 1 -- 172.21.15.73:0/3411367117 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff45c1f05d0 con 0x7ff45c153ed0 2024-05-08T21:52:04.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.013+0000 7ff461e59700 1 -- 172.21.15.73:0/3411367117 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff45c0caa90 con 0x7ff45c153ed0 2024-05-08T21:52:04.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.014+0000 7ff453fff700 1 -- 172.21.15.73:0/3411367117 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff4540043e0 con 0x7ff45c153ed0 2024-05-08T21:52:04.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.014+0000 7ff453fff700 1 --2- 172.21.15.73:0/3411367117 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7ff43c06ac90 0x7ff43c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:04.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.014+0000 7ff453fff700 1 -- 172.21.15.73:0/3411367117 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5883+0+0 (secure 0 0 0) 0x7ff454022070 con 0x7ff45c153ed0 2024-05-08T21:52:04.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.014+0000 7ff45b7fe700 1 --2- 172.21.15.73:0/3411367117 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7ff43c06ac90 0x7ff43c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:04.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.015+0000 7ff45b7fe700 1 --2- 172.21.15.73:0/3411367117 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7ff43c06ac90 0x7ff43c06d150 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff44c00a9b0 tx=0x7ff44c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:52:04.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.019+0000 7ff453fff700 1 -- 172.21.15.73:0/3411367117 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7ff4540563c0 con 0x7ff45c153ed0 2024-05-08T21:52:04.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.259+0000 7ff461e59700 1 -- 172.21.15.73:0/3411367117 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff45c068b80 con 0x7ff45c153ed0 2024-05-08T21:52:04.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.260+0000 7ff453fff700 1 -- 172.21.15.73:0/3411367117 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+6250 (secure 0 0 0) 0x7ff4540599e0 con 0x7ff45c153ed0 2024-05-08T21:52:04.260 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:52:04.260 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3242319177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6833","nonce":3242319177},{"type":"v1","addr":"172.21.15.115:6835","nonce":3242319177}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6834/2136341349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2136341349},{"type":"v1","addr":"172.21.15.115:6834","nonce":2136341349}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4249,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1439647913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1439647913},{"type":"v1","addr":"172.21.15.115:6837","nonce":1439647913}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/2386382396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2386382396},{"type":"v1","addr":"172.21.15.73:6836","nonce":2386382396}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/1772457954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":1772457954},{"type":"v1","addr":"172.21.15.73:6837","nonce":1772457954}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:49:43.747162+0000","modified":"2024-05-08T21:49:48.814033+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.73:6839/1477468490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1477468490},{"type":"v1","addr":"172.21.15.73:6839","nonce":1477468490}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:52:04.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.262+0000 7ff461e59700 1 -- 172.21.15.73:0/3411367117 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7ff43c06ac90 msgr2=0x7ff43c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:04.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.262+0000 7ff461e59700 1 --2- 172.21.15.73:0/3411367117 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7ff43c06ac90 0x7ff43c06d150 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff44c00a9b0 tx=0x7ff44c008040 comp rx=0 tx=0).stop 2024-05-08T21:52:04.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.262+0000 7ff461e59700 1 -- 172.21.15.73:0/3411367117 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff45c153ed0 msgr2=0x7ff45c158f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:04.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.262+0000 7ff461e59700 1 --2- 172.21.15.73:0/3411367117 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff45c153ed0 0x7ff45c158f10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff454014040 tx=0x7ff454004ad0 comp rx=0 tx=0).stop 2024-05-08T21:52:04.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.262+0000 7ff461e59700 1 -- 172.21.15.73:0/3411367117 shutdown_connections 2024-05-08T21:52:04.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.262+0000 7ff461e59700 1 --2- 172.21.15.73:0/3411367117 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7ff43c06ac90 0x7ff43c06d150 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:04.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.262+0000 7ff461e59700 1 --2- 172.21.15.73:0/3411367117 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff45c153ed0 0x7ff45c158f10 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:04.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.262+0000 7ff461e59700 1 --2- 172.21.15.73:0/3411367117 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff45c0cafc0 0x7ff45c1516d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:04.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.262+0000 7ff461e59700 1 --2- 172.21.15.73:0/3411367117 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff45c0cb630 0x7ff45c0c8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:04.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.262+0000 7ff461e59700 1 -- 172.21.15.73:0/3411367117 >> 172.21.15.73:0/3411367117 conn(0x7ff45c0666c0 msgr2=0x7ff45c1525b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:52:04.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.262+0000 7ff461e59700 1 -- 172.21.15.73:0/3411367117 shutdown_connections 2024-05-08T21:52:04.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:04.262+0000 7ff461e59700 1 -- 172.21.15.73:0/3411367117 wait complete. 2024-05-08T21:52:04.263 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 8 2024-05-08T21:52:04.274 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is laggy/crashed, in failed state, or mds.e is removed from mdsmap 2024-05-08T21:52:06.276 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:52:06.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.411+0000 7f31d9f9a700 1 Processor -- start 2024-05-08T21:52:06.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.411+0000 7f31d9f9a700 1 -- start start 2024-05-08T21:52:06.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.412+0000 7f31d9f9a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f31d4150df0 0x7f31d40c6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:06.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.412+0000 7f31d9f9a700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f31d40c7a90 0x7f31d40c5b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:06.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.412+0000 7f31d9f9a700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31d40c4020 con 0x7f31d40c7fe0 2024-05-08T21:52:06.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.412+0000 7f31d9f9a700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31d40c5770 con 0x7f31d40c7a90 2024-05-08T21:52:06.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.412+0000 7f31d9f9a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31d41511d0 con 0x7f31d4150df0 2024-05-08T21:52:06.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.412+0000 7f31d3fff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f31d40c7a90 0x7f31d40c5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:06.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.412+0000 7f31d3fff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f31d40c7a90 0x7f31d40c5b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41370/0 (socket says 172.21.15.73:41370) 2024-05-08T21:52:06.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.412+0000 7f31d3fff700 1 -- 172.21.15.73:0/4134829337 learned_addr learned my addr 172.21.15.73:0/4134829337 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:52:06.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.412+0000 7f31d37fe700 1 --2- 172.21.15.73:0/4134829337 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f31d4150df0 0x7f31d40c6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:06.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.413+0000 7f31d3fff700 1 -- 172.21.15.73:0/4134829337 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f31d4150df0 msgr2=0x7f31d40c6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:52:06.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.413+0000 7f31d3fff700 1 --2- 172.21.15.73:0/4134829337 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f31d4150df0 0x7f31d40c6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:06.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.413+0000 7f31d3fff700 1 -- 172.21.15.73:0/4134829337 >> v1:172.21.15.115:6789/0 conn(0x7f31d40c7fe0 legacy=0x7f31d40c8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:06.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.413+0000 7f31d3fff700 1 -- 172.21.15.73:0/4134829337 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d40c3d40 con 0x7f31d40c7a90 2024-05-08T21:52:06.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.413+0000 7f31d3fff700 1 --2- 172.21.15.73:0/4134829337 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31d40c7a90 0x7f31d40c5b90 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f31cc00d150 tx=0x7f31cc00d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deb06af8a5bfcbe4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:52:06.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.413+0000 7f31d27fc700 1 -- 172.21.15.73:0/4134829337 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31cc010070 con 0x7f31d40c7a90 2024-05-08T21:52:06.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.413+0000 7f31d27fc700 1 -- 172.21.15.73:0/4134829337 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31cc00dd10 con 0x7f31d40c7a90 2024-05-08T21:52:06.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.413+0000 7f31d27fc700 1 -- 172.21.15.73:0/4134829337 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31cc00b310 con 0x7f31d40c7a90 2024-05-08T21:52:06.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.413+0000 7f31d9f9a700 1 -- 172.21.15.73:0/4134829337 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31d40c7a90 msgr2=0x7f31d40c5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:06.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.414+0000 7f31d9f9a700 1 --2- 172.21.15.73:0/4134829337 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31d40c7a90 0x7f31d40c5b90 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f31cc00d150 tx=0x7f31cc00d460 comp rx=0 tx=0).stop 2024-05-08T21:52:06.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.414+0000 7f31d9f9a700 1 -- 172.21.15.73:0/4134829337 shutdown_connections 2024-05-08T21:52:06.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.414+0000 7f31d9f9a700 1 --2- 172.21.15.73:0/4134829337 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31d40c7a90 0x7f31d40c5b90 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:06.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.414+0000 7f31d9f9a700 1 --2- 172.21.15.73:0/4134829337 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f31d4150df0 0x7f31d40c6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:06.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.414+0000 7f31d9f9a700 1 -- 172.21.15.73:0/4134829337 >> 172.21.15.73:0/4134829337 conn(0x7f31d40cc420 msgr2=0x7f31d40cc800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:52:06.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.414+0000 7f31d9f9a700 1 -- 172.21.15.73:0/4134829337 shutdown_connections 2024-05-08T21:52:06.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.414+0000 7f31d9f9a700 1 -- 172.21.15.73:0/4134829337 wait complete. 2024-05-08T21:52:06.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.415+0000 7f31d9f9a700 1 Processor -- start 2024-05-08T21:52:06.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.415+0000 7f31d9f9a700 1 -- start start 2024-05-08T21:52:06.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.416+0000 7f31d9f9a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f31d40c7a90 0x7f31d4144e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:06.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.416+0000 7f31d9f9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31d40c7fe0 0x7f31d4157480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:06.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.416+0000 7f31d9f9a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31d4150df0 0x7f31d4156620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:06.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.416+0000 7f31d9f9a700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d4153900 con 0x7f31d4150df0 2024-05-08T21:52:06.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.416+0000 7f31d9f9a700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d41579c0 con 0x7f31d40c7fe0 2024-05-08T21:52:06.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.416+0000 7f31d9f9a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31d4145450 con 0x7f31d40c7a90 2024-05-08T21:52:06.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.416+0000 7f31d3fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31d4150df0 0x7f31d4156620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:06.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.416+0000 7f31d3fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31d4150df0 0x7f31d4156620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41376/0 (socket says 172.21.15.73:41376) 2024-05-08T21:52:06.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.416+0000 7f31d3fff700 1 -- 172.21.15.73:0/774206622 learned_addr learned my addr 172.21.15.73:0/774206622 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:52:06.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.416+0000 7f31d37fe700 1 --2- 172.21.15.73:0/774206622 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f31d40c7a90 0x7f31d4144e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:06.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.416+0000 7f31d2ffd700 1 --2- 172.21.15.73:0/774206622 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31d40c7fe0 0x7f31d4157480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:06.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.416+0000 7f31d3fff700 1 -- 172.21.15.73:0/774206622 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f31d40c7a90 msgr2=0x7f31d4144e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:06.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.416+0000 7f31d3fff700 1 --2- 172.21.15.73:0/774206622 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f31d40c7a90 0x7f31d4144e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:06.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.416+0000 7f31d3fff700 1 -- 172.21.15.73:0/774206622 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31d40c7fe0 msgr2=0x7f31d4157480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:06.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.416+0000 7f31d3fff700 1 --2- 172.21.15.73:0/774206622 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31d40c7fe0 0x7f31d4157480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:06.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.416+0000 7f31d3fff700 1 -- 172.21.15.73:0/774206622 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31cc00bd40 con 0x7f31d4150df0 2024-05-08T21:52:06.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.416+0000 7f31d3fff700 1 --2- 172.21.15.73:0/774206622 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31d4150df0 0x7f31d4156620 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f31d4072da0 tx=0x7f31cc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:52:06.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.417+0000 7f31bbfff700 1 -- 172.21.15.73:0/774206622 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31cc009a10 con 0x7f31d4150df0 2024-05-08T21:52:06.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.417+0000 7f31bbfff700 1 -- 172.21.15.73:0/774206622 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31cc009b70 con 0x7f31d4150df0 2024-05-08T21:52:06.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.417+0000 7f31d9f9a700 1 -- 172.21.15.73:0/774206622 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31d4145730 con 0x7f31d4150df0 2024-05-08T21:52:06.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.417+0000 7f31bbfff700 1 -- 172.21.15.73:0/774206622 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31cc00b4c0 con 0x7f31d4150df0 2024-05-08T21:52:06.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.417+0000 7f31d9f9a700 1 -- 172.21.15.73:0/774206622 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31d41f00d0 con 0x7f31d4150df0 2024-05-08T21:52:06.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.418+0000 7f31d9f9a700 1 -- 172.21.15.73:0/774206622 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31d40c35f0 con 0x7f31d4150df0 2024-05-08T21:52:06.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.418+0000 7f31bbfff700 1 -- 172.21.15.73:0/774206622 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f31cc004040 con 0x7f31d4150df0 2024-05-08T21:52:06.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.418+0000 7f31bbfff700 1 --2- 172.21.15.73:0/774206622 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f31c006acc0 0x7f31c006d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:06.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.418+0000 7f31bbfff700 1 -- 172.21.15.73:0/774206622 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5969+0+0 (secure 0 0 0) 0x7f31cc08a320 con 0x7f31d4150df0 2024-05-08T21:52:06.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.419+0000 7f31d37fe700 1 --2- 172.21.15.73:0/774206622 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f31c006acc0 0x7f31c006d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:06.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.419+0000 7f31d37fe700 1 --2- 172.21.15.73:0/774206622 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f31c006acc0 0x7f31c006d180 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f31c8009be0 tx=0x7f31c8009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:52:06.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.423+0000 7f31bbfff700 1 -- 172.21.15.73:0/774206622 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f31cc0553f0 con 0x7f31d4150df0 2024-05-08T21:52:06.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.661+0000 7f31d9f9a700 1 -- 172.21.15.73:0/774206622 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f31d414ae70 con 0x7f31d4150df0 2024-05-08T21:52:06.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.662+0000 7f31bbfff700 1 -- 172.21.15.73:0/774206622 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+5495 (secure 0 0 0) 0x7f31cc058a10 con 0x7f31d4150df0 2024-05-08T21:52:06.663 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:52:06.663 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3242319177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6833","nonce":3242319177},{"type":"v1","addr":"172.21.15.115:6835","nonce":3242319177}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6834/2136341349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2136341349},{"type":"v1","addr":"172.21.15.115:6834","nonce":2136341349}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4249,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1439647913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1439647913},{"type":"v1","addr":"172.21.15.115:6837","nonce":1439647913}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/2386382396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2386382396},{"type":"v1","addr":"172.21.15.73:6836","nonce":2386382396}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:49:43.747162+0000","modified":"2024-05-08T21:52:05.996906+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":24,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":9,"state":"up:replay","state_seq":1,"addr":"172.21.15.73:6837/1772457954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":1772457954},{"type":"v1","addr":"172.21.15.73:6837","nonce":1772457954}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:52:06.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.664+0000 7f31d9f9a700 1 -- 172.21.15.73:0/774206622 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f31c006acc0 msgr2=0x7f31c006d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:06.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.664+0000 7f31d9f9a700 1 --2- 172.21.15.73:0/774206622 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f31c006acc0 0x7f31c006d180 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f31c8009be0 tx=0x7f31c8009210 comp rx=0 tx=0).stop 2024-05-08T21:52:06.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.664+0000 7f31d9f9a700 1 -- 172.21.15.73:0/774206622 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31d4150df0 msgr2=0x7f31d4156620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:06.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.664+0000 7f31d9f9a700 1 --2- 172.21.15.73:0/774206622 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31d4150df0 0x7f31d4156620 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f31d4072da0 tx=0x7f31cc004ad0 comp rx=0 tx=0).stop 2024-05-08T21:52:06.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.664+0000 7f31d9f9a700 1 -- 172.21.15.73:0/774206622 shutdown_connections 2024-05-08T21:52:06.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.664+0000 7f31d9f9a700 1 --2- 172.21.15.73:0/774206622 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f31c006acc0 0x7f31c006d180 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:06.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.664+0000 7f31d9f9a700 1 --2- 172.21.15.73:0/774206622 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31d4150df0 0x7f31d4156620 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:06.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.664+0000 7f31d9f9a700 1 --2- 172.21.15.73:0/774206622 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f31d40c7a90 0x7f31d4144e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:06.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.664+0000 7f31d9f9a700 1 --2- 172.21.15.73:0/774206622 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31d40c7fe0 0x7f31d4157480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:06.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.664+0000 7f31d9f9a700 1 -- 172.21.15.73:0/774206622 >> 172.21.15.73:0/774206622 conn(0x7f31d40cc420 msgr2=0x7f31d40cafe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:52:06.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.664+0000 7f31d9f9a700 1 -- 172.21.15.73:0/774206622 shutdown_connections 2024-05-08T21:52:06.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.664+0000 7f31d9f9a700 1 -- 172.21.15.73:0/774206622 wait complete. 2024-05-08T21:52:06.666 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 9 2024-05-08T21:52:06.677 INFO:tasks.mds_thrash.fs.[cephfs]:mds.e down, removed from mdsmap 2024-05-08T21:52:06.677 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for mds cluster to stabilize... 2024-05-08T21:52:06.677 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:52:06.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.797+0000 7f7c1b409700 1 Processor -- start 2024-05-08T21:52:06.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.797+0000 7f7c1b409700 1 -- start start 2024-05-08T21:52:06.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.798+0000 7f7c1b409700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7c141575e0 0x7f7c140cd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:06.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.798+0000 7f7c1b409700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c1406fd40 con 0x7f7c140c44e0 2024-05-08T21:52:06.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.798+0000 7f7c1b409700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c1406c510 con 0x7f7c1415aa30 2024-05-08T21:52:06.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.798+0000 7f7c1b409700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c141579c0 con 0x7f7c141575e0 2024-05-08T21:52:06.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.798+0000 7f7c189a4700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f7c140c44e0 0x7f7c1415a320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:51396/0 (socket says 172.21.15.73:51396) 2024-05-08T21:52:06.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.798+0000 7f7c189a4700 1 -- 172.21.15.73:0/4026133945 learned_addr learned my addr 172.21.15.73:0/4026133945 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:52:06.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.799+0000 7f7c191a5700 1 --2- 172.21.15.73:0/4026133945 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7c141575e0 0x7f7c140cd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:06.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.799+0000 7f7c0bfff700 1 -- 172.21.15.73:0/4026133945 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1405251906 0 0) 0x7f7c1406fd40 con 0x7f7c140c44e0 2024-05-08T21:52:06.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.799+0000 7f7c0bfff700 1 -- 172.21.15.73:0/4026133945 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c000035b0 con 0x7f7c140c44e0 2024-05-08T21:52:06.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.799+0000 7f7c0bfff700 1 -- 172.21.15.73:0/4026133945 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1960639488 0 0) 0x7f7c1406c510 con 0x7f7c1415aa30 2024-05-08T21:52:06.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.799+0000 7f7c0bfff700 1 -- 172.21.15.73:0/4026133945 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c1406fd40 con 0x7f7c1415aa30 2024-05-08T21:52:06.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.799+0000 7f7c0bfff700 1 -- 172.21.15.73:0/4026133945 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1109818417 0 0) 0x7f7c000035b0 con 0x7f7c140c44e0 2024-05-08T21:52:06.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.799+0000 7f7c191a5700 1 -- 172.21.15.73:0/4026133945 >> v1:172.21.15.115:6789/0 conn(0x7f7c1415aa30 legacy=0x7f7c14164770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:06.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.799+0000 7f7c191a5700 1 -- 172.21.15.73:0/4026133945 >> v1:172.21.15.73:6789/0 conn(0x7f7c140c44e0 legacy=0x7f7c1415a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:06.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.799+0000 7f7c191a5700 1 -- 172.21.15.73:0/4026133945 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c1406fa60 con 0x7f7c141575e0 2024-05-08T21:52:06.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.799+0000 7f7c191a5700 1 --2- 172.21.15.73:0/4026133945 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7c141575e0 0x7f7c140cd4e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7c04009870 tx=0x7f7c04009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=adfc890c8523c2c5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:52:06.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.799+0000 7f7c0bfff700 1 -- 172.21.15.73:0/4026133945 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c10001670 con 0x7f7c141575e0 2024-05-08T21:52:06.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.799+0000 7f7c0bfff700 1 -- 172.21.15.73:0/4026133945 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c04004030 con 0x7f7c141575e0 2024-05-08T21:52:06.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.799+0000 7f7c0bfff700 1 -- 172.21.15.73:0/4026133945 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c040043c0 con 0x7f7c141575e0 2024-05-08T21:52:06.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.800+0000 7f7c1b409700 1 -- 172.21.15.73:0/4026133945 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7c141575e0 msgr2=0x7f7c140cd4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:06.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.800+0000 7f7c1b409700 1 --2- 172.21.15.73:0/4026133945 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7c141575e0 0x7f7c140cd4e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7c04009870 tx=0x7f7c04009b80 comp rx=0 tx=0).stop 2024-05-08T21:52:06.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.800+0000 7f7c1b409700 1 -- 172.21.15.73:0/4026133945 shutdown_connections 2024-05-08T21:52:06.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.800+0000 7f7c1b409700 1 --2- 172.21.15.73:0/4026133945 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7c141575e0 0x7f7c140cd4e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:06.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.800+0000 7f7c1b409700 1 -- 172.21.15.73:0/4026133945 >> 172.21.15.73:0/4026133945 conn(0x7f7c1406ae10 msgr2=0x7f7c140666c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:52:06.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.800+0000 7f7c1b409700 1 -- 172.21.15.73:0/4026133945 shutdown_connections 2024-05-08T21:52:06.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.800+0000 7f7c1b409700 1 -- 172.21.15.73:0/4026133945 wait complete. 2024-05-08T21:52:06.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.801+0000 7f7c1b409700 1 Processor -- start 2024-05-08T21:52:06.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.801+0000 7f7c1b409700 1 -- start start 2024-05-08T21:52:06.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.802+0000 7f7c1b409700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c140c44e0 0x7f7c140cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:06.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.802+0000 7f7c1b409700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7c141575e0 0x7f7c14151eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:06.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.802+0000 7f7c1b409700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7c1415aa30 0x7f7c141523f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:06.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.802+0000 7f7c1b409700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c140c5c00 con 0x7f7c140c44e0 2024-05-08T21:52:06.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.802+0000 7f7c1b409700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c14151a90 con 0x7f7c1415aa30 2024-05-08T21:52:06.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.802+0000 7f7c1b409700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c141eff90 con 0x7f7c141575e0 2024-05-08T21:52:06.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.802+0000 7f7c191a5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c140c44e0 0x7f7c140cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:06.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.802+0000 7f7c191a5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c140c44e0 0x7f7c140cc6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41386/0 (socket says 172.21.15.73:41386) 2024-05-08T21:52:06.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.802+0000 7f7c191a5700 1 -- 172.21.15.73:0/2009618649 learned_addr learned my addr 172.21.15.73:0/2009618649 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:52:06.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.802+0000 7f7c189a4700 1 --2- 172.21.15.73:0/2009618649 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7c141575e0 0x7f7c14151eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:06.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.802+0000 7f7c199a6700 1 --2- 172.21.15.73:0/2009618649 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7c1415aa30 0x7f7c141523f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:06.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.802+0000 7f7c191a5700 1 -- 172.21.15.73:0/2009618649 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7c141575e0 msgr2=0x7f7c14151eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:06.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.802+0000 7f7c191a5700 1 --2- 172.21.15.73:0/2009618649 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7c141575e0 0x7f7c14151eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:06.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.802+0000 7f7c191a5700 1 -- 172.21.15.73:0/2009618649 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7c1415aa30 msgr2=0x7f7c141523f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:06.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.802+0000 7f7c191a5700 1 --2- 172.21.15.73:0/2009618649 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7c1415aa30 0x7f7c141523f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:06.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.802+0000 7f7c191a5700 1 -- 172.21.15.73:0/2009618649 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c040094a0 con 0x7f7c140c44e0 2024-05-08T21:52:06.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.802+0000 7f7c199a6700 1 --2- 172.21.15.73:0/2009618649 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7c1415aa30 0x7f7c141523f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:52:06.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.802+0000 7f7c191a5700 1 --2- 172.21.15.73:0/2009618649 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c140c44e0 0x7f7c140cc6f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7c040090b0 tx=0x7f7c04004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:52:06.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.803+0000 7f7c09ffb700 1 -- 172.21.15.73:0/2009618649 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c04004570 con 0x7f7c140c44e0 2024-05-08T21:52:06.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.803+0000 7f7c09ffb700 1 -- 172.21.15.73:0/2009618649 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c0401f070 con 0x7f7c140c44e0 2024-05-08T21:52:06.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.803+0000 7f7c1b409700 1 -- 172.21.15.73:0/2009618649 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c141f04c0 con 0x7f7c140c44e0 2024-05-08T21:52:06.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.803+0000 7f7c09ffb700 1 -- 172.21.15.73:0/2009618649 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c04011870 con 0x7f7c140c44e0 2024-05-08T21:52:06.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.803+0000 7f7c1b409700 1 -- 172.21.15.73:0/2009618649 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c141510f0 con 0x7f7c140c44e0 2024-05-08T21:52:06.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.804+0000 7f7c1b409700 1 -- 172.21.15.73:0/2009618649 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c14068b80 con 0x7f7c140c44e0 2024-05-08T21:52:06.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.804+0000 7f7c09ffb700 1 -- 172.21.15.73:0/2009618649 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7c040119d0 con 0x7f7c140c44e0 2024-05-08T21:52:06.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.805+0000 7f7c09ffb700 1 --2- 172.21.15.73:0/2009618649 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f7bf806acc0 0x7f7bf806d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:06.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.805+0000 7f7c09ffb700 1 -- 172.21.15.73:0/2009618649 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5969+0+0 (secure 0 0 0) 0x7f7c04021070 con 0x7f7c140c44e0 2024-05-08T21:52:06.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.805+0000 7f7c189a4700 1 --2- 172.21.15.73:0/2009618649 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f7bf806acc0 0x7f7bf806d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:06.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.805+0000 7f7c189a4700 1 --2- 172.21.15.73:0/2009618649 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f7bf806acc0 0x7f7bf806d180 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7c140b2aa0 tx=0x7f7c10009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:52:06.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:06.809+0000 7f7c09ffb700 1 -- 172.21.15.73:0/2009618649 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f7c04055e10 con 0x7f7c140c44e0 2024-05-08T21:52:07.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:07.048+0000 7f7c1b409700 1 -- 172.21.15.73:0/2009618649 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7c140cd8a0 con 0x7f7c140c44e0 2024-05-08T21:52:07.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:07.049+0000 7f7c09ffb700 1 -- 172.21.15.73:0/2009618649 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+5495 (secure 0 0 0) 0x7f7c0402b020 con 0x7f7c140c44e0 2024-05-08T21:52:07.050 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:52:07.050 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3242319177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6833","nonce":3242319177},{"type":"v1","addr":"172.21.15.115:6835","nonce":3242319177}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6834/2136341349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2136341349},{"type":"v1","addr":"172.21.15.115:6834","nonce":2136341349}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4249,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1439647913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1439647913},{"type":"v1","addr":"172.21.15.115:6837","nonce":1439647913}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/2386382396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2386382396},{"type":"v1","addr":"172.21.15.73:6836","nonce":2386382396}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:49:43.747162+0000","modified":"2024-05-08T21:52:05.996906+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":24,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":9,"state":"up:replay","state_seq":1,"addr":"172.21.15.73:6837/1772457954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":1772457954},{"type":"v1","addr":"172.21.15.73:6837","nonce":1772457954}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:52:07.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:07.051+0000 7f7c1b409700 1 -- 172.21.15.73:0/2009618649 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f7bf806acc0 msgr2=0x7f7bf806d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:07.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:07.051+0000 7f7c1b409700 1 --2- 172.21.15.73:0/2009618649 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f7bf806acc0 0x7f7bf806d180 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7c140b2aa0 tx=0x7f7c10009040 comp rx=0 tx=0).stop 2024-05-08T21:52:07.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:07.051+0000 7f7c1b409700 1 -- 172.21.15.73:0/2009618649 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c140c44e0 msgr2=0x7f7c140cc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:07.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:07.051+0000 7f7c1b409700 1 --2- 172.21.15.73:0/2009618649 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c140c44e0 0x7f7c140cc6f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7c040090b0 tx=0x7f7c04004750 comp rx=0 tx=0).stop 2024-05-08T21:52:07.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:07.051+0000 7f7c1b409700 1 -- 172.21.15.73:0/2009618649 shutdown_connections 2024-05-08T21:52:07.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:07.051+0000 7f7c1b409700 1 --2- 172.21.15.73:0/2009618649 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f7bf806acc0 0x7f7bf806d180 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:07.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:07.051+0000 7f7c1b409700 1 --2- 172.21.15.73:0/2009618649 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7c1415aa30 0x7f7c141523f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:07.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:07.051+0000 7f7c1b409700 1 --2- 172.21.15.73:0/2009618649 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c140c44e0 0x7f7c140cc6f0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:07.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:07.051+0000 7f7c1b409700 1 --2- 172.21.15.73:0/2009618649 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7c141575e0 0x7f7c14151eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:07.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:07.051+0000 7f7c1b409700 1 -- 172.21.15.73:0/2009618649 >> 172.21.15.73:0/2009618649 conn(0x7f7c1406ae10 msgr2=0x7f7c140ca3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:52:07.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:07.051+0000 7f7c1b409700 1 -- 172.21.15.73:0/2009618649 shutdown_connections 2024-05-08T21:52:07.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:07.051+0000 7f7c1b409700 1 -- 172.21.15.73:0/2009618649 wait complete. 2024-05-08T21:52:07.054 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 9 2024-05-08T21:52:07.065 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 9, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-05-08T21:49:43.747162+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 9, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_4272": { "addr": "172.21.15.73:6837/1772457954", "addrs": { "addrvec": [ { "addr": "172.21.15.73:6835", "nonce": 1772457954, "type": "v2" }, { "addr": "172.21.15.73:6837", "nonce": 1772457954, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4272, "incarnation": 9, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:replay", "state_seq": 1 } }, "last_failure": 0, "last_failure_osd_epoch": 24, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-05-08T21:52:05.996906+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4272 } } } ], "standbys": [ { "addr": "172.21.15.115:6835/3242319177", "addrs": { "addrvec": [ { "addr": "172.21.15.115:6833", "nonce": 3242319177, "type": "v2" }, { "addr": "172.21.15.115:6835", "nonce": 3242319177, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4241, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.115:6834/2136341349", "addrs": { "addrvec": [ { "addr": "172.21.15.115:6832", "nonce": 2136341349, "type": "v2" }, { "addr": "172.21.15.115:6834", "nonce": 2136341349, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4243, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.115:6837/1439647913", "addrs": { "addrvec": [ { "addr": "172.21.15.115:6836", "nonce": 1439647913, "type": "v2" }, { "addr": "172.21.15.115:6837", "nonce": 1439647913, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4249, "incarnation": 0, "join_fscid": -1, "name": "f", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.73:6836/2386382396", "addrs": { "addrvec": [ { "addr": "172.21.15.73:6834", "nonce": 2386382396, "type": "v2" }, { "addr": "172.21.15.73:6836", "nonce": 2386382396, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4263, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-05-08T21:52:09.066 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:52:09.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.207+0000 7f72a2434700 1 Processor -- start 2024-05-08T21:52:09.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.207+0000 7f72a2434700 1 -- start start 2024-05-08T21:52:09.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.208+0000 7f72a2434700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f729c15d530 0x7f729c15d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:09.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.208+0000 7f72a2434700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f729c154490 con 0x7f729c06afc0 2024-05-08T21:52:09.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.208+0000 7f72a2434700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f729c15dee0 con 0x7f729c1540b0 2024-05-08T21:52:09.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.208+0000 7f72a2434700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f729c06b430 con 0x7f729c15d530 2024-05-08T21:52:09.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.208+0000 7f72a09d1700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f729c15d530 0x7f729c15d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:09.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.208+0000 7f729b7fe700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f729c06afc0 0x7f729c0724e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47368/0 (socket says 172.21.15.73:47368) 2024-05-08T21:52:09.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.208+0000 7f729b7fe700 1 -- 172.21.15.73:0/1858563658 learned_addr learned my addr 172.21.15.73:0/1858563658 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:52:09.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.208+0000 7f72a09d1700 1 -- 172.21.15.73:0/1858563658 >> v1:172.21.15.115:6789/0 conn(0x7f729c1540b0 legacy=0x7f729c071d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:09.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.208+0000 7f72a09d1700 1 -- 172.21.15.73:0/1858563658 >> v1:172.21.15.73:6789/0 conn(0x7f729c06afc0 legacy=0x7f729c0724e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:09.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.209+0000 7f72a09d1700 1 -- 172.21.15.73:0/1858563658 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f729c0c79b0 con 0x7f729c15d530 2024-05-08T21:52:09.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.208+0000 7f729affd700 1 -- 172.21.15.73:0/1858563658 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 329919796 0 0) 0x7f729c154490 con 0x7f729c06afc0 2024-05-08T21:52:09.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.209+0000 7f72a09d1700 1 --2- 172.21.15.73:0/1858563658 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f729c15d530 0x7f729c15d9a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7294009d90 tx=0x7f729400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87d3240dce7dab44 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:52:09.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.209+0000 7f729affd700 1 -- 172.21.15.73:0/1858563658 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f729400e070 con 0x7f729c15d530 2024-05-08T21:52:09.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.209+0000 7f729affd700 1 -- 172.21.15.73:0/1858563658 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f729400bbd0 con 0x7f729c15d530 2024-05-08T21:52:09.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.209+0000 7f729affd700 1 -- 172.21.15.73:0/1858563658 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7294012430 con 0x7f729c15d530 2024-05-08T21:52:09.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.209+0000 7f72a2434700 1 -- 172.21.15.73:0/1858563658 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f729c15d530 msgr2=0x7f729c15d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:09.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.209+0000 7f72a2434700 1 --2- 172.21.15.73:0/1858563658 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f729c15d530 0x7f729c15d9a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7294009d90 tx=0x7f729400b330 comp rx=0 tx=0).stop 2024-05-08T21:52:09.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.209+0000 7f72a2434700 1 -- 172.21.15.73:0/1858563658 shutdown_connections 2024-05-08T21:52:09.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.209+0000 7f72a2434700 1 --2- 172.21.15.73:0/1858563658 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f729c15d530 0x7f729c15d9a0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:09.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.209+0000 7f72a2434700 1 -- 172.21.15.73:0/1858563658 >> 172.21.15.73:0/1858563658 conn(0x7f729c066d70 msgr2=0x7f729c0cc500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:52:09.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.209+0000 7f72a2434700 1 -- 172.21.15.73:0/1858563658 shutdown_connections 2024-05-08T21:52:09.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.210+0000 7f72a2434700 1 -- 172.21.15.73:0/1858563658 wait complete. 2024-05-08T21:52:09.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.211+0000 7f72a2434700 1 Processor -- start 2024-05-08T21:52:09.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.211+0000 7f72a2434700 1 -- start start 2024-05-08T21:52:09.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.212+0000 7f72a2434700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f729c06afc0 0x7f729c14fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:09.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.212+0000 7f72a2434700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f729c1540b0 0x7f729c1f00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:09.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.212+0000 7f72a2434700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f729c15d530 0x7f729c150550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:09.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.212+0000 7f72a2434700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f729c1efc50 con 0x7f729c15d530 2024-05-08T21:52:09.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.212+0000 7f72a2434700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f729c1ef950 con 0x7f729c06afc0 2024-05-08T21:52:09.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.212+0000 7f72a2434700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f729c1451c0 con 0x7f729c1540b0 2024-05-08T21:52:09.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.212+0000 7f72a09d1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f729c15d530 0x7f729c150550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:09.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.212+0000 7f72a09d1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f729c15d530 0x7f729c150550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42422/0 (socket says 172.21.15.73:42422) 2024-05-08T21:52:09.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.212+0000 7f72a09d1700 1 -- 172.21.15.73:0/2864383035 learned_addr learned my addr 172.21.15.73:0/2864383035 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:52:09.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.212+0000 7f729b7fe700 1 --2- 172.21.15.73:0/2864383035 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f729c1540b0 0x7f729c1f00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:09.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.212+0000 7f729bfff700 1 --2- 172.21.15.73:0/2864383035 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f729c06afc0 0x7f729c14fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:09.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.212+0000 7f72a09d1700 1 -- 172.21.15.73:0/2864383035 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f729c1540b0 msgr2=0x7f729c1f00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:09.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.212+0000 7f72a09d1700 1 --2- 172.21.15.73:0/2864383035 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f729c1540b0 0x7f729c1f00e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:09.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.212+0000 7f72a09d1700 1 -- 172.21.15.73:0/2864383035 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f729c06afc0 msgr2=0x7f729c14fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:09.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.212+0000 7f72a09d1700 1 --2- 172.21.15.73:0/2864383035 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f729c06afc0 0x7f729c14fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:09.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.212+0000 7f72a09d1700 1 -- 172.21.15.73:0/2864383035 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7294009a70 con 0x7f729c15d530 2024-05-08T21:52:09.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.212+0000 7f729bfff700 1 --2- 172.21.15.73:0/2864383035 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f729c06afc0 0x7f729c14fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:52:09.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.212+0000 7f72a09d1700 1 --2- 172.21.15.73:0/2864383035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f729c15d530 0x7f729c150550 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7294014040 tx=0x7f7294004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:52:09.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.212+0000 7f7298ff9700 1 -- 172.21.15.73:0/2864383035 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f729401b810 con 0x7f729c15d530 2024-05-08T21:52:09.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.212+0000 7f7298ff9700 1 -- 172.21.15.73:0/2864383035 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7294020070 con 0x7f729c15d530 2024-05-08T21:52:09.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.212+0000 7f72a2434700 1 -- 172.21.15.73:0/2864383035 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f729c14e3d0 con 0x7f729c15d530 2024-05-08T21:52:09.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.212+0000 7f7298ff9700 1 -- 172.21.15.73:0/2864383035 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f729401bbb0 con 0x7f729c15d530 2024-05-08T21:52:09.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.212+0000 7f72a2434700 1 -- 172.21.15.73:0/2864383035 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f729c0c5190 con 0x7f729c15d530 2024-05-08T21:52:09.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.213+0000 7f72a2434700 1 -- 172.21.15.73:0/2864383035 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f729c1efdc0 con 0x7f729c15d530 2024-05-08T21:52:09.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.214+0000 7f7298ff9700 1 -- 172.21.15.73:0/2864383035 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f729401bd10 con 0x7f729c15d530 2024-05-08T21:52:09.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.214+0000 7f7298ff9700 1 --2- 172.21.15.73:0/2864383035 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f728806ac90 0x7f728806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:09.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.214+0000 7f7298ff9700 1 -- 172.21.15.73:0/2864383035 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5969+0+0 (secure 0 0 0) 0x7f7294022070 con 0x7f729c15d530 2024-05-08T21:52:09.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.214+0000 7f729bfff700 1 --2- 172.21.15.73:0/2864383035 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f728806ac90 0x7f728806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:09.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.215+0000 7f729bfff700 1 --2- 172.21.15.73:0/2864383035 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f728806ac90 0x7f728806d150 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7290000f60 tx=0x7f7290009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:52:09.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.219+0000 7f7298ff9700 1 -- 172.21.15.73:0/2864383035 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f729405a360 con 0x7f729c15d530 2024-05-08T21:52:09.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.461+0000 7f72a2434700 1 -- 172.21.15.73:0/2864383035 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f729c068b80 con 0x7f729c15d530 2024-05-08T21:52:09.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.462+0000 7f7298ff9700 1 -- 172.21.15.73:0/2864383035 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+5495 (secure 0 0 0) 0x7f7294059ef0 con 0x7f729c15d530 2024-05-08T21:52:09.463 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:52:09.463 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3242319177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6833","nonce":3242319177},{"type":"v1","addr":"172.21.15.115:6835","nonce":3242319177}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6834/2136341349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2136341349},{"type":"v1","addr":"172.21.15.115:6834","nonce":2136341349}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4249,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1439647913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1439647913},{"type":"v1","addr":"172.21.15.115:6837","nonce":1439647913}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/2386382396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2386382396},{"type":"v1","addr":"172.21.15.73:6836","nonce":2386382396}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:49:43.747162+0000","modified":"2024-05-08T21:52:05.996906+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":24,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":9,"state":"up:replay","state_seq":1,"addr":"172.21.15.73:6837/1772457954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":1772457954},{"type":"v1","addr":"172.21.15.73:6837","nonce":1772457954}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:52:09.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.464+0000 7f72a2434700 1 -- 172.21.15.73:0/2864383035 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f728806ac90 msgr2=0x7f728806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:09.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.464+0000 7f72a2434700 1 --2- 172.21.15.73:0/2864383035 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f728806ac90 0x7f728806d150 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7290000f60 tx=0x7f7290009040 comp rx=0 tx=0).stop 2024-05-08T21:52:09.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.464+0000 7f72a2434700 1 -- 172.21.15.73:0/2864383035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f729c15d530 msgr2=0x7f729c150550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:09.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.464+0000 7f72a2434700 1 --2- 172.21.15.73:0/2864383035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f729c15d530 0x7f729c150550 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7294014040 tx=0x7f7294004ad0 comp rx=0 tx=0).stop 2024-05-08T21:52:09.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.464+0000 7f72a2434700 1 -- 172.21.15.73:0/2864383035 shutdown_connections 2024-05-08T21:52:09.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.464+0000 7f72a2434700 1 --2- 172.21.15.73:0/2864383035 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f728806ac90 0x7f728806d150 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:09.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.464+0000 7f72a2434700 1 --2- 172.21.15.73:0/2864383035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f729c15d530 0x7f729c150550 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:09.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.464+0000 7f72a2434700 1 --2- 172.21.15.73:0/2864383035 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f729c06afc0 0x7f729c14fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:09.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.464+0000 7f72a2434700 1 --2- 172.21.15.73:0/2864383035 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f729c1540b0 0x7f729c1f00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:09.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.464+0000 7f72a2434700 1 -- 172.21.15.73:0/2864383035 >> 172.21.15.73:0/2864383035 conn(0x7f729c066d70 msgr2=0x7f729c0c6680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:52:09.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.464+0000 7f72a2434700 1 -- 172.21.15.73:0/2864383035 shutdown_connections 2024-05-08T21:52:09.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:09.464+0000 7f72a2434700 1 -- 172.21.15.73:0/2864383035 wait complete. 2024-05-08T21:52:09.468 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 9 2024-05-08T21:52:09.477 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-05-08T21:52:11.479 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:52:11.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.610+0000 7fab920db700 1 Processor -- start 2024-05-08T21:52:11.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.610+0000 7fab920db700 1 -- start start 2024-05-08T21:52:11.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.611+0000 7fab920db700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fab8c154160 0x7fab8c0c6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:11.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.611+0000 7fab920db700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab8c0c80f0 0x7fab8c0c7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:11.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.611+0000 7fab920db700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fab8c071100 0x7fab8c0c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:11.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.611+0000 7fab920db700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab8c066d90 con 0x7fab8c071100 2024-05-08T21:52:11.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.611+0000 7fab920db700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab8c15e0b0 con 0x7fab8c154160 2024-05-08T21:52:11.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.611+0000 7fab920db700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab8c071ef0 con 0x7fab8c0c80f0 2024-05-08T21:52:11.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.611+0000 7fab8bfff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fab8c071100 0x7fab8c0c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:11.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.611+0000 7fab8bfff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fab8c071100 0x7fab8c0c9b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42434/0 (socket says 172.21.15.73:42434) 2024-05-08T21:52:11.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.611+0000 7fab8bfff700 1 -- 172.21.15.73:0/3649825550 learned_addr learned my addr 172.21.15.73:0/3649825550 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:52:11.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.611+0000 7fab8affd700 1 --2- 172.21.15.73:0/3649825550 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab8c0c80f0 0x7fab8c0c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:11.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.611+0000 7fab8b7fe700 1 --2- 172.21.15.73:0/3649825550 >> v2:172.21.15.115:3300/0 conn(0x7fab8c154160 0x7fab8c0c6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:11.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.611+0000 7fab8bfff700 1 -- 172.21.15.73:0/3649825550 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab8c0c80f0 msgr2=0x7fab8c0c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:52:11.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.611+0000 7fab8bfff700 1 --2- 172.21.15.73:0/3649825550 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab8c0c80f0 0x7fab8c0c7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:11.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.611+0000 7fab8bfff700 1 -- 172.21.15.73:0/3649825550 >> v2:172.21.15.115:3300/0 conn(0x7fab8c154160 msgr2=0x7fab8c0c6fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:52:11.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.611+0000 7fab8bfff700 1 --2- 172.21.15.73:0/3649825550 >> v2:172.21.15.115:3300/0 conn(0x7fab8c154160 0x7fab8c0c6fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:11.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.611+0000 7fab8bfff700 1 -- 172.21.15.73:0/3649825550 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab8c15d4e0 con 0x7fab8c071100 2024-05-08T21:52:11.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.612+0000 7fab8affd700 1 --2- 172.21.15.73:0/3649825550 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab8c0c80f0 0x7fab8c0c7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:52:11.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.612+0000 7fab8b7fe700 1 --2- 172.21.15.73:0/3649825550 >> v2:172.21.15.115:3300/0 conn(0x7fab8c154160 0x7fab8c0c6fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:52:11.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.612+0000 7fab8bfff700 1 --2- 172.21.15.73:0/3649825550 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab8c071100 0x7fab8c0c9b90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fab8c066900 tx=0x7fab8400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=388a735fb110370c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:52:11.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.612+0000 7fab8a7fc700 1 -- 172.21.15.73:0/3649825550 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab8400e070 con 0x7fab8c071100 2024-05-08T21:52:11.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.612+0000 7fab8a7fc700 1 -- 172.21.15.73:0/3649825550 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab8400b9c0 con 0x7fab8c071100 2024-05-08T21:52:11.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.612+0000 7fab8a7fc700 1 -- 172.21.15.73:0/3649825550 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab8400bd70 con 0x7fab8c071100 2024-05-08T21:52:11.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.612+0000 7fab920db700 1 -- 172.21.15.73:0/3649825550 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab8c071100 msgr2=0x7fab8c0c9b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:11.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.612+0000 7fab920db700 1 --2- 172.21.15.73:0/3649825550 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab8c071100 0x7fab8c0c9b90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fab8c066900 tx=0x7fab8400b330 comp rx=0 tx=0).stop 2024-05-08T21:52:11.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.612+0000 7fab920db700 1 -- 172.21.15.73:0/3649825550 shutdown_connections 2024-05-08T21:52:11.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.612+0000 7fab920db700 1 --2- 172.21.15.73:0/3649825550 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab8c071100 0x7fab8c0c9b90 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:11.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.612+0000 7fab920db700 1 --2- 172.21.15.73:0/3649825550 >> v2:172.21.15.115:3300/0 conn(0x7fab8c154160 0x7fab8c0c6fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:11.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.612+0000 7fab920db700 1 --2- 172.21.15.73:0/3649825550 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab8c0c80f0 0x7fab8c0c7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:11.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.612+0000 7fab920db700 1 -- 172.21.15.73:0/3649825550 >> 172.21.15.73:0/3649825550 conn(0x7fab8c0cba80 msgr2=0x7fab8c0cbe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:52:11.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.612+0000 7fab920db700 1 -- 172.21.15.73:0/3649825550 shutdown_connections 2024-05-08T21:52:11.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.612+0000 7fab920db700 1 -- 172.21.15.73:0/3649825550 wait complete. 2024-05-08T21:52:11.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.614+0000 7fab920db700 1 Processor -- start 2024-05-08T21:52:11.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.614+0000 7fab920db700 1 -- start start 2024-05-08T21:52:11.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.615+0000 7fab920db700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab8c071100 0x7fab8c14f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:11.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.615+0000 7fab920db700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab8c0c80f0 0x7fab8c1e5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:11.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.615+0000 7fab920db700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab8c154160 0x7fab8c1e6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:11.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.615+0000 7fab920db700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab8c1f0530 con 0x7fab8c0c80f0 2024-05-08T21:52:11.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.615+0000 7fab920db700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab8c1f3bd0 con 0x7fab8c071100 2024-05-08T21:52:11.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.615+0000 7fab920db700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab8c1ef920 con 0x7fab8c154160 2024-05-08T21:52:11.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.615+0000 7fab8affd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab8c0c80f0 0x7fab8c1e5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:11.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.615+0000 7fab8affd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab8c0c80f0 0x7fab8c1e5ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42442/0 (socket says 172.21.15.73:42442) 2024-05-08T21:52:11.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.615+0000 7fab8affd700 1 -- 172.21.15.73:0/803539213 learned_addr learned my addr 172.21.15.73:0/803539213 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:52:11.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.615+0000 7fab8b7fe700 1 --2- 172.21.15.73:0/803539213 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab8c071100 0x7fab8c14f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:11.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.615+0000 7fab8bfff700 1 --2- 172.21.15.73:0/803539213 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab8c154160 0x7fab8c1e6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:11.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.615+0000 7fab8affd700 1 -- 172.21.15.73:0/803539213 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab8c154160 msgr2=0x7fab8c1e6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:11.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.615+0000 7fab8affd700 1 --2- 172.21.15.73:0/803539213 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab8c154160 0x7fab8c1e6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:11.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.615+0000 7fab8affd700 1 -- 172.21.15.73:0/803539213 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab8c071100 msgr2=0x7fab8c14f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:11.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.615+0000 7fab8affd700 1 --2- 172.21.15.73:0/803539213 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab8c071100 0x7fab8c14f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:11.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.615+0000 7fab8affd700 1 -- 172.21.15.73:0/803539213 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab84009b30 con 0x7fab8c0c80f0 2024-05-08T21:52:11.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.615+0000 7fab8affd700 1 --2- 172.21.15.73:0/803539213 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab8c0c80f0 0x7fab8c1e5ff0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fab7c00c7c0 tx=0x7fab7c00cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:52:11.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.615+0000 7fab73fff700 1 -- 172.21.15.73:0/803539213 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab7c004220 con 0x7fab8c0c80f0 2024-05-08T21:52:11.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.615+0000 7fab73fff700 1 -- 172.21.15.73:0/803539213 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab7c004380 con 0x7fab8c0c80f0 2024-05-08T21:52:11.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.615+0000 7fab920db700 1 -- 172.21.15.73:0/803539213 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab8c1efc00 con 0x7fab8c0c80f0 2024-05-08T21:52:11.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.615+0000 7fab73fff700 1 -- 172.21.15.73:0/803539213 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab7c0036a0 con 0x7fab8c0c80f0 2024-05-08T21:52:11.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.615+0000 7fab920db700 1 -- 172.21.15.73:0/803539213 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab8c1f01c0 con 0x7fab8c0c80f0 2024-05-08T21:52:11.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.616+0000 7fab920db700 1 -- 172.21.15.73:0/803539213 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab8c1f06e0 con 0x7fab8c0c80f0 2024-05-08T21:52:11.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.617+0000 7fab73fff700 1 -- 172.21.15.73:0/803539213 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fab7c003800 con 0x7fab8c0c80f0 2024-05-08T21:52:11.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.617+0000 7fab73fff700 1 --2- 172.21.15.73:0/803539213 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fab7806acc0 0x7fab7806d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:11.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.617+0000 7fab73fff700 1 -- 172.21.15.73:0/803539213 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5969+0+0 (secure 0 0 0) 0x7fab7c0896d0 con 0x7fab8c0c80f0 2024-05-08T21:52:11.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.617+0000 7fab8b7fe700 1 --2- 172.21.15.73:0/803539213 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fab7806acc0 0x7fab7806d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:11.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.618+0000 7fab8b7fe700 1 --2- 172.21.15.73:0/803539213 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fab7806acc0 0x7fab7806d180 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fab80006fd0 tx=0x7fab80008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:52:11.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.622+0000 7fab73fff700 1 -- 172.21.15.73:0/803539213 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fab8c1f06e0 con 0x7fab8c0c80f0 2024-05-08T21:52:11.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.860+0000 7fab920db700 1 -- 172.21.15.73:0/803539213 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fab8c067a20 con 0x7fab8c0c80f0 2024-05-08T21:52:11.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.860+0000 7fab73fff700 1 -- 172.21.15.73:0/803539213 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+5501 (secure 0 0 0) 0x7fab7c058240 con 0x7fab8c0c80f0 2024-05-08T21:52:11.861 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:52:11.861 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3242319177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6833","nonce":3242319177},{"type":"v1","addr":"172.21.15.115:6835","nonce":3242319177}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6834/2136341349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2136341349},{"type":"v1","addr":"172.21.15.115:6834","nonce":2136341349}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4249,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1439647913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1439647913},{"type":"v1","addr":"172.21.15.115:6837","nonce":1439647913}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/2386382396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2386382396},{"type":"v1","addr":"172.21.15.73:6836","nonce":2386382396}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:49:43.747162+0000","modified":"2024-05-08T21:52:11.261538+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":24,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":9,"state":"up:reconnect","state_seq":40,"addr":"172.21.15.73:6837/1772457954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":1772457954},{"type":"v1","addr":"172.21.15.73:6837","nonce":1772457954}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:52:11.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.862+0000 7fab920db700 1 -- 172.21.15.73:0/803539213 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fab7806acc0 msgr2=0x7fab7806d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:11.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.862+0000 7fab920db700 1 --2- 172.21.15.73:0/803539213 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fab7806acc0 0x7fab7806d180 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fab80006fd0 tx=0x7fab80008040 comp rx=0 tx=0).stop 2024-05-08T21:52:11.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.862+0000 7fab920db700 1 -- 172.21.15.73:0/803539213 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab8c0c80f0 msgr2=0x7fab8c1e5ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:11.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.862+0000 7fab920db700 1 --2- 172.21.15.73:0/803539213 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab8c0c80f0 0x7fab8c1e5ff0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fab7c00c7c0 tx=0x7fab7c00cb80 comp rx=0 tx=0).stop 2024-05-08T21:52:11.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.862+0000 7fab920db700 1 -- 172.21.15.73:0/803539213 shutdown_connections 2024-05-08T21:52:11.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.862+0000 7fab920db700 1 --2- 172.21.15.73:0/803539213 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fab7806acc0 0x7fab7806d180 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:11.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.862+0000 7fab920db700 1 --2- 172.21.15.73:0/803539213 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab8c154160 0x7fab8c1e6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:11.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.862+0000 7fab920db700 1 --2- 172.21.15.73:0/803539213 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab8c071100 0x7fab8c14f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:11.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.862+0000 7fab920db700 1 --2- 172.21.15.73:0/803539213 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab8c0c80f0 0x7fab8c1e5ff0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:11.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.862+0000 7fab920db700 1 -- 172.21.15.73:0/803539213 >> 172.21.15.73:0/803539213 conn(0x7fab8c0cba80 msgr2=0x7fab8c0c9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:52:11.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.863+0000 7fab920db700 1 -- 172.21.15.73:0/803539213 shutdown_connections 2024-05-08T21:52:11.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:11.863+0000 7fab920db700 1 -- 172.21.15.73:0/803539213 wait complete. 2024-05-08T21:52:11.865 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 10 2024-05-08T21:52:11.880 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-05-08T21:52:13.881 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:52:14.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.018+0000 7f6580147700 1 Processor -- start 2024-05-08T21:52:14.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.018+0000 7f6580147700 1 -- start start 2024-05-08T21:52:14.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.019+0000 7f6580147700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f65781576e0 0x7f65780cd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:14.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.019+0000 7f6580147700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f657815ac10 0x7f65780cda20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:14.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.019+0000 7f6580147700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65780c8900 con 0x7f65780c7f50 2024-05-08T21:52:14.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.019+0000 7f6580147700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65780c8ea0 con 0x7f657815ac10 2024-05-08T21:52:14.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.019+0000 7f6580147700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f657806fc60 con 0x7f65781576e0 2024-05-08T21:52:14.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.019+0000 7f657d6e2700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f65780c7f50 0x7f657815a500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47382/0 (socket says 172.21.15.73:47382) 2024-05-08T21:52:14.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.019+0000 7f657d6e2700 1 -- 172.21.15.73:0/1469315781 learned_addr learned my addr 172.21.15.73:0/1469315781 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:52:14.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.020+0000 7f657e6e4700 1 --2- 172.21.15.73:0/1469315781 >> v2:172.21.15.115:3300/0 conn(0x7f657815ac10 0x7f65780cda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:14.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.020+0000 7f657cee1700 1 -- 172.21.15.73:0/1469315781 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 291901206 0 0) 0x7f65780c8900 con 0x7f65780c7f50 2024-05-08T21:52:14.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.020+0000 7f657dee3700 1 --2- 172.21.15.73:0/1469315781 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f65781576e0 0x7f65780cd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:14.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.020+0000 7f657cee1700 1 -- 172.21.15.73:0/1469315781 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65640035b0 con 0x7f65780c7f50 2024-05-08T21:52:14.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.020+0000 7f657cee1700 1 -- 172.21.15.73:0/1469315781 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2638814285 0 0) 0x7f65640035b0 con 0x7f65780c7f50 2024-05-08T21:52:14.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.020+0000 7f657cee1700 1 -- 172.21.15.73:0/1469315781 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f65781576e0 msgr2=0x7f65780cd4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:52:14.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.020+0000 7f657cee1700 1 --2- 172.21.15.73:0/1469315781 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f65781576e0 0x7f65780cd4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:14.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.020+0000 7f657cee1700 1 -- 172.21.15.73:0/1469315781 >> v2:172.21.15.115:3300/0 conn(0x7f657815ac10 msgr2=0x7f65780cda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:52:14.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.020+0000 7f657cee1700 1 --2- 172.21.15.73:0/1469315781 >> v2:172.21.15.115:3300/0 conn(0x7f657815ac10 0x7f65780cda20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:14.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.020+0000 7f657cee1700 1 -- 172.21.15.73:0/1469315781 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65780c8bc0 con 0x7f65780c7f50 2024-05-08T21:52:14.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.020+0000 7f657cee1700 1 -- 172.21.15.73:0/1469315781 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 953298616 0 0) 0x7f6574001670 con 0x7f65780c7f50 2024-05-08T21:52:14.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.020+0000 7f657cee1700 1 -- 172.21.15.73:0/1469315781 >> v1:172.21.15.73:6789/0 conn(0x7f65780c7f50 legacy=0x7f657815a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:14.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.020+0000 7f657cee1700 1 --2- 172.21.15.73:0/1469315781 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f65781576e0 0x7f6564003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:14.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.020+0000 7f657cee1700 1 --2- 172.21.15.73:0/1469315781 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6564003f80 0x7f6564004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:14.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.020+0000 7f657cee1700 1 --2- 172.21.15.73:0/1469315781 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6564004d90 0x7f6564005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:14.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.020+0000 7f657cee1700 1 -- 172.21.15.73:0/1469315781 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65780c8ea0 con 0x7f6564004d90 2024-05-08T21:52:14.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.020+0000 7f657cee1700 1 -- 172.21.15.73:0/1469315781 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f657806fc60 con 0x7f6564003f80 2024-05-08T21:52:14.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.020+0000 7f657cee1700 1 -- 172.21.15.73:0/1469315781 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f656400ba10 con 0x7f65781576e0 2024-05-08T21:52:14.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.020+0000 7f657e6e4700 1 --2- 172.21.15.73:0/1469315781 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6564004d90 0x7f6564005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:14.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.020+0000 7f657d6e2700 1 --2- 172.21.15.73:0/1469315781 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6564003f80 0x7f6564004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:14.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.020+0000 7f657dee3700 1 --2- 172.21.15.73:0/1469315781 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f65781576e0 0x7f6564003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:14.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.020+0000 7f657e6e4700 1 -- 172.21.15.73:0/1469315781 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f65781576e0 msgr2=0x7f6564003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:52:14.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.020+0000 7f657e6e4700 1 --2- 172.21.15.73:0/1469315781 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f65781576e0 0x7f6564003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:14.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.021+0000 7f657e6e4700 1 -- 172.21.15.73:0/1469315781 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6564003f80 msgr2=0x7f6564004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:52:14.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.021+0000 7f657e6e4700 1 --2- 172.21.15.73:0/1469315781 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6564003f80 0x7f6564004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:14.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.021+0000 7f657e6e4700 1 -- 172.21.15.73:0/1469315781 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65640035b0 con 0x7f6564004d90 2024-05-08T21:52:14.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.021+0000 7f657e6e4700 1 --2- 172.21.15.73:0/1469315781 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6564004d90 0x7f6564005210 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f65780c8780 tx=0x7f6564005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64192b85508d525d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:52:14.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.021+0000 7f657cee1700 1 -- 172.21.15.73:0/1469315781 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f657000eb70 con 0x7f6564004d90 2024-05-08T21:52:14.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.021+0000 7f657cee1700 1 -- 172.21.15.73:0/1469315781 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f657000f040 con 0x7f6564004d90 2024-05-08T21:52:14.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.021+0000 7f657cee1700 1 -- 172.21.15.73:0/1469315781 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6570014480 con 0x7f6564004d90 2024-05-08T21:52:14.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.021+0000 7f6580147700 1 -- 172.21.15.73:0/1469315781 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6564004d90 msgr2=0x7f6564005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:14.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.021+0000 7f6580147700 1 --2- 172.21.15.73:0/1469315781 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6564004d90 0x7f6564005210 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f65780c8780 tx=0x7f6564005880 comp rx=0 tx=0).stop 2024-05-08T21:52:14.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.021+0000 7f657e6e4700 1 -- 172.21.15.73:0/1469315781 reap_dead start 2024-05-08T21:52:14.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.021+0000 7f6580147700 1 -- 172.21.15.73:0/1469315781 shutdown_connections 2024-05-08T21:52:14.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.021+0000 7f6580147700 1 -- 172.21.15.73:0/1469315781 >> 172.21.15.73:0/1469315781 conn(0x7f657806ae10 msgr2=0x7f65780666c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:52:14.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.021+0000 7f6580147700 1 -- 172.21.15.73:0/1469315781 shutdown_connections 2024-05-08T21:52:14.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.021+0000 7f6580147700 1 -- 172.21.15.73:0/1469315781 wait complete. 2024-05-08T21:52:14.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.023+0000 7f6580147700 1 Processor -- start 2024-05-08T21:52:14.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.023+0000 7f6580147700 1 -- start start 2024-05-08T21:52:14.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.023+0000 7f6580147700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6564004d90 0x7f65781ef2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:14.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.023+0000 7f6580147700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f65781f0730 0x7f65780adf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:14.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.023+0000 7f6580147700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6578152c60 0x7f6578153670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:14.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.023+0000 7f6580147700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65780ae4c0 con 0x7f6578152c60 2024-05-08T21:52:14.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.023+0000 7f6580147700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65781518e0 con 0x7f6564004d90 2024-05-08T21:52:14.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.023+0000 7f6580147700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6578151bc0 con 0x7f65781f0730 2024-05-08T21:52:14.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.023+0000 7f657e6e4700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6578152c60 0x7f6578153670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:14.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.024+0000 7f657e6e4700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6578152c60 0x7f6578153670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42454/0 (socket says 172.21.15.73:42454) 2024-05-08T21:52:14.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.024+0000 7f657e6e4700 1 -- 172.21.15.73:0/1138761991 learned_addr learned my addr 172.21.15.73:0/1138761991 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:52:14.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.024+0000 7f657d6e2700 1 --2- 172.21.15.73:0/1138761991 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f65781f0730 0x7f65780adf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:14.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.024+0000 7f657dee3700 1 --2- 172.21.15.73:0/1138761991 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6564004d90 0x7f65781ef2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:14.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.024+0000 7f657e6e4700 1 -- 172.21.15.73:0/1138761991 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f65781f0730 msgr2=0x7f65780adf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:14.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.024+0000 7f657e6e4700 1 --2- 172.21.15.73:0/1138761991 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f65781f0730 0x7f65780adf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:14.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.024+0000 7f657e6e4700 1 -- 172.21.15.73:0/1138761991 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6564004d90 msgr2=0x7f65781ef2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:14.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.024+0000 7f657e6e4700 1 --2- 172.21.15.73:0/1138761991 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6564004d90 0x7f65781ef2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:14.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.024+0000 7f657e6e4700 1 -- 172.21.15.73:0/1138761991 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6578151ea0 con 0x7f6578152c60 2024-05-08T21:52:14.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.024+0000 7f657e6e4700 1 --2- 172.21.15.73:0/1138761991 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6578152c60 0x7f6578153670 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6570016040 tx=0x7f6570009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:52:14.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.024+0000 7f656e7fc700 1 -- 172.21.15.73:0/1138761991 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6570007000 con 0x7f6578152c60 2024-05-08T21:52:14.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.024+0000 7f656e7fc700 1 -- 172.21.15.73:0/1138761991 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6570003e50 con 0x7f6578152c60 2024-05-08T21:52:14.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.024+0000 7f656e7fc700 1 -- 172.21.15.73:0/1138761991 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6570014aa0 con 0x7f6578152c60 2024-05-08T21:52:14.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.024+0000 7f6580147700 1 -- 172.21.15.73:0/1138761991 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6578152180 con 0x7f6578152c60 2024-05-08T21:52:14.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.024+0000 7f6580147700 1 -- 172.21.15.73:0/1138761991 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6578152740 con 0x7f6578152c60 2024-05-08T21:52:14.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.025+0000 7f6580147700 1 -- 172.21.15.73:0/1138761991 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6578068b80 con 0x7f6578152c60 2024-05-08T21:52:14.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.026+0000 7f656e7fc700 1 -- 172.21.15.73:0/1138761991 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6570024070 con 0x7f6578152c60 2024-05-08T21:52:14.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.026+0000 7f656e7fc700 1 --2- 172.21.15.73:0/1138761991 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f655c06ac90 0x7f655c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:14.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.026+0000 7f656e7fc700 1 -- 172.21.15.73:0/1138761991 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5969+0+0 (secure 0 0 0) 0x7f657008af80 con 0x7f6578152c60 2024-05-08T21:52:14.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.026+0000 7f657dee3700 1 --2- 172.21.15.73:0/1138761991 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f655c06ac90 0x7f655c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:14.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.026+0000 7f657dee3700 1 --2- 172.21.15.73:0/1138761991 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f655c06ac90 0x7f655c06d150 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6568009c60 tx=0x7f6568009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:52:14.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.030+0000 7f656e7fc700 1 -- 172.21.15.73:0/1138761991 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f6570056200 con 0x7f6578152c60 2024-05-08T21:52:14.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.272+0000 7f6580147700 1 -- 172.21.15.73:0/1138761991 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f657806fe80 con 0x7f6578152c60 2024-05-08T21:52:14.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.273+0000 7f656e7fc700 1 -- 172.21.15.73:0/1138761991 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+5501 (secure 0 0 0) 0x7f6570059820 con 0x7f6578152c60 2024-05-08T21:52:14.275 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:52:14.275 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3242319177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6833","nonce":3242319177},{"type":"v1","addr":"172.21.15.115:6835","nonce":3242319177}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6834/2136341349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2136341349},{"type":"v1","addr":"172.21.15.115:6834","nonce":2136341349}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4249,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1439647913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1439647913},{"type":"v1","addr":"172.21.15.115:6837","nonce":1439647913}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/2386382396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2386382396},{"type":"v1","addr":"172.21.15.73:6836","nonce":2386382396}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:49:43.747162+0000","modified":"2024-05-08T21:52:11.261538+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":24,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":9,"state":"up:reconnect","state_seq":40,"addr":"172.21.15.73:6837/1772457954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":1772457954},{"type":"v1","addr":"172.21.15.73:6837","nonce":1772457954}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:52:14.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.276+0000 7f6580147700 1 -- 172.21.15.73:0/1138761991 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f655c06ac90 msgr2=0x7f655c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:14.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.276+0000 7f6580147700 1 --2- 172.21.15.73:0/1138761991 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f655c06ac90 0x7f655c06d150 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6568009c60 tx=0x7f6568009210 comp rx=0 tx=0).stop 2024-05-08T21:52:14.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.276+0000 7f6580147700 1 -- 172.21.15.73:0/1138761991 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6578152c60 msgr2=0x7f6578153670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:14.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.276+0000 7f6580147700 1 --2- 172.21.15.73:0/1138761991 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6578152c60 0x7f6578153670 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6570016040 tx=0x7f6570009750 comp rx=0 tx=0).stop 2024-05-08T21:52:14.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.276+0000 7f6580147700 1 -- 172.21.15.73:0/1138761991 shutdown_connections 2024-05-08T21:52:14.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.276+0000 7f6580147700 1 --2- 172.21.15.73:0/1138761991 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f655c06ac90 0x7f655c06d150 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:14.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.276+0000 7f6580147700 1 --2- 172.21.15.73:0/1138761991 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6578152c60 0x7f6578153670 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:14.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.276+0000 7f6580147700 1 --2- 172.21.15.73:0/1138761991 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6564004d90 0x7f65781ef2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:14.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.276+0000 7f6580147700 1 --2- 172.21.15.73:0/1138761991 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f65781f0730 0x7f65780adf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:14.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.276+0000 7f6580147700 1 -- 172.21.15.73:0/1138761991 >> 172.21.15.73:0/1138761991 conn(0x7f657806ae10 msgr2=0x7f6578154f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:52:14.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.276+0000 7f6580147700 1 -- 172.21.15.73:0/1138761991 shutdown_connections 2024-05-08T21:52:14.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:14.276+0000 7f6580147700 1 -- 172.21.15.73:0/1138761991 wait complete. 2024-05-08T21:52:14.280 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 10 2024-05-08T21:52:14.290 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-05-08T21:52:16.291 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:52:16.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.433+0000 7f4fa4586700 1 Processor -- start 2024-05-08T21:52:16.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.433+0000 7f4fa4586700 1 -- start start 2024-05-08T21:52:16.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.434+0000 7f4fa4586700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4f9c153d20 0x7f4f9c15d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:16.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.434+0000 7f4fa4586700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4f9c06f700 0x7f4f9c0c8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:16.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.434+0000 7f4fa4586700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f9c0c77e0 con 0x7f4f9c0c6510 2024-05-08T21:52:16.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.434+0000 7f4fa4586700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f9c0c7da0 con 0x7f4f9c153d20 2024-05-08T21:52:16.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.434+0000 7f4fa4586700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9c06fc50 con 0x7f4f9c06f700 2024-05-08T21:52:16.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.434+0000 7f4fa2322700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4f9c153d20 0x7f4f9c15d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:16.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.434+0000 7f4fa2b23700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f4f9c0c6510 0x7f4f9c06a9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47388/0 (socket says 172.21.15.73:47388) 2024-05-08T21:52:16.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.434+0000 7f4fa2b23700 1 -- 172.21.15.73:0/1390219568 learned_addr learned my addr 172.21.15.73:0/1390219568 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:52:16.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.435+0000 7f4fa1b21700 1 --2- 172.21.15.73:0/1390219568 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4f9c06f700 0x7f4f9c0c8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:16.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.435+0000 7f4fa2322700 1 -- 172.21.15.73:0/1390219568 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4f9c06f700 msgr2=0x7f4f9c0c8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:52:16.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.435+0000 7f4fa2322700 1 --2- 172.21.15.73:0/1390219568 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4f9c06f700 0x7f4f9c0c8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:16.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.435+0000 7f4fa2322700 1 -- 172.21.15.73:0/1390219568 >> v1:172.21.15.73:6789/0 conn(0x7f4f9c0c6510 legacy=0x7f4f9c06a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:16.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.435+0000 7f4fa2322700 1 -- 172.21.15.73:0/1390219568 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f9c06ff30 con 0x7f4f9c153d20 2024-05-08T21:52:16.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.435+0000 7f4fa1320700 1 -- 172.21.15.73:0/1390219568 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2798394497 0 0) 0x7f4f9c0c77e0 con 0x7f4f9c0c6510 2024-05-08T21:52:16.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.435+0000 7f4fa2322700 1 --2- 172.21.15.73:0/1390219568 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4f9c153d20 0x7f4f9c15d160 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c009840 tx=0x7f4f8c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37025ce99c3b13b8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:52:16.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.435+0000 7f4fa1320700 1 -- 172.21.15.73:0/1390219568 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c011830 con 0x7f4f9c153d20 2024-05-08T21:52:16.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.435+0000 7f4fa1320700 1 -- 172.21.15.73:0/1390219568 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f8c011990 con 0x7f4f9c153d20 2024-05-08T21:52:16.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.435+0000 7f4fa1320700 1 -- 172.21.15.73:0/1390219568 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c011d20 con 0x7f4f9c153d20 2024-05-08T21:52:16.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.436+0000 7f4fa4586700 1 -- 172.21.15.73:0/1390219568 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4f9c153d20 msgr2=0x7f4f9c15d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:16.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.436+0000 7f4fa4586700 1 --2- 172.21.15.73:0/1390219568 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4f9c153d20 0x7f4f9c15d160 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c009840 tx=0x7f4f8c009b50 comp rx=0 tx=0).stop 2024-05-08T21:52:16.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.436+0000 7f4fa4586700 1 -- 172.21.15.73:0/1390219568 shutdown_connections 2024-05-08T21:52:16.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.436+0000 7f4fa4586700 1 --2- 172.21.15.73:0/1390219568 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4f9c153d20 0x7f4f9c15d160 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:16.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.436+0000 7f4fa4586700 1 --2- 172.21.15.73:0/1390219568 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4f9c06f700 0x7f4f9c0c8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:16.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.436+0000 7f4fa4586700 1 -- 172.21.15.73:0/1390219568 >> 172.21.15.73:0/1390219568 conn(0x7f4f9c0cc420 msgr2=0x7f4f9c0cc800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:52:16.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.436+0000 7f4fa4586700 1 -- 172.21.15.73:0/1390219568 shutdown_connections 2024-05-08T21:52:16.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.436+0000 7f4fa4586700 1 -- 172.21.15.73:0/1390219568 wait complete. 2024-05-08T21:52:16.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.437+0000 7f4fa4586700 1 Processor -- start 2024-05-08T21:52:16.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.437+0000 7f4fa4586700 1 -- start start 2024-05-08T21:52:16.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.438+0000 7f4fa4586700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4f9c06f700 0x7f4f9c15b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:16.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.438+0000 7f4fa4586700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4f9c0c6510 0x7f4f9c1f35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:16.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.438+0000 7f4fa4586700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f9c153d20 0x7f4f9c14e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:16.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.438+0000 7f4fa4586700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9c157100 con 0x7f4f9c06f700 2024-05-08T21:52:16.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.438+0000 7f4fa4586700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9c15b500 con 0x7f4f9c153d20 2024-05-08T21:52:16.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.438+0000 7f4fa4586700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9c15bed0 con 0x7f4f9c0c6510 2024-05-08T21:52:16.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.438+0000 7f4fa2322700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4f9c06f700 0x7f4f9c15b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:16.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.438+0000 7f4fa2322700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4f9c06f700 0x7f4f9c15b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42474/0 (socket says 172.21.15.73:42474) 2024-05-08T21:52:16.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.438+0000 7f4fa2322700 1 -- 172.21.15.73:0/95405585 learned_addr learned my addr 172.21.15.73:0/95405585 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:52:16.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.438+0000 7f4fa2b23700 1 --2- 172.21.15.73:0/95405585 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f9c153d20 0x7f4f9c14e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:16.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.438+0000 7f4fa1b21700 1 --2- 172.21.15.73:0/95405585 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4f9c0c6510 0x7f4f9c1f35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:16.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.438+0000 7f4fa2322700 1 -- 172.21.15.73:0/95405585 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4f9c0c6510 msgr2=0x7f4f9c1f35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:16.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.438+0000 7f4fa2322700 1 --2- 172.21.15.73:0/95405585 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4f9c0c6510 0x7f4f9c1f35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:16.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.438+0000 7f4fa2322700 1 -- 172.21.15.73:0/95405585 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f9c153d20 msgr2=0x7f4f9c14e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:16.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.438+0000 7f4fa2322700 1 --2- 172.21.15.73:0/95405585 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f9c153d20 0x7f4f9c14e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:16.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.438+0000 7f4fa2322700 1 -- 172.21.15.73:0/95405585 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f8c0094a0 con 0x7f4f9c06f700 2024-05-08T21:52:16.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.438+0000 7f4fa1b21700 1 --2- 172.21.15.73:0/95405585 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4f9c0c6510 0x7f4f9c1f35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:52:16.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.438+0000 7f4fa2b23700 1 --2- 172.21.15.73:0/95405585 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f9c153d20 0x7f4f9c14e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:52:16.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.438+0000 7f4fa2322700 1 --2- 172.21.15.73:0/95405585 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4f9c06f700 0x7f4f9c15b990 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c009b90 tx=0x7f4f8c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:52:16.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.439+0000 7f4f92ffd700 1 -- 172.21.15.73:0/95405585 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c0038a0 con 0x7f4f9c06f700 2024-05-08T21:52:16.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.439+0000 7f4f92ffd700 1 -- 172.21.15.73:0/95405585 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f8c01e070 con 0x7f4f9c06f700 2024-05-08T21:52:16.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.439+0000 7f4fa4586700 1 -- 172.21.15.73:0/95405585 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f9c1f3b00 con 0x7f4f9c06f700 2024-05-08T21:52:16.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.439+0000 7f4f92ffd700 1 -- 172.21.15.73:0/95405585 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c003c00 con 0x7f4f9c06f700 2024-05-08T21:52:16.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.439+0000 7f4fa4586700 1 -- 172.21.15.73:0/95405585 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f9c15cae0 con 0x7f4f9c06f700 2024-05-08T21:52:16.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.440+0000 7f4fa4586700 1 -- 172.21.15.73:0/95405585 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f9c15b7e0 con 0x7f4f9c06f700 2024-05-08T21:52:16.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.440+0000 7f4f92ffd700 1 -- 172.21.15.73:0/95405585 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4f8c01a420 con 0x7f4f9c06f700 2024-05-08T21:52:16.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.440+0000 7f4f92ffd700 1 --2- 172.21.15.73:0/95405585 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f4f8006ac90 0x7f4f8006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:16.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.441+0000 7f4f92ffd700 1 -- 172.21.15.73:0/95405585 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5969+0+0 (secure 0 0 0) 0x7f4f8c08a520 con 0x7f4f9c06f700 2024-05-08T21:52:16.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.441+0000 7f4fa1b21700 1 --2- 172.21.15.73:0/95405585 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f4f8006ac90 0x7f4f8006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:16.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.441+0000 7f4fa1b21700 1 --2- 172.21.15.73:0/95405585 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f4f8006ac90 0x7f4f8006d150 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c1ed2c0 tx=0x7f4f98008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:52:16.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.445+0000 7f4f92ffd700 1 -- 172.21.15.73:0/95405585 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f4f8c055680 con 0x7f4f9c06f700 2024-05-08T21:52:16.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.688+0000 7f4fa4586700 1 -- 172.21.15.73:0/95405585 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4f9c067c30 con 0x7f4f9c06f700 2024-05-08T21:52:16.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.689+0000 7f4f92ffd700 1 -- 172.21.15.73:0/95405585 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+5498 (secure 0 0 0) 0x7f4f8c058ca0 con 0x7f4f9c06f700 2024-05-08T21:52:16.690 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:52:16.690 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":11,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3242319177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6833","nonce":3242319177},{"type":"v1","addr":"172.21.15.115:6835","nonce":3242319177}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6834/2136341349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2136341349},{"type":"v1","addr":"172.21.15.115:6834","nonce":2136341349}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4249,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1439647913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1439647913},{"type":"v1","addr":"172.21.15.115:6837","nonce":1439647913}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/2386382396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2386382396},{"type":"v1","addr":"172.21.15.73:6836","nonce":2386382396}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:49:43.747162+0000","modified":"2024-05-08T21:52:16.279824+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":24,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":9,"state":"up:rejoin","state_seq":42,"addr":"172.21.15.73:6837/1772457954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":1772457954},{"type":"v1","addr":"172.21.15.73:6837","nonce":1772457954}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:52:16.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.691+0000 7f4fa4586700 1 -- 172.21.15.73:0/95405585 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f4f8006ac90 msgr2=0x7f4f8006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:16.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.691+0000 7f4fa4586700 1 --2- 172.21.15.73:0/95405585 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f4f8006ac90 0x7f4f8006d150 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c1ed2c0 tx=0x7f4f98008040 comp rx=0 tx=0).stop 2024-05-08T21:52:16.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.691+0000 7f4fa4586700 1 -- 172.21.15.73:0/95405585 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4f9c06f700 msgr2=0x7f4f9c15b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:16.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.691+0000 7f4fa4586700 1 --2- 172.21.15.73:0/95405585 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4f9c06f700 0x7f4f9c15b990 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c009b90 tx=0x7f4f8c004750 comp rx=0 tx=0).stop 2024-05-08T21:52:16.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.691+0000 7f4fa4586700 1 -- 172.21.15.73:0/95405585 shutdown_connections 2024-05-08T21:52:16.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.691+0000 7f4fa4586700 1 --2- 172.21.15.73:0/95405585 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f4f8006ac90 0x7f4f8006d150 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:16.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.691+0000 7f4fa4586700 1 --2- 172.21.15.73:0/95405585 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f9c153d20 0x7f4f9c14e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:16.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.691+0000 7f4fa4586700 1 --2- 172.21.15.73:0/95405585 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4f9c06f700 0x7f4f9c15b990 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:16.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.691+0000 7f4fa4586700 1 --2- 172.21.15.73:0/95405585 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4f9c0c6510 0x7f4f9c1f35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:16.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.691+0000 7f4fa4586700 1 -- 172.21.15.73:0/95405585 >> 172.21.15.73:0/95405585 conn(0x7f4f9c0cc420 msgr2=0x7f4f9c0c8e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:52:16.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.691+0000 7f4fa4586700 1 -- 172.21.15.73:0/95405585 shutdown_connections 2024-05-08T21:52:16.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:16.691+0000 7f4fa4586700 1 -- 172.21.15.73:0/95405585 wait complete. 2024-05-08T21:52:16.693 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 11 2024-05-08T21:52:16.704 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-05-08T21:52:18.705 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:52:18.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:18.838+0000 7f7ddc116700 1 Processor -- start 2024-05-08T21:52:18.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:18.838+0000 7f7ddc116700 1 -- start start 2024-05-08T21:52:18.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:18.839+0000 7f7ddc116700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7dd40c3c40 0x7f7dd40c6c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:18.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:18.839+0000 7f7ddc116700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7dd40c8a30 0x7f7dd406e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:18.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:18.839+0000 7f7ddc116700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dd4150580 con 0x7f7dd41501a0 2024-05-08T21:52:18.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:18.839+0000 7f7ddc116700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dd40c30a0 con 0x7f7dd40c3c40 2024-05-08T21:52:18.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:18.839+0000 7f7ddc116700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd40c67e0 con 0x7f7dd40c8a30 2024-05-08T21:52:18.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:18.839+0000 7f7dd96b1700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7dd40c3c40 0x7f7dd40c6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:18.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:18.839+0000 7f7dd96b1700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7dd40c3c40 0x7f7dd40c6c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53986/0 (socket says 172.21.15.73:53986) 2024-05-08T21:52:18.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:18.839+0000 7f7dd96b1700 1 -- 172.21.15.73:0/1116009084 learned_addr learned my addr 172.21.15.73:0/1116009084 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:52:18.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:18.839+0000 7f7dda6b3700 1 --2- 172.21.15.73:0/1116009084 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7dd40c8a30 0x7f7dd406e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:18.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:18.840+0000 7f7dd96b1700 1 -- 172.21.15.73:0/1116009084 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7dd40c8a30 msgr2=0x7f7dd406e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:52:18.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:18.840+0000 7f7dd96b1700 1 --2- 172.21.15.73:0/1116009084 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7dd40c8a30 0x7f7dd406e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:18.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:18.840+0000 7f7dd96b1700 1 -- 172.21.15.73:0/1116009084 >> v1:172.21.15.115:6789/0 conn(0x7f7dd41501a0 legacy=0x7f7dd4156ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:52:18.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:18.840+0000 7f7dd96b1700 1 -- 172.21.15.73:0/1116009084 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd40c71b0 con 0x7f7dd40c3c40 2024-05-08T21:52:18.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:18.840+0000 7f7dda6b3700 1 --2- 172.21.15.73:0/1116009084 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7dd40c8a30 0x7f7dd406e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:52:18.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:18.840+0000 7f7dd96b1700 1 --2- 172.21.15.73:0/1116009084 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7dd40c3c40 0x7f7dd40c6c70 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7dc400bb90 tx=0x7f7dc400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=223f69dfd9829f88 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:52:18.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:18.840+0000 7f7dd8eb0700 1 -- 172.21.15.73:0/1116009084 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc400dd10 con 0x7f7dd40c3c40 2024-05-08T21:52:18.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:18.840+0000 7f7dd8eb0700 1 -- 172.21.15.73:0/1116009084 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc400de70 con 0x7f7dd40c3c40 2024-05-08T21:52:18.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:18.840+0000 7f7dd8eb0700 1 -- 172.21.15.73:0/1116009084 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc4004230 con 0x7f7dd40c3c40 2024-05-08T21:52:18.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:18.840+0000 7f7ddc116700 1 -- 172.21.15.73:0/1116009084 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7dd40c3c40 msgr2=0x7f7dd40c6c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:18.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:18.840+0000 7f7ddc116700 1 --2- 172.21.15.73:0/1116009084 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7dd40c3c40 0x7f7dd40c6c70 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7dc400bb90 tx=0x7f7dc400bea0 comp rx=0 tx=0).stop 2024-05-08T21:52:18.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:18.840+0000 7f7ddc116700 1 -- 172.21.15.73:0/1116009084 shutdown_connections 2024-05-08T21:52:18.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:18.840+0000 7f7ddc116700 1 --2- 172.21.15.73:0/1116009084 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7dd40c8a30 0x7f7dd406e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:18.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:18.840+0000 7f7ddc116700 1 --2- 172.21.15.73:0/1116009084 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7dd40c3c40 0x7f7dd40c6c70 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:18.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:18.840+0000 7f7ddc116700 1 -- 172.21.15.73:0/1116009084 >> 172.21.15.73:0/1116009084 conn(0x7f7dd406ce80 msgr2=0x7f7dd406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:52:18.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:18.841+0000 7f7ddc116700 1 -- 172.21.15.73:0/1116009084 shutdown_connections 2024-05-08T21:52:18.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:18.841+0000 7f7ddc116700 1 -- 172.21.15.73:0/1116009084 wait complete. 2024-05-08T21:52:18.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:18.842+0000 7f7ddc116700 1 Processor -- start 2024-05-08T21:52:18.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:18.842+0000 7f7ddc116700 1 -- start start 2024-05-08T21:52:18.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:18.843+0000 7f7ddc116700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7dd40c3c40 0x7f7dd41ef620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:18.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:18.843+0000 7f7ddc116700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7dd40c8a30 0x7f7dd413d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:18.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:18.843+0000 7f7ddc116700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7dd41501a0 0x7f7dd41dd800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:18.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:18.843+0000 7f7ddc116700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd41eb6f0 con 0x7f7dd41501a0 2024-05-08T21:52:18.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:18.843+0000 7f7ddc116700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd40cc130 con 0x7f7dd40c8a30 2024-05-08T21:52:18.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:18.843+0000 7f7ddc116700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd41efb60 con 0x7f7dd40c3c40 2024-05-08T21:52:18.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:18.843+0000 7f7dda6b3700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7dd41501a0 0x7f7dd41dd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:18.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:18.843+0000 7f7dda6b3700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7dd41501a0 0x7f7dd41dd800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53996/0 (socket says 172.21.15.73:53996) 2024-05-08T21:52:18.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:18.843+0000 7f7dda6b3700 1 -- 172.21.15.73:0/1429224915 learned_addr learned my addr 172.21.15.73:0/1429224915 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:52:18.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:18.843+0000 7f7dd9eb2700 1 --2- 172.21.15.73:0/1429224915 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7dd40c3c40 0x7f7dd41ef620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:18.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:18.843+0000 7f7dd96b1700 1 --2- 172.21.15.73:0/1429224915 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7dd40c8a30 0x7f7dd413d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:18.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:18.843+0000 7f7dda6b3700 1 -- 172.21.15.73:0/1429224915 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7dd40c3c40 msgr2=0x7f7dd41ef620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:18.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:18.843+0000 7f7dda6b3700 1 --2- 172.21.15.73:0/1429224915 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7dd40c3c40 0x7f7dd41ef620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:18.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:18.843+0000 7f7dda6b3700 1 -- 172.21.15.73:0/1429224915 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7dd40c8a30 msgr2=0x7f7dd413d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:18.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:18.843+0000 7f7dda6b3700 1 --2- 172.21.15.73:0/1429224915 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7dd40c8a30 0x7f7dd413d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:18.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:18.843+0000 7f7dda6b3700 1 -- 172.21.15.73:0/1429224915 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc400b7f0 con 0x7f7dd41501a0 2024-05-08T21:52:18.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:18.843+0000 7f7dd9eb2700 1 --2- 172.21.15.73:0/1429224915 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7dd40c3c40 0x7f7dd41ef620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:52:18.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:18.843+0000 7f7dd96b1700 1 --2- 172.21.15.73:0/1429224915 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7dd40c8a30 0x7f7dd413d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:52:18.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:18.844+0000 7f7dda6b3700 1 --2- 172.21.15.73:0/1429224915 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7dd41501a0 0x7f7dd41dd800 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc00cef0 tx=0x7f7dcc00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:52:18.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:18.844+0000 7f7dca7fc700 1 -- 172.21.15.73:0/1429224915 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc00ae50 con 0x7f7dd41501a0 2024-05-08T21:52:18.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:18.844+0000 7f7dca7fc700 1 -- 172.21.15.73:0/1429224915 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dcc015440 con 0x7f7dd41501a0 2024-05-08T21:52:18.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:18.844+0000 7f7ddc116700 1 -- 172.21.15.73:0/1429224915 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dd40cb5f0 con 0x7f7dd41501a0 2024-05-08T21:52:18.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:18.844+0000 7f7dca7fc700 1 -- 172.21.15.73:0/1429224915 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc0157f0 con 0x7f7dd41501a0 2024-05-08T21:52:18.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:18.844+0000 7f7ddc116700 1 -- 172.21.15.73:0/1429224915 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dd40cbb70 con 0x7f7dd41501a0 2024-05-08T21:52:18.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:18.845+0000 7f7ddc116700 1 -- 172.21.15.73:0/1429224915 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dd406dae0 con 0x7f7dd41501a0 2024-05-08T21:52:18.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:18.846+0000 7f7dca7fc700 1 -- 172.21.15.73:0/1429224915 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7dcc00d430 con 0x7f7dd41501a0 2024-05-08T21:52:18.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:18.846+0000 7f7dca7fc700 1 --2- 172.21.15.73:0/1429224915 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f7db806ac90 0x7f7db806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:18.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:18.846+0000 7f7dca7fc700 1 -- 172.21.15.73:0/1429224915 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5969+0+0 (secure 0 0 0) 0x7f7dcc089e50 con 0x7f7dd41501a0 2024-05-08T21:52:18.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:18.846+0000 7f7dd9eb2700 1 --2- 172.21.15.73:0/1429224915 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f7db806ac90 0x7f7db806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:18.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:18.846+0000 7f7dd9eb2700 1 --2- 172.21.15.73:0/1429224915 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f7db806ac90 0x7f7db806d150 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7dd0009930 tx=0x7f7dd0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:52:18.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:18.850+0000 7f7dca7fc700 1 -- 172.21.15.73:0/1429224915 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f7dcc055000 con 0x7f7dd41501a0 2024-05-08T21:52:19.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:19.090+0000 7f7ddc116700 1 -- 172.21.15.73:0/1429224915 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7dd4067a20 con 0x7f7dd41501a0 2024-05-08T21:52:19.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:19.091+0000 7f7dca7fc700 1 -- 172.21.15.73:0/1429224915 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+5498 (secure 0 0 0) 0x7f7dcc01a020 con 0x7f7dd41501a0 2024-05-08T21:52:19.092 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:52:19.092 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":11,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3242319177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6833","nonce":3242319177},{"type":"v1","addr":"172.21.15.115:6835","nonce":3242319177}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6834/2136341349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2136341349},{"type":"v1","addr":"172.21.15.115:6834","nonce":2136341349}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4249,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1439647913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1439647913},{"type":"v1","addr":"172.21.15.115:6837","nonce":1439647913}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/2386382396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2386382396},{"type":"v1","addr":"172.21.15.73:6836","nonce":2386382396}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:49:43.747162+0000","modified":"2024-05-08T21:52:16.279824+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":24,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":9,"state":"up:rejoin","state_seq":42,"addr":"172.21.15.73:6837/1772457954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":1772457954},{"type":"v1","addr":"172.21.15.73:6837","nonce":1772457954}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:52:19.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:19.093+0000 7f7ddc116700 1 -- 172.21.15.73:0/1429224915 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f7db806ac90 msgr2=0x7f7db806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:19.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:19.093+0000 7f7ddc116700 1 --2- 172.21.15.73:0/1429224915 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f7db806ac90 0x7f7db806d150 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7dd0009930 tx=0x7f7dd0008040 comp rx=0 tx=0).stop 2024-05-08T21:52:19.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:19.093+0000 7f7ddc116700 1 -- 172.21.15.73:0/1429224915 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7dd41501a0 msgr2=0x7f7dd41dd800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:19.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:19.093+0000 7f7ddc116700 1 --2- 172.21.15.73:0/1429224915 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7dd41501a0 0x7f7dd41dd800 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc00cef0 tx=0x7f7dcc00a340 comp rx=0 tx=0).stop 2024-05-08T21:52:19.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:19.093+0000 7f7ddc116700 1 -- 172.21.15.73:0/1429224915 shutdown_connections 2024-05-08T21:52:19.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:19.093+0000 7f7ddc116700 1 --2- 172.21.15.73:0/1429224915 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f7db806ac90 0x7f7db806d150 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:19.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:19.093+0000 7f7ddc116700 1 --2- 172.21.15.73:0/1429224915 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7dd41501a0 0x7f7dd41dd800 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:19.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:19.093+0000 7f7ddc116700 1 --2- 172.21.15.73:0/1429224915 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7dd40c3c40 0x7f7dd41ef620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:19.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:19.093+0000 7f7ddc116700 1 --2- 172.21.15.73:0/1429224915 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7dd40c8a30 0x7f7dd413d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:19.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:19.093+0000 7f7ddc116700 1 -- 172.21.15.73:0/1429224915 >> 172.21.15.73:0/1429224915 conn(0x7f7dd406ce80 msgr2=0x7f7dd41452d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:52:19.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:19.093+0000 7f7ddc116700 1 -- 172.21.15.73:0/1429224915 shutdown_connections 2024-05-08T21:52:19.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:19.093+0000 7f7ddc116700 1 -- 172.21.15.73:0/1429224915 wait complete. 2024-05-08T21:52:19.095 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 11 2024-05-08T21:52:19.107 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 11, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-05-08T21:49:43.747162+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 11, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_4272": { "addr": "172.21.15.73:6837/1772457954", "addrs": { "addrvec": [ { "addr": "172.21.15.73:6835", "nonce": 1772457954, "type": "v2" }, { "addr": "172.21.15.73:6837", "nonce": 1772457954, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4272, "incarnation": 9, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:rejoin", "state_seq": 42 } }, "last_failure": 0, "last_failure_osd_epoch": 24, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-05-08T21:52:16.279824+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4272 } } } ], "standbys": [ { "addr": "172.21.15.115:6835/3242319177", "addrs": { "addrvec": [ { "addr": "172.21.15.115:6833", "nonce": 3242319177, "type": "v2" }, { "addr": "172.21.15.115:6835", "nonce": 3242319177, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4241, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.115:6834/2136341349", "addrs": { "addrvec": [ { "addr": "172.21.15.115:6832", "nonce": 2136341349, "type": "v2" }, { "addr": "172.21.15.115:6834", "nonce": 2136341349, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4243, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.115:6837/1439647913", "addrs": { "addrvec": [ { "addr": "172.21.15.115:6836", "nonce": 1439647913, "type": "v2" }, { "addr": "172.21.15.115:6837", "nonce": 1439647913, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4249, "incarnation": 0, "join_fscid": -1, "name": "f", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.73:6836/2386382396", "addrs": { "addrvec": [ { "addr": "172.21.15.73:6834", "nonce": 2386382396, "type": "v2" }, { "addr": "172.21.15.73:6836", "nonce": 2386382396, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4263, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-05-08T21:52:20.321 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:52:20.324 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:52:21.108 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:52:21.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.249+0000 7fe7e20cf700 1 Processor -- start 2024-05-08T21:52:21.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.249+0000 7fe7e20cf700 1 -- start start 2024-05-08T21:52:21.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.250+0000 7fe7e20cf700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe7dc157430 0x7fe7dc06f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:21.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.250+0000 7fe7e20cf700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe7dc0cdf40 0x7fe7dc06f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:21.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.250+0000 7fe7e20cf700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7dc06bb70 con 0x7fe7dc0afdd0 2024-05-08T21:52:21.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.250+0000 7fe7e20cf700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7dc06d1e0 con 0x7fe7dc0cdf40 2024-05-08T21:52:21.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.250+0000 7fe7e20cf700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7dc070030 con 0x7fe7dc157430 2024-05-08T21:52:21.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.250+0000 7fe7daffd700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe7dc0cdf40 0x7fe7dc06f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:21.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.250+0000 7fe7daffd700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe7dc0cdf40 0x7fe7dc06f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54000/0 (socket says 172.21.15.73:54000) 2024-05-08T21:52:21.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.250+0000 7fe7daffd700 1 -- 172.21.15.73:0/739796067 learned_addr learned my addr 172.21.15.73:0/739796067 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:52:21.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.250+0000 7fe7db7fe700 1 --2- 172.21.15.73:0/739796067 >> v2:172.21.15.115:3300/0 conn(0x7fe7dc157430 0x7fe7dc06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:21.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.250+0000 7fe7daffd700 1 -- 172.21.15.73:0/739796067 >> v2:172.21.15.115:3300/0 conn(0x7fe7dc157430 msgr2=0x7fe7dc06f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:52:21.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.250+0000 7fe7daffd700 1 --2- 172.21.15.73:0/739796067 >> v2:172.21.15.115:3300/0 conn(0x7fe7dc157430 0x7fe7dc06f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:21.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.250+0000 7fe7daffd700 1 -- 172.21.15.73:0/739796067 >> v1:172.21.15.115:6789/0 conn(0x7fe7dc0afdd0 legacy=0x7fe7dc159ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:52:21.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.250+0000 7fe7daffd700 1 -- 172.21.15.73:0/739796067 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7dc157810 con 0x7fe7dc0cdf40 2024-05-08T21:52:21.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.251+0000 7fe7daffd700 1 --2- 172.21.15.73:0/739796067 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7dc0cdf40 0x7fe7dc06f650 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc06ee30 tx=0x7fe7cc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ce0cc9941aec4ae server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:52:21.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.251+0000 7fe7da7fc700 1 -- 172.21.15.73:0/739796067 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7cc004230 con 0x7fe7dc0cdf40 2024-05-08T21:52:21.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.251+0000 7fe7da7fc700 1 -- 172.21.15.73:0/739796067 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7cc004390 con 0x7fe7dc0cdf40 2024-05-08T21:52:21.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.251+0000 7fe7da7fc700 1 -- 172.21.15.73:0/739796067 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7cc0036a0 con 0x7fe7dc0cdf40 2024-05-08T21:52:21.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.251+0000 7fe7e20cf700 1 -- 172.21.15.73:0/739796067 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7dc0cdf40 msgr2=0x7fe7dc06f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:21.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.251+0000 7fe7e20cf700 1 --2- 172.21.15.73:0/739796067 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7dc0cdf40 0x7fe7dc06f650 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc06ee30 tx=0x7fe7cc009bd0 comp rx=0 tx=0).stop 2024-05-08T21:52:21.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.251+0000 7fe7e20cf700 1 -- 172.21.15.73:0/739796067 shutdown_connections 2024-05-08T21:52:21.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.251+0000 7fe7e20cf700 1 --2- 172.21.15.73:0/739796067 >> v2:172.21.15.115:3300/0 conn(0x7fe7dc157430 0x7fe7dc06f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:21.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.251+0000 7fe7e20cf700 1 --2- 172.21.15.73:0/739796067 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7dc0cdf40 0x7fe7dc06f650 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:21.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.251+0000 7fe7e20cf700 1 -- 172.21.15.73:0/739796067 >> 172.21.15.73:0/739796067 conn(0x7fe7dc06aff0 msgr2=0x7fe7dc0666c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:52:21.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.251+0000 7fe7e20cf700 1 -- 172.21.15.73:0/739796067 shutdown_connections 2024-05-08T21:52:21.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.251+0000 7fe7e20cf700 1 -- 172.21.15.73:0/739796067 wait complete. 2024-05-08T21:52:21.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.253+0000 7fe7e20cf700 1 Processor -- start 2024-05-08T21:52:21.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.253+0000 7fe7e20cf700 1 -- start start 2024-05-08T21:52:21.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.254+0000 7fe7e20cf700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe7dc0afdd0 0x7fe7dc0ccc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:21.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.254+0000 7fe7e20cf700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7dc0cdf40 0x7fe7dc1e4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:21.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.254+0000 7fe7e20cf700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7dc157430 0x7fe7dc1e54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:21.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.254+0000 7fe7e20cf700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7dc0c4550 con 0x7fe7dc157430 2024-05-08T21:52:21.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.254+0000 7fe7e20cf700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7dc0c3630 con 0x7fe7dc0cdf40 2024-05-08T21:52:21.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.254+0000 7fe7e20cf700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7dc0c47a0 con 0x7fe7dc0afdd0 2024-05-08T21:52:21.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.254+0000 7fe7dbfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7dc157430 0x7fe7dc1e54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:21.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.254+0000 7fe7dbfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7dc157430 0x7fe7dc1e54b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54010/0 (socket says 172.21.15.73:54010) 2024-05-08T21:52:21.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.254+0000 7fe7dbfff700 1 -- 172.21.15.73:0/65544331 learned_addr learned my addr 172.21.15.73:0/65544331 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:52:21.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.254+0000 7fe7daffd700 1 --2- 172.21.15.73:0/65544331 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7dc0cdf40 0x7fe7dc1e4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:21.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.254+0000 7fe7db7fe700 1 --2- 172.21.15.73:0/65544331 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe7dc0afdd0 0x7fe7dc0ccc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:21.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.255+0000 7fe7dbfff700 1 -- 172.21.15.73:0/65544331 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe7dc0afdd0 msgr2=0x7fe7dc0ccc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:21.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.255+0000 7fe7dbfff700 1 --2- 172.21.15.73:0/65544331 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe7dc0afdd0 0x7fe7dc0ccc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:21.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.255+0000 7fe7dbfff700 1 -- 172.21.15.73:0/65544331 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7dc0cdf40 msgr2=0x7fe7dc1e4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:21.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.255+0000 7fe7dbfff700 1 --2- 172.21.15.73:0/65544331 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7dc0cdf40 0x7fe7dc1e4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:21.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.255+0000 7fe7dbfff700 1 -- 172.21.15.73:0/65544331 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7cc009550 con 0x7fe7dc157430 2024-05-08T21:52:21.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.255+0000 7fe7dbfff700 1 --2- 172.21.15.73:0/65544331 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7dc157430 0x7fe7dc1e54b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe7d400b990 tx=0x7fe7d400bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:52:21.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.255+0000 7fe7d3fff700 1 -- 172.21.15.73:0/65544331 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d400c9d0 con 0x7fe7dc157430 2024-05-08T21:52:21.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.255+0000 7fe7d3fff700 1 -- 172.21.15.73:0/65544331 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7d400cb30 con 0x7fe7dc157430 2024-05-08T21:52:21.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.255+0000 7fe7e20cf700 1 -- 172.21.15.73:0/65544331 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7dc0cd590 con 0x7fe7dc157430 2024-05-08T21:52:21.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.255+0000 7fe7d3fff700 1 -- 172.21.15.73:0/65544331 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d4014440 con 0x7fe7dc157430 2024-05-08T21:52:21.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.255+0000 7fe7e20cf700 1 -- 172.21.15.73:0/65544331 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7dc1e4a50 con 0x7fe7dc157430 2024-05-08T21:52:21.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.256+0000 7fe7e20cf700 1 -- 172.21.15.73:0/65544331 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7dc1e4c40 con 0x7fe7dc157430 2024-05-08T21:52:21.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.256+0000 7fe7d3fff700 1 -- 172.21.15.73:0/65544331 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe7d4006d50 con 0x7fe7dc157430 2024-05-08T21:52:21.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.257+0000 7fe7d3fff700 1 --2- 172.21.15.73:0/65544331 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fe7bc06ac90 0x7fe7bc06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:21.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.257+0000 7fe7d3fff700 1 -- 172.21.15.73:0/65544331 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5969+0+0 (secure 0 0 0) 0x7fe7d4088e80 con 0x7fe7dc157430 2024-05-08T21:52:21.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.257+0000 7fe7db7fe700 1 --2- 172.21.15.73:0/65544331 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fe7bc06ac90 0x7fe7bc06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:21.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.257+0000 7fe7db7fe700 1 --2- 172.21.15.73:0/65544331 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fe7bc06ac90 0x7fe7bc06d150 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe7c400a990 tx=0x7fe7c4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:52:21.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.261+0000 7fe7d3fff700 1 -- 172.21.15.73:0/65544331 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fe7d4053fe0 con 0x7fe7dc157430 2024-05-08T21:52:21.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.508+0000 7fe7e20cf700 1 -- 172.21.15.73:0/65544331 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe7dc068b80 con 0x7fe7dc157430 2024-05-08T21:52:21.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.508+0000 7fe7d3fff700 1 -- 172.21.15.73:0/65544331 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+5498 (secure 0 0 0) 0x7fe7d4019020 con 0x7fe7dc157430 2024-05-08T21:52:21.509 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:52:21.510 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3242319177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6833","nonce":3242319177},{"type":"v1","addr":"172.21.15.115:6835","nonce":3242319177}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6834/2136341349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2136341349},{"type":"v1","addr":"172.21.15.115:6834","nonce":2136341349}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4249,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1439647913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1439647913},{"type":"v1","addr":"172.21.15.115:6837","nonce":1439647913}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/2386382396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2386382396},{"type":"v1","addr":"172.21.15.73:6836","nonce":2386382396}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:49:43.747162+0000","modified":"2024-05-08T21:52:21.299913+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":24,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":9,"state":"up:active","state_seq":44,"addr":"172.21.15.73:6837/1772457954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":1772457954},{"type":"v1","addr":"172.21.15.73:6837","nonce":1772457954}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:52:21.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.510+0000 7fe7e20cf700 1 -- 172.21.15.73:0/65544331 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fe7bc06ac90 msgr2=0x7fe7bc06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:21.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.510+0000 7fe7e20cf700 1 --2- 172.21.15.73:0/65544331 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fe7bc06ac90 0x7fe7bc06d150 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe7c400a990 tx=0x7fe7c4008040 comp rx=0 tx=0).stop 2024-05-08T21:52:21.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.510+0000 7fe7e20cf700 1 -- 172.21.15.73:0/65544331 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7dc157430 msgr2=0x7fe7dc1e54b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:21.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.510+0000 7fe7e20cf700 1 --2- 172.21.15.73:0/65544331 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7dc157430 0x7fe7dc1e54b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe7d400b990 tx=0x7fe7d400bd50 comp rx=0 tx=0).stop 2024-05-08T21:52:21.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.510+0000 7fe7e20cf700 1 -- 172.21.15.73:0/65544331 shutdown_connections 2024-05-08T21:52:21.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.510+0000 7fe7e20cf700 1 --2- 172.21.15.73:0/65544331 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fe7bc06ac90 0x7fe7bc06d150 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:21.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.510+0000 7fe7e20cf700 1 --2- 172.21.15.73:0/65544331 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7dc157430 0x7fe7dc1e54b0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:21.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.510+0000 7fe7e20cf700 1 --2- 172.21.15.73:0/65544331 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe7dc0afdd0 0x7fe7dc0ccc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:21.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.510+0000 7fe7e20cf700 1 --2- 172.21.15.73:0/65544331 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7dc0cdf40 0x7fe7dc1e4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:21.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.510+0000 7fe7e20cf700 1 -- 172.21.15.73:0/65544331 >> 172.21.15.73:0/65544331 conn(0x7fe7dc06aff0 msgr2=0x7fe7dc0c9630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:52:21.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.510+0000 7fe7e20cf700 1 -- 172.21.15.73:0/65544331 shutdown_connections 2024-05-08T21:52:21.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:21.510+0000 7fe7e20cf700 1 -- 172.21.15.73:0/65544331 wait complete. 2024-05-08T21:52:21.513 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 12 2024-05-08T21:52:21.523 INFO:tasks.mds_thrash.fs.[cephfs]:mds.c has gained rank=0, replacing gid=4275 2024-05-08T21:52:21.524 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 6 secs before reviving mds.e 2024-05-08T21:52:26.320 INFO:tasks.workunit.client.0.smithi073.stderr:+ iozone -c -e -s 1024M -r 16K -t 1 -F f1 -i 0 -i 1 2024-05-08T21:52:26.364 INFO:tasks.workunit.client.0.smithi073.stdout: Iozone: Performance Test of File I/O 2024-05-08T21:52:26.364 INFO:tasks.workunit.client.0.smithi073.stdout: Version $Revision: 3.489 $ 2024-05-08T21:52:26.364 INFO:tasks.workunit.client.0.smithi073.stdout: Compiled for 64 bit mode. 2024-05-08T21:52:26.364 INFO:tasks.workunit.client.0.smithi073.stdout: Build: linux-AMD64 2024-05-08T21:52:26.364 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-05-08T21:52:26.364 INFO:tasks.workunit.client.0.smithi073.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-05-08T21:52:26.364 INFO:tasks.workunit.client.0.smithi073.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-05-08T21:52:26.364 INFO:tasks.workunit.client.0.smithi073.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-05-08T21:52:26.365 INFO:tasks.workunit.client.0.smithi073.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-05-08T21:52:26.365 INFO:tasks.workunit.client.0.smithi073.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-05-08T21:52:26.365 INFO:tasks.workunit.client.0.smithi073.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-05-08T21:52:26.365 INFO:tasks.workunit.client.0.smithi073.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-05-08T21:52:26.365 INFO:tasks.workunit.client.0.smithi073.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-05-08T21:52:26.365 INFO:tasks.workunit.client.0.smithi073.stdout: Alexey Skidanov, Sudhir Kumar. 2024-05-08T21:52:26.365 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-05-08T21:52:26.365 INFO:tasks.workunit.client.0.smithi073.stdout: Run began: Wed May 8 21:52:26 2024 2024-05-08T21:52:26.365 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-05-08T21:52:26.365 INFO:tasks.workunit.client.0.smithi073.stdout: Include close in write timing 2024-05-08T21:52:26.365 INFO:tasks.workunit.client.0.smithi073.stdout: Include fsync in write timing 2024-05-08T21:52:26.365 INFO:tasks.workunit.client.0.smithi073.stdout: File size set to 1048576 kB 2024-05-08T21:52:26.365 INFO:tasks.workunit.client.0.smithi073.stdout: Record Size 16 kB 2024-05-08T21:52:26.366 INFO:tasks.workunit.client.0.smithi073.stdout: Command line used: iozone -c -e -s 1024M -r 16K -t 1 -F f1 -i 0 -i 1 2024-05-08T21:52:26.366 INFO:tasks.workunit.client.0.smithi073.stdout: Output is in kBytes/sec 2024-05-08T21:52:26.366 INFO:tasks.workunit.client.0.smithi073.stdout: Time Resolution = 0.000001 seconds. 2024-05-08T21:52:26.366 INFO:tasks.workunit.client.0.smithi073.stdout: Processor cache size set to 1024 kBytes. 2024-05-08T21:52:26.366 INFO:tasks.workunit.client.0.smithi073.stdout: Processor cache line size set to 32 bytes. 2024-05-08T21:52:26.366 INFO:tasks.workunit.client.0.smithi073.stdout: File stride size set to 17 * record size. 2024-05-08T21:52:26.366 INFO:tasks.workunit.client.0.smithi073.stdout: Throughput test with 1 process 2024-05-08T21:52:26.366 INFO:tasks.workunit.client.0.smithi073.stdout: Each process writes a 1048576 kByte file in 16 kByte records 2024-05-08T21:52:27.397 INFO:tasks.ceph.mds.c.smithi073.stderr:2024-05-08T21:52:27.396+0000 7f0fa4245700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-08T21:52:27.525 INFO:tasks.mds_thrash.fs.[cephfs]:reviving mds.e 2024-05-08T21:52:27.525 INFO:tasks.ceph.mds.e:Restarting daemon 2024-05-08T21:52:27.525 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2024-05-08T21:52:27.528 INFO:tasks.ceph.mds.e:Started 2024-05-08T21:52:27.528 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:52:27.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:27.674+0000 7f9c28cc0700 1 Processor -- start 2024-05-08T21:52:27.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:27.674+0000 7f9c28cc0700 1 -- start start 2024-05-08T21:52:27.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:27.675+0000 7f9c28cc0700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9c24071c20 0x7f9c240b19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:27.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:27.675+0000 7f9c28cc0700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c24066700 con 0x7f9c24071370 2024-05-08T21:52:27.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:27.675+0000 7f9c28cc0700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c240c9880 con 0x7f9c24071750 2024-05-08T21:52:27.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:27.675+0000 7f9c28cc0700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c24066950 con 0x7f9c24071c20 2024-05-08T21:52:27.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:27.675+0000 7f9c2259c700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f9c24071370 0x7f9c2415b3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:53850/0 (socket says 172.21.15.73:53850) 2024-05-08T21:52:27.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:27.675+0000 7f9c2259c700 1 -- 172.21.15.73:0/2233896451 learned_addr learned my addr 172.21.15.73:0/2233896451 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:52:27.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:27.676+0000 7f9c22d9d700 1 --2- 172.21.15.73:0/2233896451 >> v2:172.21.15.115:3300/0 conn(0x7f9c24071c20 0x7f9c240b19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:27.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:27.676+0000 7f9c2159a700 1 -- 172.21.15.73:0/2233896451 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2776414955 0 0) 0x7f9c24066700 con 0x7f9c24071370 2024-05-08T21:52:27.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:27.676+0000 7f9c2159a700 1 -- 172.21.15.73:0/2233896451 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c100035b0 con 0x7f9c24071370 2024-05-08T21:52:27.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:27.676+0000 7f9c22d9d700 1 -- 172.21.15.73:0/2233896451 >> v1:172.21.15.115:6789/0 conn(0x7f9c24071750 legacy=0x7f9c24151a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:27.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:27.676+0000 7f9c22d9d700 1 -- 172.21.15.73:0/2233896451 >> v1:172.21.15.73:6789/0 conn(0x7f9c24071370 legacy=0x7f9c2415b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:27.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:27.676+0000 7f9c22d9d700 1 -- 172.21.15.73:0/2233896451 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c24066c30 con 0x7f9c24071c20 2024-05-08T21:52:27.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:27.676+0000 7f9c22d9d700 1 --2- 172.21.15.73:0/2233896451 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c24071c20 0x7f9c240b19f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c009d90 tx=0x7f9c1c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc01bfb25d9d22d9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:52:27.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:27.733+0000 7f9c2159a700 1 -- 172.21.15.73:0/2233896451 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1c00e070 con 0x7f9c24071c20 2024-05-08T21:52:27.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:27.733+0000 7f9c2159a700 1 -- 172.21.15.73:0/2233896451 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c1c00bb20 con 0x7f9c24071c20 2024-05-08T21:52:27.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:27.733+0000 7f9c2159a700 1 -- 172.21.15.73:0/2233896451 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1c012430 con 0x7f9c24071c20 2024-05-08T21:52:27.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:27.734+0000 7f9c28cc0700 1 -- 172.21.15.73:0/2233896451 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c24071c20 msgr2=0x7f9c240b19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:27.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:27.734+0000 7f9c28cc0700 1 --2- 172.21.15.73:0/2233896451 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c24071c20 0x7f9c240b19f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c009d90 tx=0x7f9c1c00b330 comp rx=0 tx=0).stop 2024-05-08T21:52:27.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:27.734+0000 7f9c28cc0700 1 -- 172.21.15.73:0/2233896451 shutdown_connections 2024-05-08T21:52:27.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:27.734+0000 7f9c28cc0700 1 --2- 172.21.15.73:0/2233896451 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c24071c20 0x7f9c240b19f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:27.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:27.734+0000 7f9c28cc0700 1 -- 172.21.15.73:0/2233896451 >> 172.21.15.73:0/2233896451 conn(0x7f9c240cba80 msgr2=0x7f9c240cbe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:52:27.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:27.734+0000 7f9c28cc0700 1 -- 172.21.15.73:0/2233896451 shutdown_connections 2024-05-08T21:52:27.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:27.734+0000 7f9c28cc0700 1 -- 172.21.15.73:0/2233896451 wait complete. 2024-05-08T21:52:27.736 INFO:tasks.ceph.mds.e.smithi073.stdout:starting mds.e at 2024-05-08T21:52:27.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:27.735+0000 7f9c28cc0700 1 Processor -- start 2024-05-08T21:52:27.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:27.735+0000 7f9c28cc0700 1 -- start start 2024-05-08T21:52:27.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:27.736+0000 7f9c28cc0700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c24071370 0x7f9c24148b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:27.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:27.736+0000 7f9c28cc0700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9c24071750 0x7f9c24150d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:27.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:27.736+0000 7f9c28cc0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c24071c20 0x7f9c241ed7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:27.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:27.736+0000 7f9c28cc0700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c241ed370 con 0x7f9c24071c20 2024-05-08T21:52:27.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:27.736+0000 7f9c28cc0700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c2415aad0 con 0x7f9c24071370 2024-05-08T21:52:27.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:27.736+0000 7f9c28cc0700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c240c2990 con 0x7f9c24071750 2024-05-08T21:52:27.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:27.736+0000 7f9c22d9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c24071c20 0x7f9c241ed7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:27.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:27.736+0000 7f9c22d9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c24071c20 0x7f9c241ed7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54016/0 (socket says 172.21.15.73:54016) 2024-05-08T21:52:27.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:27.736+0000 7f9c21d9b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9c24071750 0x7f9c24150d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:27.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:27.736+0000 7f9c22d9d700 1 -- 172.21.15.73:0/2259459966 learned_addr learned my addr 172.21.15.73:0/2259459966 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:52:27.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:27.736+0000 7f9c2259c700 1 --2- 172.21.15.73:0/2259459966 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c24071370 0x7f9c24148b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:27.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:27.737+0000 7f9c22d9d700 1 -- 172.21.15.73:0/2259459966 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9c24071750 msgr2=0x7f9c24150d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:27.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:27.737+0000 7f9c22d9d700 1 --2- 172.21.15.73:0/2259459966 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9c24071750 0x7f9c24150d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:27.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:27.737+0000 7f9c22d9d700 1 -- 172.21.15.73:0/2259459966 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c24071370 msgr2=0x7f9c24148b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:27.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:27.737+0000 7f9c22d9d700 1 --2- 172.21.15.73:0/2259459966 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c24071370 0x7f9c24148b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:27.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:27.737+0000 7f9c22d9d700 1 -- 172.21.15.73:0/2259459966 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c1c009a70 con 0x7f9c24071c20 2024-05-08T21:52:27.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:27.737+0000 7f9c22d9d700 1 --2- 172.21.15.73:0/2259459966 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c24071c20 0x7f9c241ed7c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c00b680 tx=0x7f9c1c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:52:27.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:27.737+0000 7f9c1affd700 1 -- 172.21.15.73:0/2259459966 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1c012430 con 0x7f9c24071c20 2024-05-08T21:52:27.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:27.737+0000 7f9c1affd700 1 -- 172.21.15.73:0/2259459966 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c1c020070 con 0x7f9c24071c20 2024-05-08T21:52:27.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:27.737+0000 7f9c1affd700 1 -- 172.21.15.73:0/2259459966 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1c004280 con 0x7f9c24071c20 2024-05-08T21:52:27.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:27.737+0000 7f9c28cc0700 1 -- 172.21.15.73:0/2259459966 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c2415ad40 con 0x7f9c24071c20 2024-05-08T21:52:27.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:27.738+0000 7f9c28cc0700 1 -- 172.21.15.73:0/2259459966 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c24158eb0 con 0x7f9c24071c20 2024-05-08T21:52:27.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:27.740+0000 7f9c1affd700 1 -- 172.21.15.73:0/2259459966 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9c1c0043e0 con 0x7f9c24071c20 2024-05-08T21:52:27.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:27.740+0000 7f9c1affd700 1 --2- 172.21.15.73:0/2259459966 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f9c0406acc0 0x7f9c0406d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:27.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:27.740+0000 7f9c1affd700 1 -- 172.21.15.73:0/2259459966 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5969+0+0 (secure 0 0 0) 0x7f9c1c022070 con 0x7f9c24071c20 2024-05-08T21:52:27.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:27.741+0000 7f9c28cc0700 1 -- 172.21.15.73:0/2259459966 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c241ed4e0 con 0x7f9c24071c20 2024-05-08T21:52:27.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:27.741+0000 7f9c2259c700 1 --2- 172.21.15.73:0/2259459966 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f9c0406acc0 0x7f9c0406d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:27.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:27.742+0000 7f9c2259c700 1 --2- 172.21.15.73:0/2259459966 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f9c0406acc0 0x7f9c0406d180 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c007fd0 tx=0x7f9c0c007dc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:52:27.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:27.746+0000 7f9c1affd700 1 -- 172.21.15.73:0/2259459966 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f9c241ed4e0 con 0x7f9c24071c20 2024-05-08T21:52:27.762 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-05-08T21:52:27.763 INFO:tasks.workunit.client.0.smithi073.stdout: Children see throughput for 1 initial writers = 751631.19 kB/sec 2024-05-08T21:52:27.763 INFO:tasks.workunit.client.0.smithi073.stdout: Parent sees throughput for 1 initial writers = 751519.20 kB/sec 2024-05-08T21:52:27.763 INFO:tasks.workunit.client.0.smithi073.stdout: Min throughput per process = 751631.19 kB/sec 2024-05-08T21:52:27.763 INFO:tasks.workunit.client.0.smithi073.stdout: Max throughput per process = 751631.19 kB/sec 2024-05-08T21:52:27.763 INFO:tasks.workunit.client.0.smithi073.stdout: Avg throughput per process = 751631.19 kB/sec 2024-05-08T21:52:27.763 INFO:tasks.workunit.client.0.smithi073.stdout: Min xfer = 1048576.00 kB 2024-05-08T21:52:27.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:27.998+0000 7f9c28cc0700 1 -- 172.21.15.73:0/2259459966 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9c241ed4e0 con 0x7f9c24071c20 2024-05-08T21:52:28.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:27.999+0000 7f9c1affd700 1 -- 172.21.15.73:0/2259459966 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+5498 (secure 0 0 0) 0x7f9c241ed4e0 con 0x7f9c24071c20 2024-05-08T21:52:28.000 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:52:28.000 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3242319177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6833","nonce":3242319177},{"type":"v1","addr":"172.21.15.115:6835","nonce":3242319177}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6834/2136341349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2136341349},{"type":"v1","addr":"172.21.15.115:6834","nonce":2136341349}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4249,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1439647913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1439647913},{"type":"v1","addr":"172.21.15.115:6837","nonce":1439647913}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/2386382396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2386382396},{"type":"v1","addr":"172.21.15.73:6836","nonce":2386382396}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:49:43.747162+0000","modified":"2024-05-08T21:52:21.299913+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":24,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":9,"state":"up:active","state_seq":44,"addr":"172.21.15.73:6837/1772457954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":1772457954},{"type":"v1","addr":"172.21.15.73:6837","nonce":1772457954}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:52:28.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:28.001+0000 7f9c28cc0700 1 -- 172.21.15.73:0/2259459966 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f9c0406acc0 msgr2=0x7f9c0406d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:28.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:28.001+0000 7f9c28cc0700 1 --2- 172.21.15.73:0/2259459966 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f9c0406acc0 0x7f9c0406d180 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c007fd0 tx=0x7f9c0c007dc0 comp rx=0 tx=0).stop 2024-05-08T21:52:28.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:28.001+0000 7f9c28cc0700 1 -- 172.21.15.73:0/2259459966 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c24071c20 msgr2=0x7f9c241ed7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:28.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:28.001+0000 7f9c28cc0700 1 --2- 172.21.15.73:0/2259459966 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c24071c20 0x7f9c241ed7c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c00b680 tx=0x7f9c1c004ad0 comp rx=0 tx=0).stop 2024-05-08T21:52:28.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:28.001+0000 7f9c28cc0700 1 -- 172.21.15.73:0/2259459966 shutdown_connections 2024-05-08T21:52:28.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:28.001+0000 7f9c28cc0700 1 --2- 172.21.15.73:0/2259459966 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f9c0406acc0 0x7f9c0406d180 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:28.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:28.001+0000 7f9c28cc0700 1 --2- 172.21.15.73:0/2259459966 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c24071c20 0x7f9c241ed7c0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:28.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:28.001+0000 7f9c28cc0700 1 --2- 172.21.15.73:0/2259459966 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c24071370 0x7f9c24148b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:28.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:28.001+0000 7f9c28cc0700 1 --2- 172.21.15.73:0/2259459966 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9c24071750 0x7f9c24150d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:28.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:28.001+0000 7f9c28cc0700 1 -- 172.21.15.73:0/2259459966 >> 172.21.15.73:0/2259459966 conn(0x7f9c240cba80 msgr2=0x7f9c240c8380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:52:28.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:28.001+0000 7f9c28cc0700 1 -- 172.21.15.73:0/2259459966 shutdown_connections 2024-05-08T21:52:28.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:28.001+0000 7f9c28cc0700 1 -- 172.21.15.73:0/2259459966 wait complete. 2024-05-08T21:52:28.003 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 12 2024-05-08T21:52:28.015 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is in active, standby or standby-replay 2024-05-08T21:52:30.016 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:52:30.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.158+0000 7fe0b2a2b700 1 Processor -- start 2024-05-08T21:52:30.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.158+0000 7fe0b2a2b700 1 -- start start 2024-05-08T21:52:30.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.159+0000 7fe0b2a2b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0ac0c3490 0x7fe0ac072460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:30.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.159+0000 7fe0b2a2b700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe0ac0c3a00 0x7fe0ac161350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:30.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.159+0000 7fe0b2a2b700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0ac0c3f10 con 0x7fe0ac072080 2024-05-08T21:52:30.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.159+0000 7fe0b2a2b700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0ac0729a0 con 0x7fe0ac0c3a00 2024-05-08T21:52:30.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.159+0000 7fe0b2a2b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ac0c41b0 con 0x7fe0ac0c3490 2024-05-08T21:52:30.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.159+0000 7fe0b0fc8700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe0ac0c3a00 0x7fe0ac161350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:30.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.159+0000 7fe0b0fc8700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe0ac0c3a00 0x7fe0ac161350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42830/0 (socket says 172.21.15.73:42830) 2024-05-08T21:52:30.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.159+0000 7fe0b0fc8700 1 -- 172.21.15.73:0/3246035430 learned_addr learned my addr 172.21.15.73:0/3246035430 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:52:30.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.159+0000 7fe0ab7fe700 1 --2- 172.21.15.73:0/3246035430 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0ac0c3490 0x7fe0ac072460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:30.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.159+0000 7fe0b0fc8700 1 -- 172.21.15.73:0/3246035430 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0ac0c3490 msgr2=0x7fe0ac072460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:52:30.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.159+0000 7fe0b0fc8700 1 --2- 172.21.15.73:0/3246035430 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0ac0c3490 0x7fe0ac072460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:30.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.159+0000 7fe0b0fc8700 1 -- 172.21.15.73:0/3246035430 >> v1:172.21.15.73:6789/0 conn(0x7fe0ac072080 legacy=0x7fe0ac156dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:30.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.159+0000 7fe0b0fc8700 1 -- 172.21.15.73:0/3246035430 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0ac0c7820 con 0x7fe0ac0c3a00 2024-05-08T21:52:30.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.160+0000 7fe0b0fc8700 1 --2- 172.21.15.73:0/3246035430 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0ac0c3a00 0x7fe0ac161350 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe0a400d150 tx=0x7fe0a400d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ed79eed00a901dc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:52:30.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.160+0000 7fe0aaffd700 1 -- 172.21.15.73:0/3246035430 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a4010070 con 0x7fe0ac0c3a00 2024-05-08T21:52:30.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.160+0000 7fe0aaffd700 1 -- 172.21.15.73:0/3246035430 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0a400ddc0 con 0x7fe0ac0c3a00 2024-05-08T21:52:30.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.160+0000 7fe0aaffd700 1 -- 172.21.15.73:0/3246035430 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a400b310 con 0x7fe0ac0c3a00 2024-05-08T21:52:30.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.160+0000 7fe0b2a2b700 1 -- 172.21.15.73:0/3246035430 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0ac0c3a00 msgr2=0x7fe0ac161350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:30.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.160+0000 7fe0b2a2b700 1 --2- 172.21.15.73:0/3246035430 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0ac0c3a00 0x7fe0ac161350 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe0a400d150 tx=0x7fe0a400d460 comp rx=0 tx=0).stop 2024-05-08T21:52:30.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.160+0000 7fe0b2a2b700 1 -- 172.21.15.73:0/3246035430 shutdown_connections 2024-05-08T21:52:30.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.160+0000 7fe0b2a2b700 1 --2- 172.21.15.73:0/3246035430 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0ac0c3a00 0x7fe0ac161350 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:30.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.160+0000 7fe0b2a2b700 1 --2- 172.21.15.73:0/3246035430 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0ac0c3490 0x7fe0ac072460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:30.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.160+0000 7fe0b2a2b700 1 -- 172.21.15.73:0/3246035430 >> 172.21.15.73:0/3246035430 conn(0x7fe0ac066d70 msgr2=0x7fe0ac0cc500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:52:30.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.160+0000 7fe0b2a2b700 1 -- 172.21.15.73:0/3246035430 shutdown_connections 2024-05-08T21:52:30.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.160+0000 7fe0b2a2b700 1 -- 172.21.15.73:0/3246035430 wait complete. 2024-05-08T21:52:30.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.162+0000 7fe0b2a2b700 1 Processor -- start 2024-05-08T21:52:30.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.162+0000 7fe0b2a2b700 1 -- start start 2024-05-08T21:52:30.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.163+0000 7fe0b2a2b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0ac072080 0x7fe0ac1491c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:30.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.163+0000 7fe0b2a2b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0ac0c3490 0x7fe0ac1561d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:30.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.163+0000 7fe0b2a2b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0ac0c3a00 0x7fe0ac06bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:30.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.163+0000 7fe0b2a2b700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ac1546d0 con 0x7fe0ac072080 2024-05-08T21:52:30.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.163+0000 7fe0b2a2b700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ac147bf0 con 0x7fe0ac0c3490 2024-05-08T21:52:30.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.163+0000 7fe0b2a2b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ac156880 con 0x7fe0ac0c3a00 2024-05-08T21:52:30.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.163+0000 7fe0abfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0ac072080 0x7fe0ac1491c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:30.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.163+0000 7fe0abfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0ac072080 0x7fe0ac1491c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42836/0 (socket says 172.21.15.73:42836) 2024-05-08T21:52:30.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.163+0000 7fe0abfff700 1 -- 172.21.15.73:0/1974014079 learned_addr learned my addr 172.21.15.73:0/1974014079 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:52:30.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.163+0000 7fe0b0fc8700 1 --2- 172.21.15.73:0/1974014079 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0ac0c3a00 0x7fe0ac06bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:30.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.163+0000 7fe0ab7fe700 1 --2- 172.21.15.73:0/1974014079 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0ac0c3490 0x7fe0ac1561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:30.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.163+0000 7fe0abfff700 1 -- 172.21.15.73:0/1974014079 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0ac0c3a00 msgr2=0x7fe0ac06bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:30.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.163+0000 7fe0abfff700 1 --2- 172.21.15.73:0/1974014079 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0ac0c3a00 0x7fe0ac06bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:30.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.163+0000 7fe0abfff700 1 -- 172.21.15.73:0/1974014079 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0ac0c3490 msgr2=0x7fe0ac1561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:30.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.163+0000 7fe0abfff700 1 --2- 172.21.15.73:0/1974014079 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0ac0c3490 0x7fe0ac1561d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:30.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.163+0000 7fe0abfff700 1 -- 172.21.15.73:0/1974014079 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a400bd40 con 0x7fe0ac072080 2024-05-08T21:52:30.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.163+0000 7fe0abfff700 1 --2- 172.21.15.73:0/1974014079 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0ac072080 0x7fe0ac1491c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe09400c4e0 tx=0x7fe09400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:52:30.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.163+0000 7fe0a8ff9700 1 -- 172.21.15.73:0/1974014079 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0940052d0 con 0x7fe0ac072080 2024-05-08T21:52:30.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.163+0000 7fe0a8ff9700 1 -- 172.21.15.73:0/1974014079 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe094005430 con 0x7fe0ac072080 2024-05-08T21:52:30.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.163+0000 7fe0b2a2b700 1 -- 172.21.15.73:0/1974014079 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0ac147e40 con 0x7fe0ac072080 2024-05-08T21:52:30.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.163+0000 7fe0a8ff9700 1 -- 172.21.15.73:0/1974014079 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0940038c0 con 0x7fe0ac072080 2024-05-08T21:52:30.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.163+0000 7fe0b2a2b700 1 -- 172.21.15.73:0/1974014079 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0ac148400 con 0x7fe0ac072080 2024-05-08T21:52:30.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.164+0000 7fe0b2a2b700 1 -- 172.21.15.73:0/1974014079 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0ac148620 con 0x7fe0ac072080 2024-05-08T21:52:30.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.165+0000 7fe0a8ff9700 1 -- 172.21.15.73:0/1974014079 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe094003a20 con 0x7fe0ac072080 2024-05-08T21:52:30.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.165+0000 7fe0a8ff9700 1 --2- 172.21.15.73:0/1974014079 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fe08c06ac90 0x7fe08c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:52:30.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.165+0000 7fe0a8ff9700 1 -- 172.21.15.73:0/1974014079 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5969+0+0 (secure 0 0 0) 0x7fe094088780 con 0x7fe0ac072080 2024-05-08T21:52:30.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.166+0000 7fe0ab7fe700 1 --2- 172.21.15.73:0/1974014079 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fe08c06ac90 0x7fe08c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:52:30.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.166+0000 7fe0ab7fe700 1 --2- 172.21.15.73:0/1974014079 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fe08c06ac90 0x7fe08c06d150 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac15aaf0 tx=0x7fe09c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:52:30.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.170+0000 7fe0a8ff9700 1 -- 172.21.15.73:0/1974014079 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fe094053850 con 0x7fe0ac072080 2024-05-08T21:52:30.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.412+0000 7fe0b2a2b700 1 -- 172.21.15.73:0/1974014079 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe0ac154810 con 0x7fe0ac072080 2024-05-08T21:52:30.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.412+0000 7fe0a8ff9700 1 -- 172.21.15.73:0/1974014079 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+6255 (secure 0 0 0) 0x7fe094056e70 con 0x7fe0ac072080 2024-05-08T21:52:30.413 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:52:30.413 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3242319177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6833","nonce":3242319177},{"type":"v1","addr":"172.21.15.115:6835","nonce":3242319177}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6834/2136341349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2136341349},{"type":"v1","addr":"172.21.15.115:6834","nonce":2136341349}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4249,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1439647913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1439647913},{"type":"v1","addr":"172.21.15.115:6837","nonce":1439647913}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/2386382396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2386382396},{"type":"v1","addr":"172.21.15.73:6836","nonce":2386382396}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4920,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6839/1242908203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1242908203},{"type":"v1","addr":"172.21.15.73:6839","nonce":1242908203}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:49:43.747162+0000","modified":"2024-05-08T21:52:21.299913+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":24,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":9,"state":"up:active","state_seq":44,"addr":"172.21.15.73:6837/1772457954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":1772457954},{"type":"v1","addr":"172.21.15.73:6837","nonce":1772457954}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:52:30.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.414+0000 7fe0b2a2b700 1 -- 172.21.15.73:0/1974014079 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fe08c06ac90 msgr2=0x7fe08c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:30.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.414+0000 7fe0b2a2b700 1 --2- 172.21.15.73:0/1974014079 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fe08c06ac90 0x7fe08c06d150 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac15aaf0 tx=0x7fe09c008040 comp rx=0 tx=0).stop 2024-05-08T21:52:30.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.414+0000 7fe0b2a2b700 1 -- 172.21.15.73:0/1974014079 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0ac072080 msgr2=0x7fe0ac1491c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:52:30.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.414+0000 7fe0b2a2b700 1 --2- 172.21.15.73:0/1974014079 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0ac072080 0x7fe0ac1491c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe09400c4e0 tx=0x7fe09400c7f0 comp rx=0 tx=0).stop 2024-05-08T21:52:30.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.414+0000 7fe0b2a2b700 1 -- 172.21.15.73:0/1974014079 shutdown_connections 2024-05-08T21:52:30.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.414+0000 7fe0b2a2b700 1 --2- 172.21.15.73:0/1974014079 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fe08c06ac90 0x7fe08c06d150 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:30.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.414+0000 7fe0b2a2b700 1 --2- 172.21.15.73:0/1974014079 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0ac0c3a00 0x7fe0ac06bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:30.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.414+0000 7fe0b2a2b700 1 --2- 172.21.15.73:0/1974014079 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0ac072080 0x7fe0ac1491c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:30.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.414+0000 7fe0b2a2b700 1 --2- 172.21.15.73:0/1974014079 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0ac0c3490 0x7fe0ac1561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:52:30.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.415+0000 7fe0b2a2b700 1 -- 172.21.15.73:0/1974014079 >> 172.21.15.73:0/1974014079 conn(0x7fe0ac066d70 msgr2=0x7fe0ac156cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:52:30.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.415+0000 7fe0b2a2b700 1 -- 172.21.15.73:0/1974014079 shutdown_connections 2024-05-08T21:52:30.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:52:30.415+0000 7fe0b2a2b700 1 -- 172.21.15.73:0/1974014079 wait complete. 2024-05-08T21:52:30.417 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 13 2024-05-08T21:52:30.428 INFO:tasks.mds_thrash.fs.[cephfs]:mds.e reported in up:standby state 2024-05-08T21:52:30.428 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 91 secs before thrashing 2024-05-08T21:52:33.027 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-05-08T21:52:33.027 INFO:tasks.workunit.client.0.smithi073.stdout: Children see throughput for 1 rewriters = 817331.00 kB/sec 2024-05-08T21:52:33.028 INFO:tasks.workunit.client.0.smithi073.stdout: Parent sees throughput for 1 rewriters = 817194.02 kB/sec 2024-05-08T21:52:33.028 INFO:tasks.workunit.client.0.smithi073.stdout: Min throughput per process = 817331.00 kB/sec 2024-05-08T21:52:33.028 INFO:tasks.workunit.client.0.smithi073.stdout: Max throughput per process = 817331.00 kB/sec 2024-05-08T21:52:33.028 INFO:tasks.workunit.client.0.smithi073.stdout: Avg throughput per process = 817331.00 kB/sec 2024-05-08T21:52:33.028 INFO:tasks.workunit.client.0.smithi073.stdout: Min xfer = 1048576.00 kB 2024-05-08T21:52:35.323 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-05-08T21:52:35.323 INFO:tasks.workunit.client.0.smithi073.stdout: Children see throughput for 1 readers = 6301578.00 kB/sec 2024-05-08T21:52:35.323 INFO:tasks.workunit.client.0.smithi073.stdout: Parent sees throughput for 1 readers = 6292318.87 kB/sec 2024-05-08T21:52:35.324 INFO:tasks.workunit.client.0.smithi073.stdout: Min throughput per process = 6301578.00 kB/sec 2024-05-08T21:52:35.324 INFO:tasks.workunit.client.0.smithi073.stdout: Max throughput per process = 6301578.00 kB/sec 2024-05-08T21:52:35.324 INFO:tasks.workunit.client.0.smithi073.stdout: Avg throughput per process = 6301578.00 kB/sec 2024-05-08T21:52:35.324 INFO:tasks.workunit.client.0.smithi073.stdout: Min xfer = 1048576.00 kB 2024-05-08T21:52:37.630 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-05-08T21:52:37.630 INFO:tasks.workunit.client.0.smithi073.stdout: Children see throughput for 1 re-readers = 5364002.50 kB/sec 2024-05-08T21:52:37.630 INFO:tasks.workunit.client.0.smithi073.stdout: Parent sees throughput for 1 re-readers = 5358212.43 kB/sec 2024-05-08T21:52:37.630 INFO:tasks.workunit.client.0.smithi073.stdout: Min throughput per process = 5364002.50 kB/sec 2024-05-08T21:52:37.630 INFO:tasks.workunit.client.0.smithi073.stdout: Max throughput per process = 5364002.50 kB/sec 2024-05-08T21:52:37.630 INFO:tasks.workunit.client.0.smithi073.stdout: Avg throughput per process = 5364002.50 kB/sec 2024-05-08T21:52:37.630 INFO:tasks.workunit.client.0.smithi073.stdout: Min xfer = 1048576.00 kB 2024-05-08T21:52:48.436 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-05-08T21:52:48.436 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-05-08T21:52:48.436 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-05-08T21:52:48.436 INFO:tasks.workunit.client.0.smithi073.stdout:iozone test complete. 2024-05-08T21:52:48.436 INFO:tasks.workunit.client.0.smithi073.stderr:+ iozone -c -e -s 1024M -r 1M -t 1 -F f2 -i 0 -i 1 2024-05-08T21:52:48.469 INFO:tasks.workunit.client.0.smithi073.stdout: Iozone: Performance Test of File I/O 2024-05-08T21:52:48.470 INFO:tasks.workunit.client.0.smithi073.stdout: Version $Revision: 3.489 $ 2024-05-08T21:52:48.470 INFO:tasks.workunit.client.0.smithi073.stdout: Compiled for 64 bit mode. 2024-05-08T21:52:48.470 INFO:tasks.workunit.client.0.smithi073.stdout: Build: linux-AMD64 2024-05-08T21:52:48.470 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-05-08T21:52:48.470 INFO:tasks.workunit.client.0.smithi073.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-05-08T21:52:48.470 INFO:tasks.workunit.client.0.smithi073.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-05-08T21:52:48.470 INFO:tasks.workunit.client.0.smithi073.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-05-08T21:52:48.470 INFO:tasks.workunit.client.0.smithi073.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-05-08T21:52:48.470 INFO:tasks.workunit.client.0.smithi073.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-05-08T21:52:48.470 INFO:tasks.workunit.client.0.smithi073.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-05-08T21:52:48.470 INFO:tasks.workunit.client.0.smithi073.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-05-08T21:52:48.470 INFO:tasks.workunit.client.0.smithi073.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-05-08T21:52:48.470 INFO:tasks.workunit.client.0.smithi073.stdout: Alexey Skidanov, Sudhir Kumar. 2024-05-08T21:52:48.470 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-05-08T21:52:48.471 INFO:tasks.workunit.client.0.smithi073.stdout: Run began: Wed May 8 21:52:48 2024 2024-05-08T21:52:48.471 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-05-08T21:52:48.471 INFO:tasks.workunit.client.0.smithi073.stdout: Include close in write timing 2024-05-08T21:52:48.471 INFO:tasks.workunit.client.0.smithi073.stdout: Include fsync in write timing 2024-05-08T21:52:48.471 INFO:tasks.workunit.client.0.smithi073.stdout: File size set to 1048576 kB 2024-05-08T21:52:48.471 INFO:tasks.workunit.client.0.smithi073.stdout: Record Size 1024 kB 2024-05-08T21:52:48.471 INFO:tasks.workunit.client.0.smithi073.stdout: Command line used: iozone -c -e -s 1024M -r 1M -t 1 -F f2 -i 0 -i 1 2024-05-08T21:52:48.471 INFO:tasks.workunit.client.0.smithi073.stdout: Output is in kBytes/sec 2024-05-08T21:52:48.471 INFO:tasks.workunit.client.0.smithi073.stdout: Time Resolution = 0.000001 seconds. 2024-05-08T21:52:48.471 INFO:tasks.workunit.client.0.smithi073.stdout: Processor cache size set to 1024 kBytes. 2024-05-08T21:52:48.471 INFO:tasks.workunit.client.0.smithi073.stdout: Processor cache line size set to 32 bytes. 2024-05-08T21:52:48.471 INFO:tasks.workunit.client.0.smithi073.stdout: File stride size set to 17 * record size. 2024-05-08T21:52:48.471 INFO:tasks.workunit.client.0.smithi073.stdout: Throughput test with 1 process 2024-05-08T21:52:48.471 INFO:tasks.workunit.client.0.smithi073.stdout: Each process writes a 1048576 kByte file in 1024 kByte records 2024-05-08T21:52:49.833 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-05-08T21:52:49.833 INFO:tasks.workunit.client.0.smithi073.stdout: Children see throughput for 1 initial writers = 788321.25 kB/sec 2024-05-08T21:52:49.833 INFO:tasks.workunit.client.0.smithi073.stdout: Parent sees throughput for 1 initial writers = 788174.33 kB/sec 2024-05-08T21:52:49.833 INFO:tasks.workunit.client.0.smithi073.stdout: Min throughput per process = 788321.25 kB/sec 2024-05-08T21:52:49.833 INFO:tasks.workunit.client.0.smithi073.stdout: Max throughput per process = 788321.25 kB/sec 2024-05-08T21:52:49.833 INFO:tasks.workunit.client.0.smithi073.stdout: Avg throughput per process = 788321.25 kB/sec 2024-05-08T21:52:49.833 INFO:tasks.workunit.client.0.smithi073.stdout: Min xfer = 1048576.00 kB 2024-05-08T21:52:50.393 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:52:50.396 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:52:53.191 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-05-08T21:52:53.191 INFO:tasks.workunit.client.0.smithi073.stdout: Children see throughput for 1 rewriters = 836035.00 kB/sec 2024-05-08T21:52:53.191 INFO:tasks.workunit.client.0.smithi073.stdout: Parent sees throughput for 1 rewriters = 835787.81 kB/sec 2024-05-08T21:52:53.192 INFO:tasks.workunit.client.0.smithi073.stdout: Min throughput per process = 836035.00 kB/sec 2024-05-08T21:52:53.192 INFO:tasks.workunit.client.0.smithi073.stdout: Max throughput per process = 836035.00 kB/sec 2024-05-08T21:52:53.192 INFO:tasks.workunit.client.0.smithi073.stdout: Avg throughput per process = 836035.00 kB/sec 2024-05-08T21:52:53.192 INFO:tasks.workunit.client.0.smithi073.stdout: Min xfer = 1048576.00 kB 2024-05-08T21:52:55.522 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-05-08T21:52:55.522 INFO:tasks.workunit.client.0.smithi073.stdout: Children see throughput for 1 readers = 7134569.00 kB/sec 2024-05-08T21:52:55.522 INFO:tasks.workunit.client.0.smithi073.stdout: Parent sees throughput for 1 readers = 7121445.22 kB/sec 2024-05-08T21:52:55.522 INFO:tasks.workunit.client.0.smithi073.stdout: Min throughput per process = 7134569.00 kB/sec 2024-05-08T21:52:55.522 INFO:tasks.workunit.client.0.smithi073.stdout: Max throughput per process = 7134569.00 kB/sec 2024-05-08T21:52:55.522 INFO:tasks.workunit.client.0.smithi073.stdout: Avg throughput per process = 7134569.00 kB/sec 2024-05-08T21:52:55.522 INFO:tasks.workunit.client.0.smithi073.stdout: Min xfer = 1048576.00 kB 2024-05-08T21:52:57.867 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-05-08T21:52:57.867 INFO:tasks.workunit.client.0.smithi073.stdout: Children see throughput for 1 re-readers = 5727698.50 kB/sec 2024-05-08T21:52:57.867 INFO:tasks.workunit.client.0.smithi073.stdout: Parent sees throughput for 1 re-readers = 5718054.87 kB/sec 2024-05-08T21:52:57.867 INFO:tasks.workunit.client.0.smithi073.stdout: Min throughput per process = 5727698.50 kB/sec 2024-05-08T21:52:57.867 INFO:tasks.workunit.client.0.smithi073.stdout: Max throughput per process = 5727698.50 kB/sec 2024-05-08T21:52:57.867 INFO:tasks.workunit.client.0.smithi073.stdout: Avg throughput per process = 5727698.50 kB/sec 2024-05-08T21:52:57.868 INFO:tasks.workunit.client.0.smithi073.stdout: Min xfer = 1048576.00 kB 2024-05-08T21:53:08.503 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-05-08T21:53:08.503 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-05-08T21:53:08.503 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-05-08T21:53:08.503 INFO:tasks.workunit.client.0.smithi073.stdout:iozone test complete. 2024-05-08T21:53:08.504 INFO:tasks.workunit.client.0.smithi073.stderr:+ iozone -c -e -s 10240M -r 1M -t 1 -F f3 -i 0 -i 1 2024-05-08T21:53:08.542 INFO:tasks.workunit.client.0.smithi073.stdout: Iozone: Performance Test of File I/O 2024-05-08T21:53:08.542 INFO:tasks.workunit.client.0.smithi073.stdout: Version $Revision: 3.489 $ 2024-05-08T21:53:08.542 INFO:tasks.workunit.client.0.smithi073.stdout: Compiled for 64 bit mode. 2024-05-08T21:53:08.542 INFO:tasks.workunit.client.0.smithi073.stdout: Build: linux-AMD64 2024-05-08T21:53:08.542 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-05-08T21:53:08.542 INFO:tasks.workunit.client.0.smithi073.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-05-08T21:53:08.542 INFO:tasks.workunit.client.0.smithi073.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-05-08T21:53:08.542 INFO:tasks.workunit.client.0.smithi073.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-05-08T21:53:08.543 INFO:tasks.workunit.client.0.smithi073.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-05-08T21:53:08.543 INFO:tasks.workunit.client.0.smithi073.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-05-08T21:53:08.543 INFO:tasks.workunit.client.0.smithi073.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-05-08T21:53:08.543 INFO:tasks.workunit.client.0.smithi073.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-05-08T21:53:08.543 INFO:tasks.workunit.client.0.smithi073.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-05-08T21:53:08.543 INFO:tasks.workunit.client.0.smithi073.stdout: Alexey Skidanov, Sudhir Kumar. 2024-05-08T21:53:08.543 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-05-08T21:53:08.543 INFO:tasks.workunit.client.0.smithi073.stdout: Run began: Wed May 8 21:53:08 2024 2024-05-08T21:53:08.543 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-05-08T21:53:08.543 INFO:tasks.workunit.client.0.smithi073.stdout: Include close in write timing 2024-05-08T21:53:08.543 INFO:tasks.workunit.client.0.smithi073.stdout: Include fsync in write timing 2024-05-08T21:53:08.543 INFO:tasks.workunit.client.0.smithi073.stdout: File size set to 10485760 kB 2024-05-08T21:53:08.543 INFO:tasks.workunit.client.0.smithi073.stdout: Record Size 1024 kB 2024-05-08T21:53:08.544 INFO:tasks.workunit.client.0.smithi073.stdout: Command line used: iozone -c -e -s 10240M -r 1M -t 1 -F f3 -i 0 -i 1 2024-05-08T21:53:08.544 INFO:tasks.workunit.client.0.smithi073.stdout: Output is in kBytes/sec 2024-05-08T21:53:08.544 INFO:tasks.workunit.client.0.smithi073.stdout: Time Resolution = 0.000001 seconds. 2024-05-08T21:53:08.544 INFO:tasks.workunit.client.0.smithi073.stdout: Processor cache size set to 1024 kBytes. 2024-05-08T21:53:08.544 INFO:tasks.workunit.client.0.smithi073.stdout: Processor cache line size set to 32 bytes. 2024-05-08T21:53:08.544 INFO:tasks.workunit.client.0.smithi073.stdout: File stride size set to 17 * record size. 2024-05-08T21:53:08.544 INFO:tasks.workunit.client.0.smithi073.stdout: Throughput test with 1 process 2024-05-08T21:53:08.544 INFO:tasks.workunit.client.0.smithi073.stdout: Each process writes a 10485760 kByte file in 1024 kByte records 2024-05-08T21:53:20.297 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-05-08T21:53:20.298 INFO:tasks.workunit.client.0.smithi073.stdout: Children see throughput for 1 initial writers = 894910.19 kB/sec 2024-05-08T21:53:20.298 INFO:tasks.workunit.client.0.smithi073.stdout: Parent sees throughput for 1 initial writers = 894886.34 kB/sec 2024-05-08T21:53:20.298 INFO:tasks.workunit.client.0.smithi073.stdout: Min throughput per process = 894910.19 kB/sec 2024-05-08T21:53:20.298 INFO:tasks.workunit.client.0.smithi073.stdout: Max throughput per process = 894910.19 kB/sec 2024-05-08T21:53:20.298 INFO:tasks.workunit.client.0.smithi073.stdout: Avg throughput per process = 894910.19 kB/sec 2024-05-08T21:53:20.298 INFO:tasks.workunit.client.0.smithi073.stdout: Min xfer = 10485760.00 kB 2024-05-08T21:53:20.455 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:53:20.458 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:53:33.385 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-05-08T21:53:33.385 INFO:tasks.workunit.client.0.smithi073.stdout: Children see throughput for 1 rewriters = 965383.75 kB/sec 2024-05-08T21:53:33.385 INFO:tasks.workunit.client.0.smithi073.stdout: Parent sees throughput for 1 rewriters = 965359.76 kB/sec 2024-05-08T21:53:33.385 INFO:tasks.workunit.client.0.smithi073.stdout: Min throughput per process = 965383.75 kB/sec 2024-05-08T21:53:33.385 INFO:tasks.workunit.client.0.smithi073.stdout: Max throughput per process = 965383.75 kB/sec 2024-05-08T21:53:33.385 INFO:tasks.workunit.client.0.smithi073.stdout: Avg throughput per process = 965383.75 kB/sec 2024-05-08T21:53:33.386 INFO:tasks.workunit.client.0.smithi073.stdout: Min xfer = 10485760.00 kB 2024-05-08T21:53:36.921 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-05-08T21:53:36.921 INFO:tasks.workunit.client.0.smithi073.stdout: Children see throughput for 1 readers = 7585503.00 kB/sec 2024-05-08T21:53:36.921 INFO:tasks.workunit.client.0.smithi073.stdout: Parent sees throughput for 1 readers = 7583807.96 kB/sec 2024-05-08T21:53:36.921 INFO:tasks.workunit.client.0.smithi073.stdout: Min throughput per process = 7585503.00 kB/sec 2024-05-08T21:53:36.921 INFO:tasks.workunit.client.0.smithi073.stdout: Max throughput per process = 7585503.00 kB/sec 2024-05-08T21:53:36.921 INFO:tasks.workunit.client.0.smithi073.stdout: Avg throughput per process = 7585503.00 kB/sec 2024-05-08T21:53:36.922 INFO:tasks.workunit.client.0.smithi073.stdout: Min xfer = 10485760.00 kB 2024-05-08T21:53:40.698 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-05-08T21:53:40.698 INFO:tasks.workunit.client.0.smithi073.stdout: Children see throughput for 1 re-readers = 6217280.00 kB/sec 2024-05-08T21:53:40.698 INFO:tasks.workunit.client.0.smithi073.stdout: Parent sees throughput for 1 re-readers = 6216129.67 kB/sec 2024-05-08T21:53:40.698 INFO:tasks.workunit.client.0.smithi073.stdout: Min throughput per process = 6217280.00 kB/sec 2024-05-08T21:53:40.698 INFO:tasks.workunit.client.0.smithi073.stdout: Max throughput per process = 6217280.00 kB/sec 2024-05-08T21:53:40.698 INFO:tasks.workunit.client.0.smithi073.stdout: Avg throughput per process = 6217280.00 kB/sec 2024-05-08T21:53:40.698 INFO:tasks.workunit.client.0.smithi073.stdout: Min xfer = 10485760.00 kB 2024-05-08T21:53:49.399 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-05-08T21:53:49.399 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-05-08T21:53:49.399 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-05-08T21:53:49.399 INFO:tasks.workunit.client.0.smithi073.stdout:iozone test complete. 2024-05-08T21:53:49.400 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-05-08T21:53:49.401 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-05-08T21:53:49.445 INFO:tasks.workunit:Stopping ['suites/iozone.sh'] on client.0... 2024-05-08T21:53:49.445 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-05-08T21:53:49.721 DEBUG:teuthology.parallel:result is None 2024-05-08T21:53:49.722 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-05-08T21:53:49.753 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-05-08T21:53:49.754 DEBUG:teuthology.run_tasks:Unwinding manager mds_thrash 2024-05-08T21:53:49.763 INFO:tasks.mds_thrash:joining mds_thrasher 2024-05-08T21:53:49.763 INFO:tasks.mds_thrash.fs.[cephfs]:stat['max_mds'] = 0 2024-05-08T21:53:49.763 INFO:tasks.mds_thrash.fs.[cephfs]:stat['deactivate'] = 0 2024-05-08T21:53:49.763 INFO:tasks.mds_thrash.fs.[cephfs]:stat['kill'] = 1 2024-05-08T21:53:49.764 INFO:tasks.mds_thrash:done joining 2024-05-08T21:53:49.764 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-05-08T21:53:49.775 INFO:tasks.kclient:Unmounting kernel clients... 2024-05-08T21:53:49.775 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-05-08T21:53:49.775 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T21:53:49.814 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-05-08T21:53:49.814 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T21:53:49.872 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T21:53:50.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.032+0000 7fb096cc0700 1 Processor -- start 2024-05-08T21:53:50.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.032+0000 7fb096cc0700 1 -- start start 2024-05-08T21:53:50.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.033+0000 7fb096cc0700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb0900c9990 0x7fb090072710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:50.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.033+0000 7fb096cc0700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb0900c8450 0x7fb09015b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:50.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.033+0000 7fb096cc0700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0900c5db0 con 0x7fb090141120 2024-05-08T21:53:50.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.033+0000 7fb096cc0700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0900c7910 con 0x7fb0900c9990 2024-05-08T21:53:50.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.033+0000 7fb096cc0700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb090072ff0 con 0x7fb0900c8450 2024-05-08T21:53:50.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.033+0000 7fb08ffff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb0900c9990 0x7fb090072710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:50.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.033+0000 7fb08ffff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb0900c9990 0x7fb090072710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56396/0 (socket says 172.21.15.73:56396) 2024-05-08T21:53:50.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.033+0000 7fb08ffff700 1 -- 172.21.15.73:0/711809176 learned_addr learned my addr 172.21.15.73:0/711809176 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:53:50.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.033+0000 7fb094a5c700 1 --1- 172.21.15.73:0/711809176 >> v1:172.21.15.73:6789/0 conn(0x7fb090141120 0x7fb09006ad90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:33582/0 (socket says 172.21.15.73:33582) 2024-05-08T21:53:50.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.033+0000 7fb09525d700 1 --2- 172.21.15.73:0/711809176 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb0900c8450 0x7fb09015b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:50.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.033+0000 7fb08ffff700 1 -- 172.21.15.73:0/711809176 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb0900c8450 msgr2=0x7fb09015b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:53:50.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.033+0000 7fb08ffff700 1 --2- 172.21.15.73:0/711809176 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb0900c8450 0x7fb09015b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:50.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.033+0000 7fb08ffff700 1 -- 172.21.15.73:0/711809176 >> v1:172.21.15.73:6789/0 conn(0x7fb090141120 legacy=0x7fb09006ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:50.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.033+0000 7fb08ffff700 1 -- 172.21.15.73:0/711809176 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb090072d30 con 0x7fb0900c9990 2024-05-08T21:53:50.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.033+0000 7fb08f7fe700 1 -- 172.21.15.73:0/711809176 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 500474615 0 0) 0x7fb0900c5db0 con 0x7fb090141120 2024-05-08T21:53:50.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.033+0000 7fb08ffff700 1 --2- 172.21.15.73:0/711809176 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0900c9990 0x7fb090072710 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb07c009920 tx=0x7fb07c009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34bfb42bd89d5220 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:50.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.033+0000 7fb08f7fe700 1 -- 172.21.15.73:0/711809176 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07c00ba20 con 0x7fb0900c9990 2024-05-08T21:53:50.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.034+0000 7fb08f7fe700 1 -- 172.21.15.73:0/711809176 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb07c00bb80 con 0x7fb0900c9990 2024-05-08T21:53:50.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.034+0000 7fb08f7fe700 1 -- 172.21.15.73:0/711809176 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07c009e70 con 0x7fb0900c9990 2024-05-08T21:53:50.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.034+0000 7fb096cc0700 1 -- 172.21.15.73:0/711809176 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0900c9990 msgr2=0x7fb090072710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:50.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.034+0000 7fb096cc0700 1 --2- 172.21.15.73:0/711809176 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0900c9990 0x7fb090072710 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb07c009920 tx=0x7fb07c009c30 comp rx=0 tx=0).stop 2024-05-08T21:53:50.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.034+0000 7fb096cc0700 1 -- 172.21.15.73:0/711809176 shutdown_connections 2024-05-08T21:53:50.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.034+0000 7fb096cc0700 1 --2- 172.21.15.73:0/711809176 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb0900c8450 0x7fb09015b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:50.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.034+0000 7fb096cc0700 1 --2- 172.21.15.73:0/711809176 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0900c9990 0x7fb090072710 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:50.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.034+0000 7fb096cc0700 1 -- 172.21.15.73:0/711809176 >> 172.21.15.73:0/711809176 conn(0x7fb090066d70 msgr2=0x7fb0900cc500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:53:50.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.034+0000 7fb096cc0700 1 -- 172.21.15.73:0/711809176 shutdown_connections 2024-05-08T21:53:50.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.034+0000 7fb096cc0700 1 -- 172.21.15.73:0/711809176 wait complete. 2024-05-08T21:53:50.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.035+0000 7fb096cc0700 1 Processor -- start 2024-05-08T21:53:50.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.035+0000 7fb096cc0700 1 -- start start 2024-05-08T21:53:50.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.036+0000 7fb096cc0700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0900c8450 0x7fb0901f30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:50.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.036+0000 7fb096cc0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0900c9990 0x7fb0901e3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:50.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.036+0000 7fb096cc0700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb090141120 0x7fb090138c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:50.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.036+0000 7fb096cc0700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0900c3da0 con 0x7fb0900c9990 2024-05-08T21:53:50.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.036+0000 7fb096cc0700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0900c4cd0 con 0x7fb0900c8450 2024-05-08T21:53:50.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.036+0000 7fb096cc0700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0900c3a00 con 0x7fb090141120 2024-05-08T21:53:50.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.036+0000 7fb08ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0900c9990 0x7fb0901e3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:50.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.036+0000 7fb08ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0900c9990 0x7fb0901e3680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56398/0 (socket says 172.21.15.73:56398) 2024-05-08T21:53:50.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.036+0000 7fb08ffff700 1 -- 172.21.15.73:0/2661224400 learned_addr learned my addr 172.21.15.73:0/2661224400 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:53:50.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.036+0000 7fb09525d700 1 --2- 172.21.15.73:0/2661224400 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb090141120 0x7fb090138c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:50.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.036+0000 7fb08ffff700 1 -- 172.21.15.73:0/2661224400 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb090141120 msgr2=0x7fb090138c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:50.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.036+0000 7fb094a5c700 1 --2- 172.21.15.73:0/2661224400 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0900c8450 0x7fb0901f30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:50.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.036+0000 7fb08ffff700 1 --2- 172.21.15.73:0/2661224400 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb090141120 0x7fb090138c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:50.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.037+0000 7fb08ffff700 1 -- 172.21.15.73:0/2661224400 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0900c8450 msgr2=0x7fb0901f30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:50.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.037+0000 7fb08ffff700 1 --2- 172.21.15.73:0/2661224400 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0900c8450 0x7fb0901f30e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:50.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.037+0000 7fb08ffff700 1 -- 172.21.15.73:0/2661224400 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb07c009550 con 0x7fb0900c9990 2024-05-08T21:53:50.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.037+0000 7fb09525d700 1 --2- 172.21.15.73:0/2661224400 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb090141120 0x7fb090138c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:53:50.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.037+0000 7fb094a5c700 1 --2- 172.21.15.73:0/2661224400 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0900c8450 0x7fb0901f30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:53:50.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.037+0000 7fb08ffff700 1 --2- 172.21.15.73:0/2661224400 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0900c9990 0x7fb0901e3680 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb07c009c70 tx=0x7fb07c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:50.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.037+0000 7fb08d7fa700 1 -- 172.21.15.73:0/2661224400 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07c004480 con 0x7fb0900c9990 2024-05-08T21:53:50.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.037+0000 7fb08d7fa700 1 -- 172.21.15.73:0/2661224400 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb07c01f070 con 0x7fb0900c9990 2024-05-08T21:53:50.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.037+0000 7fb096cc0700 1 -- 172.21.15.73:0/2661224400 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0901f3a10 con 0x7fb0900c9990 2024-05-08T21:53:50.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.037+0000 7fb08d7fa700 1 -- 172.21.15.73:0/2661224400 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07c0038e0 con 0x7fb0900c9990 2024-05-08T21:53:50.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.037+0000 7fb096cc0700 1 -- 172.21.15.73:0/2661224400 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0900c46b0 con 0x7fb0900c9990 2024-05-08T21:53:50.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.038+0000 7fb096cc0700 1 -- 172.21.15.73:0/2661224400 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0900c3ee0 con 0x7fb0900c9990 2024-05-08T21:53:50.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.038+0000 7fb08d7fa700 1 -- 172.21.15.73:0/2661224400 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb07c021030 con 0x7fb0900c9990 2024-05-08T21:53:50.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.039+0000 7fb08d7fa700 1 --2- 172.21.15.73:0/2661224400 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fb07406ac90 0x7fb07406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:50.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.039+0000 7fb08d7fa700 1 -- 172.21.15.73:0/2661224400 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5969+0+0 (secure 0 0 0) 0x7fb07c08a920 con 0x7fb0900c9990 2024-05-08T21:53:50.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.039+0000 7fb094a5c700 1 --2- 172.21.15.73:0/2661224400 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fb07406ac90 0x7fb07406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:50.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.039+0000 7fb094a5c700 1 --2- 172.21.15.73:0/2661224400 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fb07406ac90 0x7fb07406d150 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb084007fd0 tx=0x7fb084009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:50.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.043+0000 7fb08d7fa700 1 -- 172.21.15.73:0/2661224400 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fb07c055a80 con 0x7fb0900c9990 2024-05-08T21:53:50.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.238+0000 7fb096cc0700 1 -- 172.21.15.73:0/2661224400 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb090068b80 con 0x7fb0900c9990 2024-05-08T21:53:50.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.239+0000 7fb08d7fa700 1 -- 172.21.15.73:0/2661224400 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16510 (secure 0 0 0) 0x7fb07c015090 con 0x7fb0900c9990 2024-05-08T21:53:50.240 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:53:50.240 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":24,"fsid":"143164b7-c9c7-4737-a494-7dafa5a3320c","created":"2024-05-08T21:49:26.221909+0000","modified":"2024-05-08T21:52:05.996447+0000","last_up_change":"2024-05-08T21:49:37.118386+0000","last_in_change":"2024-05-08T21:49:28.836944+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T21:49:35.998578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T21:49:42.171760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T21:49:42.576293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6b7439c1-daaa-44af-8333-a455f9e9dc67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":47228},{"type":"v1","addr":"172.21.15.73:6809","nonce":47228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":47228},{"type":"v1","addr":"172.21.15.73:6811","nonce":47228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":47228},{"type":"v1","addr":"172.21.15.73:6815","nonce":47228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":47228},{"type":"v1","addr":"172.21.15.73:6813","nonce":47228}]},"public_addr":"172.21.15.73:6809/47228","cluster_addr":"172.21.15.73:6811/47228","heartbeat_back_addr":"172.21.15.73:6815/47228","heartbeat_front_addr":"172.21.15.73:6813/47228","state":["exists","up"]},{"osd":1,"uuid":"fb67886a-d7f7-45ac-832f-36c871c8a208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":47227},{"type":"v1","addr":"172.21.15.73:6801","nonce":47227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":47227},{"type":"v1","addr":"172.21.15.73:6803","nonce":47227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":47227},{"type":"v1","addr":"172.21.15.73:6807","nonce":47227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":47227},{"type":"v1","addr":"172.21.15.73:6805","nonce":47227}]},"public_addr":"172.21.15.73:6801/47227","cluster_addr":"172.21.15.73:6803/47227","heartbeat_back_addr":"172.21.15.73:6807/47227","heartbeat_front_addr":"172.21.15.73:6805/47227","state":["exists","up"]},{"osd":2,"uuid":"a5cd6e98-6621-473a-bfb8-5c648abbb563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":47229},{"type":"v1","addr":"172.21.15.73:6817","nonce":47229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":47229},{"type":"v1","addr":"172.21.15.73:6819","nonce":47229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":47229},{"type":"v1","addr":"172.21.15.73:6823","nonce":47229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":47229},{"type":"v1","addr":"172.21.15.73:6821","nonce":47229}]},"public_addr":"172.21.15.73:6817/47229","cluster_addr":"172.21.15.73:6819/47229","heartbeat_back_addr":"172.21.15.73:6823/47229","heartbeat_front_addr":"172.21.15.73:6821/47229","state":["exists","up"]},{"osd":3,"uuid":"36927c20-4241-4f3b-91b5-a6a6f27598e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":47232},{"type":"v1","addr":"172.21.15.73:6825","nonce":47232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":47232},{"type":"v1","addr":"172.21.15.73:6827","nonce":47232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":47232},{"type":"v1","addr":"172.21.15.73:6831","nonce":47232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":47232},{"type":"v1","addr":"172.21.15.73:6829","nonce":47232}]},"public_addr":"172.21.15.73:6825/47232","cluster_addr":"172.21.15.73:6827/47232","heartbeat_back_addr":"172.21.15.73:6831/47232","heartbeat_front_addr":"172.21.15.73:6829/47232","state":["exists","up"]},{"osd":4,"uuid":"4ebe0a18-8216-4815-878a-39c39a6cd3fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":47200},{"type":"v1","addr":"172.21.15.115:6801","nonce":47200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":47200},{"type":"v1","addr":"172.21.15.115:6803","nonce":47200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":47200},{"type":"v1","addr":"172.21.15.115:6807","nonce":47200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":47200},{"type":"v1","addr":"172.21.15.115:6805","nonce":47200}]},"public_addr":"172.21.15.115:6801/47200","cluster_addr":"172.21.15.115:6803/47200","heartbeat_back_addr":"172.21.15.115:6807/47200","heartbeat_front_addr":"172.21.15.115:6805/47200","state":["exists","up"]},{"osd":5,"uuid":"957f0ac1-5f26-4f02-8c05-488e6b67ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":47201},{"type":"v1","addr":"172.21.15.115:6809","nonce":47201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":47201},{"type":"v1","addr":"172.21.15.115:6811","nonce":47201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":47201},{"type":"v1","addr":"172.21.15.115:6815","nonce":47201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":47201},{"type":"v1","addr":"172.21.15.115:6813","nonce":47201}]},"public_addr":"172.21.15.115:6809/47201","cluster_addr":"172.21.15.115:6811/47201","heartbeat_back_addr":"172.21.15.115:6815/47201","heartbeat_front_addr":"172.21.15.115:6813/47201","state":["exists","up"]},{"osd":6,"uuid":"f5a6768f-ba7f-4f66-b335-0c303b158e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":47202},{"type":"v1","addr":"172.21.15.115:6817","nonce":47202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":47202},{"type":"v1","addr":"172.21.15.115:6819","nonce":47202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":47202},{"type":"v1","addr":"172.21.15.115:6823","nonce":47202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":47202},{"type":"v1","addr":"172.21.15.115:6821","nonce":47202}]},"public_addr":"172.21.15.115:6817/47202","cluster_addr":"172.21.15.115:6819/47202","heartbeat_back_addr":"172.21.15.115:6823/47202","heartbeat_front_addr":"172.21.15.115:6821/47202","state":["exists","up"]},{"osd":7,"uuid":"f4187743-f9e6-42e6-aca9-0604a58db1ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":47211},{"type":"v1","addr":"172.21.15.115:6825","nonce":47211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":47211},{"type":"v1","addr":"172.21.15.115:6827","nonce":47211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":47211},{"type":"v1","addr":"172.21.15.115:6831","nonce":47211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":47211},{"type":"v1","addr":"172.21.15.115:6829","nonce":47211}]},"public_addr":"172.21.15.115:6825/47211","cluster_addr":"172.21.15.115:6827/47211","heartbeat_back_addr":"172.21.15.115:6831/47211","heartbeat_front_addr":"172.21.15.115:6829/47211","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:33.996335+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:33.687451+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:34.072549+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:33.997588+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:34.047260+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:34.876272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:33.965472+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:34.038637+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.18","mappings":[{"from":3,"to":2}]},{"pgid":"3.1a","mappings":[{"from":4,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.3b","mappings":[{"from":7,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:6839/1477468490":"2024-05-09T21:52:05.996377+0000","172.21.15.73:6838/1477468490":"2024-05-09T21:52:05.996377+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T21:53:50.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.241+0000 7fb096cc0700 1 -- 172.21.15.73:0/2661224400 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fb07406ac90 msgr2=0x7fb07406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:50.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.241+0000 7fb096cc0700 1 --2- 172.21.15.73:0/2661224400 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fb07406ac90 0x7fb07406d150 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb084007fd0 tx=0x7fb084009040 comp rx=0 tx=0).stop 2024-05-08T21:53:50.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.241+0000 7fb096cc0700 1 -- 172.21.15.73:0/2661224400 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0900c9990 msgr2=0x7fb0901e3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:50.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.241+0000 7fb096cc0700 1 --2- 172.21.15.73:0/2661224400 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0900c9990 0x7fb0901e3680 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb07c009c70 tx=0x7fb07c004750 comp rx=0 tx=0).stop 2024-05-08T21:53:50.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.241+0000 7fb096cc0700 1 -- 172.21.15.73:0/2661224400 shutdown_connections 2024-05-08T21:53:50.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.241+0000 7fb096cc0700 1 --2- 172.21.15.73:0/2661224400 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fb07406ac90 0x7fb07406d150 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:50.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.241+0000 7fb096cc0700 1 --2- 172.21.15.73:0/2661224400 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb090141120 0x7fb090138c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:50.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.241+0000 7fb096cc0700 1 --2- 172.21.15.73:0/2661224400 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0900c8450 0x7fb0901f30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:50.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.241+0000 7fb096cc0700 1 --2- 172.21.15.73:0/2661224400 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0900c9990 0x7fb0901e3680 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:50.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.241+0000 7fb096cc0700 1 -- 172.21.15.73:0/2661224400 >> 172.21.15.73:0/2661224400 conn(0x7fb090066d70 msgr2=0x7fb090159a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:53:50.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.241+0000 7fb096cc0700 1 -- 172.21.15.73:0/2661224400 shutdown_connections 2024-05-08T21:53:50.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.241+0000 7fb096cc0700 1 -- 172.21.15.73:0/2661224400 wait complete. 2024-05-08T21:53:50.255 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T21:49:35.998578+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T21:49:42.171760+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T21:49:42.576293+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T21:53:50.255 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T21:53:50.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.379+0000 7f138accc700 1 Processor -- start 2024-05-08T21:53:50.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.379+0000 7f138accc700 1 -- start start 2024-05-08T21:53:50.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.380+0000 7f138accc700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1384150b40 0x7f13841571f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:50.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.380+0000 7f138accc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f13840c65d0 0x7f13840cc390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:50.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.380+0000 7f138accc700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1384156d60 con 0x7f1384071db0 2024-05-08T21:53:50.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.380+0000 7f138accc700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13840722f0 con 0x7f1384150b40 2024-05-08T21:53:50.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.380+0000 7f138accc700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13840c39c0 con 0x7f13840c65d0 2024-05-08T21:53:50.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.380+0000 7f1388a68700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1384150b40 0x7f13841571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:50.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.380+0000 7f1388a68700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1384150b40 0x7f13841571f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56406/0 (socket says 172.21.15.73:56406) 2024-05-08T21:53:50.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.380+0000 7f1388a68700 1 -- 172.21.15.73:0/210442982 learned_addr learned my addr 172.21.15.73:0/210442982 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:53:50.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.380+0000 7f1383fff700 1 --2- 172.21.15.73:0/210442982 >> v2:172.21.15.115:3300/0 conn(0x7f13840c65d0 0x7f13840cc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:50.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.380+0000 7f1388a68700 1 -- 172.21.15.73:0/210442982 >> v2:172.21.15.115:3300/0 conn(0x7f13840c65d0 msgr2=0x7f13840cc390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:53:50.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.380+0000 7f1388a68700 1 --2- 172.21.15.73:0/210442982 >> v2:172.21.15.115:3300/0 conn(0x7f13840c65d0 0x7f13840cc390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:50.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.380+0000 7f1388a68700 1 -- 172.21.15.73:0/210442982 >> v1:172.21.15.115:6789/0 conn(0x7f1384071db0 legacy=0x7f1384159ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:50.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.380+0000 7f1388a68700 1 -- 172.21.15.73:0/210442982 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13840c3ca0 con 0x7f1384150b40 2024-05-08T21:53:50.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.381+0000 7f1388a68700 1 --2- 172.21.15.73:0/210442982 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1384150b40 0x7f13841571f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f13840c9ed0 tx=0x7f1378009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a30364b9db88be85 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:50.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.381+0000 7f13837fe700 1 -- 172.21.15.73:0/210442982 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1378011830 con 0x7f1384150b40 2024-05-08T21:53:50.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.381+0000 7f13837fe700 1 -- 172.21.15.73:0/210442982 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1378011990 con 0x7f1384150b40 2024-05-08T21:53:50.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.381+0000 7f13837fe700 1 -- 172.21.15.73:0/210442982 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1378011d20 con 0x7f1384150b40 2024-05-08T21:53:50.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.381+0000 7f138accc700 1 -- 172.21.15.73:0/210442982 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1384150b40 msgr2=0x7f13841571f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:50.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.381+0000 7f138accc700 1 --2- 172.21.15.73:0/210442982 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1384150b40 0x7f13841571f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f13840c9ed0 tx=0x7f1378009bd0 comp rx=0 tx=0).stop 2024-05-08T21:53:50.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.381+0000 7f138accc700 1 -- 172.21.15.73:0/210442982 shutdown_connections 2024-05-08T21:53:50.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.381+0000 7f138accc700 1 --2- 172.21.15.73:0/210442982 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1384150b40 0x7f13841571f0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:50.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.381+0000 7f138accc700 1 --2- 172.21.15.73:0/210442982 >> v2:172.21.15.115:3300/0 conn(0x7f13840c65d0 0x7f13840cc390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:50.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.381+0000 7f138accc700 1 -- 172.21.15.73:0/210442982 >> 172.21.15.73:0/210442982 conn(0x7f1384066ab0 msgr2=0x7f138406f550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:53:50.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.381+0000 7f138accc700 1 -- 172.21.15.73:0/210442982 shutdown_connections 2024-05-08T21:53:50.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.381+0000 7f138accc700 1 -- 172.21.15.73:0/210442982 wait complete. 2024-05-08T21:53:50.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.383+0000 7f138accc700 1 Processor -- start 2024-05-08T21:53:50.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.383+0000 7f138accc700 1 -- start start 2024-05-08T21:53:50.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.384+0000 7f138accc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1384071db0 0x7f138413f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:50.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.384+0000 7f138accc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13840c65d0 0x7f13840c74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:50.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.384+0000 7f138accc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1384150b40 0x7f138414c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:50.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.384+0000 7f138accc700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1384139190 con 0x7f1384071db0 2024-05-08T21:53:50.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.384+0000 7f138accc700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13840c7040 con 0x7f1384150b40 2024-05-08T21:53:50.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.384+0000 7f138accc700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f138406ad70 con 0x7f13840c65d0 2024-05-08T21:53:50.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.384+0000 7f1388a68700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1384071db0 0x7f138413f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:50.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.384+0000 7f1388a68700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1384071db0 0x7f138413f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56416/0 (socket says 172.21.15.73:56416) 2024-05-08T21:53:50.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.384+0000 7f1388a68700 1 -- 172.21.15.73:0/1372927257 learned_addr learned my addr 172.21.15.73:0/1372927257 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:53:50.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.384+0000 7f1388a68700 1 -- 172.21.15.73:0/1372927257 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13840c65d0 msgr2=0x7f13840c74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:50.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.384+0000 7f1388a68700 1 --2- 172.21.15.73:0/1372927257 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13840c65d0 0x7f13840c74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:50.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.384+0000 7f1389269700 1 --2- 172.21.15.73:0/1372927257 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1384150b40 0x7f138414c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:50.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.384+0000 7f1388a68700 1 -- 172.21.15.73:0/1372927257 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1384150b40 msgr2=0x7f138414c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:50.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.384+0000 7f1388a68700 1 --2- 172.21.15.73:0/1372927257 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1384150b40 0x7f138414c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:50.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.384+0000 7f1388a68700 1 -- 172.21.15.73:0/1372927257 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1378009550 con 0x7f1384071db0 2024-05-08T21:53:50.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.384+0000 7f1388a68700 1 --2- 172.21.15.73:0/1372927257 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1384071db0 0x7f138413f030 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1378009c10 tx=0x7f1378004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:50.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.385+0000 7f13817fa700 1 -- 172.21.15.73:0/1372927257 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1378004530 con 0x7f1384071db0 2024-05-08T21:53:50.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.385+0000 7f13817fa700 1 -- 172.21.15.73:0/1372927257 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f137801f070 con 0x7f1384071db0 2024-05-08T21:53:50.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.385+0000 7f13817fa700 1 -- 172.21.15.73:0/1372927257 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13780038e0 con 0x7f1384071db0 2024-05-08T21:53:50.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.385+0000 7f138accc700 1 -- 172.21.15.73:0/1372927257 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f138414ac80 con 0x7f1384071db0 2024-05-08T21:53:50.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.385+0000 7f138accc700 1 -- 172.21.15.73:0/1372927257 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1384139380 con 0x7f1384071db0 2024-05-08T21:53:50.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.386+0000 7f138accc700 1 -- 172.21.15.73:0/1372927257 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13840c7320 con 0x7f1384071db0 2024-05-08T21:53:50.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.386+0000 7f13817fa700 1 -- 172.21.15.73:0/1372927257 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1378021030 con 0x7f1384071db0 2024-05-08T21:53:50.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.386+0000 7f13817fa700 1 --2- 172.21.15.73:0/1372927257 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f136806acc0 0x7f136806d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:50.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.387+0000 7f13817fa700 1 -- 172.21.15.73:0/1372927257 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5969+0+0 (secure 0 0 0) 0x7f137808a890 con 0x7f1384071db0 2024-05-08T21:53:50.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.387+0000 7f1383fff700 1 --2- 172.21.15.73:0/1372927257 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f136806acc0 0x7f136806d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:50.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.387+0000 7f1383fff700 1 --2- 172.21.15.73:0/1372927257 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f136806acc0 0x7f136806d180 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1370006b20 tx=0x7f1370006ab0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:50.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.391+0000 7f13817fa700 1 -- 172.21.15.73:0/1372927257 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f1378055a80 con 0x7f1384071db0 2024-05-08T21:53:50.577 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:53:50.579 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:53:50.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.589+0000 7f138accc700 1 -- 172.21.15.73:0/1372927257 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1384157710 con 0x7f1384071db0 2024-05-08T21:53:50.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.589+0000 7f13817fa700 1 -- 172.21.15.73:0/1372927257 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1384157710 con 0x7f1384071db0 2024-05-08T21:53:50.590 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-05-08T21:53:50.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.592+0000 7f138accc700 1 -- 172.21.15.73:0/1372927257 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f136806acc0 msgr2=0x7f136806d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:50.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.592+0000 7f138accc700 1 --2- 172.21.15.73:0/1372927257 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f136806acc0 0x7f136806d180 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1370006b20 tx=0x7f1370006ab0 comp rx=0 tx=0).stop 2024-05-08T21:53:50.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.592+0000 7f138accc700 1 -- 172.21.15.73:0/1372927257 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1384071db0 msgr2=0x7f138413f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:50.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.592+0000 7f138accc700 1 --2- 172.21.15.73:0/1372927257 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1384071db0 0x7f138413f030 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1378009c10 tx=0x7f1378004750 comp rx=0 tx=0).stop 2024-05-08T21:53:50.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.592+0000 7f138accc700 1 -- 172.21.15.73:0/1372927257 shutdown_connections 2024-05-08T21:53:50.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.592+0000 7f138accc700 1 --2- 172.21.15.73:0/1372927257 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f136806acc0 0x7f136806d180 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:50.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.592+0000 7f138accc700 1 --2- 172.21.15.73:0/1372927257 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1384150b40 0x7f138414c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:50.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.592+0000 7f138accc700 1 --2- 172.21.15.73:0/1372927257 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1384071db0 0x7f138413f030 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:50.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.592+0000 7f138accc700 1 --2- 172.21.15.73:0/1372927257 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13840c65d0 0x7f13840c74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:50.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.592+0000 7f138accc700 1 -- 172.21.15.73:0/1372927257 >> 172.21.15.73:0/1372927257 conn(0x7f1384066ab0 msgr2=0x7f138414fc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:53:50.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.592+0000 7f138accc700 1 -- 172.21.15.73:0/1372927257 shutdown_connections 2024-05-08T21:53:50.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.592+0000 7f138accc700 1 -- 172.21.15.73:0/1372927257 wait complete. 2024-05-08T21:53:50.606 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T21:53:50.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.801+0000 7ff95c031700 1 Processor -- start 2024-05-08T21:53:50.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.802+0000 7ff95c031700 1 -- start start 2024-05-08T21:53:50.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.802+0000 7ff95c031700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff954153f50 0x7ff9540ca140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:50.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.802+0000 7ff95c031700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff9540cc560 0x7ff954159c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:50.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.802+0000 7ff95c031700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff954154330 con 0x7ff9540c6130 2024-05-08T21:53:50.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.802+0000 7ff95c031700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9540ccff0 con 0x7ff9540cc560 2024-05-08T21:53:50.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.802+0000 7ff95c031700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9540cca30 con 0x7ff954153f50 2024-05-08T21:53:50.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.803+0000 7ff9595cc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff9540cc560 0x7ff954159c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:50.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.803+0000 7ff959dcd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff954153f50 0x7ff9540ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:50.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.803+0000 7ff95a5ce700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7ff9540c6130 0x7ff9540c8d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.73:40798/0 (socket says 172.21.15.73:40798) 2024-05-08T21:53:50.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.803+0000 7ff9595cc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff9540cc560 0x7ff954159c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.73:60354/0 (socket says 172.21.15.73:60354) 2024-05-08T21:53:50.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.803+0000 7ff95a5ce700 1 -- 172.21.15.73:0/2922610379 learned_addr learned my addr 172.21.15.73:0/2922610379 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:53:50.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.803+0000 7ff9595cc700 1 -- 172.21.15.73:0/2922610379 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff954153f50 msgr2=0x7ff9540ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:53:50.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.803+0000 7ff9595cc700 1 --2- 172.21.15.73:0/2922610379 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff954153f50 0x7ff9540ca140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:50.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.803+0000 7ff9595cc700 1 -- 172.21.15.73:0/2922610379 >> v1:172.21.15.115:6789/0 conn(0x7ff9540c6130 legacy=0x7ff9540c8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:50.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.803+0000 7ff958dcb700 1 -- 172.21.15.73:0/2922610379 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2360554200 0 0) 0x7ff954154330 con 0x7ff9540c6130 2024-05-08T21:53:50.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.803+0000 7ff9595cc700 1 -- 172.21.15.73:0/2922610379 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9540ccd10 con 0x7ff9540cc560 2024-05-08T21:53:50.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.803+0000 7ff9595cc700 1 --2- 172.21.15.73:0/2922610379 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9540cc560 0x7ff954159c00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff950009840 tx=0x7ff950009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be0dcd7400228fab server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:50.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.804+0000 7ff958dcb700 1 -- 172.21.15.73:0/2922610379 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff950011830 con 0x7ff9540cc560 2024-05-08T21:53:50.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.804+0000 7ff958dcb700 1 -- 172.21.15.73:0/2922610379 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff950011990 con 0x7ff9540cc560 2024-05-08T21:53:50.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.804+0000 7ff958dcb700 1 -- 172.21.15.73:0/2922610379 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff950011d20 con 0x7ff9540cc560 2024-05-08T21:53:50.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.804+0000 7ff95c031700 1 -- 172.21.15.73:0/2922610379 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9540cc560 msgr2=0x7ff954159c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:50.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.804+0000 7ff95c031700 1 --2- 172.21.15.73:0/2922610379 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9540cc560 0x7ff954159c00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff950009840 tx=0x7ff950009b50 comp rx=0 tx=0).stop 2024-05-08T21:53:50.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.804+0000 7ff95c031700 1 -- 172.21.15.73:0/2922610379 shutdown_connections 2024-05-08T21:53:50.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.804+0000 7ff95c031700 1 --2- 172.21.15.73:0/2922610379 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff954153f50 0x7ff9540ca140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:50.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.804+0000 7ff95c031700 1 --2- 172.21.15.73:0/2922610379 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9540cc560 0x7ff954159c00 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:50.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.804+0000 7ff95c031700 1 -- 172.21.15.73:0/2922610379 >> 172.21.15.73:0/2922610379 conn(0x7ff95406bad0 msgr2=0x7ff95406bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:53:50.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.804+0000 7ff95c031700 1 -- 172.21.15.73:0/2922610379 shutdown_connections 2024-05-08T21:53:50.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.804+0000 7ff95c031700 1 -- 172.21.15.73:0/2922610379 wait complete. 2024-05-08T21:53:50.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.805+0000 7ff95c031700 1 Processor -- start 2024-05-08T21:53:50.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.806+0000 7ff95c031700 1 -- start start 2024-05-08T21:53:50.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.806+0000 7ff95c031700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9540c6130 0x7ff95414c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:50.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.806+0000 7ff95c031700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff9540cc560 0x7ff9541551a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:50.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.806+0000 7ff95c031700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff954153f50 0x7ff9540c4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:50.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.806+0000 7ff95c031700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9541556e0 con 0x7ff9540c6130 2024-05-08T21:53:50.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.806+0000 7ff95c031700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff954155a50 con 0x7ff954153f50 2024-05-08T21:53:50.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.806+0000 7ff95c031700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff95415af20 con 0x7ff9540cc560 2024-05-08T21:53:50.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.806+0000 7ff959dcd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9540c6130 0x7ff95414c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:50.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.806+0000 7ff959dcd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9540c6130 0x7ff95414c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56428/0 (socket says 172.21.15.73:56428) 2024-05-08T21:53:50.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.806+0000 7ff959dcd700 1 -- 172.21.15.73:0/1210391642 learned_addr learned my addr 172.21.15.73:0/1210391642 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:53:50.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.807+0000 7ff95a5ce700 1 --2- 172.21.15.73:0/1210391642 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff954153f50 0x7ff9540c4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:50.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.807+0000 7ff9595cc700 1 --2- 172.21.15.73:0/1210391642 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff9540cc560 0x7ff9541551a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:50.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.807+0000 7ff959dcd700 1 -- 172.21.15.73:0/1210391642 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff9540cc560 msgr2=0x7ff9541551a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:50.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.807+0000 7ff959dcd700 1 --2- 172.21.15.73:0/1210391642 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff9540cc560 0x7ff9541551a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:50.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.807+0000 7ff959dcd700 1 -- 172.21.15.73:0/1210391642 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff954153f50 msgr2=0x7ff9540c4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:50.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.807+0000 7ff959dcd700 1 --2- 172.21.15.73:0/1210391642 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff954153f50 0x7ff9540c4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:50.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.807+0000 7ff959dcd700 1 -- 172.21.15.73:0/1210391642 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9500094a0 con 0x7ff9540c6130 2024-05-08T21:53:50.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.807+0000 7ff95a5ce700 1 --2- 172.21.15.73:0/1210391642 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff954153f50 0x7ff9540c4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:53:50.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.807+0000 7ff959dcd700 1 --2- 172.21.15.73:0/1210391642 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9540c6130 0x7ff95414c870 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff94400e9d0 tx=0x7ff94400ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:50.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.807+0000 7ff94a7fc700 1 -- 172.21.15.73:0/1210391642 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff944009730 con 0x7ff9540c6130 2024-05-08T21:53:50.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.807+0000 7ff94a7fc700 1 -- 172.21.15.73:0/1210391642 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff94400c850 con 0x7ff9540c6130 2024-05-08T21:53:50.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.807+0000 7ff95c031700 1 -- 172.21.15.73:0/1210391642 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff95415b4c0 con 0x7ff9540c6130 2024-05-08T21:53:50.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.807+0000 7ff94a7fc700 1 -- 172.21.15.73:0/1210391642 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94400cbe0 con 0x7ff9540c6130 2024-05-08T21:53:50.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.807+0000 7ff95c031700 1 -- 172.21.15.73:0/1210391642 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff954149990 con 0x7ff9540c6130 2024-05-08T21:53:50.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.808+0000 7ff95c031700 1 -- 172.21.15.73:0/1210391642 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff954068b80 con 0x7ff9540c6130 2024-05-08T21:53:50.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.809+0000 7ff94a7fc700 1 -- 172.21.15.73:0/1210391642 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff94400cd40 con 0x7ff9540c6130 2024-05-08T21:53:50.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.809+0000 7ff94a7fc700 1 --2- 172.21.15.73:0/1210391642 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7ff93806ac90 0x7ff93806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:50.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.809+0000 7ff94a7fc700 1 -- 172.21.15.73:0/1210391642 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5969+0+0 (secure 0 0 0) 0x7ff944089d10 con 0x7ff9540c6130 2024-05-08T21:53:50.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.809+0000 7ff9595cc700 1 --2- 172.21.15.73:0/1210391642 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7ff93806ac90 0x7ff93806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:50.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.810+0000 7ff9595cc700 1 --2- 172.21.15.73:0/1210391642 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7ff93806ac90 0x7ff93806d150 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff9540cc960 tx=0x7ff950008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:50.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:50.813+0000 7ff94a7fc700 1 -- 172.21.15.73:0/1210391642 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7ff944054e50 con 0x7ff9540c6130 2024-05-08T21:53:51.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.007+0000 7ff95c031700 1 -- 172.21.15.73:0/1210391642 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff9540cd130 con 0x7ff9540c6130 2024-05-08T21:53:51.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.007+0000 7ff94a7fc700 1 -- 172.21.15.73:0/1210391642 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff944058470 con 0x7ff9540c6130 2024-05-08T21:53:51.008 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-05-08T21:53:51.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.009+0000 7ff95c031700 1 -- 172.21.15.73:0/1210391642 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7ff93806ac90 msgr2=0x7ff93806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:51.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.009+0000 7ff95c031700 1 --2- 172.21.15.73:0/1210391642 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7ff93806ac90 0x7ff93806d150 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff9540cc960 tx=0x7ff950008030 comp rx=0 tx=0).stop 2024-05-08T21:53:51.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.009+0000 7ff95c031700 1 -- 172.21.15.73:0/1210391642 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9540c6130 msgr2=0x7ff95414c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:51.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.009+0000 7ff95c031700 1 --2- 172.21.15.73:0/1210391642 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9540c6130 0x7ff95414c870 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff94400e9d0 tx=0x7ff94400ed90 comp rx=0 tx=0).stop 2024-05-08T21:53:51.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.009+0000 7ff95c031700 1 -- 172.21.15.73:0/1210391642 shutdown_connections 2024-05-08T21:53:51.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.009+0000 7ff95c031700 1 --2- 172.21.15.73:0/1210391642 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7ff93806ac90 0x7ff93806d150 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:51.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.009+0000 7ff95c031700 1 --2- 172.21.15.73:0/1210391642 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff954153f50 0x7ff9540c4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:51.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.009+0000 7ff95c031700 1 --2- 172.21.15.73:0/1210391642 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9540c6130 0x7ff95414c870 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:51.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.009+0000 7ff95c031700 1 --2- 172.21.15.73:0/1210391642 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff9540cc560 0x7ff9541551a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:51.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.009+0000 7ff95c031700 1 -- 172.21.15.73:0/1210391642 >> 172.21.15.73:0/1210391642 conn(0x7ff95406bad0 msgr2=0x7ff954157e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:53:51.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.009+0000 7ff95c031700 1 -- 172.21.15.73:0/1210391642 shutdown_connections 2024-05-08T21:53:51.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.009+0000 7ff95c031700 1 -- 172.21.15.73:0/1210391642 wait complete. 2024-05-08T21:53:51.023 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T21:53:51.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.146+0000 7fbfac0ed700 1 Processor -- start 2024-05-08T21:53:51.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.146+0000 7fbfac0ed700 1 -- start start 2024-05-08T21:53:51.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.147+0000 7fbfac0ed700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fbfa415de50 0x7fbfa40cd9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:51.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.147+0000 7fbfac0ed700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbfa406d820 0x7fbfa40c8750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:51.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.147+0000 7fbfac0ed700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfa40cd550 con 0x7fbfa415d2a0 2024-05-08T21:53:51.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.147+0000 7fbfac0ed700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfa415e230 con 0x7fbfa406d820 2024-05-08T21:53:51.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.147+0000 7fbfac0ed700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfa406f2f0 con 0x7fbfa415de50 2024-05-08T21:53:51.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.147+0000 7fbfa9688700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbfa406d820 0x7fbfa40c8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:51.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.147+0000 7fbfa9688700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbfa406d820 0x7fbfa40c8750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56440/0 (socket says 172.21.15.73:56440) 2024-05-08T21:53:51.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.147+0000 7fbfa9688700 1 -- 172.21.15.73:0/847306688 learned_addr learned my addr 172.21.15.73:0/847306688 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:53:51.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.147+0000 7fbfa9e89700 1 --2- 172.21.15.73:0/847306688 >> v2:172.21.15.115:3300/0 conn(0x7fbfa415de50 0x7fbfa40cd9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:51.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.147+0000 7fbfa9688700 1 -- 172.21.15.73:0/847306688 >> v2:172.21.15.115:3300/0 conn(0x7fbfa415de50 msgr2=0x7fbfa40cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:53:51.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.147+0000 7fbfa9688700 1 --2- 172.21.15.73:0/847306688 >> v2:172.21.15.115:3300/0 conn(0x7fbfa415de50 0x7fbfa40cd9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:51.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.147+0000 7fbfa9688700 1 -- 172.21.15.73:0/847306688 >> v1:172.21.15.115:6789/0 conn(0x7fbfa415d2a0 legacy=0x7fbfa40ca050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:53:51.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.147+0000 7fbfa9688700 1 -- 172.21.15.73:0/847306688 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfa40c4470 con 0x7fbfa406d820 2024-05-08T21:53:51.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.148+0000 7fbfa9688700 1 --2- 172.21.15.73:0/847306688 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfa406d820 0x7fbfa40c8750 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fbfa40cb160 tx=0x7fbfa0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8371b39fadcadcfa server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:51.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.148+0000 7fbfa8e87700 1 -- 172.21.15.73:0/847306688 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa0004230 con 0x7fbfa406d820 2024-05-08T21:53:51.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.148+0000 7fbfa8e87700 1 -- 172.21.15.73:0/847306688 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfa0004390 con 0x7fbfa406d820 2024-05-08T21:53:51.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.148+0000 7fbfa8e87700 1 -- 172.21.15.73:0/847306688 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa00036a0 con 0x7fbfa406d820 2024-05-08T21:53:51.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.148+0000 7fbfac0ed700 1 -- 172.21.15.73:0/847306688 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfa406d820 msgr2=0x7fbfa40c8750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:51.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.148+0000 7fbfac0ed700 1 --2- 172.21.15.73:0/847306688 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfa406d820 0x7fbfa40c8750 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fbfa40cb160 tx=0x7fbfa0009bd0 comp rx=0 tx=0).stop 2024-05-08T21:53:51.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.148+0000 7fbfac0ed700 1 -- 172.21.15.73:0/847306688 shutdown_connections 2024-05-08T21:53:51.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.148+0000 7fbfac0ed700 1 --2- 172.21.15.73:0/847306688 >> v2:172.21.15.115:3300/0 conn(0x7fbfa415de50 0x7fbfa40cd9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:51.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.148+0000 7fbfac0ed700 1 --2- 172.21.15.73:0/847306688 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfa406d820 0x7fbfa40c8750 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:51.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.148+0000 7fbfac0ed700 1 -- 172.21.15.73:0/847306688 >> 172.21.15.73:0/847306688 conn(0x7fbfa406aff0 msgr2=0x7fbfa40666c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:53:51.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.148+0000 7fbfac0ed700 1 -- 172.21.15.73:0/847306688 shutdown_connections 2024-05-08T21:53:51.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.148+0000 7fbfac0ed700 1 -- 172.21.15.73:0/847306688 wait complete. 2024-05-08T21:53:51.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.150+0000 7fbfac0ed700 1 Processor -- start 2024-05-08T21:53:51.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.150+0000 7fbfac0ed700 1 -- start start 2024-05-08T21:53:51.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.150+0000 7fbfac0ed700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbfa406d820 0x7fbfa41541a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:51.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.150+0000 7fbfac0ed700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfa415de50 0x7fbfa4159400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:51.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.150+0000 7fbfac0ed700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbfa415cc10 0x7fbfa4154c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:51.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.150+0000 7fbfac0ed700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa4152460 con 0x7fbfa415de50 2024-05-08T21:53:51.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.150+0000 7fbfac0ed700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa41f0380 con 0x7fbfa406d820 2024-05-08T21:53:51.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.150+0000 7fbfac0ed700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa41efe40 con 0x7fbfa415cc10 2024-05-08T21:53:51.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.150+0000 7fbfa9688700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfa415de50 0x7fbfa4159400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:51.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.151+0000 7fbfa9688700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfa415de50 0x7fbfa4159400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56448/0 (socket says 172.21.15.73:56448) 2024-05-08T21:53:51.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.151+0000 7fbfa9688700 1 -- 172.21.15.73:0/3115171054 learned_addr learned my addr 172.21.15.73:0/3115171054 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:53:51.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.151+0000 7fbfaa68a700 1 --2- 172.21.15.73:0/3115171054 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbfa415cc10 0x7fbfa4154c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:51.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.151+0000 7fbfa9e89700 1 --2- 172.21.15.73:0/3115171054 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbfa406d820 0x7fbfa41541a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:51.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.151+0000 7fbfa9688700 1 -- 172.21.15.73:0/3115171054 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbfa415cc10 msgr2=0x7fbfa4154c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:51.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.151+0000 7fbfa9688700 1 --2- 172.21.15.73:0/3115171054 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbfa415cc10 0x7fbfa4154c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:51.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.151+0000 7fbfa9688700 1 -- 172.21.15.73:0/3115171054 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbfa406d820 msgr2=0x7fbfa41541a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:51.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.151+0000 7fbfa9688700 1 --2- 172.21.15.73:0/3115171054 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbfa406d820 0x7fbfa41541a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:51.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.151+0000 7fbfa9688700 1 -- 172.21.15.73:0/3115171054 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfa0009550 con 0x7fbfa415de50 2024-05-08T21:53:51.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.151+0000 7fbfa9e89700 1 --2- 172.21.15.73:0/3115171054 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbfa406d820 0x7fbfa41541a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:53:51.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.151+0000 7fbfa9688700 1 --2- 172.21.15.73:0/3115171054 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfa415de50 0x7fbfa4159400 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fbfa0009130 tx=0x7fbfa0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:51.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.151+0000 7fbf9a7fc700 1 -- 172.21.15.73:0/3115171054 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa0003d40 con 0x7fbfa415de50 2024-05-08T21:53:51.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.151+0000 7fbf9a7fc700 1 -- 172.21.15.73:0/3115171054 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfa001f070 con 0x7fbfa415de50 2024-05-08T21:53:51.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.151+0000 7fbfac0ed700 1 -- 172.21.15.73:0/3115171054 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfa41514d0 con 0x7fbfa415de50 2024-05-08T21:53:51.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.151+0000 7fbf9a7fc700 1 -- 172.21.15.73:0/3115171054 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa0011870 con 0x7fbfa415de50 2024-05-08T21:53:51.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.151+0000 7fbfac0ed700 1 -- 172.21.15.73:0/3115171054 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfa4151ac0 con 0x7fbfa415de50 2024-05-08T21:53:51.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.152+0000 7fbfac0ed700 1 -- 172.21.15.73:0/3115171054 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfa41525a0 con 0x7fbfa415de50 2024-05-08T21:53:51.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.152+0000 7fbf9a7fc700 1 -- 172.21.15.73:0/3115171054 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbfa0021030 con 0x7fbfa415de50 2024-05-08T21:53:51.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.153+0000 7fbf9a7fc700 1 --2- 172.21.15.73:0/3115171054 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fbf8806ac90 0x7fbf8806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:51.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.153+0000 7fbf9a7fc700 1 -- 172.21.15.73:0/3115171054 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5969+0+0 (secure 0 0 0) 0x7fbfa008ab40 con 0x7fbfa415de50 2024-05-08T21:53:51.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.153+0000 7fbfa9e89700 1 --2- 172.21.15.73:0/3115171054 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fbf8806ac90 0x7fbf8806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:51.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.153+0000 7fbfa9e89700 1 --2- 172.21.15.73:0/3115171054 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fbf8806ac90 0x7fbf8806d150 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbf94009820 tx=0x7fbf94008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:51.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.157+0000 7fbf9a7fc700 1 -- 172.21.15.73:0/3115171054 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fbfa41525a0 con 0x7fbfa415de50 2024-05-08T21:53:51.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.361+0000 7fbfac0ed700 1 -- 172.21.15.73:0/3115171054 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbfa41525a0 con 0x7fbfa415de50 2024-05-08T21:53:51.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.362+0000 7fbf9a7fc700 1 -- 172.21.15.73:0/3115171054 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbfa41525a0 con 0x7fbfa415de50 2024-05-08T21:53:51.363 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-05-08T21:53:51.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.364+0000 7fbfac0ed700 1 -- 172.21.15.73:0/3115171054 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fbf8806ac90 msgr2=0x7fbf8806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:51.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.364+0000 7fbfac0ed700 1 --2- 172.21.15.73:0/3115171054 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fbf8806ac90 0x7fbf8806d150 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbf94009820 tx=0x7fbf94008040 comp rx=0 tx=0).stop 2024-05-08T21:53:51.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.364+0000 7fbfac0ed700 1 -- 172.21.15.73:0/3115171054 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfa415de50 msgr2=0x7fbfa4159400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:51.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.364+0000 7fbfac0ed700 1 --2- 172.21.15.73:0/3115171054 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfa415de50 0x7fbfa4159400 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fbfa0009130 tx=0x7fbfa0004750 comp rx=0 tx=0).stop 2024-05-08T21:53:51.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.364+0000 7fbfac0ed700 1 -- 172.21.15.73:0/3115171054 shutdown_connections 2024-05-08T21:53:51.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.364+0000 7fbfac0ed700 1 --2- 172.21.15.73:0/3115171054 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fbf8806ac90 0x7fbf8806d150 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:51.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.364+0000 7fbfac0ed700 1 --2- 172.21.15.73:0/3115171054 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbfa415cc10 0x7fbfa4154c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:51.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.364+0000 7fbfac0ed700 1 --2- 172.21.15.73:0/3115171054 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbfa406d820 0x7fbfa41541a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:51.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.364+0000 7fbfac0ed700 1 --2- 172.21.15.73:0/3115171054 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfa415de50 0x7fbfa4159400 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:51.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.364+0000 7fbfac0ed700 1 -- 172.21.15.73:0/3115171054 >> 172.21.15.73:0/3115171054 conn(0x7fbfa406aff0 msgr2=0x7fbfa40666c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:53:51.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.364+0000 7fbfac0ed700 1 -- 172.21.15.73:0/3115171054 shutdown_connections 2024-05-08T21:53:51.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.364+0000 7fbfac0ed700 1 -- 172.21.15.73:0/3115171054 wait complete. 2024-05-08T21:53:51.378 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-08T21:53:51.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.500+0000 7f1e45b69700 1 Processor -- start 2024-05-08T21:53:51.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.500+0000 7f1e45b69700 1 -- start start 2024-05-08T21:53:51.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.501+0000 7f1e45b69700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1e40150c50 0x7f1e40072a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:51.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.501+0000 7f1e45b69700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e400cb250 0x7f1e400c9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:51.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.501+0000 7f1e45b69700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e400c3eb0 con 0x7f1e400ca140 2024-05-08T21:53:51.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.501+0000 7f1e45b69700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e400c3bd0 con 0x7f1e40150c50 2024-05-08T21:53:51.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.501+0000 7f1e45b69700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e400c5580 con 0x7f1e400cb250 2024-05-08T21:53:51.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.501+0000 7f1e3ffff700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f1e400ca140 0x7f1e400cc2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:33584/0 (socket says 172.21.15.73:33584) 2024-05-08T21:53:51.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.501+0000 7f1e3ffff700 1 -- 172.21.15.73:0/1506762686 learned_addr learned my addr 172.21.15.73:0/1506762686 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:53:51.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.501+0000 7f1e3effd700 1 --2- 172.21.15.73:0/1506762686 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e400cb250 0x7f1e400c9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:51.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.501+0000 7f1e3f7fe700 1 --2- 172.21.15.73:0/1506762686 >> v2:172.21.15.115:3300/0 conn(0x7f1e40150c50 0x7f1e40072a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:51.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.501+0000 7f1e3e7fc700 1 -- 172.21.15.73:0/1506762686 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 885794967 0 0) 0x7f1e400c3eb0 con 0x7f1e400ca140 2024-05-08T21:53:51.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.501+0000 7f1e3e7fc700 1 -- 172.21.15.73:0/1506762686 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e280035b0 con 0x7f1e400ca140 2024-05-08T21:53:51.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.501+0000 7f1e3e7fc700 1 -- 172.21.15.73:0/1506762686 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 570470683 0 0) 0x7f1e280035b0 con 0x7f1e400ca140 2024-05-08T21:53:51.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.501+0000 7f1e3e7fc700 1 -- 172.21.15.73:0/1506762686 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e400cb250 msgr2=0x7f1e400c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:53:51.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.501+0000 7f1e3e7fc700 1 --2- 172.21.15.73:0/1506762686 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e400cb250 0x7f1e400c9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:51.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.501+0000 7f1e3e7fc700 1 -- 172.21.15.73:0/1506762686 >> v2:172.21.15.115:3300/0 conn(0x7f1e40150c50 msgr2=0x7f1e40072a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:53:51.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.501+0000 7f1e3e7fc700 1 --2- 172.21.15.73:0/1506762686 >> v2:172.21.15.115:3300/0 conn(0x7f1e40150c50 0x7f1e40072a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:51.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.501+0000 7f1e3e7fc700 1 -- 172.21.15.73:0/1506762686 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e400c5860 con 0x7f1e400ca140 2024-05-08T21:53:51.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.502+0000 7f1e3e7fc700 1 -- 172.21.15.73:0/1506762686 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 953298616 0 0) 0x7f1e380019f0 con 0x7f1e400ca140 2024-05-08T21:53:51.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.502+0000 7f1e3e7fc700 1 -- 172.21.15.73:0/1506762686 >> v1:172.21.15.73:6789/0 conn(0x7f1e400ca140 legacy=0x7f1e400cc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:51.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.502+0000 7f1e3e7fc700 1 --2- 172.21.15.73:0/1506762686 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e400cb250 0x7f1e28003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:51.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.502+0000 7f1e3e7fc700 1 --2- 172.21.15.73:0/1506762686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e28003f80 0x7f1e28004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:51.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.502+0000 7f1e3e7fc700 1 --2- 172.21.15.73:0/1506762686 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e28004d90 0x7f1e28005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:51.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.502+0000 7f1e3e7fc700 1 -- 172.21.15.73:0/1506762686 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e400c3bd0 con 0x7f1e28003f80 2024-05-08T21:53:51.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.502+0000 7f1e3e7fc700 1 -- 172.21.15.73:0/1506762686 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e400c5580 con 0x7f1e28004d90 2024-05-08T21:53:51.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.502+0000 7f1e3e7fc700 1 -- 172.21.15.73:0/1506762686 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2800ba40 con 0x7f1e400cb250 2024-05-08T21:53:51.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.502+0000 7f1e3effd700 1 --2- 172.21.15.73:0/1506762686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e28003f80 0x7f1e28004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:51.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.502+0000 7f1e3f7fe700 1 --2- 172.21.15.73:0/1506762686 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e400cb250 0x7f1e28003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:51.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.502+0000 7f1e3ffff700 1 --2- 172.21.15.73:0/1506762686 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e28004d90 0x7f1e28005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:51.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.502+0000 7f1e3effd700 1 -- 172.21.15.73:0/1506762686 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e400cb250 msgr2=0x7f1e28003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:53:51.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.502+0000 7f1e3effd700 1 --2- 172.21.15.73:0/1506762686 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e400cb250 0x7f1e28003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:51.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.502+0000 7f1e3effd700 1 -- 172.21.15.73:0/1506762686 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e28004d90 msgr2=0x7f1e28005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:53:51.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.502+0000 7f1e3effd700 1 --2- 172.21.15.73:0/1506762686 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e28004d90 0x7f1e28005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:51.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.502+0000 7f1e3effd700 1 -- 172.21.15.73:0/1506762686 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e280035b0 con 0x7f1e28003f80 2024-05-08T21:53:51.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.502+0000 7f1e3ffff700 1 --2- 172.21.15.73:0/1506762686 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e28004d90 0x7f1e28005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:53:51.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.502+0000 7f1e3effd700 1 --2- 172.21.15.73:0/1506762686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e28003f80 0x7f1e28004850 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1e30009b60 tx=0x7f1e28005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ec22dfa01aa0288 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:51.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.502+0000 7f1e3e7fc700 1 -- 172.21.15.73:0/1506762686 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3000e6c0 con 0x7f1e28003f80 2024-05-08T21:53:51.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.502+0000 7f1e3e7fc700 1 -- 172.21.15.73:0/1506762686 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e3000e820 con 0x7f1e28003f80 2024-05-08T21:53:51.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.502+0000 7f1e3e7fc700 1 -- 172.21.15.73:0/1506762686 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3000eb90 con 0x7f1e28003f80 2024-05-08T21:53:51.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.503+0000 7f1e45b69700 1 -- 172.21.15.73:0/1506762686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e28003f80 msgr2=0x7f1e28004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:51.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.503+0000 7f1e45b69700 1 --2- 172.21.15.73:0/1506762686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e28003f80 0x7f1e28004850 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1e30009b60 tx=0x7f1e28005880 comp rx=0 tx=0).stop 2024-05-08T21:53:51.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.503+0000 7f1e3ffff700 1 -- 172.21.15.73:0/1506762686 reap_dead start 2024-05-08T21:53:51.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.503+0000 7f1e45b69700 1 -- 172.21.15.73:0/1506762686 shutdown_connections 2024-05-08T21:53:51.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.503+0000 7f1e45b69700 1 -- 172.21.15.73:0/1506762686 >> 172.21.15.73:0/1506762686 conn(0x7f1e4006bad0 msgr2=0x7f1e4006bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:53:51.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.503+0000 7f1e45b69700 1 -- 172.21.15.73:0/1506762686 shutdown_connections 2024-05-08T21:53:51.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.503+0000 7f1e45b69700 1 -- 172.21.15.73:0/1506762686 wait complete. 2024-05-08T21:53:51.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.504+0000 7f1e45b69700 1 Processor -- start 2024-05-08T21:53:51.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.504+0000 7f1e45b69700 1 -- start start 2024-05-08T21:53:51.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.505+0000 7f1e45b69700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e28003f80 0x7f1e40145db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:51.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.505+0000 7f1e45b69700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e4014aef0 0x7f1e400c8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:51.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.505+0000 7f1e45b69700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e401f3000 0x7f1e401f34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:51.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.505+0000 7f1e45b69700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4014c670 con 0x7f1e4014aef0 2024-05-08T21:53:51.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.505+0000 7f1e45b69700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e401462f0 con 0x7f1e28003f80 2024-05-08T21:53:51.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.505+0000 7f1e45b69700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4014c930 con 0x7f1e401f3000 2024-05-08T21:53:51.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.505+0000 7f1e3effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e4014aef0 0x7f1e400c8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:51.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.505+0000 7f1e3effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e4014aef0 0x7f1e400c8fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56470/0 (socket says 172.21.15.73:56470) 2024-05-08T21:53:51.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.505+0000 7f1e3effd700 1 -- 172.21.15.73:0/2299693767 learned_addr learned my addr 172.21.15.73:0/2299693767 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:53:51.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.505+0000 7f1e3ffff700 1 --2- 172.21.15.73:0/2299693767 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e401f3000 0x7f1e401f34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:51.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.505+0000 7f1e3f7fe700 1 --2- 172.21.15.73:0/2299693767 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e28003f80 0x7f1e40145db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:51.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.505+0000 7f1e3effd700 1 -- 172.21.15.73:0/2299693767 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e401f3000 msgr2=0x7f1e401f34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:51.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.505+0000 7f1e3effd700 1 --2- 172.21.15.73:0/2299693767 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e401f3000 0x7f1e401f34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:51.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.505+0000 7f1e3effd700 1 -- 172.21.15.73:0/2299693767 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e28003f80 msgr2=0x7f1e40145db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:51.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.505+0000 7f1e3effd700 1 --2- 172.21.15.73:0/2299693767 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e28003f80 0x7f1e40145db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:51.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.505+0000 7f1e3effd700 1 -- 172.21.15.73:0/2299693767 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e401f2b70 con 0x7f1e4014aef0 2024-05-08T21:53:51.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.505+0000 7f1e3effd700 1 --2- 172.21.15.73:0/2299693767 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e4014aef0 0x7f1e400c8fe0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1e3000e4b0 tx=0x7f1e300047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:51.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.505+0000 7f1e27fff700 1 -- 172.21.15.73:0/2299693767 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3000e6c0 con 0x7f1e4014aef0 2024-05-08T21:53:51.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.505+0000 7f1e27fff700 1 -- 172.21.15.73:0/2299693767 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e30003ab0 con 0x7f1e4014aef0 2024-05-08T21:53:51.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.506+0000 7f1e27fff700 1 -- 172.21.15.73:0/2299693767 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e30003e60 con 0x7f1e4014aef0 2024-05-08T21:53:51.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.506+0000 7f1e45b69700 1 -- 172.21.15.73:0/2299693767 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e401f39f0 con 0x7f1e4014aef0 2024-05-08T21:53:51.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.506+0000 7f1e45b69700 1 -- 172.21.15.73:0/2299693767 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e4014ce40 con 0x7f1e4014aef0 2024-05-08T21:53:51.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.506+0000 7f1e45b69700 1 -- 172.21.15.73:0/2299693767 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e401f2d00 con 0x7f1e4014aef0 2024-05-08T21:53:51.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.507+0000 7f1e27fff700 1 -- 172.21.15.73:0/2299693767 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1e30013470 con 0x7f1e4014aef0 2024-05-08T21:53:51.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.507+0000 7f1e27fff700 1 --2- 172.21.15.73:0/2299693767 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f1e2c06ac90 0x7f1e2c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:51.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.507+0000 7f1e27fff700 1 -- 172.21.15.73:0/2299693767 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5969+0+0 (secure 0 0 0) 0x7f1e3008ac70 con 0x7f1e4014aef0 2024-05-08T21:53:51.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.507+0000 7f1e3f7fe700 1 --2- 172.21.15.73:0/2299693767 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f1e2c06ac90 0x7f1e2c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:51.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.508+0000 7f1e3f7fe700 1 --2- 172.21.15.73:0/2299693767 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f1e2c06ac90 0x7f1e2c06d150 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1e34009c20 tx=0x7f1e34008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:51.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.512+0000 7f1e27fff700 1 -- 172.21.15.73:0/2299693767 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f1e30055f30 con 0x7f1e4014aef0 2024-05-08T21:53:51.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.723+0000 7f1e45b69700 1 -- 172.21.15.73:0/2299693767 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f1e400c3540 con 0x7f1e4014aef0 2024-05-08T21:53:51.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.723+0000 7f1e27fff700 1 -- 172.21.15.73:0/2299693767 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v24) v1 ==== 80+0+122 (secure 0 0 0) 0x7f1e30017080 con 0x7f1e4014aef0 2024-05-08T21:53:51.724 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:6839/1477468490 2024-05-09T21:52:05.996377+0000 2024-05-08T21:53:51.725 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:6838/1477468490 2024-05-09T21:52:05.996377+0000 2024-05-08T21:53:51.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.725+0000 7f1e45b69700 1 -- 172.21.15.73:0/2299693767 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f1e2c06ac90 msgr2=0x7f1e2c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:51.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.725+0000 7f1e45b69700 1 --2- 172.21.15.73:0/2299693767 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f1e2c06ac90 0x7f1e2c06d150 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1e34009c20 tx=0x7f1e34008040 comp rx=0 tx=0).stop 2024-05-08T21:53:51.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.725+0000 7f1e45b69700 1 -- 172.21.15.73:0/2299693767 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e4014aef0 msgr2=0x7f1e400c8fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:51.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.725+0000 7f1e45b69700 1 --2- 172.21.15.73:0/2299693767 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e4014aef0 0x7f1e400c8fe0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1e3000e4b0 tx=0x7f1e300047c0 comp rx=0 tx=0).stop 2024-05-08T21:53:51.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.726+0000 7f1e45b69700 1 -- 172.21.15.73:0/2299693767 shutdown_connections 2024-05-08T21:53:51.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.726+0000 7f1e45b69700 1 --2- 172.21.15.73:0/2299693767 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f1e2c06ac90 0x7f1e2c06d150 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:51.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.726+0000 7f1e45b69700 1 --2- 172.21.15.73:0/2299693767 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e401f3000 0x7f1e401f34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:51.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.726+0000 7f1e45b69700 1 --2- 172.21.15.73:0/2299693767 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e28003f80 0x7f1e40145db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:51.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.726+0000 7f1e45b69700 1 --2- 172.21.15.73:0/2299693767 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e4014aef0 0x7f1e400c8fe0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:51.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.726+0000 7f1e45b69700 1 -- 172.21.15.73:0/2299693767 >> 172.21.15.73:0/2299693767 conn(0x7f1e4006bad0 msgr2=0x7f1e4006bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:53:51.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.726+0000 7f1e45b69700 1 -- 172.21.15.73:0/2299693767 shutdown_connections 2024-05-08T21:53:51.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:51.726+0000 7f1e45b69700 1 -- 172.21.15.73:0/2299693767 wait complete. 2024-05-08T21:53:51.728 INFO:teuthology.orchestra.run.smithi073.stderr:listed 2 entries 2024-05-08T21:53:51.739 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-08T21:53:51.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:53:51.740 DEBUG:teuthology.orchestra.run.smithi073:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-08T21:53:51.806 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi073.front.sepia.ceph.com 2024-05-08T21:53:51.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:53:51.807 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-08T21:53:51.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:53:51.839 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2024-05-08T21:53:51.897 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-08T21:53:51.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:53:51.898 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-08T21:53:51.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:53:51.982 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link delete ceph-brx 2024-05-08T21:53:52.083 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-05-08T21:53:52.093 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-08T21:53:52.093 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T21:53:52.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.215+0000 7f5f03997700 1 Processor -- start 2024-05-08T21:53:52.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.216+0000 7f5f03997700 1 -- start start 2024-05-08T21:53:52.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.216+0000 7f5f03997700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5efc0cb630 0x7f5efc0cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:52.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.216+0000 7f5f03997700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5efc0cafc0 0x7f5efc0cc480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:52.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.216+0000 7f5f03997700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5efc15e1b0 con 0x7f5efc153ed0 2024-05-08T21:53:52.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.216+0000 7f5f03997700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5efc0ca930 con 0x7f5efc0cb630 2024-05-08T21:53:52.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.216+0000 7f5f03997700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5efc06bc00 con 0x7f5efc0cafc0 2024-05-08T21:53:52.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.216+0000 7f5f00f32700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5efc0cb630 0x7f5efc0cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:52.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.217+0000 7f5f00f32700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5efc0cb630 0x7f5efc0cbf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56474/0 (socket says 172.21.15.73:56474) 2024-05-08T21:53:52.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.217+0000 7f5f00f32700 1 -- 172.21.15.73:0/489427038 learned_addr learned my addr 172.21.15.73:0/489427038 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:53:52.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.217+0000 7f5f01f34700 1 --2- 172.21.15.73:0/489427038 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5efc0cafc0 0x7f5efc0cc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:52.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.217+0000 7f5f00f32700 1 -- 172.21.15.73:0/489427038 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5efc0cafc0 msgr2=0x7f5efc0cc480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:53:52.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.217+0000 7f5f00f32700 1 --2- 172.21.15.73:0/489427038 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5efc0cafc0 0x7f5efc0cc480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:52.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.217+0000 7f5f00f32700 1 -- 172.21.15.73:0/489427038 >> v1:172.21.15.115:6789/0 conn(0x7f5efc153ed0 legacy=0x7f5efc06c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:52.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.217+0000 7f5f00f32700 1 -- 172.21.15.73:0/489427038 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5efc0cbcc0 con 0x7f5efc0cb630 2024-05-08T21:53:52.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.217+0000 7f5f00f32700 1 --2- 172.21.15.73:0/489427038 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5efc0cb630 0x7f5efc0cbf40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5ef80098f0 tx=0x7f5ef8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f95657cfc1e8a405 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:52.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.217+0000 7f5eeffff700 1 -- 172.21.15.73:0/489427038 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef800b8a0 con 0x7f5efc0cb630 2024-05-08T21:53:52.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.217+0000 7f5eeffff700 1 -- 172.21.15.73:0/489427038 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ef800ba00 con 0x7f5efc0cb630 2024-05-08T21:53:52.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.217+0000 7f5eeffff700 1 -- 172.21.15.73:0/489427038 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef800bd90 con 0x7f5efc0cb630 2024-05-08T21:53:52.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.218+0000 7f5f03997700 1 -- 172.21.15.73:0/489427038 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5efc0cb630 msgr2=0x7f5efc0cbf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:52.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.218+0000 7f5f03997700 1 --2- 172.21.15.73:0/489427038 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5efc0cb630 0x7f5efc0cbf40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5ef80098f0 tx=0x7f5ef8009c00 comp rx=0 tx=0).stop 2024-05-08T21:53:52.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.218+0000 7f5f03997700 1 -- 172.21.15.73:0/489427038 shutdown_connections 2024-05-08T21:53:52.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.218+0000 7f5f03997700 1 --2- 172.21.15.73:0/489427038 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5efc0cafc0 0x7f5efc0cc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:52.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.218+0000 7f5f03997700 1 --2- 172.21.15.73:0/489427038 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5efc0cb630 0x7f5efc0cbf40 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:52.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.218+0000 7f5f03997700 1 -- 172.21.15.73:0/489427038 >> 172.21.15.73:0/489427038 conn(0x7f5efc0666c0 msgr2=0x7f5efc066ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:53:52.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.218+0000 7f5f03997700 1 -- 172.21.15.73:0/489427038 shutdown_connections 2024-05-08T21:53:52.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.218+0000 7f5f03997700 1 -- 172.21.15.73:0/489427038 wait complete. 2024-05-08T21:53:52.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.219+0000 7f5f03997700 1 Processor -- start 2024-05-08T21:53:52.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.219+0000 7f5f03997700 1 -- start start 2024-05-08T21:53:52.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.220+0000 7f5f03997700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5efc0cafc0 0x7f5efc149b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:52.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.220+0000 7f5f03997700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5efc0cb630 0x7f5efc14a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:52.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.220+0000 7f5f03997700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5efc153ed0 0x7f5efc15c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:52.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.220+0000 7f5f03997700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5efc1ef980 con 0x7f5efc0cafc0 2024-05-08T21:53:52.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.220+0000 7f5f03997700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5efc1efc60 con 0x7f5efc0cb630 2024-05-08T21:53:52.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.220+0000 7f5f03997700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5efc1eff40 con 0x7f5efc153ed0 2024-05-08T21:53:52.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.220+0000 7f5f01733700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5efc0cafc0 0x7f5efc149b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:52.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.220+0000 7f5f01733700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5efc0cafc0 0x7f5efc149b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56480/0 (socket says 172.21.15.73:56480) 2024-05-08T21:53:52.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.220+0000 7f5f01733700 1 -- 172.21.15.73:0/1967270220 learned_addr learned my addr 172.21.15.73:0/1967270220 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:53:52.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.220+0000 7f5f00f32700 1 --2- 172.21.15.73:0/1967270220 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5efc0cb630 0x7f5efc14a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:52.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.220+0000 7f5f01f34700 1 --2- 172.21.15.73:0/1967270220 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5efc153ed0 0x7f5efc15c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:52.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.220+0000 7f5f01733700 1 -- 172.21.15.73:0/1967270220 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5efc153ed0 msgr2=0x7f5efc15c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:52.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.220+0000 7f5f01733700 1 --2- 172.21.15.73:0/1967270220 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5efc153ed0 0x7f5efc15c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:52.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.220+0000 7f5f01733700 1 -- 172.21.15.73:0/1967270220 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5efc0cb630 msgr2=0x7f5efc14a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:52.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.220+0000 7f5f01733700 1 --2- 172.21.15.73:0/1967270220 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5efc0cb630 0x7f5efc14a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:52.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.220+0000 7f5f01733700 1 -- 172.21.15.73:0/1967270220 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ef8009550 con 0x7f5efc0cafc0 2024-05-08T21:53:52.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.220+0000 7f5f01733700 1 --2- 172.21.15.73:0/1967270220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5efc0cafc0 0x7f5efc149b30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5ef000c450 tx=0x7f5ef000c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:52.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.220+0000 7f5eedffb700 1 -- 172.21.15.73:0/1967270220 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef00052d0 con 0x7f5efc0cafc0 2024-05-08T21:53:52.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.220+0000 7f5eedffb700 1 -- 172.21.15.73:0/1967270220 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ef0005430 con 0x7f5efc0cafc0 2024-05-08T21:53:52.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.220+0000 7f5eedffb700 1 -- 172.21.15.73:0/1967270220 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef00038c0 con 0x7f5efc0cafc0 2024-05-08T21:53:52.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.220+0000 7f5f03997700 1 -- 172.21.15.73:0/1967270220 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5efc1f0220 con 0x7f5efc0cafc0 2024-05-08T21:53:52.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.221+0000 7f5f03997700 1 -- 172.21.15.73:0/1967270220 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5efc1ef630 con 0x7f5efc0cafc0 2024-05-08T21:53:52.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.222+0000 7f5f03997700 1 -- 172.21.15.73:0/1967270220 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5efc06c5c0 con 0x7f5efc0cafc0 2024-05-08T21:53:52.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.222+0000 7f5eedffb700 1 -- 172.21.15.73:0/1967270220 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5ef0003a20 con 0x7f5efc0cafc0 2024-05-08T21:53:52.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.222+0000 7f5eedffb700 1 --2- 172.21.15.73:0/1967270220 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f5ee006ac90 0x7f5ee006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:52.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.223+0000 7f5f00f32700 1 --2- 172.21.15.73:0/1967270220 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f5ee006ac90 0x7f5ee006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:52.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.223+0000 7f5eedffb700 1 -- 172.21.15.73:0/1967270220 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5969+0+0 (secure 0 0 0) 0x7f5ef0088810 con 0x7f5efc0cafc0 2024-05-08T21:53:52.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.223+0000 7f5f00f32700 1 --2- 172.21.15.73:0/1967270220 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f5ee006ac90 0x7f5ee006d150 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5efc0cba50 tx=0x7f5ef8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:52.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.227+0000 7f5eedffb700 1 -- 172.21.15.73:0/1967270220 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f5ef00538e0 con 0x7f5efc0cafc0 2024-05-08T21:53:52.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.425+0000 7f5f03997700 1 -- 172.21.15.73:0/1967270220 --> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5efc06b890 con 0x7f5ee006ac90 2024-05-08T21:53:52.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.433+0000 7f5eedffb700 1 -- 172.21.15.73:0/1967270220 <== mgr.4104 v2:172.21.15.73:6832/46949 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289872 (secure 0 0 0) 0x7f5ef800bb70 con 0x7f5ee006ac90 2024-05-08T21:53:52.438 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:53:52.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.436+0000 7f5f03997700 1 -- 172.21.15.73:0/1967270220 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f5ee006ac90 msgr2=0x7f5ee006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:52.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.436+0000 7f5f03997700 1 --2- 172.21.15.73:0/1967270220 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f5ee006ac90 0x7f5ee006d150 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5efc0cba50 tx=0x7f5ef8008030 comp rx=0 tx=0).stop 2024-05-08T21:53:52.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.436+0000 7f5f03997700 1 -- 172.21.15.73:0/1967270220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5efc0cafc0 msgr2=0x7f5efc149b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:52.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.436+0000 7f5f03997700 1 --2- 172.21.15.73:0/1967270220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5efc0cafc0 0x7f5efc149b30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5ef000c450 tx=0x7f5ef000c760 comp rx=0 tx=0).stop 2024-05-08T21:53:52.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.436+0000 7f5f03997700 1 -- 172.21.15.73:0/1967270220 shutdown_connections 2024-05-08T21:53:52.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.436+0000 7f5f03997700 1 --2- 172.21.15.73:0/1967270220 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f5ee006ac90 0x7f5ee006d150 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:52.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.436+0000 7f5f03997700 1 --2- 172.21.15.73:0/1967270220 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5efc153ed0 0x7f5efc15c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:52.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.436+0000 7f5f03997700 1 --2- 172.21.15.73:0/1967270220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5efc0cafc0 0x7f5efc149b30 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:52.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.436+0000 7f5f03997700 1 --2- 172.21.15.73:0/1967270220 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5efc0cb630 0x7f5efc14a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:52.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.436+0000 7f5f03997700 1 -- 172.21.15.73:0/1967270220 >> 172.21.15.73:0/1967270220 conn(0x7f5efc0666c0 msgr2=0x7f5efc0ceb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:53:52.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.437+0000 7f5f03997700 1 -- 172.21.15.73:0/1967270220 shutdown_connections 2024-05-08T21:53:52.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.437+0000 7f5f03997700 1 -- 172.21.15.73:0/1967270220 wait complete. 2024-05-08T21:53:52.441 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-05-08T21:53:52.450 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":145,"stamp":"2024-05-08T21:53:52.017183+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2173623217,"num_objects":543,"num_object_clones":0,"num_object_copies":1086,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":543,"num_whiteouts":0,"num_read":198,"num_read_kb":190,"num_write":9104,"num_write_kb":25168788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10207,"ondisk_log_size":10207,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":7183216,"kb_used_data":6926128,"kb_used_omap":12,"kb_used_meta":248819,"kb_avail":747791504,"statfs":{"total":773094113280,"available":765738500096,"internally_reserved":0,"allocated":7092355072,"data_stored":7091049853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":254791226},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8564758204,"num_objects":-2042,"num_object_clones":0,"num_object_copies":-4084,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2042,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2050,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002900"},"pg_stats":[{"pgid":"3.3f","version":"24'159","reported_seq":173,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.976255+0000","last_change":"2024-05-08T21:49:43.775912+0000","last_active":"2024-05-08T21:53:48.976255+0000","last_peered":"2024-05-08T21:53:48.976255+0000","last_clean":"2024-05-08T21:53:48.976255+0000","last_became_active":"2024-05-08T21:49:43.775657+0000","last_became_peered":"2024-05-08T21:49:43.775657+0000","last_unstale":"2024-05-08T21:53:48.976255+0000","last_undegraded":"2024-05-08T21:53:48.976255+0000","last_fullsized":"2024-05-08T21:53:48.976255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:10:07.209965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"24'148","reported_seq":162,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.979741+0000","last_change":"2024-05-08T21:49:43.766984+0000","last_active":"2024-05-08T21:53:48.979741+0000","last_peered":"2024-05-08T21:53:48.979741+0000","last_clean":"2024-05-08T21:53:48.979741+0000","last_became_active":"2024-05-08T21:49:43.765995+0000","last_became_peered":"2024-05-08T21:49:43.765995+0000","last_unstale":"2024-05-08T21:53:48.979741+0000","last_undegraded":"2024-05-08T21:53:48.979741+0000","last_fullsized":"2024-05-08T21:53:48.979741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:21:41.238890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"24'157","reported_seq":171,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.757121+0000","last_change":"2024-05-08T21:49:43.766107+0000","last_active":"2024-05-08T21:53:48.757121+0000","last_peered":"2024-05-08T21:53:48.757121+0000","last_clean":"2024-05-08T21:53:48.757121+0000","last_became_active":"2024-05-08T21:49:43.765874+0000","last_became_peered":"2024-05-08T21:49:43.765874+0000","last_unstale":"2024-05-08T21:53:48.757121+0000","last_undegraded":"2024-05-08T21:53:48.757121+0000","last_fullsized":"2024-05-08T21:53:48.757121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:06:50.769169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"24'137","reported_seq":152,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:47.651414+0000","last_change":"2024-05-08T21:49:43.766355+0000","last_active":"2024-05-08T21:53:47.651414+0000","last_peered":"2024-05-08T21:53:47.651414+0000","last_clean":"2024-05-08T21:53:47.651414+0000","last_became_active":"2024-05-08T21:49:43.765507+0000","last_became_peered":"2024-05-08T21:49:43.765507+0000","last_unstale":"2024-05-08T21:53:47.651414+0000","last_undegraded":"2024-05-08T21:53:47.651414+0000","last_fullsized":"2024-05-08T21:53:47.651414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:09:09.676078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159383552,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"24'170","reported_seq":182,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.982792+0000","last_change":"2024-05-08T21:50:33.104253+0000","last_active":"2024-05-08T21:53:48.982792+0000","last_peered":"2024-05-08T21:53:48.982792+0000","last_clean":"2024-05-08T21:53:48.982792+0000","last_became_active":"2024-05-08T21:50:33.103943+0000","last_became_peered":"2024-05-08T21:50:33.103943+0000","last_unstale":"2024-05-08T21:53:48.982792+0000","last_undegraded":"2024-05-08T21:53:48.982792+0000","last_fullsized":"2024-05-08T21:53:48.982792+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:22:41.503872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"24'110","reported_seq":124,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:47.605360+0000","last_change":"2024-05-08T21:49:43.771390+0000","last_active":"2024-05-08T21:53:47.605360+0000","last_peered":"2024-05-08T21:53:47.605360+0000","last_clean":"2024-05-08T21:53:47.605360+0000","last_became_active":"2024-05-08T21:49:43.770893+0000","last_became_peered":"2024-05-08T21:49:43.770893+0000","last_unstale":"2024-05-08T21:53:47.605360+0000","last_undegraded":"2024-05-08T21:53:47.605360+0000","last_fullsized":"2024-05-08T21:53:47.605360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:28.979468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"24'183","reported_seq":197,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.935714+0000","last_change":"2024-05-08T21:49:43.769981+0000","last_active":"2024-05-08T21:53:48.935714+0000","last_peered":"2024-05-08T21:53:48.935714+0000","last_clean":"2024-05-08T21:53:48.935714+0000","last_became_active":"2024-05-08T21:49:43.769667+0000","last_became_peered":"2024-05-08T21:49:43.769667+0000","last_unstale":"2024-05-08T21:53:48.935714+0000","last_undegraded":"2024-05-08T21:53:48.935714+0000","last_fullsized":"2024-05-08T21:53:48.935714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:12:00.381761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"24'161","reported_seq":175,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.068085+0000","last_change":"2024-05-08T21:49:43.771078+0000","last_active":"2024-05-08T21:53:48.068085+0000","last_peered":"2024-05-08T21:53:48.068085+0000","last_clean":"2024-05-08T21:53:48.068085+0000","last_became_active":"2024-05-08T21:49:43.770912+0000","last_became_peered":"2024-05-08T21:49:43.770912+0000","last_unstale":"2024-05-08T21:53:48.068085+0000","last_undegraded":"2024-05-08T21:53:48.068085+0000","last_fullsized":"2024-05-08T21:53:48.068085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:12:00.381761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":483328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"24'167","reported_seq":189,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.950277+0000","last_change":"2024-05-08T21:50:33.106461+0000","last_active":"2024-05-08T21:53:48.950277+0000","last_peered":"2024-05-08T21:53:48.950277+0000","last_clean":"2024-05-08T21:53:48.950277+0000","last_became_active":"2024-05-08T21:50:33.106142+0000","last_became_peered":"2024-05-08T21:50:33.106142+0000","last_unstale":"2024-05-08T21:53:48.950277+0000","last_undegraded":"2024-05-08T21:53:48.950277+0000","last_fullsized":"2024-05-08T21:53:48.950277+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:18:29.982214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"24'175","reported_seq":189,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.986601+0000","last_change":"2024-05-08T21:49:43.772784+0000","last_active":"2024-05-08T21:53:48.986601+0000","last_peered":"2024-05-08T21:53:48.986601+0000","last_clean":"2024-05-08T21:53:48.986601+0000","last_became_active":"2024-05-08T21:49:43.772505+0000","last_became_peered":"2024-05-08T21:49:43.772505+0000","last_unstale":"2024-05-08T21:53:48.986601+0000","last_undegraded":"2024-05-08T21:53:48.986601+0000","last_fullsized":"2024-05-08T21:53:48.986601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:19:28.925404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"24'208","reported_seq":222,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.995969+0000","last_change":"2024-05-08T21:49:43.771781+0000","last_active":"2024-05-08T21:53:48.995969+0000","last_peered":"2024-05-08T21:53:48.995969+0000","last_clean":"2024-05-08T21:53:48.995969+0000","last_became_active":"2024-05-08T21:49:43.771457+0000","last_became_peered":"2024-05-08T21:49:43.771457+0000","last_unstale":"2024-05-08T21:53:48.995969+0000","last_undegraded":"2024-05-08T21:53:48.995969+0000","last_fullsized":"2024-05-08T21:53:48.995969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:43.798909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"24'159","reported_seq":173,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:49.006621+0000","last_change":"2024-05-08T21:49:43.764249+0000","last_active":"2024-05-08T21:53:49.006621+0000","last_peered":"2024-05-08T21:53:49.006621+0000","last_clean":"2024-05-08T21:53:49.006621+0000","last_became_active":"2024-05-08T21:49:43.763986+0000","last_became_peered":"2024-05-08T21:49:43.763986+0000","last_unstale":"2024-05-08T21:53:49.006621+0000","last_undegraded":"2024-05-08T21:53:49.006621+0000","last_fullsized":"2024-05-08T21:53:49.006621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:33:13.833915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"24'141","reported_seq":155,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.165586+0000","last_change":"2024-05-08T21:49:43.761127+0000","last_active":"2024-05-08T21:53:48.165586+0000","last_peered":"2024-05-08T21:53:48.165586+0000","last_clean":"2024-05-08T21:53:48.165586+0000","last_became_active":"2024-05-08T21:49:43.760874+0000","last_became_peered":"2024-05-08T21:49:43.760874+0000","last_unstale":"2024-05-08T21:53:48.165586+0000","last_undegraded":"2024-05-08T21:53:48.165586+0000","last_fullsized":"2024-05-08T21:53:48.165586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:17:34.570817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"24'156","reported_seq":170,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.768707+0000","last_change":"2024-05-08T21:49:43.765829+0000","last_active":"2024-05-08T21:53:48.768707+0000","last_peered":"2024-05-08T21:53:48.768707+0000","last_clean":"2024-05-08T21:53:48.768707+0000","last_became_active":"2024-05-08T21:49:43.765566+0000","last_became_peered":"2024-05-08T21:49:43.765566+0000","last_unstale":"2024-05-08T21:53:48.768707+0000","last_undegraded":"2024-05-08T21:53:48.768707+0000","last_fullsized":"2024-05-08T21:53:48.768707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:39.954320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"24'170","reported_seq":184,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.988387+0000","last_change":"2024-05-08T21:49:43.765080+0000","last_active":"2024-05-08T21:53:48.988387+0000","last_peered":"2024-05-08T21:53:48.988387+0000","last_clean":"2024-05-08T21:53:48.988387+0000","last_became_active":"2024-05-08T21:49:43.764810+0000","last_became_peered":"2024-05-08T21:49:43.764810+0000","last_unstale":"2024-05-08T21:53:48.988387+0000","last_undegraded":"2024-05-08T21:53:48.988387+0000","last_fullsized":"2024-05-08T21:53:48.988387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:24:11.223913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"24'119","reported_seq":133,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:47.642980+0000","last_change":"2024-05-08T21:49:43.766717+0000","last_active":"2024-05-08T21:53:47.642980+0000","last_peered":"2024-05-08T21:53:47.642980+0000","last_clean":"2024-05-08T21:53:47.642980+0000","last_became_active":"2024-05-08T21:49:43.766427+0000","last_became_peered":"2024-05-08T21:49:43.766427+0000","last_unstale":"2024-05-08T21:53:47.642980+0000","last_undegraded":"2024-05-08T21:53:47.642980+0000","last_fullsized":"2024-05-08T21:53:47.642980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:49:22.833820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"24'114","reported_seq":128,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:47.597062+0000","last_change":"2024-05-08T21:49:43.776929+0000","last_active":"2024-05-08T21:53:47.597062+0000","last_peered":"2024-05-08T21:53:47.597062+0000","last_clean":"2024-05-08T21:53:47.597062+0000","last_became_active":"2024-05-08T21:49:43.776509+0000","last_became_peered":"2024-05-08T21:49:43.776509+0000","last_unstale":"2024-05-08T21:53:47.597062+0000","last_undegraded":"2024-05-08T21:53:47.597062+0000","last_fullsized":"2024-05-08T21:53:47.597062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:26.199459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"24'169","reported_seq":183,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.988290+0000","last_change":"2024-05-08T21:49:43.762646+0000","last_active":"2024-05-08T21:53:48.988290+0000","last_peered":"2024-05-08T21:53:48.988290+0000","last_clean":"2024-05-08T21:53:48.988290+0000","last_became_active":"2024-05-08T21:49:43.762237+0000","last_became_peered":"2024-05-08T21:49:43.762237+0000","last_unstale":"2024-05-08T21:53:48.988290+0000","last_undegraded":"2024-05-08T21:53:48.988290+0000","last_fullsized":"2024-05-08T21:53:48.988290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:46:08.821947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"24'198","reported_seq":212,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.997405+0000","last_change":"2024-05-08T21:49:43.774729+0000","last_active":"2024-05-08T21:53:48.997405+0000","last_peered":"2024-05-08T21:53:48.997405+0000","last_clean":"2024-05-08T21:53:48.997405+0000","last_became_active":"2024-05-08T21:49:43.774450+0000","last_became_peered":"2024-05-08T21:49:43.774450+0000","last_unstale":"2024-05-08T21:53:48.997405+0000","last_undegraded":"2024-05-08T21:53:48.997405+0000","last_fullsized":"2024-05-08T21:53:48.997405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:25.661350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"24'5","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:11.012373+0000","last_change":"2024-05-08T21:49:43.219461+0000","last_active":"2024-05-08T21:52:11.012373+0000","last_peered":"2024-05-08T21:52:11.012373+0000","last_clean":"2024-05-08T21:52:11.012373+0000","last_became_active":"2024-05-08T21:49:43.219161+0000","last_became_peered":"2024-05-08T21:49:43.219161+0000","last_unstale":"2024-05-08T21:52:11.012373+0000","last_undegraded":"2024-05-08T21:52:11.012373+0000","last_fullsized":"2024-05-08T21:52:11.012373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:02:45.778415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"24'137","reported_seq":152,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.165338+0000","last_change":"2024-05-08T21:49:43.764252+0000","last_active":"2024-05-08T21:53:48.165338+0000","last_peered":"2024-05-08T21:53:48.165338+0000","last_clean":"2024-05-08T21:53:48.165338+0000","last_became_active":"2024-05-08T21:49:43.764045+0000","last_became_peered":"2024-05-08T21:49:43.764045+0000","last_unstale":"2024-05-08T21:53:48.165338+0000","last_undegraded":"2024-05-08T21:53:48.165338+0000","last_fullsized":"2024-05-08T21:53:48.165338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:43.798909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:11.012823+0000","last_change":"2024-05-08T21:49:43.221599+0000","last_active":"2024-05-08T21:52:11.012823+0000","last_peered":"2024-05-08T21:52:11.012823+0000","last_clean":"2024-05-08T21:52:11.012823+0000","last_became_active":"2024-05-08T21:49:43.221309+0000","last_became_peered":"2024-05-08T21:49:43.221309+0000","last_unstale":"2024-05-08T21:52:11.012823+0000","last_undegraded":"2024-05-08T21:52:11.012823+0000","last_fullsized":"2024-05-08T21:52:11.012823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:17.379362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"24'145","reported_seq":159,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.797613+0000","last_change":"2024-05-08T21:49:43.771523+0000","last_active":"2024-05-08T21:53:48.797613+0000","last_peered":"2024-05-08T21:53:48.797613+0000","last_clean":"2024-05-08T21:53:48.797613+0000","last_became_active":"2024-05-08T21:49:43.771295+0000","last_became_peered":"2024-05-08T21:49:43.771295+0000","last_unstale":"2024-05-08T21:53:48.797613+0000","last_undegraded":"2024-05-08T21:53:48.797613+0000","last_fullsized":"2024-05-08T21:53:48.797613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:53:14.774835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"24'3","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:26.315599+0000","last_change":"2024-05-08T21:49:43.226637+0000","last_active":"2024-05-08T21:52:26.315599+0000","last_peered":"2024-05-08T21:52:26.315599+0000","last_clean":"2024-05-08T21:52:26.315599+0000","last_became_active":"2024-05-08T21:49:43.226284+0000","last_became_peered":"2024-05-08T21:49:43.226284+0000","last_unstale":"2024-05-08T21:52:26.315599+0000","last_undegraded":"2024-05-08T21:52:26.315599+0000","last_fullsized":"2024-05-08T21:52:26.315599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:01.844011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"24'117","reported_seq":131,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:47.604436+0000","last_change":"2024-05-08T21:49:43.766694+0000","last_active":"2024-05-08T21:53:47.604436+0000","last_peered":"2024-05-08T21:53:47.604436+0000","last_clean":"2024-05-08T21:53:47.604436+0000","last_became_active":"2024-05-08T21:49:43.766079+0000","last_became_peered":"2024-05-08T21:49:43.766079+0000","last_unstale":"2024-05-08T21:53:47.604436+0000","last_undegraded":"2024-05-08T21:53:47.604436+0000","last_fullsized":"2024-05-08T21:53:47.604436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:01:16.682080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:26.310680+0000","last_change":"2024-05-08T21:49:43.230152+0000","last_active":"2024-05-08T21:52:26.310680+0000","last_peered":"2024-05-08T21:52:26.310680+0000","last_clean":"2024-05-08T21:52:26.310680+0000","last_became_active":"2024-05-08T21:49:43.229891+0000","last_became_peered":"2024-05-08T21:49:43.229891+0000","last_unstale":"2024-05-08T21:52:26.310680+0000","last_undegraded":"2024-05-08T21:52:26.310680+0000","last_fullsized":"2024-05-08T21:52:26.310680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:33:12.827218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"24'190","reported_seq":202,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.997217+0000","last_change":"2024-05-08T21:50:33.113046+0000","last_active":"2024-05-08T21:53:48.997217+0000","last_peered":"2024-05-08T21:53:48.997217+0000","last_clean":"2024-05-08T21:53:48.997217+0000","last_became_active":"2024-05-08T21:50:33.112776+0000","last_became_peered":"2024-05-08T21:50:33.112776+0000","last_unstale":"2024-05-08T21:53:48.997217+0000","last_undegraded":"2024-05-08T21:53:48.997217+0000","last_fullsized":"2024-05-08T21:53:48.997217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:27:54.132637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":458752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"24'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:11.012352+0000","last_change":"2024-05-08T21:49:43.220418+0000","last_active":"2024-05-08T21:52:11.012352+0000","last_peered":"2024-05-08T21:52:11.012352+0000","last_clean":"2024-05-08T21:52:11.012352+0000","last_became_active":"2024-05-08T21:49:43.220090+0000","last_became_peered":"2024-05-08T21:49:43.220090+0000","last_unstale":"2024-05-08T21:52:11.012352+0000","last_undegraded":"2024-05-08T21:52:11.012352+0000","last_fullsized":"2024-05-08T21:52:11.012352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:33:28.074468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"24'142","reported_seq":154,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.960004+0000","last_change":"2024-05-08T21:50:33.103551+0000","last_active":"2024-05-08T21:53:48.960004+0000","last_peered":"2024-05-08T21:53:48.960004+0000","last_clean":"2024-05-08T21:53:48.960004+0000","last_became_active":"2024-05-08T21:50:33.103147+0000","last_became_peered":"2024-05-08T21:50:33.103147+0000","last_unstale":"2024-05-08T21:53:48.960004+0000","last_undegraded":"2024-05-08T21:53:48.960004+0000","last_fullsized":"2024-05-08T21:53:48.960004+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:50.167387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"24'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:11.012089+0000","last_change":"2024-05-08T21:49:43.220518+0000","last_active":"2024-05-08T21:52:11.012089+0000","last_peered":"2024-05-08T21:52:11.012089+0000","last_clean":"2024-05-08T21:52:11.012089+0000","last_became_active":"2024-05-08T21:49:43.218473+0000","last_became_peered":"2024-05-08T21:49:43.218473+0000","last_unstale":"2024-05-08T21:52:11.012089+0000","last_undegraded":"2024-05-08T21:52:11.012089+0000","last_fullsized":"2024-05-08T21:52:11.012089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:10.497167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"24'150","reported_seq":164,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.811305+0000","last_change":"2024-05-08T21:49:43.770935+0000","last_active":"2024-05-08T21:53:48.811305+0000","last_peered":"2024-05-08T21:53:48.811305+0000","last_clean":"2024-05-08T21:53:48.811305+0000","last_became_active":"2024-05-08T21:49:43.770677+0000","last_became_peered":"2024-05-08T21:49:43.770677+0000","last_unstale":"2024-05-08T21:53:48.811305+0000","last_undegraded":"2024-05-08T21:53:48.811305+0000","last_fullsized":"2024-05-08T21:53:48.811305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:04:14.416894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:06.001782+0000","last_change":"2024-05-08T21:49:43.221027+0000","last_active":"2024-05-08T21:52:06.001782+0000","last_peered":"2024-05-08T21:52:06.001782+0000","last_clean":"2024-05-08T21:52:06.001782+0000","last_became_active":"2024-05-08T21:49:43.220780+0000","last_became_peered":"2024-05-08T21:49:43.220780+0000","last_unstale":"2024-05-08T21:52:06.001782+0000","last_undegraded":"2024-05-08T21:52:06.001782+0000","last_fullsized":"2024-05-08T21:52:06.001782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:20:34.123736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"24'182","reported_seq":194,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.989238+0000","last_change":"2024-05-08T21:50:33.305422+0000","last_active":"2024-05-08T21:53:48.989238+0000","last_peered":"2024-05-08T21:53:48.989238+0000","last_clean":"2024-05-08T21:53:48.989238+0000","last_became_active":"2024-05-08T21:50:33.305037+0000","last_became_peered":"2024-05-08T21:50:33.305037+0000","last_unstale":"2024-05-08T21:53:48.989238+0000","last_undegraded":"2024-05-08T21:53:48.989238+0000","last_fullsized":"2024-05-08T21:53:48.989238+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:20:06.560937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:06.619556+0000","last_change":"2024-05-08T21:49:43.225299+0000","last_active":"2024-05-08T21:52:06.619556+0000","last_peered":"2024-05-08T21:52:06.619556+0000","last_clean":"2024-05-08T21:52:06.619556+0000","last_became_active":"2024-05-08T21:49:43.225057+0000","last_became_peered":"2024-05-08T21:49:43.225057+0000","last_unstale":"2024-05-08T21:52:06.619556+0000","last_undegraded":"2024-05-08T21:52:06.619556+0000","last_fullsized":"2024-05-08T21:52:06.619556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:38:43.069159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"24'177","reported_seq":191,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.994522+0000","last_change":"2024-05-08T21:49:43.757361+0000","last_active":"2024-05-08T21:53:48.994522+0000","last_peered":"2024-05-08T21:53:48.994522+0000","last_clean":"2024-05-08T21:53:48.994522+0000","last_became_active":"2024-05-08T21:49:43.757092+0000","last_became_peered":"2024-05-08T21:49:43.757092+0000","last_unstale":"2024-05-08T21:53:48.994522+0000","last_undegraded":"2024-05-08T21:53:48.994522+0000","last_fullsized":"2024-05-08T21:53:48.994522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:24:02.741766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"24'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:08.039542+0000","last_change":"2024-05-08T21:49:43.229405+0000","last_active":"2024-05-08T21:52:08.039542+0000","last_peered":"2024-05-08T21:52:08.039542+0000","last_clean":"2024-05-08T21:52:08.039542+0000","last_became_active":"2024-05-08T21:49:43.229105+0000","last_became_peered":"2024-05-08T21:49:43.229105+0000","last_unstale":"2024-05-08T21:52:08.039542+0000","last_undegraded":"2024-05-08T21:52:08.039542+0000","last_fullsized":"2024-05-08T21:52:08.039542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:18:58.164159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"24'178","reported_seq":192,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:47.651834+0000","last_change":"2024-05-08T21:49:43.773243+0000","last_active":"2024-05-08T21:53:47.651834+0000","last_peered":"2024-05-08T21:53:47.651834+0000","last_clean":"2024-05-08T21:53:47.651834+0000","last_became_active":"2024-05-08T21:49:43.772944+0000","last_became_peered":"2024-05-08T21:49:43.772944+0000","last_unstale":"2024-05-08T21:53:47.651834+0000","last_undegraded":"2024-05-08T21:53:47.651834+0000","last_fullsized":"2024-05-08T21:53:47.651834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:21:41.238890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":213909504,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":598016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:06.620035+0000","last_change":"2024-05-08T21:49:43.224999+0000","last_active":"2024-05-08T21:52:06.620035+0000","last_peered":"2024-05-08T21:52:06.620035+0000","last_clean":"2024-05-08T21:52:06.620035+0000","last_became_active":"2024-05-08T21:49:43.223476+0000","last_became_peered":"2024-05-08T21:49:43.223476+0000","last_unstale":"2024-05-08T21:52:06.620035+0000","last_undegraded":"2024-05-08T21:52:06.620035+0000","last_fullsized":"2024-05-08T21:52:06.620035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:09:12.983430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"24'146","reported_seq":160,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.772198+0000","last_change":"2024-05-08T21:49:43.771526+0000","last_active":"2024-05-08T21:53:48.772198+0000","last_peered":"2024-05-08T21:53:48.772198+0000","last_clean":"2024-05-08T21:53:48.772198+0000","last_became_active":"2024-05-08T21:49:43.771279+0000","last_became_peered":"2024-05-08T21:49:43.771279+0000","last_unstale":"2024-05-08T21:53:48.772198+0000","last_undegraded":"2024-05-08T21:53:48.772198+0000","last_fullsized":"2024-05-08T21:53:48.772198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:41:45.602022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"24'7","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:08.589052+0000","last_change":"2024-05-08T21:49:43.224378+0000","last_active":"2024-05-08T21:53:08.589052+0000","last_peered":"2024-05-08T21:53:08.589052+0000","last_clean":"2024-05-08T21:53:08.589052+0000","last_became_active":"2024-05-08T21:49:43.224164+0000","last_became_peered":"2024-05-08T21:49:43.224164+0000","last_unstale":"2024-05-08T21:53:08.589052+0000","last_undegraded":"2024-05-08T21:53:08.589052+0000","last_fullsized":"2024-05-08T21:53:08.589052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:06:10.276907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"24'157","reported_seq":171,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.942200+0000","last_change":"2024-05-08T21:49:43.772948+0000","last_active":"2024-05-08T21:53:48.942200+0000","last_peered":"2024-05-08T21:53:48.942200+0000","last_clean":"2024-05-08T21:53:48.942200+0000","last_became_active":"2024-05-08T21:49:43.772685+0000","last_became_peered":"2024-05-08T21:49:43.772685+0000","last_unstale":"2024-05-08T21:53:48.942200+0000","last_undegraded":"2024-05-08T21:53:48.942200+0000","last_fullsized":"2024-05-08T21:53:48.942200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:02.850708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"24'179","reported_seq":200,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:49.442985+0000","last_change":"2024-05-08T21:49:43.222308+0000","last_active":"2024-05-08T21:53:49.442985+0000","last_peered":"2024-05-08T21:53:49.442985+0000","last_clean":"2024-05-08T21:53:49.442985+0000","last_became_active":"2024-05-08T21:49:43.221844+0000","last_became_peered":"2024-05-08T21:49:43.221844+0000","last_unstale":"2024-05-08T21:53:49.442985+0000","last_undegraded":"2024-05-08T21:53:49.442985+0000","last_fullsized":"2024-05-08T21:53:49.442985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:17.379362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":382276,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":177,"num_write_kb":522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"24'170","reported_seq":184,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.988815+0000","last_change":"2024-05-08T21:49:43.773923+0000","last_active":"2024-05-08T21:53:48.988815+0000","last_peered":"2024-05-08T21:53:48.988815+0000","last_clean":"2024-05-08T21:53:48.988815+0000","last_became_active":"2024-05-08T21:49:43.772037+0000","last_became_peered":"2024-05-08T21:49:43.772037+0000","last_unstale":"2024-05-08T21:53:48.988815+0000","last_undegraded":"2024-05-08T21:53:48.988815+0000","last_fullsized":"2024-05-08T21:53:48.988815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:52:32.629407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:11.006373+0000","last_change":"2024-05-08T21:49:43.219473+0000","last_active":"2024-05-08T21:52:11.006373+0000","last_peered":"2024-05-08T21:52:11.006373+0000","last_clean":"2024-05-08T21:52:11.006373+0000","last_became_active":"2024-05-08T21:49:43.219186+0000","last_became_peered":"2024-05-08T21:49:43.219186+0000","last_unstale":"2024-05-08T21:52:11.006373+0000","last_undegraded":"2024-05-08T21:52:11.006373+0000","last_fullsized":"2024-05-08T21:52:11.006373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:20:34.123736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"24'165","reported_seq":179,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.793723+0000","last_change":"2024-05-08T21:49:43.775135+0000","last_active":"2024-05-08T21:53:48.793723+0000","last_peered":"2024-05-08T21:53:48.793723+0000","last_clean":"2024-05-08T21:53:48.793723+0000","last_became_active":"2024-05-08T21:49:43.774919+0000","last_became_peered":"2024-05-08T21:49:43.774919+0000","last_unstale":"2024-05-08T21:53:48.793723+0000","last_undegraded":"2024-05-08T21:53:48.793723+0000","last_fullsized":"2024-05-08T21:53:48.793723+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:01:00.614249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T21:52:06.031614+0000","last_change":"2024-05-08T21:49:43.227386+0000","last_active":"2024-05-08T21:52:06.031614+0000","last_peered":"2024-05-08T21:52:06.031614+0000","last_clean":"2024-05-08T21:52:06.031614+0000","last_became_active":"2024-05-08T21:49:43.227065+0000","last_became_peered":"2024-05-08T21:49:43.227065+0000","last_unstale":"2024-05-08T21:52:06.031614+0000","last_undegraded":"2024-05-08T21:52:06.031614+0000","last_fullsized":"2024-05-08T21:52:06.031614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:43:48.019170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"24'186","reported_seq":200,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.993574+0000","last_change":"2024-05-08T21:49:43.770509+0000","last_active":"2024-05-08T21:53:48.993574+0000","last_peered":"2024-05-08T21:53:48.993574+0000","last_clean":"2024-05-08T21:53:48.993574+0000","last_became_active":"2024-05-08T21:49:43.770180+0000","last_became_peered":"2024-05-08T21:49:43.770180+0000","last_unstale":"2024-05-08T21:53:48.993574+0000","last_undegraded":"2024-05-08T21:53:48.993574+0000","last_fullsized":"2024-05-08T21:53:48.993574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:00:38.941899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T21:52:03.038898+0000","last_change":"2024-05-08T21:49:43.220942+0000","last_active":"2024-05-08T21:52:03.038898+0000","last_peered":"2024-05-08T21:52:03.038898+0000","last_clean":"2024-05-08T21:52:03.038898+0000","last_became_active":"2024-05-08T21:49:43.220641+0000","last_became_peered":"2024-05-08T21:49:43.220641+0000","last_unstale":"2024-05-08T21:52:03.038898+0000","last_undegraded":"2024-05-08T21:52:03.038898+0000","last_fullsized":"2024-05-08T21:52:03.038898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:52.323917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"24'191","reported_seq":205,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.997366+0000","last_change":"2024-05-08T21:49:43.766269+0000","last_active":"2024-05-08T21:53:48.997366+0000","last_peered":"2024-05-08T21:53:48.997366+0000","last_clean":"2024-05-08T21:53:48.997366+0000","last_became_active":"2024-05-08T21:49:43.765945+0000","last_became_peered":"2024-05-08T21:49:43.765945+0000","last_unstale":"2024-05-08T21:53:48.997366+0000","last_undegraded":"2024-05-08T21:53:48.997366+0000","last_fullsized":"2024-05-08T21:53:48.997366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:17:34.570817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:26.314118+0000","last_change":"2024-05-08T21:49:43.208328+0000","last_active":"2024-05-08T21:52:26.314118+0000","last_peered":"2024-05-08T21:52:26.314118+0000","last_clean":"2024-05-08T21:52:26.314118+0000","last_became_active":"2024-05-08T21:49:43.208013+0000","last_became_peered":"2024-05-08T21:49:43.208013+0000","last_unstale":"2024-05-08T21:52:26.314118+0000","last_undegraded":"2024-05-08T21:52:26.314118+0000","last_fullsized":"2024-05-08T21:52:26.314118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:10.497167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"24'209","reported_seq":223,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.939563+0000","last_change":"2024-05-08T21:49:43.774210+0000","last_active":"2024-05-08T21:53:48.939563+0000","last_peered":"2024-05-08T21:53:48.939563+0000","last_clean":"2024-05-08T21:53:48.939563+0000","last_became_active":"2024-05-08T21:49:43.773933+0000","last_became_peered":"2024-05-08T21:49:43.773933+0000","last_unstale":"2024-05-08T21:53:48.939563+0000","last_undegraded":"2024-05-08T21:53:48.939563+0000","last_fullsized":"2024-05-08T21:53:48.939563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:10:25.398535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:07.434727+0000","last_change":"2024-05-08T21:49:43.217456+0000","last_active":"2024-05-08T21:52:07.434727+0000","last_peered":"2024-05-08T21:52:07.434727+0000","last_clean":"2024-05-08T21:52:07.434727+0000","last_became_active":"2024-05-08T21:49:43.216822+0000","last_became_peered":"2024-05-08T21:49:43.216822+0000","last_unstale":"2024-05-08T21:52:07.434727+0000","last_undegraded":"2024-05-08T21:52:07.434727+0000","last_fullsized":"2024-05-08T21:52:07.434727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:41:35.881003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"24'170","reported_seq":184,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:49.012486+0000","last_change":"2024-05-08T21:49:43.770066+0000","last_active":"2024-05-08T21:53:49.012486+0000","last_peered":"2024-05-08T21:53:49.012486+0000","last_clean":"2024-05-08T21:53:49.012486+0000","last_became_active":"2024-05-08T21:49:43.769762+0000","last_became_peered":"2024-05-08T21:49:43.769762+0000","last_unstale":"2024-05-08T21:53:49.012486+0000","last_undegraded":"2024-05-08T21:53:49.012486+0000","last_fullsized":"2024-05-08T21:53:49.012486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:40:20.301747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T21:51:51.029492+0000","last_change":"2024-05-08T21:49:43.215293+0000","last_active":"2024-05-08T21:51:51.029492+0000","last_peered":"2024-05-08T21:51:51.029492+0000","last_clean":"2024-05-08T21:51:51.029492+0000","last_became_active":"2024-05-08T21:49:43.215048+0000","last_became_peered":"2024-05-08T21:49:43.215048+0000","last_unstale":"2024-05-08T21:51:51.029492+0000","last_undegraded":"2024-05-08T21:51:51.029492+0000","last_fullsized":"2024-05-08T21:51:51.029492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:43:48.019170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"24'115","reported_seq":129,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:47.503014+0000","last_change":"2024-05-08T21:49:43.770326+0000","last_active":"2024-05-08T21:53:47.503014+0000","last_peered":"2024-05-08T21:53:47.503014+0000","last_clean":"2024-05-08T21:53:47.503014+0000","last_became_active":"2024-05-08T21:49:43.770029+0000","last_became_peered":"2024-05-08T21:49:43.770029+0000","last_unstale":"2024-05-08T21:53:47.503014+0000","last_undegraded":"2024-05-08T21:53:47.503014+0000","last_fullsized":"2024-05-08T21:53:47.503014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:33:33.642847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T21:51:51.029535+0000","last_change":"2024-05-08T21:49:43.227710+0000","last_active":"2024-05-08T21:51:51.029535+0000","last_peered":"2024-05-08T21:51:51.029535+0000","last_clean":"2024-05-08T21:51:51.029535+0000","last_became_active":"2024-05-08T21:49:43.227430+0000","last_became_peered":"2024-05-08T21:49:43.227430+0000","last_unstale":"2024-05-08T21:51:51.029535+0000","last_undegraded":"2024-05-08T21:51:51.029535+0000","last_fullsized":"2024-05-08T21:51:51.029535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:05:58.875400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"24'170","reported_seq":184,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:49.009057+0000","last_change":"2024-05-08T21:49:43.768588+0000","last_active":"2024-05-08T21:53:49.009057+0000","last_peered":"2024-05-08T21:53:49.009057+0000","last_clean":"2024-05-08T21:53:49.009057+0000","last_became_active":"2024-05-08T21:49:43.768307+0000","last_became_peered":"2024-05-08T21:49:43.768307+0000","last_unstale":"2024-05-08T21:53:49.009057+0000","last_undegraded":"2024-05-08T21:53:49.009057+0000","last_fullsized":"2024-05-08T21:53:49.009057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:04.968184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"24'157","reported_seq":172,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.998860+0000","last_change":"2024-05-08T21:49:43.758618+0000","last_active":"2024-05-08T21:53:48.998860+0000","last_peered":"2024-05-08T21:53:48.998860+0000","last_clean":"2024-05-08T21:53:48.998860+0000","last_became_active":"2024-05-08T21:49:43.758367+0000","last_became_peered":"2024-05-08T21:49:43.758367+0000","last_unstale":"2024-05-08T21:53:48.998860+0000","last_undegraded":"2024-05-08T21:53:48.998860+0000","last_fullsized":"2024-05-08T21:53:48.998860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:30:06.569971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"24'4","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:47.358418+0000","last_change":"2024-05-08T21:49:43.217410+0000","last_active":"2024-05-08T21:53:47.358418+0000","last_peered":"2024-05-08T21:53:47.358418+0000","last_clean":"2024-05-08T21:53:47.358418+0000","last_became_active":"2024-05-08T21:49:43.217133+0000","last_became_peered":"2024-05-08T21:49:43.217133+0000","last_unstale":"2024-05-08T21:53:47.358418+0000","last_undegraded":"2024-05-08T21:53:47.358418+0000","last_fullsized":"2024-05-08T21:53:47.358418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:17.379362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":303,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"24'138","reported_seq":152,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.100219+0000","last_change":"2024-05-08T21:49:43.771651+0000","last_active":"2024-05-08T21:53:48.100219+0000","last_peered":"2024-05-08T21:53:48.100219+0000","last_clean":"2024-05-08T21:53:48.100219+0000","last_became_active":"2024-05-08T21:49:43.771451+0000","last_became_peered":"2024-05-08T21:49:43.771451+0000","last_unstale":"2024-05-08T21:53:48.100219+0000","last_undegraded":"2024-05-08T21:53:48.100219+0000","last_fullsized":"2024-05-08T21:53:48.100219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:00:38.941899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T21:51:51.029553+0000","last_change":"2024-05-08T21:49:43.224929+0000","last_active":"2024-05-08T21:51:51.029553+0000","last_peered":"2024-05-08T21:51:51.029553+0000","last_clean":"2024-05-08T21:51:51.029553+0000","last_became_active":"2024-05-08T21:49:43.223469+0000","last_became_peered":"2024-05-08T21:49:43.223469+0000","last_unstale":"2024-05-08T21:51:51.029553+0000","last_undegraded":"2024-05-08T21:51:51.029553+0000","last_fullsized":"2024-05-08T21:51:51.029553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:27.504127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":169,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:06.294108+0000","last_change":"2024-05-08T21:49:38.626519+0000","last_active":"2024-05-08T21:52:06.294108+0000","last_peered":"2024-05-08T21:52:06.294108+0000","last_clean":"2024-05-08T21:52:06.294108+0000","last_became_active":"2024-05-08T21:49:38.626159+0000","last_became_peered":"2024-05-08T21:49:38.626159+0000","last_unstale":"2024-05-08T21:52:06.294108+0000","last_undegraded":"2024-05-08T21:52:06.294108+0000","last_fullsized":"2024-05-08T21:52:06.294108+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:36.031649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:36.031649+0000","last_clean_scrub_stamp":"2024-05-08T21:49:36.031649+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:12:04.846500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"24'151","reported_seq":165,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.795812+0000","last_change":"2024-05-08T21:49:43.770966+0000","last_active":"2024-05-08T21:53:48.795812+0000","last_peered":"2024-05-08T21:53:48.795812+0000","last_clean":"2024-05-08T21:53:48.795812+0000","last_became_active":"2024-05-08T21:49:43.770711+0000","last_became_peered":"2024-05-08T21:49:43.770711+0000","last_unstale":"2024-05-08T21:53:48.795812+0000","last_undegraded":"2024-05-08T21:53:48.795812+0000","last_fullsized":"2024-05-08T21:53:48.795812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:17:34.570817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:06.294247+0000","last_change":"2024-05-08T21:49:43.221086+0000","last_active":"2024-05-08T21:52:06.294247+0000","last_peered":"2024-05-08T21:52:06.294247+0000","last_clean":"2024-05-08T21:52:06.294247+0000","last_became_active":"2024-05-08T21:49:43.220539+0000","last_became_peered":"2024-05-08T21:49:43.220539+0000","last_unstale":"2024-05-08T21:52:06.294247+0000","last_undegraded":"2024-05-08T21:52:06.294247+0000","last_fullsized":"2024-05-08T21:52:06.294247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:52.323917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T21:51:48.035134+0000","last_change":"2024-05-08T21:49:43.222410+0000","last_active":"2024-05-08T21:51:48.035134+0000","last_peered":"2024-05-08T21:51:48.035134+0000","last_clean":"2024-05-08T21:51:48.035134+0000","last_became_active":"2024-05-08T21:49:43.222131+0000","last_became_peered":"2024-05-08T21:49:43.222131+0000","last_unstale":"2024-05-08T21:51:48.035134+0000","last_undegraded":"2024-05-08T21:51:48.035134+0000","last_fullsized":"2024-05-08T21:51:48.035134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:18:58.164159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"24'153","reported_seq":167,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:49.002757+0000","last_change":"2024-05-08T21:49:43.758424+0000","last_active":"2024-05-08T21:53:49.002757+0000","last_peered":"2024-05-08T21:53:49.002757+0000","last_clean":"2024-05-08T21:53:49.002757+0000","last_became_active":"2024-05-08T21:49:43.758140+0000","last_became_peered":"2024-05-08T21:49:43.758140+0000","last_unstale":"2024-05-08T21:53:49.002757+0000","last_undegraded":"2024-05-08T21:53:49.002757+0000","last_fullsized":"2024-05-08T21:53:49.002757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:10.795540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"24'13","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:26.917117+0000","last_change":"2024-05-08T21:49:43.218241+0000","last_active":"2024-05-08T21:53:26.917117+0000","last_peered":"2024-05-08T21:53:26.917117+0000","last_clean":"2024-05-08T21:53:26.917117+0000","last_became_active":"2024-05-08T21:49:43.217780+0000","last_became_peered":"2024-05-08T21:49:43.217780+0000","last_unstale":"2024-05-08T21:53:26.917117+0000","last_undegraded":"2024-05-08T21:53:26.917117+0000","last_fullsized":"2024-05-08T21:53:26.917117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:27.504127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":25,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"24'128","reported_seq":142,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.068226+0000","last_change":"2024-05-08T21:49:43.770491+0000","last_active":"2024-05-08T21:53:48.068226+0000","last_peered":"2024-05-08T21:53:48.068226+0000","last_clean":"2024-05-08T21:53:48.068226+0000","last_became_active":"2024-05-08T21:49:43.770221+0000","last_became_peered":"2024-05-08T21:49:43.770221+0000","last_unstale":"2024-05-08T21:53:48.068226+0000","last_undegraded":"2024-05-08T21:53:48.068226+0000","last_fullsized":"2024-05-08T21:53:48.068226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:25.661350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:26.312014+0000","last_change":"2024-05-08T21:49:43.221345+0000","last_active":"2024-05-08T21:52:26.312014+0000","last_peered":"2024-05-08T21:52:26.312014+0000","last_clean":"2024-05-08T21:52:26.312014+0000","last_became_active":"2024-05-08T21:49:43.220953+0000","last_became_peered":"2024-05-08T21:49:43.220953+0000","last_unstale":"2024-05-08T21:52:26.312014+0000","last_undegraded":"2024-05-08T21:52:26.312014+0000","last_fullsized":"2024-05-08T21:52:26.312014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:33:28.074468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"24'165","reported_seq":179,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.797008+0000","last_change":"2024-05-08T21:49:43.765001+0000","last_active":"2024-05-08T21:53:48.797008+0000","last_peered":"2024-05-08T21:53:48.797008+0000","last_clean":"2024-05-08T21:53:48.797008+0000","last_became_active":"2024-05-08T21:49:43.764740+0000","last_became_peered":"2024-05-08T21:49:43.764740+0000","last_unstale":"2024-05-08T21:53:48.797008+0000","last_undegraded":"2024-05-08T21:53:48.797008+0000","last_fullsized":"2024-05-08T21:53:48.797008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:18:58.836430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T21:51:53.035540+0000","last_change":"2024-05-08T21:49:43.221251+0000","last_active":"2024-05-08T21:51:53.035540+0000","last_peered":"2024-05-08T21:51:53.035540+0000","last_clean":"2024-05-08T21:51:53.035540+0000","last_became_active":"2024-05-08T21:49:43.220839+0000","last_became_peered":"2024-05-08T21:49:43.220839+0000","last_unstale":"2024-05-08T21:51:53.035540+0000","last_undegraded":"2024-05-08T21:51:53.035540+0000","last_fullsized":"2024-05-08T21:51:53.035540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:10.497167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"24'160","reported_seq":174,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:49.008663+0000","last_change":"2024-05-08T21:49:43.762511+0000","last_active":"2024-05-08T21:53:49.008663+0000","last_peered":"2024-05-08T21:53:49.008663+0000","last_clean":"2024-05-08T21:53:49.008663+0000","last_became_active":"2024-05-08T21:49:43.762170+0000","last_became_peered":"2024-05-08T21:49:43.762170+0000","last_unstale":"2024-05-08T21:53:49.008663+0000","last_undegraded":"2024-05-08T21:53:49.008663+0000","last_fullsized":"2024-05-08T21:53:49.008663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:11.503864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T21:51:56.029980+0000","last_change":"2024-05-08T21:49:43.215361+0000","last_active":"2024-05-08T21:51:56.029980+0000","last_peered":"2024-05-08T21:51:56.029980+0000","last_clean":"2024-05-08T21:51:56.029980+0000","last_became_active":"2024-05-08T21:49:43.215162+0000","last_became_peered":"2024-05-08T21:49:43.215162+0000","last_unstale":"2024-05-08T21:51:56.029980+0000","last_undegraded":"2024-05-08T21:51:56.029980+0000","last_fullsized":"2024-05-08T21:51:56.029980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:05:58.875400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"24'132","reported_seq":146,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.145508+0000","last_change":"2024-05-08T21:49:43.757512+0000","last_active":"2024-05-08T21:53:48.145508+0000","last_peered":"2024-05-08T21:53:48.145508+0000","last_clean":"2024-05-08T21:53:48.145508+0000","last_became_active":"2024-05-08T21:49:43.757233+0000","last_became_peered":"2024-05-08T21:49:43.757233+0000","last_unstale":"2024-05-08T21:53:48.145508+0000","last_undegraded":"2024-05-08T21:53:48.145508+0000","last_fullsized":"2024-05-08T21:53:48.145508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:53:14.774835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T21:51:56.030001+0000","last_change":"2024-05-08T21:49:43.217935+0000","last_active":"2024-05-08T21:51:56.030001+0000","last_peered":"2024-05-08T21:51:56.030001+0000","last_clean":"2024-05-08T21:51:56.030001+0000","last_became_active":"2024-05-08T21:49:43.217595+0000","last_became_peered":"2024-05-08T21:49:43.217595+0000","last_unstale":"2024-05-08T21:51:56.030001+0000","last_undegraded":"2024-05-08T21:51:56.030001+0000","last_fullsized":"2024-05-08T21:51:56.030001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:38:43.069159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"24'126","reported_seq":140,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.068793+0000","last_change":"2024-05-08T21:49:43.766816+0000","last_active":"2024-05-08T21:53:48.068793+0000","last_peered":"2024-05-08T21:53:48.068793+0000","last_clean":"2024-05-08T21:53:48.068793+0000","last_became_active":"2024-05-08T21:49:43.766596+0000","last_became_peered":"2024-05-08T21:49:43.766596+0000","last_unstale":"2024-05-08T21:53:48.068793+0000","last_undegraded":"2024-05-08T21:53:48.068793+0000","last_fullsized":"2024-05-08T21:53:48.068793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:01:00.614249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"24'4","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:11.011988+0000","last_change":"2024-05-08T21:49:43.224243+0000","last_active":"2024-05-08T21:52:11.011988+0000","last_peered":"2024-05-08T21:52:11.011988+0000","last_clean":"2024-05-08T21:52:11.011988+0000","last_became_active":"2024-05-08T21:49:43.223974+0000","last_became_peered":"2024-05-08T21:49:43.223974+0000","last_unstale":"2024-05-08T21:52:11.011988+0000","last_undegraded":"2024-05-08T21:52:11.011988+0000","last_fullsized":"2024-05-08T21:52:11.011988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:03.961487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"24'149","reported_seq":163,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:49.000712+0000","last_change":"2024-05-08T21:49:43.764377+0000","last_active":"2024-05-08T21:53:49.000712+0000","last_peered":"2024-05-08T21:53:49.000712+0000","last_clean":"2024-05-08T21:53:49.000712+0000","last_became_active":"2024-05-08T21:49:43.764075+0000","last_became_peered":"2024-05-08T21:49:43.764075+0000","last_unstale":"2024-05-08T21:53:49.000712+0000","last_undegraded":"2024-05-08T21:53:49.000712+0000","last_fullsized":"2024-05-08T21:53:49.000712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:41:45.602022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T21:51:58.034698+0000","last_change":"2024-05-08T21:49:43.229414+0000","last_active":"2024-05-08T21:51:58.034698+0000","last_peered":"2024-05-08T21:51:58.034698+0000","last_clean":"2024-05-08T21:51:58.034698+0000","last_became_active":"2024-05-08T21:49:43.229121+0000","last_became_peered":"2024-05-08T21:49:43.229121+0000","last_unstale":"2024-05-08T21:51:58.034698+0000","last_undegraded":"2024-05-08T21:51:58.034698+0000","last_fullsized":"2024-05-08T21:51:58.034698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:33:28.074468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"24'168","reported_seq":182,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.974981+0000","last_change":"2024-05-08T21:49:43.774111+0000","last_active":"2024-05-08T21:53:48.974981+0000","last_peered":"2024-05-08T21:53:48.974981+0000","last_clean":"2024-05-08T21:53:48.974981+0000","last_became_active":"2024-05-08T21:49:43.772528+0000","last_became_peered":"2024-05-08T21:49:43.772528+0000","last_unstale":"2024-05-08T21:53:48.974981+0000","last_undegraded":"2024-05-08T21:53:48.974981+0000","last_fullsized":"2024-05-08T21:53:48.974981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:28.983476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:06.001179+0000","last_change":"2024-05-08T21:49:43.208581+0000","last_active":"2024-05-08T21:52:06.001179+0000","last_peered":"2024-05-08T21:52:06.001179+0000","last_clean":"2024-05-08T21:52:06.001179+0000","last_became_active":"2024-05-08T21:49:43.208326+0000","last_became_peered":"2024-05-08T21:49:43.208326+0000","last_unstale":"2024-05-08T21:52:06.001179+0000","last_undegraded":"2024-05-08T21:52:06.001179+0000","last_fullsized":"2024-05-08T21:52:06.001179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:13:35.461791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"24'111","reported_seq":125,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:47.658001+0000","last_change":"2024-05-08T21:49:43.766519+0000","last_active":"2024-05-08T21:53:47.658001+0000","last_peered":"2024-05-08T21:53:47.658001+0000","last_clean":"2024-05-08T21:53:47.658001+0000","last_became_active":"2024-05-08T21:49:43.765789+0000","last_became_peered":"2024-05-08T21:49:43.765789+0000","last_unstale":"2024-05-08T21:53:47.658001+0000","last_undegraded":"2024-05-08T21:53:47.658001+0000","last_fullsized":"2024-05-08T21:53:47.658001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:23.674986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:26.311376+0000","last_change":"2024-05-08T21:49:43.218079+0000","last_active":"2024-05-08T21:52:26.311376+0000","last_peered":"2024-05-08T21:52:26.311376+0000","last_clean":"2024-05-08T21:52:26.311376+0000","last_became_active":"2024-05-08T21:49:43.217814+0000","last_became_peered":"2024-05-08T21:49:43.217814+0000","last_unstale":"2024-05-08T21:52:26.311376+0000","last_undegraded":"2024-05-08T21:52:26.311376+0000","last_fullsized":"2024-05-08T21:52:26.311376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:18:58.164159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"24'153","reported_seq":167,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.919653+0000","last_change":"2024-05-08T21:49:43.775713+0000","last_active":"2024-05-08T21:53:48.919653+0000","last_peered":"2024-05-08T21:53:48.919653+0000","last_clean":"2024-05-08T21:53:48.919653+0000","last_became_active":"2024-05-08T21:49:43.775361+0000","last_became_peered":"2024-05-08T21:49:43.775361+0000","last_unstale":"2024-05-08T21:53:48.919653+0000","last_undegraded":"2024-05-08T21:53:48.919653+0000","last_fullsized":"2024-05-08T21:53:48.919653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:48:24.482146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"24'171","reported_seq":185,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.995797+0000","last_change":"2024-05-08T21:49:43.767129+0000","last_active":"2024-05-08T21:53:48.995797+0000","last_peered":"2024-05-08T21:53:48.995797+0000","last_clean":"2024-05-08T21:53:48.995797+0000","last_became_active":"2024-05-08T21:49:43.766789+0000","last_became_peered":"2024-05-08T21:49:43.766789+0000","last_unstale":"2024-05-08T21:53:48.995797+0000","last_undegraded":"2024-05-08T21:53:48.995797+0000","last_fullsized":"2024-05-08T21:53:48.995797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:39.954320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"24'146","reported_seq":168,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.938359+0000","last_change":"2024-05-08T21:50:33.103563+0000","last_active":"2024-05-08T21:53:48.938359+0000","last_peered":"2024-05-08T21:53:48.938359+0000","last_clean":"2024-05-08T21:53:48.938359+0000","last_became_active":"2024-05-08T21:50:33.103289+0000","last_became_peered":"2024-05-08T21:50:33.103289+0000","last_unstale":"2024-05-08T21:53:48.938359+0000","last_undegraded":"2024-05-08T21:53:48.938359+0000","last_fullsized":"2024-05-08T21:53:48.938359+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:01:29.931035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"24'107","reported_seq":121,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:47.572706+0000","last_change":"2024-05-08T21:49:43.768929+0000","last_active":"2024-05-08T21:53:47.572706+0000","last_peered":"2024-05-08T21:53:47.572706+0000","last_clean":"2024-05-08T21:53:47.572706+0000","last_became_active":"2024-05-08T21:49:43.767606+0000","last_became_peered":"2024-05-08T21:49:43.767606+0000","last_unstale":"2024-05-08T21:53:47.572706+0000","last_undegraded":"2024-05-08T21:53:47.572706+0000","last_fullsized":"2024-05-08T21:53:47.572706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:13:06.426154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"24'118","reported_seq":132,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.770518+0000","last_change":"2024-05-08T21:49:43.774673+0000","last_active":"2024-05-08T21:53:48.770518+0000","last_peered":"2024-05-08T21:53:48.770518+0000","last_clean":"2024-05-08T21:53:48.770518+0000","last_became_active":"2024-05-08T21:49:43.774406+0000","last_became_peered":"2024-05-08T21:49:43.774406+0000","last_unstale":"2024-05-08T21:53:48.770518+0000","last_undegraded":"2024-05-08T21:53:48.770518+0000","last_fullsized":"2024-05-08T21:53:48.770518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:43.798909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"24'121","reported_seq":135,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.020457+0000","last_change":"2024-05-08T21:49:43.764222+0000","last_active":"2024-05-08T21:53:48.020457+0000","last_peered":"2024-05-08T21:53:48.020457+0000","last_clean":"2024-05-08T21:53:48.020457+0000","last_became_active":"2024-05-08T21:49:43.763937+0000","last_became_peered":"2024-05-08T21:49:43.763937+0000","last_unstale":"2024-05-08T21:53:48.020457+0000","last_undegraded":"2024-05-08T21:53:48.020457+0000","last_fullsized":"2024-05-08T21:53:48.020457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:04:14.416894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"24'160","reported_seq":174,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.980127+0000","last_change":"2024-05-08T21:49:43.757318+0000","last_active":"2024-05-08T21:53:48.980127+0000","last_peered":"2024-05-08T21:53:48.980127+0000","last_clean":"2024-05-08T21:53:48.980127+0000","last_became_active":"2024-05-08T21:49:43.757083+0000","last_became_peered":"2024-05-08T21:49:43.757083+0000","last_unstale":"2024-05-08T21:53:48.980127+0000","last_undegraded":"2024-05-08T21:53:48.980127+0000","last_fullsized":"2024-05-08T21:53:48.980127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:47.551474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"24'202","reported_seq":216,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.922778+0000","last_change":"2024-05-08T21:49:43.773491+0000","last_active":"2024-05-08T21:53:48.922778+0000","last_peered":"2024-05-08T21:53:48.922778+0000","last_clean":"2024-05-08T21:53:48.922778+0000","last_became_active":"2024-05-08T21:49:43.773203+0000","last_became_peered":"2024-05-08T21:49:43.773203+0000","last_unstale":"2024-05-08T21:53:48.922778+0000","last_undegraded":"2024-05-08T21:53:48.922778+0000","last_fullsized":"2024-05-08T21:53:48.922778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:53:14.774835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"24'122","reported_seq":136,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.126669+0000","last_change":"2024-05-08T21:49:43.761926+0000","last_active":"2024-05-08T21:53:48.126669+0000","last_peered":"2024-05-08T21:53:48.126669+0000","last_clean":"2024-05-08T21:53:48.126669+0000","last_became_active":"2024-05-08T21:49:43.761645+0000","last_became_peered":"2024-05-08T21:49:43.761645+0000","last_unstale":"2024-05-08T21:53:48.126669+0000","last_undegraded":"2024-05-08T21:53:48.126669+0000","last_fullsized":"2024-05-08T21:53:48.126669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:10:07.209965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"24'144","reported_seq":158,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:47.663192+0000","last_change":"2024-05-08T21:49:43.768942+0000","last_active":"2024-05-08T21:53:47.663192+0000","last_peered":"2024-05-08T21:53:47.663192+0000","last_clean":"2024-05-08T21:53:47.663192+0000","last_became_active":"2024-05-08T21:49:43.768673+0000","last_became_peered":"2024-05-08T21:49:43.768673+0000","last_unstale":"2024-05-08T21:53:47.663192+0000","last_undegraded":"2024-05-08T21:53:47.663192+0000","last_fullsized":"2024-05-08T21:53:47.663192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:15:41.869107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155189248,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":475136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"24'121","reported_seq":135,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.158009+0000","last_change":"2024-05-08T21:49:43.766452+0000","last_active":"2024-05-08T21:53:48.158009+0000","last_peered":"2024-05-08T21:53:48.158009+0000","last_clean":"2024-05-08T21:53:48.158009+0000","last_became_active":"2024-05-08T21:49:43.765723+0000","last_became_peered":"2024-05-08T21:49:43.765723+0000","last_unstale":"2024-05-08T21:53:48.158009+0000","last_undegraded":"2024-05-08T21:53:48.158009+0000","last_fullsized":"2024-05-08T21:53:48.158009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:19:28.925404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"24'140","reported_seq":154,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:47.640672+0000","last_change":"2024-05-08T21:49:43.775098+0000","last_active":"2024-05-08T21:53:47.640672+0000","last_peered":"2024-05-08T21:53:47.640672+0000","last_clean":"2024-05-08T21:53:47.640672+0000","last_became_active":"2024-05-08T21:49:43.774808+0000","last_became_peered":"2024-05-08T21:49:43.774808+0000","last_unstale":"2024-05-08T21:53:47.640672+0000","last_undegraded":"2024-05-08T21:53:47.640672+0000","last_fullsized":"2024-05-08T21:53:47.640672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:51:15.152611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"24'138","reported_seq":152,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.811522+0000","last_change":"2024-05-08T21:49:43.775129+0000","last_active":"2024-05-08T21:53:48.811522+0000","last_peered":"2024-05-08T21:53:48.811522+0000","last_clean":"2024-05-08T21:53:48.811522+0000","last_became_active":"2024-05-08T21:49:43.774881+0000","last_became_peered":"2024-05-08T21:49:43.774881+0000","last_unstale":"2024-05-08T21:53:48.811522+0000","last_undegraded":"2024-05-08T21:53:48.811522+0000","last_fullsized":"2024-05-08T21:53:48.811522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:19:28.925404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"24'171","reported_seq":185,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:49.003450+0000","last_change":"2024-05-08T21:49:43.764163+0000","last_active":"2024-05-08T21:53:49.003450+0000","last_peered":"2024-05-08T21:53:49.003450+0000","last_clean":"2024-05-08T21:53:49.003450+0000","last_became_active":"2024-05-08T21:49:43.763907+0000","last_became_peered":"2024-05-08T21:49:43.763907+0000","last_unstale":"2024-05-08T21:53:49.003450+0000","last_undegraded":"2024-05-08T21:53:49.003450+0000","last_fullsized":"2024-05-08T21:53:49.003450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:01:00.614249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":417792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2172649472,"num_objects":518,"num_object_clones":0,"num_object_copies":1036,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":518,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8698,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3728736256,"data_stored":3728736256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9850,"ondisk_log_size":9850,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":383377,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":82,"num_read_kb":90,"num_write":247,"num_write_kb":548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":827392,"data_stored":761693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":240,"ondisk_log_size":240,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509495,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31936,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339904,"statfs":{"total":96636764160,"available":96604061696,"internally_reserved":0,"allocated":843776,"data_stored":682658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.61299999999999999,"15min":0.60599999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":3.5680000000000001,"5min":3.5680000000000001,"15min":3.5680000000000001},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.64800000000000002,"15min":0.61799999999999999},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":3.6469999999999998,"5min":3.6469999999999998,"15min":3.6469999999999998},"last":0.5}]},{"osd":1,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.60299999999999998,"15min":0.56499999999999995},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":3.2669999999999999,"5min":3.2669999999999999,"15min":3.2669999999999999},"last":0.32600000000000001},{"interface":"front","average":{"1min":1.0980000000000001,"5min":0.65900000000000003,"15min":0.59399999999999997},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":5.5330000000000004,"5min":5.5330000000000004,"15min":5.5330000000000004},"last":0.46600000000000003}]},{"osd":2,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.61299999999999999,"15min":0.57699999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":5.0730000000000004,"5min":5.0730000000000004,"15min":5.0730000000000004},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.745,"5min":0.60299999999999998,"15min":0.57199999999999995},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":4.0250000000000004,"5min":4.0250000000000004,"15min":4.0250000000000004},"last":0.38100000000000001}]},{"osd":3,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":1.603,"5min":0.78000000000000003,"15min":0.64800000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":20.791,"5min":20.791,"15min":20.791},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.60199999999999998,"15min":0.60399999999999998},"min":{"1min":0.40899999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.69199999999999995}]},{"osd":4,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.52400000000000002,"15min":0.50600000000000001},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":4.0979999999999999,"5min":4.0979999999999999,"15min":4.0979999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.52500000000000002,"15min":0.52700000000000002},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":1.133}]},{"osd":5,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.52400000000000002,"15min":0.53200000000000003},"min":{"1min":0.32600000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.81899999999999995,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.626,"15min":0.59599999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":7.0890000000000004,"5min":7.0890000000000004,"15min":7.0890000000000004},"last":0.59599999999999997}]},{"osd":6,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.61299999999999999,"15min":0.60899999999999999},"min":{"1min":0.40100000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":2.2440000000000002,"5min":2.2440000000000002,"15min":2.2440000000000002},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.57999999999999996,"15min":0.59599999999999997},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.33600000000000002}]}]},{"osd":6,"up_from":15,"seq":64424509495,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31736,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340104,"statfs":{"total":96636764160,"available":96604266496,"internally_reserved":0,"allocated":638976,"data_stored":473984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.91800000000000004,"15min":0.66300000000000003},"min":{"1min":0.39200000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":5.2839999999999998,"5min":23.625,"15min":23.625},"last":0.39800000000000002},{"interface":"front","average":{"1min":2.2090000000000001,"5min":2.2730000000000001,"15min":1.131},"min":{"1min":0.32600000000000001,"5min":0.308,"15min":0.308},"max":{"1min":23.975999999999999,"5min":73.831999999999994,"15min":73.831999999999994},"last":0.54400000000000004}]},{"osd":1,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":1.897,"5min":0.86599999999999999,"15min":0.74399999999999999},"min":{"1min":0.33400000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":11.552,"5min":11.552,"15min":11.552},"last":0.44800000000000001},{"interface":"front","average":{"1min":1.8180000000000001,"5min":1.012,"15min":0.73199999999999998},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":11.619999999999999,"5min":11.619999999999999,"15min":11.619999999999999},"last":0.63900000000000001}]},{"osd":2,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":2.3220000000000001,"5min":1.552,"15min":0.88400000000000001},"min":{"1min":0.36599999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":23.77,"5min":36.951000000000001,"15min":36.951000000000001},"last":0.502},{"interface":"front","average":{"1min":1.986,"5min":0.86899999999999999,"15min":0.69499999999999995},"min":{"1min":0.35899999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":20.956,"5min":20.956,"15min":20.956},"last":0.52500000000000002}]},{"osd":3,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":1.55,"5min":0.79400000000000004,"15min":0.68200000000000005},"min":{"1min":0.41199999999999998,"5min":0.38,"15min":0.38},"max":{"1min":7.9690000000000003,"5min":7.9690000000000003,"15min":7.9690000000000003},"last":0.59599999999999997},{"interface":"front","average":{"1min":1.54,"5min":0.78500000000000003,"15min":0.66900000000000004},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":8.0709999999999997,"5min":8.0709999999999997,"15min":8.0709999999999997},"last":0.57799999999999996}]},{"osd":4,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.53500000000000003,"15min":0.505},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":5.1840000000000002,"5min":5.1840000000000002,"15min":5.1840000000000002},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.749,"5min":0.55500000000000005,"15min":0.53100000000000003},"min":{"1min":0.34899999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":2.976,"5min":2.976,"15min":2.976},"last":0.66200000000000003}]},{"osd":5,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.53200000000000003,"15min":0.498},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":3.0369999999999999,"5min":3.0369999999999999,"15min":3.0369999999999999},"last":0.62},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.60199999999999998,"15min":0.56999999999999995},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":5.1219999999999999,"5min":5.1219999999999999,"15min":5.1219999999999999},"last":0.56499999999999995}]},{"osd":7,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.61899999999999999,"15min":0.56999999999999995},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":4.0389999999999997,"5min":4.0389999999999997,"15min":4.0389999999999997},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.60099999999999998,"15min":0.56799999999999995},"min":{"1min":0.40100000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":2.883,"5min":2.883,"15min":2.883},"last":0.64800000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574901,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3164796,"kb_used_data":3133684,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":91207044,"statfs":{"total":96636764160,"available":93396013056,"internally_reserved":0,"allocated":3208892416,"data_stored":3208734358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:52:49 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55300000000000005,"15min":0.57299999999999995},"min":{"1min":0.33900000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.93700000000000006,"5min":1.97,"15min":1.97},"last":0.627},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.57899999999999996,"15min":0.59699999999999998},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.91500000000000004,"5min":2.161,"15min":2.161},"last":0.59099999999999997}]},{"osd":1,"last update":"Wed May 8 21:53:44 2024","interfaces":[{"interface":"back","average":{"1min":4.1360000000000001,"5min":1.294,"15min":0.84299999999999997},"min":{"1min":0.41699999999999998,"5min":0.313,"15min":0.313},"max":{"1min":53.069000000000003,"5min":53.069000000000003,"15min":53.069000000000003},"last":0.63900000000000001},{"interface":"front","average":{"1min":6.2969999999999997,"5min":1.681,"15min":0.88500000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":80.463999999999999,"5min":80.463999999999999,"15min":80.463999999999999},"last":0.55600000000000005}]},{"osd":2,"last update":"Wed May 8 21:52:49 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.61399999999999999,"15min":0.63},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.72199999999999998,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.59099999999999997,"15min":0.58299999999999996},"min":{"1min":0.46200000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":2.238,"5min":2.238,"15min":2.238},"last":0.64900000000000002}]},{"osd":3,"last update":"Wed May 8 21:52:49 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.55900000000000005,"15min":0.54500000000000004},"min":{"1min":0.36099999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":2.2719999999999998,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.59399999999999997,"15min":0.61199999999999999},"min":{"1min":0.38300000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.96699999999999997,"5min":1.883,"15min":1.883},"last":0.65800000000000003}]},{"osd":4,"last update":"Wed May 8 21:52:49 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.51000000000000001,"15min":0.52800000000000002},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.78200000000000003,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.55800000000000005,"15min":0.59199999999999997},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.68300000000000005,"5min":2.3239999999999998,"15min":2.3239999999999998},"last":0.53900000000000003}]},{"osd":6,"last update":"Wed May 8 21:52:49 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.52400000000000002,"15min":0.52800000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":2.1509999999999998,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.56399999999999995,"15min":0.58799999999999997},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.88700000000000001,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.56499999999999995}]},{"osd":7,"last update":"Wed May 8 21:52:49 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58799999999999997,"15min":0.60399999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.8640000000000001,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.56699999999999995,"15min":0.56200000000000006},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.52000000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574901,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31360,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340480,"statfs":{"total":96636764160,"available":96604651520,"internally_reserved":0,"allocated":253952,"data_stored":91868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":9.1020000000000003,"5min":2.2200000000000002,"15min":1.1719999999999999},"min":{"1min":0.26100000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":119.55200000000001,"5min":119.55200000000001,"15min":119.55200000000001},"last":0.29299999999999998},{"interface":"front","average":{"1min":2.9020000000000001,"5min":1.028,"15min":0.83999999999999997},"min":{"1min":0.24099999999999999,"5min":0.192,"15min":0.192},"max":{"1min":23.457999999999998,"5min":23.457999999999998,"15min":23.457999999999998},"last":0.24099999999999999}]},{"osd":2,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":3.9689999999999999,"5min":1.125,"15min":0.68300000000000005},"min":{"1min":0.255,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":33.259,"5min":33.259,"15min":33.259},"last":0.28000000000000003},{"interface":"front","average":{"1min":4.3860000000000001,"5min":1.343,"15min":0.97299999999999998},"min":{"1min":0.249,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":43.167000000000002,"5min":43.167000000000002,"15min":43.167000000000002},"last":0.34200000000000003}]},{"osd":3,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":4.6210000000000004,"5min":1.26,"15min":0.71399999999999997},"min":{"1min":0.254,"5min":0.247,"15min":0.247},"max":{"1min":43.131,"5min":43.131,"15min":43.131},"last":0.254},{"interface":"front","average":{"1min":7.319,"5min":1.7949999999999999,"15min":0.88100000000000001},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":52.923999999999999,"5min":52.923999999999999,"15min":52.923999999999999},"last":0.32600000000000001}]},{"osd":4,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":2.7330000000000001,"5min":1.0549999999999999,"15min":0.78700000000000003},"min":{"1min":0.41599999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":16.914000000000001,"5min":16.914000000000001,"15min":16.914000000000001},"last":0.45300000000000001},{"interface":"front","average":{"1min":4.056,"5min":1.2929999999999999,"15min":0.83299999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":43.078000000000003,"5min":43.078000000000003,"15min":43.078000000000003},"last":0.38100000000000001}]},{"osd":5,"last update":"Wed May 8 21:53:38 2024","interfaces":[{"interface":"back","average":{"1min":3.8370000000000002,"5min":1.28,"15min":0.86199999999999999},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":33.198,"5min":33.198,"15min":33.198},"last":0.41799999999999998},{"interface":"front","average":{"1min":1.6990000000000001,"5min":1.002,"15min":1.0169999999999999},"min":{"1min":0.48899999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":7.6139999999999999,"5min":9.2400000000000002,"15min":9.2400000000000002},"last":0.49299999999999999}]},{"osd":6,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":1.665,"5min":0.98199999999999998,"15min":0.98799999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":7.5449999999999999,"5min":9.202,"15min":9.202},"last":0.433},{"interface":"front","average":{"1min":3.5529999999999999,"5min":1.2450000000000001,"15min":0.86899999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":33.283000000000001,"5min":33.283000000000001,"15min":33.283000000000001},"last":0.39300000000000002}]},{"osd":7,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":1.6319999999999999,"5min":0.98499999999999999,"15min":1.0049999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":7.6669999999999998,"5min":9.2249999999999996,"15min":9.2249999999999996},"last":0.40300000000000002},{"interface":"front","average":{"1min":3.2189999999999999,"5min":1.1799999999999999,"15min":0.85599999999999998},"min":{"1min":0.44400000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":16.981000000000002,"5min":16.981000000000002,"15min":16.981000000000002},"last":0.48399999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509493,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1981640,"kb_used_data":1942336,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":92390200,"statfs":{"total":96636764160,"available":94607564800,"internally_reserved":0,"allocated":1988952064,"data_stored":1988782810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":1.6599999999999999,"5min":0.63500000000000001,"15min":0.46899999999999997},"min":{"1min":0.26100000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":27.239999999999998,"5min":27.239999999999998,"15min":27.239999999999998},"last":0.505},{"interface":"front","average":{"1min":2.0640000000000001,"5min":0.73299999999999998,"15min":0.52500000000000002},"min":{"1min":0.26100000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":27.643000000000001,"5min":27.643000000000001,"15min":27.643000000000001},"last":0.46800000000000003}]},{"osd":2,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":1.583,"5min":0.63,"15min":0.48499999999999999},"min":{"1min":0.24299999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":25.739000000000001,"5min":25.739000000000001,"15min":25.739000000000001},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.47399999999999998,"15min":0.43099999999999999},"min":{"1min":0.28000000000000003,"5min":0.253,"15min":0.253},"max":{"1min":4.9989999999999997,"5min":4.9989999999999997,"15min":4.9989999999999997},"last":0.495}]},{"osd":3,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":1.952,"5min":0.71599999999999997,"15min":0.52200000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":13.685,"5min":13.685,"15min":13.685},"last":0.438},{"interface":"front","average":{"1min":1.8500000000000001,"5min":0.71799999999999997,"15min":0.54300000000000004},"min":{"1min":0.27400000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":28.379999999999999,"5min":28.379999999999999,"15min":28.379999999999999},"last":0.45000000000000001}]},{"osd":4,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":0.69599999999999995,"15min":0.626},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":5.6790000000000003,"5min":5.6790000000000003,"15min":5.6790000000000003},"last":0.64500000000000002},{"interface":"front","average":{"1min":1.8600000000000001,"5min":0.82499999999999996,"15min":0.64900000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":13.794,"5min":13.794,"15min":13.794},"last":0.747}]},{"osd":5,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":1.877,"5min":0.84599999999999997,"15min":0.67200000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":13.827,"5min":13.827,"15min":13.827},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.66300000000000003,"15min":0.64900000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":4.9240000000000004,"5min":4.9240000000000004,"15min":4.9240000000000004},"last":0.75600000000000001}]},{"osd":6,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":0.70999999999999996,"15min":0.65400000000000003},"min":{"1min":0.379,"5min":0.376,"15min":0.376},"max":{"1min":8.3379999999999992,"5min":8.3379999999999992,"15min":8.3379999999999992},"last":0.70999999999999996},{"interface":"front","average":{"1min":1.1359999999999999,"5min":0.70199999999999996,"15min":0.63400000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":5.6500000000000004,"5min":5.6500000000000004,"15min":5.6500000000000004},"last":0.66200000000000003}]},{"osd":7,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":0.76500000000000001,"15min":0.68000000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":9.1950000000000003,"5min":9.1950000000000003,"15min":9.1950000000000003},"last":0.69999999999999996},{"interface":"front","average":{"1min":1.8799999999999999,"5min":0.86799999999999999,"15min":0.70799999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":13.756,"5min":13.756,"15min":13.756},"last":0.65300000000000002}]}]},{"osd":2,"up_from":15,"seq":64424509495,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31356,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340484,"statfs":{"total":96636764160,"available":96604655616,"internally_reserved":0,"allocated":249856,"data_stored":92011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:53:45 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.42199999999999999,"15min":0.34999999999999998},"min":{"1min":0.255,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":3.73,"5min":3.73,"15min":3.73},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.44,"15min":0.38200000000000001},"min":{"1min":0.27400000000000002,"5min":0.254,"15min":0.254},"max":{"1min":3.1600000000000001,"5min":3.1600000000000001,"15min":3.1600000000000001},"last":0.30299999999999999}]},{"osd":1,"last update":"Wed May 8 21:53:45 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.39600000000000002,"15min":0.36199999999999999},"min":{"1min":0.23999999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":3.1930000000000001,"5min":3.1930000000000001,"15min":3.1930000000000001},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.40100000000000002,"15min":0.375},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":2.1299999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":0.33100000000000002}]},{"osd":3,"last update":"Wed May 8 21:53:45 2024","interfaces":[{"interface":"back","average":{"1min":4.0759999999999996,"5min":1.1160000000000001,"15min":0.60699999999999998},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":60.899000000000001,"5min":60.899000000000001,"15min":60.899000000000001},"last":0.27700000000000002},{"interface":"front","average":{"1min":1.1140000000000001,"5min":0.53900000000000003,"15min":0.437},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":9.7469999999999999,"5min":9.7469999999999999,"15min":9.7469999999999999},"last":0.38700000000000001}]},{"osd":4,"last update":"Wed May 8 21:53:45 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":0.69099999999999995,"15min":0.63600000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":7.8499999999999996,"5min":7.8499999999999996,"15min":7.8499999999999996},"last":0.68200000000000005},{"interface":"front","average":{"1min":1.123,"5min":0.72399999999999998,"15min":0.66000000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":8.1189999999999998,"5min":8.1189999999999998,"15min":8.1189999999999998},"last":0.61099999999999999}]},{"osd":5,"last update":"Wed May 8 21:53:45 2024","interfaces":[{"interface":"back","average":{"1min":1.462,"5min":0.77100000000000002,"15min":0.65100000000000002},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":11.326000000000001,"5min":11.326000000000001,"15min":11.326000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":1.1259999999999999,"5min":0.69199999999999995,"15min":0.628},"min":{"1min":0.375,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":7.8860000000000001,"5min":7.8860000000000001,"15min":7.8860000000000001},"last":0.64100000000000001}]},{"osd":6,"last update":"Wed May 8 21:53:45 2024","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":0.69799999999999995,"15min":0.63800000000000001},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":8.1709999999999994,"5min":8.1709999999999994,"15min":8.1709999999999994},"last":0.54900000000000004},{"interface":"front","average":{"1min":1.421,"5min":0.76700000000000002,"15min":0.66000000000000003},"min":{"1min":0.40300000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":10.41,"5min":10.41,"15min":10.41},"last":0.625}]},{"osd":7,"last update":"Wed May 8 21:53:45 2024","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.67000000000000004,"15min":0.62},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":5.2699999999999996,"5min":5.2699999999999996,"15min":5.2699999999999996},"last":0.66500000000000004},{"interface":"front","average":{"1min":1.1679999999999999,"5min":0.72799999999999998,"15min":0.65200000000000002},"min":{"1min":0.42899999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":7.5810000000000004,"5min":7.5810000000000004,"15min":7.5810000000000004},"last":0.58099999999999996}]}]},{"osd":3,"up_from":15,"seq":64424509493,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1879028,"kb_used_data":1847916,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":92492812,"statfs":{"total":96636764160,"available":94712639488,"internally_reserved":0,"allocated":1892265984,"data_stored":1892100330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:53:42 2024","interfaces":[{"interface":"back","average":{"1min":2.0739999999999998,"5min":0.69299999999999995,"15min":0.47899999999999998},"min":{"1min":0.21299999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":39.470999999999997,"5min":39.470999999999997,"15min":39.470999999999997},"last":0.23799999999999999},{"interface":"front","average":{"1min":1.9750000000000001,"5min":0.68400000000000005,"15min":0.48099999999999998},"min":{"1min":0.25700000000000001,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":32.802,"5min":32.802,"15min":32.802},"last":0.31900000000000001}]},{"osd":1,"last update":"Wed May 8 21:53:42 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.38500000000000001,"15min":0.38700000000000001},"min":{"1min":0.252,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.34599999999999997},{"interface":"front","average":{"1min":2.48,"5min":0.82799999999999996,"15min":0.56399999999999995},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":43.493000000000002,"5min":43.493000000000002,"15min":43.493000000000002},"last":0.29799999999999999}]},{"osd":2,"last update":"Wed May 8 21:53:42 2024","interfaces":[{"interface":"back","average":{"1min":2.4969999999999999,"5min":0.85099999999999998,"15min":0.59299999999999997},"min":{"1min":0.318,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":43.445999999999998,"5min":43.445999999999998,"15min":43.445999999999998},"last":0.33800000000000002},{"interface":"front","average":{"1min":2.3530000000000002,"5min":0.83799999999999997,"15min":0.59599999999999997},"min":{"1min":0.34499999999999997,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":39.569000000000003,"5min":39.569000000000003,"15min":39.569000000000003},"last":0.35899999999999999}]},{"osd":4,"last update":"Wed May 8 21:53:42 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.629,"15min":0.61499999999999999},"min":{"1min":0.41199999999999998,"5min":0.377,"15min":0.377},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":0.54100000000000004},{"interface":"front","average":{"1min":1.821,"5min":0.85699999999999998,"15min":0.70399999999999996},"min":{"1min":0.375,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":19.024999999999999,"5min":19.024999999999999,"15min":19.024999999999999},"last":0.60899999999999999}]},{"osd":5,"last update":"Wed May 8 21:53:42 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.63200000000000001,"15min":0.627},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.833,"5min":1.833,"15min":1.833},"last":0.75},{"interface":"front","average":{"1min":2.0470000000000002,"5min":0.91900000000000004,"15min":0.72099999999999997},"min":{"1min":0.46700000000000003,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":27.678999999999998,"5min":27.678999999999998,"15min":27.678999999999998},"last":0.71799999999999997}]},{"osd":6,"last update":"Wed May 8 21:53:42 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.65400000000000003,"15min":0.64400000000000002},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.915,"5min":1.915,"15min":1.915},"last":0.73299999999999998},{"interface":"front","average":{"1min":2.2530000000000001,"5min":0.96299999999999997,"15min":0.77100000000000002},"min":{"1min":0.46500000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":32.655000000000001,"5min":32.655000000000001,"15min":32.655000000000001},"last":0.56100000000000005}]},{"osd":7,"last update":"Wed May 8 21:53:42 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.68700000000000006,"15min":0.66700000000000004},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":3.4089999999999998,"5min":3.4089999999999998,"15min":3.4089999999999998},"last":0.70799999999999996},{"interface":"front","average":{"1min":1.653,"5min":0.88800000000000001,"15min":0.72299999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":18.939,"5min":18.939,"15min":18.939},"last":0.57899999999999996}]}]},{"osd":4,"up_from":15,"seq":64424509494,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31364,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340476,"statfs":{"total":96636764160,"available":96604647424,"internally_reserved":0,"allocated":258048,"data_stored":91834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:53:44 2024","interfaces":[{"interface":"back","average":{"1min":2.1030000000000002,"5min":0.82299999999999995,"15min":0.59999999999999998},"min":{"1min":0.29399999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":21.042999999999999,"5min":21.042999999999999,"15min":21.042999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":2.1970000000000001,"5min":0.874,"15min":0.65200000000000002},"min":{"1min":0.46200000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":21.478999999999999,"5min":21.478999999999999,"15min":21.478999999999999},"last":0.53800000000000003}]},{"osd":1,"last update":"Wed May 8 21:53:44 2024","interfaces":[{"interface":"back","average":{"1min":1.986,"5min":0.83699999999999997,"15min":0.63100000000000001},"min":{"1min":0.372,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":14.555999999999999,"5min":14.555999999999999,"15min":14.555999999999999},"last":0.495},{"interface":"front","average":{"1min":1.1100000000000001,"5min":0.63700000000000001,"15min":0.55500000000000005},"min":{"1min":0.40799999999999997,"5min":0.314,"15min":0.314},"max":{"1min":7.7140000000000004,"5min":7.7140000000000004,"15min":7.7140000000000004},"last":0.52900000000000003}]},{"osd":2,"last update":"Wed May 8 21:53:44 2024","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":0.69399999999999995,"15min":0.58199999999999996},"min":{"1min":0.41899999999999998,"5min":0.377,"15min":0.377},"max":{"1min":11.724,"5min":11.724,"15min":11.724},"last":0.56799999999999995},{"interface":"front","average":{"1min":1.089,"5min":0.65700000000000003,"15min":0.58899999999999997},"min":{"1min":0.44600000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":4.6740000000000004,"5min":4.6740000000000004,"15min":4.6740000000000004},"last":0.45100000000000001}]},{"osd":3,"last update":"Wed May 8 21:53:44 2024","interfaces":[{"interface":"back","average":{"1min":2.4849999999999999,"5min":0.93700000000000006,"15min":0.68300000000000005},"min":{"1min":0.39400000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":30.84,"5min":30.84,"15min":30.84},"last":0.55800000000000005},{"interface":"front","average":{"1min":2.0739999999999998,"5min":0.89000000000000001,"15min":0.69099999999999995},"min":{"1min":0.41499999999999998,"5min":0.37,"15min":0.37},"max":{"1min":21.754000000000001,"5min":21.754000000000001,"15min":21.754000000000001},"last":0.52100000000000002}]},{"osd":5,"last update":"Wed May 8 21:53:44 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.52200000000000002,"15min":0.51200000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":4.4660000000000002,"5min":4.4660000000000002,"15min":4.4660000000000002},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.56899999999999995,"15min":0.56599999999999995},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":5.2190000000000003,"5min":5.2190000000000003,"15min":5.2190000000000003},"last":0.504}]},{"osd":6,"last update":"Wed May 8 21:53:44 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.61299999999999999,"15min":0.59499999999999997},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":4.9720000000000004,"5min":4.9720000000000004,"15min":4.9720000000000004},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.60599999999999998,"15min":0.60699999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":4.4100000000000001,"5min":4.4100000000000001,"15min":4.4100000000000001},"last":0.58399999999999996}]},{"osd":7,"last update":"Wed May 8 21:53:44 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.60399999999999998,"15min":0.61399999999999999},"min":{"1min":0.34699999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":4.444,"5min":4.444,"15min":4.444},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.877,"5min":0.67900000000000005,"15min":0.66100000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":5.0430000000000001,"5min":5.0430000000000001,"15min":5.0430000000000001},"last":0.67500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":389120,"data_stored":377518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":382276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1291845632,"data_stored":1291845632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":2436890624,"data_stored":2436890624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T21:53:52.455 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T21:53:52.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.611+0000 7fa5c5e29700 1 Processor -- start 2024-05-08T21:53:52.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.611+0000 7fa5c5e29700 1 -- start start 2024-05-08T21:53:52.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.611+0000 7fa5c5e29700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa5c00701d0 0x7fa5c00c5b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:52.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.611+0000 7fa5c5e29700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa5c006b1e0 0x7fa5c00c6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:52.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.611+0000 7fa5c5e29700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5c015b970 con 0x7fa5c0151e70 2024-05-08T21:53:52.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.611+0000 7fa5c5e29700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5c006fde0 con 0x7fa5c00701d0 2024-05-08T21:53:52.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.611+0000 7fa5c5e29700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c015beb0 con 0x7fa5c006b1e0 2024-05-08T21:53:52.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.612+0000 7fa5bf7fe700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fa5c0151e70 0x7fa5c006f6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:33592/0 (socket says 172.21.15.73:33592) 2024-05-08T21:53:52.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.612+0000 7fa5bf7fe700 1 -- 172.21.15.73:0/1565223461 learned_addr learned my addr 172.21.15.73:0/1565223461 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:53:52.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.612+0000 7fa5beffd700 1 --2- 172.21.15.73:0/1565223461 >> v2:172.21.15.115:3300/0 conn(0x7fa5c00701d0 0x7fa5c00c5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:52.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.612+0000 7fa5bffff700 1 --2- 172.21.15.73:0/1565223461 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa5c006b1e0 0x7fa5c00c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:52.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.612+0000 7fa5be7fc700 1 -- 172.21.15.73:0/1565223461 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4219554513 0 0) 0x7fa5c015b970 con 0x7fa5c0151e70 2024-05-08T21:53:52.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.612+0000 7fa5be7fc700 1 -- 172.21.15.73:0/1565223461 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5a80035b0 con 0x7fa5c0151e70 2024-05-08T21:53:52.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.612+0000 7fa5be7fc700 1 -- 172.21.15.73:0/1565223461 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3158196253 0 0) 0x7fa5a80035b0 con 0x7fa5c0151e70 2024-05-08T21:53:52.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.612+0000 7fa5be7fc700 1 -- 172.21.15.73:0/1565223461 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa5c006b1e0 msgr2=0x7fa5c00c6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:53:52.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.612+0000 7fa5be7fc700 1 --2- 172.21.15.73:0/1565223461 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa5c006b1e0 0x7fa5c00c6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:52.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.612+0000 7fa5be7fc700 1 -- 172.21.15.73:0/1565223461 >> v2:172.21.15.115:3300/0 conn(0x7fa5c00701d0 msgr2=0x7fa5c00c5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:53:52.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.612+0000 7fa5be7fc700 1 --2- 172.21.15.73:0/1565223461 >> v2:172.21.15.115:3300/0 conn(0x7fa5c00701d0 0x7fa5c00c5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:52.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.612+0000 7fa5be7fc700 1 -- 172.21.15.73:0/1565223461 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c0072680 con 0x7fa5c0151e70 2024-05-08T21:53:52.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.612+0000 7fa5be7fc700 1 -- 172.21.15.73:0/1565223461 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 953298616 0 0) 0x7fa5b00019f0 con 0x7fa5c0151e70 2024-05-08T21:53:52.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.612+0000 7fa5be7fc700 1 -- 172.21.15.73:0/1565223461 >> v1:172.21.15.73:6789/0 conn(0x7fa5c0151e70 legacy=0x7fa5c006f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:52.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.612+0000 7fa5be7fc700 1 --2- 172.21.15.73:0/1565223461 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5a8003a00 0x7fa5a8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:52.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.612+0000 7fa5be7fc700 1 --2- 172.21.15.73:0/1565223461 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa5c006b1e0 0x7fa5a8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:52.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.612+0000 7fa5be7fc700 1 --2- 172.21.15.73:0/1565223461 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5a8004d90 0x7fa5a8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:52.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.612+0000 7fa5be7fc700 1 -- 172.21.15.73:0/1565223461 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c006fde0 con 0x7fa5a8003a00 2024-05-08T21:53:52.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.612+0000 7fa5be7fc700 1 -- 172.21.15.73:0/1565223461 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c015beb0 con 0x7fa5a8004d90 2024-05-08T21:53:52.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.612+0000 7fa5be7fc700 1 -- 172.21.15.73:0/1565223461 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a800ba90 con 0x7fa5c006b1e0 2024-05-08T21:53:52.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.612+0000 7fa5bf7fe700 1 --2- 172.21.15.73:0/1565223461 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5a8003a00 0x7fa5a8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:52.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.612+0000 7fa5beffd700 1 --2- 172.21.15.73:0/1565223461 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa5c006b1e0 0x7fa5a8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:52.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.612+0000 7fa5bffff700 1 --2- 172.21.15.73:0/1565223461 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5a8004d90 0x7fa5a8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:52.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.613+0000 7fa5bf7fe700 1 -- 172.21.15.73:0/1565223461 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa5c006b1e0 msgr2=0x7fa5a8004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:53:52.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.613+0000 7fa5bf7fe700 1 --2- 172.21.15.73:0/1565223461 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa5c006b1e0 0x7fa5a8004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:52.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.613+0000 7fa5bf7fe700 1 -- 172.21.15.73:0/1565223461 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5a8004d90 msgr2=0x7fa5a8005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:53:52.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.613+0000 7fa5bf7fe700 1 --2- 172.21.15.73:0/1565223461 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5a8004d90 0x7fa5a8005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:52.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.613+0000 7fa5bf7fe700 1 -- 172.21.15.73:0/1565223461 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a80035b0 con 0x7fa5a8003a00 2024-05-08T21:53:52.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.613+0000 7fa5bf7fe700 1 --2- 172.21.15.73:0/1565223461 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5a8003a00 0x7fa5a8003e20 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa5b000a840 tx=0x7fa5a8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d24cda591df610ee server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:52.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.613+0000 7fa5be7fc700 1 -- 172.21.15.73:0/1565223461 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b0012600 con 0x7fa5a8003a00 2024-05-08T21:53:52.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.613+0000 7fa5be7fc700 1 -- 172.21.15.73:0/1565223461 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b0012760 con 0x7fa5a8003a00 2024-05-08T21:53:52.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.613+0000 7fa5be7fc700 1 -- 172.21.15.73:0/1565223461 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b0012af0 con 0x7fa5a8003a00 2024-05-08T21:53:52.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.613+0000 7fa5c5e29700 1 -- 172.21.15.73:0/1565223461 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5a8003a00 msgr2=0x7fa5a8003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:52.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.613+0000 7fa5c5e29700 1 --2- 172.21.15.73:0/1565223461 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5a8003a00 0x7fa5a8003e20 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa5b000a840 tx=0x7fa5a8005880 comp rx=0 tx=0).stop 2024-05-08T21:53:52.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.613+0000 7fa5bffff700 1 -- 172.21.15.73:0/1565223461 reap_dead start 2024-05-08T21:53:52.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.614+0000 7fa5c5e29700 1 -- 172.21.15.73:0/1565223461 shutdown_connections 2024-05-08T21:53:52.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.614+0000 7fa5c5e29700 1 -- 172.21.15.73:0/1565223461 >> 172.21.15.73:0/1565223461 conn(0x7fa5c0066cf0 msgr2=0x7fa5c006bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:53:52.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.614+0000 7fa5c5e29700 1 -- 172.21.15.73:0/1565223461 shutdown_connections 2024-05-08T21:53:52.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.614+0000 7fa5c5e29700 1 -- 172.21.15.73:0/1565223461 wait complete. 2024-05-08T21:53:52.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.615+0000 7fa5c5e29700 1 Processor -- start 2024-05-08T21:53:52.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.615+0000 7fa5c5e29700 1 -- start start 2024-05-08T21:53:52.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.616+0000 7fa5c5e29700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa5a8003a00 0x7fa5c014f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:52.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.616+0000 7fa5c5e29700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5c013f0d0 0x7fa5c01445d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:52.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.616+0000 7fa5c5e29700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5c01eddb0 0x7fa5c01ee230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:52.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.616+0000 7fa5c5e29700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c01ed6a0 con 0x7fa5c01eddb0 2024-05-08T21:53:52.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.616+0000 7fa5c5e29700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c00ca220 con 0x7fa5c013f0d0 2024-05-08T21:53:52.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.616+0000 7fa5c5e29700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c01514e0 con 0x7fa5a8003a00 2024-05-08T21:53:52.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.616+0000 7fa5bffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5c01eddb0 0x7fa5c01ee230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:52.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.616+0000 7fa5bffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5c01eddb0 0x7fa5c01ee230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56508/0 (socket says 172.21.15.73:56508) 2024-05-08T21:53:52.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.616+0000 7fa5bffff700 1 -- 172.21.15.73:0/1972604318 learned_addr learned my addr 172.21.15.73:0/1972604318 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:53:52.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.616+0000 7fa5beffd700 1 --2- 172.21.15.73:0/1972604318 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5c013f0d0 0x7fa5c01445d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:52.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.616+0000 7fa5bf7fe700 1 --2- 172.21.15.73:0/1972604318 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa5a8003a00 0x7fa5c014f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:52.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.616+0000 7fa5bffff700 1 -- 172.21.15.73:0/1972604318 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa5a8003a00 msgr2=0x7fa5c014f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:52.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.616+0000 7fa5bffff700 1 --2- 172.21.15.73:0/1972604318 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa5a8003a00 0x7fa5c014f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:52.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.616+0000 7fa5bffff700 1 -- 172.21.15.73:0/1972604318 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5c013f0d0 msgr2=0x7fa5c01445d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:52.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.616+0000 7fa5bffff700 1 --2- 172.21.15.73:0/1972604318 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5c013f0d0 0x7fa5c01445d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:52.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.616+0000 7fa5bffff700 1 -- 172.21.15.73:0/1972604318 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c01ed920 con 0x7fa5c01eddb0 2024-05-08T21:53:52.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.616+0000 7fa5bffff700 1 --2- 172.21.15.73:0/1972604318 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5c01eddb0 0x7fa5c01ee230 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa5c006b170 tx=0x7fa5b8011b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:52.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.616+0000 7fa5a7fff700 1 -- 172.21.15.73:0/1972604318 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b8004240 con 0x7fa5c01eddb0 2024-05-08T21:53:52.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.616+0000 7fa5a7fff700 1 -- 172.21.15.73:0/1972604318 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b80043a0 con 0x7fa5c01eddb0 2024-05-08T21:53:52.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.616+0000 7fa5c5e29700 1 -- 172.21.15.73:0/1972604318 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5c013f700 con 0x7fa5c01eddb0 2024-05-08T21:53:52.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.616+0000 7fa5a7fff700 1 -- 172.21.15.73:0/1972604318 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b80036a0 con 0x7fa5c01eddb0 2024-05-08T21:53:52.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.616+0000 7fa5c5e29700 1 -- 172.21.15.73:0/1972604318 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5c00cbc40 con 0x7fa5c01eddb0 2024-05-08T21:53:52.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.617+0000 7fa5c5e29700 1 -- 172.21.15.73:0/1972604318 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5c0150cc0 con 0x7fa5c01eddb0 2024-05-08T21:53:52.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.618+0000 7fa5a7fff700 1 -- 172.21.15.73:0/1972604318 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa5b8003800 con 0x7fa5c01eddb0 2024-05-08T21:53:52.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.618+0000 7fa5a7fff700 1 --2- 172.21.15.73:0/1972604318 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fa5ac06ac90 0x7fa5ac06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:52.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.618+0000 7fa5a7fff700 1 -- 172.21.15.73:0/1972604318 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5969+0+0 (secure 0 0 0) 0x7fa5b8089350 con 0x7fa5c01eddb0 2024-05-08T21:53:52.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.618+0000 7fa5bf7fe700 1 --2- 172.21.15.73:0/1972604318 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fa5ac06ac90 0x7fa5ac06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:52.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.619+0000 7fa5bf7fe700 1 --2- 172.21.15.73:0/1972604318 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fa5ac06ac90 0x7fa5ac06d150 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa5b0015040 tx=0x7fa5b0009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:52.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.623+0000 7fa5a7fff700 1 -- 172.21.15.73:0/1972604318 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fa5c0150cc0 con 0x7fa5c01eddb0 2024-05-08T21:53:52.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.815+0000 7fa5c5e29700 1 -- 172.21.15.73:0/1972604318 --> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa5c01581b0 con 0x7fa5ac06ac90 2024-05-08T21:53:52.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.823+0000 7fa5a7fff700 1 -- 172.21.15.73:0/1972604318 <== mgr.4104 v2:172.21.15.73:6832/46949 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289872 (secure 0 0 0) 0x7fa5c01581b0 con 0x7fa5ac06ac90 2024-05-08T21:53:52.828 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:53:52.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.826+0000 7fa5c5e29700 1 -- 172.21.15.73:0/1972604318 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fa5ac06ac90 msgr2=0x7fa5ac06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:52.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.826+0000 7fa5c5e29700 1 --2- 172.21.15.73:0/1972604318 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fa5ac06ac90 0x7fa5ac06d150 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa5b0015040 tx=0x7fa5b0009030 comp rx=0 tx=0).stop 2024-05-08T21:53:52.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.826+0000 7fa5c5e29700 1 -- 172.21.15.73:0/1972604318 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5c01eddb0 msgr2=0x7fa5c01ee230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:52.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.826+0000 7fa5c5e29700 1 --2- 172.21.15.73:0/1972604318 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5c01eddb0 0x7fa5c01ee230 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa5c006b170 tx=0x7fa5b8011b40 comp rx=0 tx=0).stop 2024-05-08T21:53:52.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.826+0000 7fa5c5e29700 1 -- 172.21.15.73:0/1972604318 shutdown_connections 2024-05-08T21:53:52.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.826+0000 7fa5c5e29700 1 --2- 172.21.15.73:0/1972604318 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fa5ac06ac90 0x7fa5ac06d150 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:52.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.826+0000 7fa5c5e29700 1 --2- 172.21.15.73:0/1972604318 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5c01eddb0 0x7fa5c01ee230 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:52.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.826+0000 7fa5c5e29700 1 --2- 172.21.15.73:0/1972604318 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa5a8003a00 0x7fa5c014f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:52.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.826+0000 7fa5c5e29700 1 --2- 172.21.15.73:0/1972604318 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5c013f0d0 0x7fa5c01445d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:52.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.826+0000 7fa5c5e29700 1 -- 172.21.15.73:0/1972604318 >> 172.21.15.73:0/1972604318 conn(0x7fa5c0066cf0 msgr2=0x7fa5c0158440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:53:52.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.827+0000 7fa5c5e29700 1 -- 172.21.15.73:0/1972604318 shutdown_connections 2024-05-08T21:53:52.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:52.827+0000 7fa5c5e29700 1 -- 172.21.15.73:0/1972604318 wait complete. 2024-05-08T21:53:52.831 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-05-08T21:53:52.840 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":145,"stamp":"2024-05-08T21:53:52.017183+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2173623217,"num_objects":543,"num_object_clones":0,"num_object_copies":1086,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":543,"num_whiteouts":0,"num_read":198,"num_read_kb":190,"num_write":9104,"num_write_kb":25168788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10207,"ondisk_log_size":10207,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":7183216,"kb_used_data":6926128,"kb_used_omap":12,"kb_used_meta":248819,"kb_avail":747791504,"statfs":{"total":773094113280,"available":765738500096,"internally_reserved":0,"allocated":7092355072,"data_stored":7091049853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":254791226},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8564758204,"num_objects":-2042,"num_object_clones":0,"num_object_copies":-4084,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2042,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2050,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002900"},"pg_stats":[{"pgid":"3.3f","version":"24'159","reported_seq":173,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.976255+0000","last_change":"2024-05-08T21:49:43.775912+0000","last_active":"2024-05-08T21:53:48.976255+0000","last_peered":"2024-05-08T21:53:48.976255+0000","last_clean":"2024-05-08T21:53:48.976255+0000","last_became_active":"2024-05-08T21:49:43.775657+0000","last_became_peered":"2024-05-08T21:49:43.775657+0000","last_unstale":"2024-05-08T21:53:48.976255+0000","last_undegraded":"2024-05-08T21:53:48.976255+0000","last_fullsized":"2024-05-08T21:53:48.976255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:10:07.209965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"24'148","reported_seq":162,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.979741+0000","last_change":"2024-05-08T21:49:43.766984+0000","last_active":"2024-05-08T21:53:48.979741+0000","last_peered":"2024-05-08T21:53:48.979741+0000","last_clean":"2024-05-08T21:53:48.979741+0000","last_became_active":"2024-05-08T21:49:43.765995+0000","last_became_peered":"2024-05-08T21:49:43.765995+0000","last_unstale":"2024-05-08T21:53:48.979741+0000","last_undegraded":"2024-05-08T21:53:48.979741+0000","last_fullsized":"2024-05-08T21:53:48.979741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:21:41.238890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"24'157","reported_seq":171,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.757121+0000","last_change":"2024-05-08T21:49:43.766107+0000","last_active":"2024-05-08T21:53:48.757121+0000","last_peered":"2024-05-08T21:53:48.757121+0000","last_clean":"2024-05-08T21:53:48.757121+0000","last_became_active":"2024-05-08T21:49:43.765874+0000","last_became_peered":"2024-05-08T21:49:43.765874+0000","last_unstale":"2024-05-08T21:53:48.757121+0000","last_undegraded":"2024-05-08T21:53:48.757121+0000","last_fullsized":"2024-05-08T21:53:48.757121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:06:50.769169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"24'137","reported_seq":152,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:47.651414+0000","last_change":"2024-05-08T21:49:43.766355+0000","last_active":"2024-05-08T21:53:47.651414+0000","last_peered":"2024-05-08T21:53:47.651414+0000","last_clean":"2024-05-08T21:53:47.651414+0000","last_became_active":"2024-05-08T21:49:43.765507+0000","last_became_peered":"2024-05-08T21:49:43.765507+0000","last_unstale":"2024-05-08T21:53:47.651414+0000","last_undegraded":"2024-05-08T21:53:47.651414+0000","last_fullsized":"2024-05-08T21:53:47.651414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:09:09.676078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159383552,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"24'170","reported_seq":182,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.982792+0000","last_change":"2024-05-08T21:50:33.104253+0000","last_active":"2024-05-08T21:53:48.982792+0000","last_peered":"2024-05-08T21:53:48.982792+0000","last_clean":"2024-05-08T21:53:48.982792+0000","last_became_active":"2024-05-08T21:50:33.103943+0000","last_became_peered":"2024-05-08T21:50:33.103943+0000","last_unstale":"2024-05-08T21:53:48.982792+0000","last_undegraded":"2024-05-08T21:53:48.982792+0000","last_fullsized":"2024-05-08T21:53:48.982792+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:22:41.503872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"24'110","reported_seq":124,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:47.605360+0000","last_change":"2024-05-08T21:49:43.771390+0000","last_active":"2024-05-08T21:53:47.605360+0000","last_peered":"2024-05-08T21:53:47.605360+0000","last_clean":"2024-05-08T21:53:47.605360+0000","last_became_active":"2024-05-08T21:49:43.770893+0000","last_became_peered":"2024-05-08T21:49:43.770893+0000","last_unstale":"2024-05-08T21:53:47.605360+0000","last_undegraded":"2024-05-08T21:53:47.605360+0000","last_fullsized":"2024-05-08T21:53:47.605360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:28.979468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"24'183","reported_seq":197,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.935714+0000","last_change":"2024-05-08T21:49:43.769981+0000","last_active":"2024-05-08T21:53:48.935714+0000","last_peered":"2024-05-08T21:53:48.935714+0000","last_clean":"2024-05-08T21:53:48.935714+0000","last_became_active":"2024-05-08T21:49:43.769667+0000","last_became_peered":"2024-05-08T21:49:43.769667+0000","last_unstale":"2024-05-08T21:53:48.935714+0000","last_undegraded":"2024-05-08T21:53:48.935714+0000","last_fullsized":"2024-05-08T21:53:48.935714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:12:00.381761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"24'161","reported_seq":175,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.068085+0000","last_change":"2024-05-08T21:49:43.771078+0000","last_active":"2024-05-08T21:53:48.068085+0000","last_peered":"2024-05-08T21:53:48.068085+0000","last_clean":"2024-05-08T21:53:48.068085+0000","last_became_active":"2024-05-08T21:49:43.770912+0000","last_became_peered":"2024-05-08T21:49:43.770912+0000","last_unstale":"2024-05-08T21:53:48.068085+0000","last_undegraded":"2024-05-08T21:53:48.068085+0000","last_fullsized":"2024-05-08T21:53:48.068085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:12:00.381761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":483328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"24'167","reported_seq":189,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.950277+0000","last_change":"2024-05-08T21:50:33.106461+0000","last_active":"2024-05-08T21:53:48.950277+0000","last_peered":"2024-05-08T21:53:48.950277+0000","last_clean":"2024-05-08T21:53:48.950277+0000","last_became_active":"2024-05-08T21:50:33.106142+0000","last_became_peered":"2024-05-08T21:50:33.106142+0000","last_unstale":"2024-05-08T21:53:48.950277+0000","last_undegraded":"2024-05-08T21:53:48.950277+0000","last_fullsized":"2024-05-08T21:53:48.950277+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:18:29.982214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"24'175","reported_seq":189,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.986601+0000","last_change":"2024-05-08T21:49:43.772784+0000","last_active":"2024-05-08T21:53:48.986601+0000","last_peered":"2024-05-08T21:53:48.986601+0000","last_clean":"2024-05-08T21:53:48.986601+0000","last_became_active":"2024-05-08T21:49:43.772505+0000","last_became_peered":"2024-05-08T21:49:43.772505+0000","last_unstale":"2024-05-08T21:53:48.986601+0000","last_undegraded":"2024-05-08T21:53:48.986601+0000","last_fullsized":"2024-05-08T21:53:48.986601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:19:28.925404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"24'208","reported_seq":222,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.995969+0000","last_change":"2024-05-08T21:49:43.771781+0000","last_active":"2024-05-08T21:53:48.995969+0000","last_peered":"2024-05-08T21:53:48.995969+0000","last_clean":"2024-05-08T21:53:48.995969+0000","last_became_active":"2024-05-08T21:49:43.771457+0000","last_became_peered":"2024-05-08T21:49:43.771457+0000","last_unstale":"2024-05-08T21:53:48.995969+0000","last_undegraded":"2024-05-08T21:53:48.995969+0000","last_fullsized":"2024-05-08T21:53:48.995969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:43.798909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"24'159","reported_seq":173,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:49.006621+0000","last_change":"2024-05-08T21:49:43.764249+0000","last_active":"2024-05-08T21:53:49.006621+0000","last_peered":"2024-05-08T21:53:49.006621+0000","last_clean":"2024-05-08T21:53:49.006621+0000","last_became_active":"2024-05-08T21:49:43.763986+0000","last_became_peered":"2024-05-08T21:49:43.763986+0000","last_unstale":"2024-05-08T21:53:49.006621+0000","last_undegraded":"2024-05-08T21:53:49.006621+0000","last_fullsized":"2024-05-08T21:53:49.006621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:33:13.833915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"24'141","reported_seq":155,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.165586+0000","last_change":"2024-05-08T21:49:43.761127+0000","last_active":"2024-05-08T21:53:48.165586+0000","last_peered":"2024-05-08T21:53:48.165586+0000","last_clean":"2024-05-08T21:53:48.165586+0000","last_became_active":"2024-05-08T21:49:43.760874+0000","last_became_peered":"2024-05-08T21:49:43.760874+0000","last_unstale":"2024-05-08T21:53:48.165586+0000","last_undegraded":"2024-05-08T21:53:48.165586+0000","last_fullsized":"2024-05-08T21:53:48.165586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:17:34.570817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"24'156","reported_seq":170,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.768707+0000","last_change":"2024-05-08T21:49:43.765829+0000","last_active":"2024-05-08T21:53:48.768707+0000","last_peered":"2024-05-08T21:53:48.768707+0000","last_clean":"2024-05-08T21:53:48.768707+0000","last_became_active":"2024-05-08T21:49:43.765566+0000","last_became_peered":"2024-05-08T21:49:43.765566+0000","last_unstale":"2024-05-08T21:53:48.768707+0000","last_undegraded":"2024-05-08T21:53:48.768707+0000","last_fullsized":"2024-05-08T21:53:48.768707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:39.954320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"24'170","reported_seq":184,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.988387+0000","last_change":"2024-05-08T21:49:43.765080+0000","last_active":"2024-05-08T21:53:48.988387+0000","last_peered":"2024-05-08T21:53:48.988387+0000","last_clean":"2024-05-08T21:53:48.988387+0000","last_became_active":"2024-05-08T21:49:43.764810+0000","last_became_peered":"2024-05-08T21:49:43.764810+0000","last_unstale":"2024-05-08T21:53:48.988387+0000","last_undegraded":"2024-05-08T21:53:48.988387+0000","last_fullsized":"2024-05-08T21:53:48.988387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:24:11.223913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"24'119","reported_seq":133,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:47.642980+0000","last_change":"2024-05-08T21:49:43.766717+0000","last_active":"2024-05-08T21:53:47.642980+0000","last_peered":"2024-05-08T21:53:47.642980+0000","last_clean":"2024-05-08T21:53:47.642980+0000","last_became_active":"2024-05-08T21:49:43.766427+0000","last_became_peered":"2024-05-08T21:49:43.766427+0000","last_unstale":"2024-05-08T21:53:47.642980+0000","last_undegraded":"2024-05-08T21:53:47.642980+0000","last_fullsized":"2024-05-08T21:53:47.642980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:49:22.833820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"24'114","reported_seq":128,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:47.597062+0000","last_change":"2024-05-08T21:49:43.776929+0000","last_active":"2024-05-08T21:53:47.597062+0000","last_peered":"2024-05-08T21:53:47.597062+0000","last_clean":"2024-05-08T21:53:47.597062+0000","last_became_active":"2024-05-08T21:49:43.776509+0000","last_became_peered":"2024-05-08T21:49:43.776509+0000","last_unstale":"2024-05-08T21:53:47.597062+0000","last_undegraded":"2024-05-08T21:53:47.597062+0000","last_fullsized":"2024-05-08T21:53:47.597062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:26.199459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"24'169","reported_seq":183,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.988290+0000","last_change":"2024-05-08T21:49:43.762646+0000","last_active":"2024-05-08T21:53:48.988290+0000","last_peered":"2024-05-08T21:53:48.988290+0000","last_clean":"2024-05-08T21:53:48.988290+0000","last_became_active":"2024-05-08T21:49:43.762237+0000","last_became_peered":"2024-05-08T21:49:43.762237+0000","last_unstale":"2024-05-08T21:53:48.988290+0000","last_undegraded":"2024-05-08T21:53:48.988290+0000","last_fullsized":"2024-05-08T21:53:48.988290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:46:08.821947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"24'198","reported_seq":212,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.997405+0000","last_change":"2024-05-08T21:49:43.774729+0000","last_active":"2024-05-08T21:53:48.997405+0000","last_peered":"2024-05-08T21:53:48.997405+0000","last_clean":"2024-05-08T21:53:48.997405+0000","last_became_active":"2024-05-08T21:49:43.774450+0000","last_became_peered":"2024-05-08T21:49:43.774450+0000","last_unstale":"2024-05-08T21:53:48.997405+0000","last_undegraded":"2024-05-08T21:53:48.997405+0000","last_fullsized":"2024-05-08T21:53:48.997405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:25.661350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"24'5","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:11.012373+0000","last_change":"2024-05-08T21:49:43.219461+0000","last_active":"2024-05-08T21:52:11.012373+0000","last_peered":"2024-05-08T21:52:11.012373+0000","last_clean":"2024-05-08T21:52:11.012373+0000","last_became_active":"2024-05-08T21:49:43.219161+0000","last_became_peered":"2024-05-08T21:49:43.219161+0000","last_unstale":"2024-05-08T21:52:11.012373+0000","last_undegraded":"2024-05-08T21:52:11.012373+0000","last_fullsized":"2024-05-08T21:52:11.012373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:02:45.778415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"24'137","reported_seq":152,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.165338+0000","last_change":"2024-05-08T21:49:43.764252+0000","last_active":"2024-05-08T21:53:48.165338+0000","last_peered":"2024-05-08T21:53:48.165338+0000","last_clean":"2024-05-08T21:53:48.165338+0000","last_became_active":"2024-05-08T21:49:43.764045+0000","last_became_peered":"2024-05-08T21:49:43.764045+0000","last_unstale":"2024-05-08T21:53:48.165338+0000","last_undegraded":"2024-05-08T21:53:48.165338+0000","last_fullsized":"2024-05-08T21:53:48.165338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:43.798909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:11.012823+0000","last_change":"2024-05-08T21:49:43.221599+0000","last_active":"2024-05-08T21:52:11.012823+0000","last_peered":"2024-05-08T21:52:11.012823+0000","last_clean":"2024-05-08T21:52:11.012823+0000","last_became_active":"2024-05-08T21:49:43.221309+0000","last_became_peered":"2024-05-08T21:49:43.221309+0000","last_unstale":"2024-05-08T21:52:11.012823+0000","last_undegraded":"2024-05-08T21:52:11.012823+0000","last_fullsized":"2024-05-08T21:52:11.012823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:17.379362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"24'145","reported_seq":159,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.797613+0000","last_change":"2024-05-08T21:49:43.771523+0000","last_active":"2024-05-08T21:53:48.797613+0000","last_peered":"2024-05-08T21:53:48.797613+0000","last_clean":"2024-05-08T21:53:48.797613+0000","last_became_active":"2024-05-08T21:49:43.771295+0000","last_became_peered":"2024-05-08T21:49:43.771295+0000","last_unstale":"2024-05-08T21:53:48.797613+0000","last_undegraded":"2024-05-08T21:53:48.797613+0000","last_fullsized":"2024-05-08T21:53:48.797613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:53:14.774835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"24'3","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:26.315599+0000","last_change":"2024-05-08T21:49:43.226637+0000","last_active":"2024-05-08T21:52:26.315599+0000","last_peered":"2024-05-08T21:52:26.315599+0000","last_clean":"2024-05-08T21:52:26.315599+0000","last_became_active":"2024-05-08T21:49:43.226284+0000","last_became_peered":"2024-05-08T21:49:43.226284+0000","last_unstale":"2024-05-08T21:52:26.315599+0000","last_undegraded":"2024-05-08T21:52:26.315599+0000","last_fullsized":"2024-05-08T21:52:26.315599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:01.844011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"24'117","reported_seq":131,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:47.604436+0000","last_change":"2024-05-08T21:49:43.766694+0000","last_active":"2024-05-08T21:53:47.604436+0000","last_peered":"2024-05-08T21:53:47.604436+0000","last_clean":"2024-05-08T21:53:47.604436+0000","last_became_active":"2024-05-08T21:49:43.766079+0000","last_became_peered":"2024-05-08T21:49:43.766079+0000","last_unstale":"2024-05-08T21:53:47.604436+0000","last_undegraded":"2024-05-08T21:53:47.604436+0000","last_fullsized":"2024-05-08T21:53:47.604436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:01:16.682080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:26.310680+0000","last_change":"2024-05-08T21:49:43.230152+0000","last_active":"2024-05-08T21:52:26.310680+0000","last_peered":"2024-05-08T21:52:26.310680+0000","last_clean":"2024-05-08T21:52:26.310680+0000","last_became_active":"2024-05-08T21:49:43.229891+0000","last_became_peered":"2024-05-08T21:49:43.229891+0000","last_unstale":"2024-05-08T21:52:26.310680+0000","last_undegraded":"2024-05-08T21:52:26.310680+0000","last_fullsized":"2024-05-08T21:52:26.310680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:33:12.827218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"24'190","reported_seq":202,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.997217+0000","last_change":"2024-05-08T21:50:33.113046+0000","last_active":"2024-05-08T21:53:48.997217+0000","last_peered":"2024-05-08T21:53:48.997217+0000","last_clean":"2024-05-08T21:53:48.997217+0000","last_became_active":"2024-05-08T21:50:33.112776+0000","last_became_peered":"2024-05-08T21:50:33.112776+0000","last_unstale":"2024-05-08T21:53:48.997217+0000","last_undegraded":"2024-05-08T21:53:48.997217+0000","last_fullsized":"2024-05-08T21:53:48.997217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:27:54.132637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":458752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"24'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:11.012352+0000","last_change":"2024-05-08T21:49:43.220418+0000","last_active":"2024-05-08T21:52:11.012352+0000","last_peered":"2024-05-08T21:52:11.012352+0000","last_clean":"2024-05-08T21:52:11.012352+0000","last_became_active":"2024-05-08T21:49:43.220090+0000","last_became_peered":"2024-05-08T21:49:43.220090+0000","last_unstale":"2024-05-08T21:52:11.012352+0000","last_undegraded":"2024-05-08T21:52:11.012352+0000","last_fullsized":"2024-05-08T21:52:11.012352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:33:28.074468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"24'142","reported_seq":154,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.960004+0000","last_change":"2024-05-08T21:50:33.103551+0000","last_active":"2024-05-08T21:53:48.960004+0000","last_peered":"2024-05-08T21:53:48.960004+0000","last_clean":"2024-05-08T21:53:48.960004+0000","last_became_active":"2024-05-08T21:50:33.103147+0000","last_became_peered":"2024-05-08T21:50:33.103147+0000","last_unstale":"2024-05-08T21:53:48.960004+0000","last_undegraded":"2024-05-08T21:53:48.960004+0000","last_fullsized":"2024-05-08T21:53:48.960004+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:50.167387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"24'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:11.012089+0000","last_change":"2024-05-08T21:49:43.220518+0000","last_active":"2024-05-08T21:52:11.012089+0000","last_peered":"2024-05-08T21:52:11.012089+0000","last_clean":"2024-05-08T21:52:11.012089+0000","last_became_active":"2024-05-08T21:49:43.218473+0000","last_became_peered":"2024-05-08T21:49:43.218473+0000","last_unstale":"2024-05-08T21:52:11.012089+0000","last_undegraded":"2024-05-08T21:52:11.012089+0000","last_fullsized":"2024-05-08T21:52:11.012089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:10.497167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"24'150","reported_seq":164,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.811305+0000","last_change":"2024-05-08T21:49:43.770935+0000","last_active":"2024-05-08T21:53:48.811305+0000","last_peered":"2024-05-08T21:53:48.811305+0000","last_clean":"2024-05-08T21:53:48.811305+0000","last_became_active":"2024-05-08T21:49:43.770677+0000","last_became_peered":"2024-05-08T21:49:43.770677+0000","last_unstale":"2024-05-08T21:53:48.811305+0000","last_undegraded":"2024-05-08T21:53:48.811305+0000","last_fullsized":"2024-05-08T21:53:48.811305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:04:14.416894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:06.001782+0000","last_change":"2024-05-08T21:49:43.221027+0000","last_active":"2024-05-08T21:52:06.001782+0000","last_peered":"2024-05-08T21:52:06.001782+0000","last_clean":"2024-05-08T21:52:06.001782+0000","last_became_active":"2024-05-08T21:49:43.220780+0000","last_became_peered":"2024-05-08T21:49:43.220780+0000","last_unstale":"2024-05-08T21:52:06.001782+0000","last_undegraded":"2024-05-08T21:52:06.001782+0000","last_fullsized":"2024-05-08T21:52:06.001782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:20:34.123736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"24'182","reported_seq":194,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.989238+0000","last_change":"2024-05-08T21:50:33.305422+0000","last_active":"2024-05-08T21:53:48.989238+0000","last_peered":"2024-05-08T21:53:48.989238+0000","last_clean":"2024-05-08T21:53:48.989238+0000","last_became_active":"2024-05-08T21:50:33.305037+0000","last_became_peered":"2024-05-08T21:50:33.305037+0000","last_unstale":"2024-05-08T21:53:48.989238+0000","last_undegraded":"2024-05-08T21:53:48.989238+0000","last_fullsized":"2024-05-08T21:53:48.989238+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:20:06.560937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:06.619556+0000","last_change":"2024-05-08T21:49:43.225299+0000","last_active":"2024-05-08T21:52:06.619556+0000","last_peered":"2024-05-08T21:52:06.619556+0000","last_clean":"2024-05-08T21:52:06.619556+0000","last_became_active":"2024-05-08T21:49:43.225057+0000","last_became_peered":"2024-05-08T21:49:43.225057+0000","last_unstale":"2024-05-08T21:52:06.619556+0000","last_undegraded":"2024-05-08T21:52:06.619556+0000","last_fullsized":"2024-05-08T21:52:06.619556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:38:43.069159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"24'177","reported_seq":191,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.994522+0000","last_change":"2024-05-08T21:49:43.757361+0000","last_active":"2024-05-08T21:53:48.994522+0000","last_peered":"2024-05-08T21:53:48.994522+0000","last_clean":"2024-05-08T21:53:48.994522+0000","last_became_active":"2024-05-08T21:49:43.757092+0000","last_became_peered":"2024-05-08T21:49:43.757092+0000","last_unstale":"2024-05-08T21:53:48.994522+0000","last_undegraded":"2024-05-08T21:53:48.994522+0000","last_fullsized":"2024-05-08T21:53:48.994522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:24:02.741766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"24'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:08.039542+0000","last_change":"2024-05-08T21:49:43.229405+0000","last_active":"2024-05-08T21:52:08.039542+0000","last_peered":"2024-05-08T21:52:08.039542+0000","last_clean":"2024-05-08T21:52:08.039542+0000","last_became_active":"2024-05-08T21:49:43.229105+0000","last_became_peered":"2024-05-08T21:49:43.229105+0000","last_unstale":"2024-05-08T21:52:08.039542+0000","last_undegraded":"2024-05-08T21:52:08.039542+0000","last_fullsized":"2024-05-08T21:52:08.039542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:18:58.164159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"24'178","reported_seq":192,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:47.651834+0000","last_change":"2024-05-08T21:49:43.773243+0000","last_active":"2024-05-08T21:53:47.651834+0000","last_peered":"2024-05-08T21:53:47.651834+0000","last_clean":"2024-05-08T21:53:47.651834+0000","last_became_active":"2024-05-08T21:49:43.772944+0000","last_became_peered":"2024-05-08T21:49:43.772944+0000","last_unstale":"2024-05-08T21:53:47.651834+0000","last_undegraded":"2024-05-08T21:53:47.651834+0000","last_fullsized":"2024-05-08T21:53:47.651834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:21:41.238890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":213909504,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":598016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:06.620035+0000","last_change":"2024-05-08T21:49:43.224999+0000","last_active":"2024-05-08T21:52:06.620035+0000","last_peered":"2024-05-08T21:52:06.620035+0000","last_clean":"2024-05-08T21:52:06.620035+0000","last_became_active":"2024-05-08T21:49:43.223476+0000","last_became_peered":"2024-05-08T21:49:43.223476+0000","last_unstale":"2024-05-08T21:52:06.620035+0000","last_undegraded":"2024-05-08T21:52:06.620035+0000","last_fullsized":"2024-05-08T21:52:06.620035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:09:12.983430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"24'146","reported_seq":160,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.772198+0000","last_change":"2024-05-08T21:49:43.771526+0000","last_active":"2024-05-08T21:53:48.772198+0000","last_peered":"2024-05-08T21:53:48.772198+0000","last_clean":"2024-05-08T21:53:48.772198+0000","last_became_active":"2024-05-08T21:49:43.771279+0000","last_became_peered":"2024-05-08T21:49:43.771279+0000","last_unstale":"2024-05-08T21:53:48.772198+0000","last_undegraded":"2024-05-08T21:53:48.772198+0000","last_fullsized":"2024-05-08T21:53:48.772198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:41:45.602022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"24'7","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:08.589052+0000","last_change":"2024-05-08T21:49:43.224378+0000","last_active":"2024-05-08T21:53:08.589052+0000","last_peered":"2024-05-08T21:53:08.589052+0000","last_clean":"2024-05-08T21:53:08.589052+0000","last_became_active":"2024-05-08T21:49:43.224164+0000","last_became_peered":"2024-05-08T21:49:43.224164+0000","last_unstale":"2024-05-08T21:53:08.589052+0000","last_undegraded":"2024-05-08T21:53:08.589052+0000","last_fullsized":"2024-05-08T21:53:08.589052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:06:10.276907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"24'157","reported_seq":171,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.942200+0000","last_change":"2024-05-08T21:49:43.772948+0000","last_active":"2024-05-08T21:53:48.942200+0000","last_peered":"2024-05-08T21:53:48.942200+0000","last_clean":"2024-05-08T21:53:48.942200+0000","last_became_active":"2024-05-08T21:49:43.772685+0000","last_became_peered":"2024-05-08T21:49:43.772685+0000","last_unstale":"2024-05-08T21:53:48.942200+0000","last_undegraded":"2024-05-08T21:53:48.942200+0000","last_fullsized":"2024-05-08T21:53:48.942200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:02.850708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"24'179","reported_seq":200,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:49.442985+0000","last_change":"2024-05-08T21:49:43.222308+0000","last_active":"2024-05-08T21:53:49.442985+0000","last_peered":"2024-05-08T21:53:49.442985+0000","last_clean":"2024-05-08T21:53:49.442985+0000","last_became_active":"2024-05-08T21:49:43.221844+0000","last_became_peered":"2024-05-08T21:49:43.221844+0000","last_unstale":"2024-05-08T21:53:49.442985+0000","last_undegraded":"2024-05-08T21:53:49.442985+0000","last_fullsized":"2024-05-08T21:53:49.442985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:17.379362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":382276,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":177,"num_write_kb":522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"24'170","reported_seq":184,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.988815+0000","last_change":"2024-05-08T21:49:43.773923+0000","last_active":"2024-05-08T21:53:48.988815+0000","last_peered":"2024-05-08T21:53:48.988815+0000","last_clean":"2024-05-08T21:53:48.988815+0000","last_became_active":"2024-05-08T21:49:43.772037+0000","last_became_peered":"2024-05-08T21:49:43.772037+0000","last_unstale":"2024-05-08T21:53:48.988815+0000","last_undegraded":"2024-05-08T21:53:48.988815+0000","last_fullsized":"2024-05-08T21:53:48.988815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:52:32.629407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:11.006373+0000","last_change":"2024-05-08T21:49:43.219473+0000","last_active":"2024-05-08T21:52:11.006373+0000","last_peered":"2024-05-08T21:52:11.006373+0000","last_clean":"2024-05-08T21:52:11.006373+0000","last_became_active":"2024-05-08T21:49:43.219186+0000","last_became_peered":"2024-05-08T21:49:43.219186+0000","last_unstale":"2024-05-08T21:52:11.006373+0000","last_undegraded":"2024-05-08T21:52:11.006373+0000","last_fullsized":"2024-05-08T21:52:11.006373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:20:34.123736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"24'165","reported_seq":179,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.793723+0000","last_change":"2024-05-08T21:49:43.775135+0000","last_active":"2024-05-08T21:53:48.793723+0000","last_peered":"2024-05-08T21:53:48.793723+0000","last_clean":"2024-05-08T21:53:48.793723+0000","last_became_active":"2024-05-08T21:49:43.774919+0000","last_became_peered":"2024-05-08T21:49:43.774919+0000","last_unstale":"2024-05-08T21:53:48.793723+0000","last_undegraded":"2024-05-08T21:53:48.793723+0000","last_fullsized":"2024-05-08T21:53:48.793723+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:01:00.614249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T21:52:06.031614+0000","last_change":"2024-05-08T21:49:43.227386+0000","last_active":"2024-05-08T21:52:06.031614+0000","last_peered":"2024-05-08T21:52:06.031614+0000","last_clean":"2024-05-08T21:52:06.031614+0000","last_became_active":"2024-05-08T21:49:43.227065+0000","last_became_peered":"2024-05-08T21:49:43.227065+0000","last_unstale":"2024-05-08T21:52:06.031614+0000","last_undegraded":"2024-05-08T21:52:06.031614+0000","last_fullsized":"2024-05-08T21:52:06.031614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:43:48.019170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"24'186","reported_seq":200,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.993574+0000","last_change":"2024-05-08T21:49:43.770509+0000","last_active":"2024-05-08T21:53:48.993574+0000","last_peered":"2024-05-08T21:53:48.993574+0000","last_clean":"2024-05-08T21:53:48.993574+0000","last_became_active":"2024-05-08T21:49:43.770180+0000","last_became_peered":"2024-05-08T21:49:43.770180+0000","last_unstale":"2024-05-08T21:53:48.993574+0000","last_undegraded":"2024-05-08T21:53:48.993574+0000","last_fullsized":"2024-05-08T21:53:48.993574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:00:38.941899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T21:52:03.038898+0000","last_change":"2024-05-08T21:49:43.220942+0000","last_active":"2024-05-08T21:52:03.038898+0000","last_peered":"2024-05-08T21:52:03.038898+0000","last_clean":"2024-05-08T21:52:03.038898+0000","last_became_active":"2024-05-08T21:49:43.220641+0000","last_became_peered":"2024-05-08T21:49:43.220641+0000","last_unstale":"2024-05-08T21:52:03.038898+0000","last_undegraded":"2024-05-08T21:52:03.038898+0000","last_fullsized":"2024-05-08T21:52:03.038898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:52.323917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"24'191","reported_seq":205,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.997366+0000","last_change":"2024-05-08T21:49:43.766269+0000","last_active":"2024-05-08T21:53:48.997366+0000","last_peered":"2024-05-08T21:53:48.997366+0000","last_clean":"2024-05-08T21:53:48.997366+0000","last_became_active":"2024-05-08T21:49:43.765945+0000","last_became_peered":"2024-05-08T21:49:43.765945+0000","last_unstale":"2024-05-08T21:53:48.997366+0000","last_undegraded":"2024-05-08T21:53:48.997366+0000","last_fullsized":"2024-05-08T21:53:48.997366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:17:34.570817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:26.314118+0000","last_change":"2024-05-08T21:49:43.208328+0000","last_active":"2024-05-08T21:52:26.314118+0000","last_peered":"2024-05-08T21:52:26.314118+0000","last_clean":"2024-05-08T21:52:26.314118+0000","last_became_active":"2024-05-08T21:49:43.208013+0000","last_became_peered":"2024-05-08T21:49:43.208013+0000","last_unstale":"2024-05-08T21:52:26.314118+0000","last_undegraded":"2024-05-08T21:52:26.314118+0000","last_fullsized":"2024-05-08T21:52:26.314118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:10.497167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"24'209","reported_seq":223,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.939563+0000","last_change":"2024-05-08T21:49:43.774210+0000","last_active":"2024-05-08T21:53:48.939563+0000","last_peered":"2024-05-08T21:53:48.939563+0000","last_clean":"2024-05-08T21:53:48.939563+0000","last_became_active":"2024-05-08T21:49:43.773933+0000","last_became_peered":"2024-05-08T21:49:43.773933+0000","last_unstale":"2024-05-08T21:53:48.939563+0000","last_undegraded":"2024-05-08T21:53:48.939563+0000","last_fullsized":"2024-05-08T21:53:48.939563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:10:25.398535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:07.434727+0000","last_change":"2024-05-08T21:49:43.217456+0000","last_active":"2024-05-08T21:52:07.434727+0000","last_peered":"2024-05-08T21:52:07.434727+0000","last_clean":"2024-05-08T21:52:07.434727+0000","last_became_active":"2024-05-08T21:49:43.216822+0000","last_became_peered":"2024-05-08T21:49:43.216822+0000","last_unstale":"2024-05-08T21:52:07.434727+0000","last_undegraded":"2024-05-08T21:52:07.434727+0000","last_fullsized":"2024-05-08T21:52:07.434727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:41:35.881003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"24'170","reported_seq":184,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:49.012486+0000","last_change":"2024-05-08T21:49:43.770066+0000","last_active":"2024-05-08T21:53:49.012486+0000","last_peered":"2024-05-08T21:53:49.012486+0000","last_clean":"2024-05-08T21:53:49.012486+0000","last_became_active":"2024-05-08T21:49:43.769762+0000","last_became_peered":"2024-05-08T21:49:43.769762+0000","last_unstale":"2024-05-08T21:53:49.012486+0000","last_undegraded":"2024-05-08T21:53:49.012486+0000","last_fullsized":"2024-05-08T21:53:49.012486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:40:20.301747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T21:51:51.029492+0000","last_change":"2024-05-08T21:49:43.215293+0000","last_active":"2024-05-08T21:51:51.029492+0000","last_peered":"2024-05-08T21:51:51.029492+0000","last_clean":"2024-05-08T21:51:51.029492+0000","last_became_active":"2024-05-08T21:49:43.215048+0000","last_became_peered":"2024-05-08T21:49:43.215048+0000","last_unstale":"2024-05-08T21:51:51.029492+0000","last_undegraded":"2024-05-08T21:51:51.029492+0000","last_fullsized":"2024-05-08T21:51:51.029492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:43:48.019170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"24'115","reported_seq":129,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:47.503014+0000","last_change":"2024-05-08T21:49:43.770326+0000","last_active":"2024-05-08T21:53:47.503014+0000","last_peered":"2024-05-08T21:53:47.503014+0000","last_clean":"2024-05-08T21:53:47.503014+0000","last_became_active":"2024-05-08T21:49:43.770029+0000","last_became_peered":"2024-05-08T21:49:43.770029+0000","last_unstale":"2024-05-08T21:53:47.503014+0000","last_undegraded":"2024-05-08T21:53:47.503014+0000","last_fullsized":"2024-05-08T21:53:47.503014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:33:33.642847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T21:51:51.029535+0000","last_change":"2024-05-08T21:49:43.227710+0000","last_active":"2024-05-08T21:51:51.029535+0000","last_peered":"2024-05-08T21:51:51.029535+0000","last_clean":"2024-05-08T21:51:51.029535+0000","last_became_active":"2024-05-08T21:49:43.227430+0000","last_became_peered":"2024-05-08T21:49:43.227430+0000","last_unstale":"2024-05-08T21:51:51.029535+0000","last_undegraded":"2024-05-08T21:51:51.029535+0000","last_fullsized":"2024-05-08T21:51:51.029535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:05:58.875400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"24'170","reported_seq":184,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:49.009057+0000","last_change":"2024-05-08T21:49:43.768588+0000","last_active":"2024-05-08T21:53:49.009057+0000","last_peered":"2024-05-08T21:53:49.009057+0000","last_clean":"2024-05-08T21:53:49.009057+0000","last_became_active":"2024-05-08T21:49:43.768307+0000","last_became_peered":"2024-05-08T21:49:43.768307+0000","last_unstale":"2024-05-08T21:53:49.009057+0000","last_undegraded":"2024-05-08T21:53:49.009057+0000","last_fullsized":"2024-05-08T21:53:49.009057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:04.968184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"24'157","reported_seq":172,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.998860+0000","last_change":"2024-05-08T21:49:43.758618+0000","last_active":"2024-05-08T21:53:48.998860+0000","last_peered":"2024-05-08T21:53:48.998860+0000","last_clean":"2024-05-08T21:53:48.998860+0000","last_became_active":"2024-05-08T21:49:43.758367+0000","last_became_peered":"2024-05-08T21:49:43.758367+0000","last_unstale":"2024-05-08T21:53:48.998860+0000","last_undegraded":"2024-05-08T21:53:48.998860+0000","last_fullsized":"2024-05-08T21:53:48.998860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:30:06.569971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"24'4","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:47.358418+0000","last_change":"2024-05-08T21:49:43.217410+0000","last_active":"2024-05-08T21:53:47.358418+0000","last_peered":"2024-05-08T21:53:47.358418+0000","last_clean":"2024-05-08T21:53:47.358418+0000","last_became_active":"2024-05-08T21:49:43.217133+0000","last_became_peered":"2024-05-08T21:49:43.217133+0000","last_unstale":"2024-05-08T21:53:47.358418+0000","last_undegraded":"2024-05-08T21:53:47.358418+0000","last_fullsized":"2024-05-08T21:53:47.358418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:17.379362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":303,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"24'138","reported_seq":152,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.100219+0000","last_change":"2024-05-08T21:49:43.771651+0000","last_active":"2024-05-08T21:53:48.100219+0000","last_peered":"2024-05-08T21:53:48.100219+0000","last_clean":"2024-05-08T21:53:48.100219+0000","last_became_active":"2024-05-08T21:49:43.771451+0000","last_became_peered":"2024-05-08T21:49:43.771451+0000","last_unstale":"2024-05-08T21:53:48.100219+0000","last_undegraded":"2024-05-08T21:53:48.100219+0000","last_fullsized":"2024-05-08T21:53:48.100219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:00:38.941899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T21:51:51.029553+0000","last_change":"2024-05-08T21:49:43.224929+0000","last_active":"2024-05-08T21:51:51.029553+0000","last_peered":"2024-05-08T21:51:51.029553+0000","last_clean":"2024-05-08T21:51:51.029553+0000","last_became_active":"2024-05-08T21:49:43.223469+0000","last_became_peered":"2024-05-08T21:49:43.223469+0000","last_unstale":"2024-05-08T21:51:51.029553+0000","last_undegraded":"2024-05-08T21:51:51.029553+0000","last_fullsized":"2024-05-08T21:51:51.029553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:27.504127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":169,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:06.294108+0000","last_change":"2024-05-08T21:49:38.626519+0000","last_active":"2024-05-08T21:52:06.294108+0000","last_peered":"2024-05-08T21:52:06.294108+0000","last_clean":"2024-05-08T21:52:06.294108+0000","last_became_active":"2024-05-08T21:49:38.626159+0000","last_became_peered":"2024-05-08T21:49:38.626159+0000","last_unstale":"2024-05-08T21:52:06.294108+0000","last_undegraded":"2024-05-08T21:52:06.294108+0000","last_fullsized":"2024-05-08T21:52:06.294108+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:36.031649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:36.031649+0000","last_clean_scrub_stamp":"2024-05-08T21:49:36.031649+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:12:04.846500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"24'151","reported_seq":165,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.795812+0000","last_change":"2024-05-08T21:49:43.770966+0000","last_active":"2024-05-08T21:53:48.795812+0000","last_peered":"2024-05-08T21:53:48.795812+0000","last_clean":"2024-05-08T21:53:48.795812+0000","last_became_active":"2024-05-08T21:49:43.770711+0000","last_became_peered":"2024-05-08T21:49:43.770711+0000","last_unstale":"2024-05-08T21:53:48.795812+0000","last_undegraded":"2024-05-08T21:53:48.795812+0000","last_fullsized":"2024-05-08T21:53:48.795812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:17:34.570817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:06.294247+0000","last_change":"2024-05-08T21:49:43.221086+0000","last_active":"2024-05-08T21:52:06.294247+0000","last_peered":"2024-05-08T21:52:06.294247+0000","last_clean":"2024-05-08T21:52:06.294247+0000","last_became_active":"2024-05-08T21:49:43.220539+0000","last_became_peered":"2024-05-08T21:49:43.220539+0000","last_unstale":"2024-05-08T21:52:06.294247+0000","last_undegraded":"2024-05-08T21:52:06.294247+0000","last_fullsized":"2024-05-08T21:52:06.294247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:52.323917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T21:51:48.035134+0000","last_change":"2024-05-08T21:49:43.222410+0000","last_active":"2024-05-08T21:51:48.035134+0000","last_peered":"2024-05-08T21:51:48.035134+0000","last_clean":"2024-05-08T21:51:48.035134+0000","last_became_active":"2024-05-08T21:49:43.222131+0000","last_became_peered":"2024-05-08T21:49:43.222131+0000","last_unstale":"2024-05-08T21:51:48.035134+0000","last_undegraded":"2024-05-08T21:51:48.035134+0000","last_fullsized":"2024-05-08T21:51:48.035134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:18:58.164159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"24'153","reported_seq":167,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:49.002757+0000","last_change":"2024-05-08T21:49:43.758424+0000","last_active":"2024-05-08T21:53:49.002757+0000","last_peered":"2024-05-08T21:53:49.002757+0000","last_clean":"2024-05-08T21:53:49.002757+0000","last_became_active":"2024-05-08T21:49:43.758140+0000","last_became_peered":"2024-05-08T21:49:43.758140+0000","last_unstale":"2024-05-08T21:53:49.002757+0000","last_undegraded":"2024-05-08T21:53:49.002757+0000","last_fullsized":"2024-05-08T21:53:49.002757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:10.795540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"24'13","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:26.917117+0000","last_change":"2024-05-08T21:49:43.218241+0000","last_active":"2024-05-08T21:53:26.917117+0000","last_peered":"2024-05-08T21:53:26.917117+0000","last_clean":"2024-05-08T21:53:26.917117+0000","last_became_active":"2024-05-08T21:49:43.217780+0000","last_became_peered":"2024-05-08T21:49:43.217780+0000","last_unstale":"2024-05-08T21:53:26.917117+0000","last_undegraded":"2024-05-08T21:53:26.917117+0000","last_fullsized":"2024-05-08T21:53:26.917117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:27.504127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":25,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"24'128","reported_seq":142,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.068226+0000","last_change":"2024-05-08T21:49:43.770491+0000","last_active":"2024-05-08T21:53:48.068226+0000","last_peered":"2024-05-08T21:53:48.068226+0000","last_clean":"2024-05-08T21:53:48.068226+0000","last_became_active":"2024-05-08T21:49:43.770221+0000","last_became_peered":"2024-05-08T21:49:43.770221+0000","last_unstale":"2024-05-08T21:53:48.068226+0000","last_undegraded":"2024-05-08T21:53:48.068226+0000","last_fullsized":"2024-05-08T21:53:48.068226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:25.661350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:26.312014+0000","last_change":"2024-05-08T21:49:43.221345+0000","last_active":"2024-05-08T21:52:26.312014+0000","last_peered":"2024-05-08T21:52:26.312014+0000","last_clean":"2024-05-08T21:52:26.312014+0000","last_became_active":"2024-05-08T21:49:43.220953+0000","last_became_peered":"2024-05-08T21:49:43.220953+0000","last_unstale":"2024-05-08T21:52:26.312014+0000","last_undegraded":"2024-05-08T21:52:26.312014+0000","last_fullsized":"2024-05-08T21:52:26.312014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:33:28.074468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"24'165","reported_seq":179,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.797008+0000","last_change":"2024-05-08T21:49:43.765001+0000","last_active":"2024-05-08T21:53:48.797008+0000","last_peered":"2024-05-08T21:53:48.797008+0000","last_clean":"2024-05-08T21:53:48.797008+0000","last_became_active":"2024-05-08T21:49:43.764740+0000","last_became_peered":"2024-05-08T21:49:43.764740+0000","last_unstale":"2024-05-08T21:53:48.797008+0000","last_undegraded":"2024-05-08T21:53:48.797008+0000","last_fullsized":"2024-05-08T21:53:48.797008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:18:58.836430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T21:51:53.035540+0000","last_change":"2024-05-08T21:49:43.221251+0000","last_active":"2024-05-08T21:51:53.035540+0000","last_peered":"2024-05-08T21:51:53.035540+0000","last_clean":"2024-05-08T21:51:53.035540+0000","last_became_active":"2024-05-08T21:49:43.220839+0000","last_became_peered":"2024-05-08T21:49:43.220839+0000","last_unstale":"2024-05-08T21:51:53.035540+0000","last_undegraded":"2024-05-08T21:51:53.035540+0000","last_fullsized":"2024-05-08T21:51:53.035540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:10.497167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"24'160","reported_seq":174,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:49.008663+0000","last_change":"2024-05-08T21:49:43.762511+0000","last_active":"2024-05-08T21:53:49.008663+0000","last_peered":"2024-05-08T21:53:49.008663+0000","last_clean":"2024-05-08T21:53:49.008663+0000","last_became_active":"2024-05-08T21:49:43.762170+0000","last_became_peered":"2024-05-08T21:49:43.762170+0000","last_unstale":"2024-05-08T21:53:49.008663+0000","last_undegraded":"2024-05-08T21:53:49.008663+0000","last_fullsized":"2024-05-08T21:53:49.008663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:11.503864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T21:51:56.029980+0000","last_change":"2024-05-08T21:49:43.215361+0000","last_active":"2024-05-08T21:51:56.029980+0000","last_peered":"2024-05-08T21:51:56.029980+0000","last_clean":"2024-05-08T21:51:56.029980+0000","last_became_active":"2024-05-08T21:49:43.215162+0000","last_became_peered":"2024-05-08T21:49:43.215162+0000","last_unstale":"2024-05-08T21:51:56.029980+0000","last_undegraded":"2024-05-08T21:51:56.029980+0000","last_fullsized":"2024-05-08T21:51:56.029980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:05:58.875400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"24'132","reported_seq":146,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.145508+0000","last_change":"2024-05-08T21:49:43.757512+0000","last_active":"2024-05-08T21:53:48.145508+0000","last_peered":"2024-05-08T21:53:48.145508+0000","last_clean":"2024-05-08T21:53:48.145508+0000","last_became_active":"2024-05-08T21:49:43.757233+0000","last_became_peered":"2024-05-08T21:49:43.757233+0000","last_unstale":"2024-05-08T21:53:48.145508+0000","last_undegraded":"2024-05-08T21:53:48.145508+0000","last_fullsized":"2024-05-08T21:53:48.145508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:53:14.774835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T21:51:56.030001+0000","last_change":"2024-05-08T21:49:43.217935+0000","last_active":"2024-05-08T21:51:56.030001+0000","last_peered":"2024-05-08T21:51:56.030001+0000","last_clean":"2024-05-08T21:51:56.030001+0000","last_became_active":"2024-05-08T21:49:43.217595+0000","last_became_peered":"2024-05-08T21:49:43.217595+0000","last_unstale":"2024-05-08T21:51:56.030001+0000","last_undegraded":"2024-05-08T21:51:56.030001+0000","last_fullsized":"2024-05-08T21:51:56.030001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:38:43.069159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"24'126","reported_seq":140,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.068793+0000","last_change":"2024-05-08T21:49:43.766816+0000","last_active":"2024-05-08T21:53:48.068793+0000","last_peered":"2024-05-08T21:53:48.068793+0000","last_clean":"2024-05-08T21:53:48.068793+0000","last_became_active":"2024-05-08T21:49:43.766596+0000","last_became_peered":"2024-05-08T21:49:43.766596+0000","last_unstale":"2024-05-08T21:53:48.068793+0000","last_undegraded":"2024-05-08T21:53:48.068793+0000","last_fullsized":"2024-05-08T21:53:48.068793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:01:00.614249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"24'4","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:11.011988+0000","last_change":"2024-05-08T21:49:43.224243+0000","last_active":"2024-05-08T21:52:11.011988+0000","last_peered":"2024-05-08T21:52:11.011988+0000","last_clean":"2024-05-08T21:52:11.011988+0000","last_became_active":"2024-05-08T21:49:43.223974+0000","last_became_peered":"2024-05-08T21:49:43.223974+0000","last_unstale":"2024-05-08T21:52:11.011988+0000","last_undegraded":"2024-05-08T21:52:11.011988+0000","last_fullsized":"2024-05-08T21:52:11.011988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:03.961487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"24'149","reported_seq":163,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:49.000712+0000","last_change":"2024-05-08T21:49:43.764377+0000","last_active":"2024-05-08T21:53:49.000712+0000","last_peered":"2024-05-08T21:53:49.000712+0000","last_clean":"2024-05-08T21:53:49.000712+0000","last_became_active":"2024-05-08T21:49:43.764075+0000","last_became_peered":"2024-05-08T21:49:43.764075+0000","last_unstale":"2024-05-08T21:53:49.000712+0000","last_undegraded":"2024-05-08T21:53:49.000712+0000","last_fullsized":"2024-05-08T21:53:49.000712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:41:45.602022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T21:51:58.034698+0000","last_change":"2024-05-08T21:49:43.229414+0000","last_active":"2024-05-08T21:51:58.034698+0000","last_peered":"2024-05-08T21:51:58.034698+0000","last_clean":"2024-05-08T21:51:58.034698+0000","last_became_active":"2024-05-08T21:49:43.229121+0000","last_became_peered":"2024-05-08T21:49:43.229121+0000","last_unstale":"2024-05-08T21:51:58.034698+0000","last_undegraded":"2024-05-08T21:51:58.034698+0000","last_fullsized":"2024-05-08T21:51:58.034698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:33:28.074468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"24'168","reported_seq":182,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.974981+0000","last_change":"2024-05-08T21:49:43.774111+0000","last_active":"2024-05-08T21:53:48.974981+0000","last_peered":"2024-05-08T21:53:48.974981+0000","last_clean":"2024-05-08T21:53:48.974981+0000","last_became_active":"2024-05-08T21:49:43.772528+0000","last_became_peered":"2024-05-08T21:49:43.772528+0000","last_unstale":"2024-05-08T21:53:48.974981+0000","last_undegraded":"2024-05-08T21:53:48.974981+0000","last_fullsized":"2024-05-08T21:53:48.974981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:28.983476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:06.001179+0000","last_change":"2024-05-08T21:49:43.208581+0000","last_active":"2024-05-08T21:52:06.001179+0000","last_peered":"2024-05-08T21:52:06.001179+0000","last_clean":"2024-05-08T21:52:06.001179+0000","last_became_active":"2024-05-08T21:49:43.208326+0000","last_became_peered":"2024-05-08T21:49:43.208326+0000","last_unstale":"2024-05-08T21:52:06.001179+0000","last_undegraded":"2024-05-08T21:52:06.001179+0000","last_fullsized":"2024-05-08T21:52:06.001179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:13:35.461791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"24'111","reported_seq":125,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:47.658001+0000","last_change":"2024-05-08T21:49:43.766519+0000","last_active":"2024-05-08T21:53:47.658001+0000","last_peered":"2024-05-08T21:53:47.658001+0000","last_clean":"2024-05-08T21:53:47.658001+0000","last_became_active":"2024-05-08T21:49:43.765789+0000","last_became_peered":"2024-05-08T21:49:43.765789+0000","last_unstale":"2024-05-08T21:53:47.658001+0000","last_undegraded":"2024-05-08T21:53:47.658001+0000","last_fullsized":"2024-05-08T21:53:47.658001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:23.674986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:26.311376+0000","last_change":"2024-05-08T21:49:43.218079+0000","last_active":"2024-05-08T21:52:26.311376+0000","last_peered":"2024-05-08T21:52:26.311376+0000","last_clean":"2024-05-08T21:52:26.311376+0000","last_became_active":"2024-05-08T21:49:43.217814+0000","last_became_peered":"2024-05-08T21:49:43.217814+0000","last_unstale":"2024-05-08T21:52:26.311376+0000","last_undegraded":"2024-05-08T21:52:26.311376+0000","last_fullsized":"2024-05-08T21:52:26.311376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:18:58.164159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"24'153","reported_seq":167,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.919653+0000","last_change":"2024-05-08T21:49:43.775713+0000","last_active":"2024-05-08T21:53:48.919653+0000","last_peered":"2024-05-08T21:53:48.919653+0000","last_clean":"2024-05-08T21:53:48.919653+0000","last_became_active":"2024-05-08T21:49:43.775361+0000","last_became_peered":"2024-05-08T21:49:43.775361+0000","last_unstale":"2024-05-08T21:53:48.919653+0000","last_undegraded":"2024-05-08T21:53:48.919653+0000","last_fullsized":"2024-05-08T21:53:48.919653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:48:24.482146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"24'171","reported_seq":185,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.995797+0000","last_change":"2024-05-08T21:49:43.767129+0000","last_active":"2024-05-08T21:53:48.995797+0000","last_peered":"2024-05-08T21:53:48.995797+0000","last_clean":"2024-05-08T21:53:48.995797+0000","last_became_active":"2024-05-08T21:49:43.766789+0000","last_became_peered":"2024-05-08T21:49:43.766789+0000","last_unstale":"2024-05-08T21:53:48.995797+0000","last_undegraded":"2024-05-08T21:53:48.995797+0000","last_fullsized":"2024-05-08T21:53:48.995797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:39.954320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"24'146","reported_seq":168,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.938359+0000","last_change":"2024-05-08T21:50:33.103563+0000","last_active":"2024-05-08T21:53:48.938359+0000","last_peered":"2024-05-08T21:53:48.938359+0000","last_clean":"2024-05-08T21:53:48.938359+0000","last_became_active":"2024-05-08T21:50:33.103289+0000","last_became_peered":"2024-05-08T21:50:33.103289+0000","last_unstale":"2024-05-08T21:53:48.938359+0000","last_undegraded":"2024-05-08T21:53:48.938359+0000","last_fullsized":"2024-05-08T21:53:48.938359+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:01:29.931035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"24'107","reported_seq":121,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:47.572706+0000","last_change":"2024-05-08T21:49:43.768929+0000","last_active":"2024-05-08T21:53:47.572706+0000","last_peered":"2024-05-08T21:53:47.572706+0000","last_clean":"2024-05-08T21:53:47.572706+0000","last_became_active":"2024-05-08T21:49:43.767606+0000","last_became_peered":"2024-05-08T21:49:43.767606+0000","last_unstale":"2024-05-08T21:53:47.572706+0000","last_undegraded":"2024-05-08T21:53:47.572706+0000","last_fullsized":"2024-05-08T21:53:47.572706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:13:06.426154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"24'118","reported_seq":132,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.770518+0000","last_change":"2024-05-08T21:49:43.774673+0000","last_active":"2024-05-08T21:53:48.770518+0000","last_peered":"2024-05-08T21:53:48.770518+0000","last_clean":"2024-05-08T21:53:48.770518+0000","last_became_active":"2024-05-08T21:49:43.774406+0000","last_became_peered":"2024-05-08T21:49:43.774406+0000","last_unstale":"2024-05-08T21:53:48.770518+0000","last_undegraded":"2024-05-08T21:53:48.770518+0000","last_fullsized":"2024-05-08T21:53:48.770518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:43.798909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"24'121","reported_seq":135,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.020457+0000","last_change":"2024-05-08T21:49:43.764222+0000","last_active":"2024-05-08T21:53:48.020457+0000","last_peered":"2024-05-08T21:53:48.020457+0000","last_clean":"2024-05-08T21:53:48.020457+0000","last_became_active":"2024-05-08T21:49:43.763937+0000","last_became_peered":"2024-05-08T21:49:43.763937+0000","last_unstale":"2024-05-08T21:53:48.020457+0000","last_undegraded":"2024-05-08T21:53:48.020457+0000","last_fullsized":"2024-05-08T21:53:48.020457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:04:14.416894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"24'160","reported_seq":174,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.980127+0000","last_change":"2024-05-08T21:49:43.757318+0000","last_active":"2024-05-08T21:53:48.980127+0000","last_peered":"2024-05-08T21:53:48.980127+0000","last_clean":"2024-05-08T21:53:48.980127+0000","last_became_active":"2024-05-08T21:49:43.757083+0000","last_became_peered":"2024-05-08T21:49:43.757083+0000","last_unstale":"2024-05-08T21:53:48.980127+0000","last_undegraded":"2024-05-08T21:53:48.980127+0000","last_fullsized":"2024-05-08T21:53:48.980127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:47.551474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"24'202","reported_seq":216,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.922778+0000","last_change":"2024-05-08T21:49:43.773491+0000","last_active":"2024-05-08T21:53:48.922778+0000","last_peered":"2024-05-08T21:53:48.922778+0000","last_clean":"2024-05-08T21:53:48.922778+0000","last_became_active":"2024-05-08T21:49:43.773203+0000","last_became_peered":"2024-05-08T21:49:43.773203+0000","last_unstale":"2024-05-08T21:53:48.922778+0000","last_undegraded":"2024-05-08T21:53:48.922778+0000","last_fullsized":"2024-05-08T21:53:48.922778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:53:14.774835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"24'122","reported_seq":136,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.126669+0000","last_change":"2024-05-08T21:49:43.761926+0000","last_active":"2024-05-08T21:53:48.126669+0000","last_peered":"2024-05-08T21:53:48.126669+0000","last_clean":"2024-05-08T21:53:48.126669+0000","last_became_active":"2024-05-08T21:49:43.761645+0000","last_became_peered":"2024-05-08T21:49:43.761645+0000","last_unstale":"2024-05-08T21:53:48.126669+0000","last_undegraded":"2024-05-08T21:53:48.126669+0000","last_fullsized":"2024-05-08T21:53:48.126669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:10:07.209965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"24'144","reported_seq":158,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:47.663192+0000","last_change":"2024-05-08T21:49:43.768942+0000","last_active":"2024-05-08T21:53:47.663192+0000","last_peered":"2024-05-08T21:53:47.663192+0000","last_clean":"2024-05-08T21:53:47.663192+0000","last_became_active":"2024-05-08T21:49:43.768673+0000","last_became_peered":"2024-05-08T21:49:43.768673+0000","last_unstale":"2024-05-08T21:53:47.663192+0000","last_undegraded":"2024-05-08T21:53:47.663192+0000","last_fullsized":"2024-05-08T21:53:47.663192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:15:41.869107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155189248,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":475136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"24'121","reported_seq":135,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.158009+0000","last_change":"2024-05-08T21:49:43.766452+0000","last_active":"2024-05-08T21:53:48.158009+0000","last_peered":"2024-05-08T21:53:48.158009+0000","last_clean":"2024-05-08T21:53:48.158009+0000","last_became_active":"2024-05-08T21:49:43.765723+0000","last_became_peered":"2024-05-08T21:49:43.765723+0000","last_unstale":"2024-05-08T21:53:48.158009+0000","last_undegraded":"2024-05-08T21:53:48.158009+0000","last_fullsized":"2024-05-08T21:53:48.158009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:19:28.925404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"24'140","reported_seq":154,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:47.640672+0000","last_change":"2024-05-08T21:49:43.775098+0000","last_active":"2024-05-08T21:53:47.640672+0000","last_peered":"2024-05-08T21:53:47.640672+0000","last_clean":"2024-05-08T21:53:47.640672+0000","last_became_active":"2024-05-08T21:49:43.774808+0000","last_became_peered":"2024-05-08T21:49:43.774808+0000","last_unstale":"2024-05-08T21:53:47.640672+0000","last_undegraded":"2024-05-08T21:53:47.640672+0000","last_fullsized":"2024-05-08T21:53:47.640672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:51:15.152611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"24'138","reported_seq":152,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.811522+0000","last_change":"2024-05-08T21:49:43.775129+0000","last_active":"2024-05-08T21:53:48.811522+0000","last_peered":"2024-05-08T21:53:48.811522+0000","last_clean":"2024-05-08T21:53:48.811522+0000","last_became_active":"2024-05-08T21:49:43.774881+0000","last_became_peered":"2024-05-08T21:49:43.774881+0000","last_unstale":"2024-05-08T21:53:48.811522+0000","last_undegraded":"2024-05-08T21:53:48.811522+0000","last_fullsized":"2024-05-08T21:53:48.811522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:19:28.925404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"24'171","reported_seq":185,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:49.003450+0000","last_change":"2024-05-08T21:49:43.764163+0000","last_active":"2024-05-08T21:53:49.003450+0000","last_peered":"2024-05-08T21:53:49.003450+0000","last_clean":"2024-05-08T21:53:49.003450+0000","last_became_active":"2024-05-08T21:49:43.763907+0000","last_became_peered":"2024-05-08T21:49:43.763907+0000","last_unstale":"2024-05-08T21:53:49.003450+0000","last_undegraded":"2024-05-08T21:53:49.003450+0000","last_fullsized":"2024-05-08T21:53:49.003450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:01:00.614249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":417792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2172649472,"num_objects":518,"num_object_clones":0,"num_object_copies":1036,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":518,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8698,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3728736256,"data_stored":3728736256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9850,"ondisk_log_size":9850,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":383377,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":82,"num_read_kb":90,"num_write":247,"num_write_kb":548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":827392,"data_stored":761693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":240,"ondisk_log_size":240,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509495,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31936,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339904,"statfs":{"total":96636764160,"available":96604061696,"internally_reserved":0,"allocated":843776,"data_stored":682658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.61299999999999999,"15min":0.60599999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":3.5680000000000001,"5min":3.5680000000000001,"15min":3.5680000000000001},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.64800000000000002,"15min":0.61799999999999999},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":3.6469999999999998,"5min":3.6469999999999998,"15min":3.6469999999999998},"last":0.5}]},{"osd":1,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.60299999999999998,"15min":0.56499999999999995},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":3.2669999999999999,"5min":3.2669999999999999,"15min":3.2669999999999999},"last":0.32600000000000001},{"interface":"front","average":{"1min":1.0980000000000001,"5min":0.65900000000000003,"15min":0.59399999999999997},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":5.5330000000000004,"5min":5.5330000000000004,"15min":5.5330000000000004},"last":0.46600000000000003}]},{"osd":2,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.61299999999999999,"15min":0.57699999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":5.0730000000000004,"5min":5.0730000000000004,"15min":5.0730000000000004},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.745,"5min":0.60299999999999998,"15min":0.57199999999999995},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":4.0250000000000004,"5min":4.0250000000000004,"15min":4.0250000000000004},"last":0.38100000000000001}]},{"osd":3,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":1.603,"5min":0.78000000000000003,"15min":0.64800000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":20.791,"5min":20.791,"15min":20.791},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.60199999999999998,"15min":0.60399999999999998},"min":{"1min":0.40899999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.69199999999999995}]},{"osd":4,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.52400000000000002,"15min":0.50600000000000001},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":4.0979999999999999,"5min":4.0979999999999999,"15min":4.0979999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.52500000000000002,"15min":0.52700000000000002},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":1.133}]},{"osd":5,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.52400000000000002,"15min":0.53200000000000003},"min":{"1min":0.32600000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.81899999999999995,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.626,"15min":0.59599999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":7.0890000000000004,"5min":7.0890000000000004,"15min":7.0890000000000004},"last":0.59599999999999997}]},{"osd":6,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.61299999999999999,"15min":0.60899999999999999},"min":{"1min":0.40100000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":2.2440000000000002,"5min":2.2440000000000002,"15min":2.2440000000000002},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.57999999999999996,"15min":0.59599999999999997},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.33600000000000002}]}]},{"osd":6,"up_from":15,"seq":64424509495,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31736,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340104,"statfs":{"total":96636764160,"available":96604266496,"internally_reserved":0,"allocated":638976,"data_stored":473984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.91800000000000004,"15min":0.66300000000000003},"min":{"1min":0.39200000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":5.2839999999999998,"5min":23.625,"15min":23.625},"last":0.39800000000000002},{"interface":"front","average":{"1min":2.2090000000000001,"5min":2.2730000000000001,"15min":1.131},"min":{"1min":0.32600000000000001,"5min":0.308,"15min":0.308},"max":{"1min":23.975999999999999,"5min":73.831999999999994,"15min":73.831999999999994},"last":0.54400000000000004}]},{"osd":1,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":1.897,"5min":0.86599999999999999,"15min":0.74399999999999999},"min":{"1min":0.33400000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":11.552,"5min":11.552,"15min":11.552},"last":0.44800000000000001},{"interface":"front","average":{"1min":1.8180000000000001,"5min":1.012,"15min":0.73199999999999998},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":11.619999999999999,"5min":11.619999999999999,"15min":11.619999999999999},"last":0.63900000000000001}]},{"osd":2,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":2.3220000000000001,"5min":1.552,"15min":0.88400000000000001},"min":{"1min":0.36599999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":23.77,"5min":36.951000000000001,"15min":36.951000000000001},"last":0.502},{"interface":"front","average":{"1min":1.986,"5min":0.86899999999999999,"15min":0.69499999999999995},"min":{"1min":0.35899999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":20.956,"5min":20.956,"15min":20.956},"last":0.52500000000000002}]},{"osd":3,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":1.55,"5min":0.79400000000000004,"15min":0.68200000000000005},"min":{"1min":0.41199999999999998,"5min":0.38,"15min":0.38},"max":{"1min":7.9690000000000003,"5min":7.9690000000000003,"15min":7.9690000000000003},"last":0.59599999999999997},{"interface":"front","average":{"1min":1.54,"5min":0.78500000000000003,"15min":0.66900000000000004},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":8.0709999999999997,"5min":8.0709999999999997,"15min":8.0709999999999997},"last":0.57799999999999996}]},{"osd":4,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.53500000000000003,"15min":0.505},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":5.1840000000000002,"5min":5.1840000000000002,"15min":5.1840000000000002},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.749,"5min":0.55500000000000005,"15min":0.53100000000000003},"min":{"1min":0.34899999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":2.976,"5min":2.976,"15min":2.976},"last":0.66200000000000003}]},{"osd":5,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.53200000000000003,"15min":0.498},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":3.0369999999999999,"5min":3.0369999999999999,"15min":3.0369999999999999},"last":0.62},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.60199999999999998,"15min":0.56999999999999995},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":5.1219999999999999,"5min":5.1219999999999999,"15min":5.1219999999999999},"last":0.56499999999999995}]},{"osd":7,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.61899999999999999,"15min":0.56999999999999995},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":4.0389999999999997,"5min":4.0389999999999997,"15min":4.0389999999999997},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.60099999999999998,"15min":0.56799999999999995},"min":{"1min":0.40100000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":2.883,"5min":2.883,"15min":2.883},"last":0.64800000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574901,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3164796,"kb_used_data":3133684,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":91207044,"statfs":{"total":96636764160,"available":93396013056,"internally_reserved":0,"allocated":3208892416,"data_stored":3208734358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:52:49 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55300000000000005,"15min":0.57299999999999995},"min":{"1min":0.33900000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.93700000000000006,"5min":1.97,"15min":1.97},"last":0.627},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.57899999999999996,"15min":0.59699999999999998},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.91500000000000004,"5min":2.161,"15min":2.161},"last":0.59099999999999997}]},{"osd":1,"last update":"Wed May 8 21:53:44 2024","interfaces":[{"interface":"back","average":{"1min":4.1360000000000001,"5min":1.294,"15min":0.84299999999999997},"min":{"1min":0.41699999999999998,"5min":0.313,"15min":0.313},"max":{"1min":53.069000000000003,"5min":53.069000000000003,"15min":53.069000000000003},"last":0.63900000000000001},{"interface":"front","average":{"1min":6.2969999999999997,"5min":1.681,"15min":0.88500000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":80.463999999999999,"5min":80.463999999999999,"15min":80.463999999999999},"last":0.55600000000000005}]},{"osd":2,"last update":"Wed May 8 21:52:49 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.61399999999999999,"15min":0.63},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.72199999999999998,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.59099999999999997,"15min":0.58299999999999996},"min":{"1min":0.46200000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":2.238,"5min":2.238,"15min":2.238},"last":0.64900000000000002}]},{"osd":3,"last update":"Wed May 8 21:52:49 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.55900000000000005,"15min":0.54500000000000004},"min":{"1min":0.36099999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":2.2719999999999998,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.59399999999999997,"15min":0.61199999999999999},"min":{"1min":0.38300000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.96699999999999997,"5min":1.883,"15min":1.883},"last":0.65800000000000003}]},{"osd":4,"last update":"Wed May 8 21:52:49 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.51000000000000001,"15min":0.52800000000000002},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.78200000000000003,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.55800000000000005,"15min":0.59199999999999997},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.68300000000000005,"5min":2.3239999999999998,"15min":2.3239999999999998},"last":0.53900000000000003}]},{"osd":6,"last update":"Wed May 8 21:52:49 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.52400000000000002,"15min":0.52800000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":2.1509999999999998,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.56399999999999995,"15min":0.58799999999999997},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.88700000000000001,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.56499999999999995}]},{"osd":7,"last update":"Wed May 8 21:52:49 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58799999999999997,"15min":0.60399999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.8640000000000001,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.56699999999999995,"15min":0.56200000000000006},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.52000000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574901,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31360,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340480,"statfs":{"total":96636764160,"available":96604651520,"internally_reserved":0,"allocated":253952,"data_stored":91868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":9.1020000000000003,"5min":2.2200000000000002,"15min":1.1719999999999999},"min":{"1min":0.26100000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":119.55200000000001,"5min":119.55200000000001,"15min":119.55200000000001},"last":0.29299999999999998},{"interface":"front","average":{"1min":2.9020000000000001,"5min":1.028,"15min":0.83999999999999997},"min":{"1min":0.24099999999999999,"5min":0.192,"15min":0.192},"max":{"1min":23.457999999999998,"5min":23.457999999999998,"15min":23.457999999999998},"last":0.24099999999999999}]},{"osd":2,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":3.9689999999999999,"5min":1.125,"15min":0.68300000000000005},"min":{"1min":0.255,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":33.259,"5min":33.259,"15min":33.259},"last":0.28000000000000003},{"interface":"front","average":{"1min":4.3860000000000001,"5min":1.343,"15min":0.97299999999999998},"min":{"1min":0.249,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":43.167000000000002,"5min":43.167000000000002,"15min":43.167000000000002},"last":0.34200000000000003}]},{"osd":3,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":4.6210000000000004,"5min":1.26,"15min":0.71399999999999997},"min":{"1min":0.254,"5min":0.247,"15min":0.247},"max":{"1min":43.131,"5min":43.131,"15min":43.131},"last":0.254},{"interface":"front","average":{"1min":7.319,"5min":1.7949999999999999,"15min":0.88100000000000001},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":52.923999999999999,"5min":52.923999999999999,"15min":52.923999999999999},"last":0.32600000000000001}]},{"osd":4,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":2.7330000000000001,"5min":1.0549999999999999,"15min":0.78700000000000003},"min":{"1min":0.41599999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":16.914000000000001,"5min":16.914000000000001,"15min":16.914000000000001},"last":0.45300000000000001},{"interface":"front","average":{"1min":4.056,"5min":1.2929999999999999,"15min":0.83299999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":43.078000000000003,"5min":43.078000000000003,"15min":43.078000000000003},"last":0.38100000000000001}]},{"osd":5,"last update":"Wed May 8 21:53:38 2024","interfaces":[{"interface":"back","average":{"1min":3.8370000000000002,"5min":1.28,"15min":0.86199999999999999},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":33.198,"5min":33.198,"15min":33.198},"last":0.41799999999999998},{"interface":"front","average":{"1min":1.6990000000000001,"5min":1.002,"15min":1.0169999999999999},"min":{"1min":0.48899999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":7.6139999999999999,"5min":9.2400000000000002,"15min":9.2400000000000002},"last":0.49299999999999999}]},{"osd":6,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":1.665,"5min":0.98199999999999998,"15min":0.98799999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":7.5449999999999999,"5min":9.202,"15min":9.202},"last":0.433},{"interface":"front","average":{"1min":3.5529999999999999,"5min":1.2450000000000001,"15min":0.86899999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":33.283000000000001,"5min":33.283000000000001,"15min":33.283000000000001},"last":0.39300000000000002}]},{"osd":7,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":1.6319999999999999,"5min":0.98499999999999999,"15min":1.0049999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":7.6669999999999998,"5min":9.2249999999999996,"15min":9.2249999999999996},"last":0.40300000000000002},{"interface":"front","average":{"1min":3.2189999999999999,"5min":1.1799999999999999,"15min":0.85599999999999998},"min":{"1min":0.44400000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":16.981000000000002,"5min":16.981000000000002,"15min":16.981000000000002},"last":0.48399999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509493,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1981640,"kb_used_data":1942336,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":92390200,"statfs":{"total":96636764160,"available":94607564800,"internally_reserved":0,"allocated":1988952064,"data_stored":1988782810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":1.6599999999999999,"5min":0.63500000000000001,"15min":0.46899999999999997},"min":{"1min":0.26100000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":27.239999999999998,"5min":27.239999999999998,"15min":27.239999999999998},"last":0.505},{"interface":"front","average":{"1min":2.0640000000000001,"5min":0.73299999999999998,"15min":0.52500000000000002},"min":{"1min":0.26100000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":27.643000000000001,"5min":27.643000000000001,"15min":27.643000000000001},"last":0.46800000000000003}]},{"osd":2,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":1.583,"5min":0.63,"15min":0.48499999999999999},"min":{"1min":0.24299999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":25.739000000000001,"5min":25.739000000000001,"15min":25.739000000000001},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.47399999999999998,"15min":0.43099999999999999},"min":{"1min":0.28000000000000003,"5min":0.253,"15min":0.253},"max":{"1min":4.9989999999999997,"5min":4.9989999999999997,"15min":4.9989999999999997},"last":0.495}]},{"osd":3,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":1.952,"5min":0.71599999999999997,"15min":0.52200000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":13.685,"5min":13.685,"15min":13.685},"last":0.438},{"interface":"front","average":{"1min":1.8500000000000001,"5min":0.71799999999999997,"15min":0.54300000000000004},"min":{"1min":0.27400000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":28.379999999999999,"5min":28.379999999999999,"15min":28.379999999999999},"last":0.45000000000000001}]},{"osd":4,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":0.69599999999999995,"15min":0.626},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":5.6790000000000003,"5min":5.6790000000000003,"15min":5.6790000000000003},"last":0.64500000000000002},{"interface":"front","average":{"1min":1.8600000000000001,"5min":0.82499999999999996,"15min":0.64900000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":13.794,"5min":13.794,"15min":13.794},"last":0.747}]},{"osd":5,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":1.877,"5min":0.84599999999999997,"15min":0.67200000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":13.827,"5min":13.827,"15min":13.827},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.66300000000000003,"15min":0.64900000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":4.9240000000000004,"5min":4.9240000000000004,"15min":4.9240000000000004},"last":0.75600000000000001}]},{"osd":6,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":0.70999999999999996,"15min":0.65400000000000003},"min":{"1min":0.379,"5min":0.376,"15min":0.376},"max":{"1min":8.3379999999999992,"5min":8.3379999999999992,"15min":8.3379999999999992},"last":0.70999999999999996},{"interface":"front","average":{"1min":1.1359999999999999,"5min":0.70199999999999996,"15min":0.63400000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":5.6500000000000004,"5min":5.6500000000000004,"15min":5.6500000000000004},"last":0.66200000000000003}]},{"osd":7,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":0.76500000000000001,"15min":0.68000000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":9.1950000000000003,"5min":9.1950000000000003,"15min":9.1950000000000003},"last":0.69999999999999996},{"interface":"front","average":{"1min":1.8799999999999999,"5min":0.86799999999999999,"15min":0.70799999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":13.756,"5min":13.756,"15min":13.756},"last":0.65300000000000002}]}]},{"osd":2,"up_from":15,"seq":64424509495,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31356,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340484,"statfs":{"total":96636764160,"available":96604655616,"internally_reserved":0,"allocated":249856,"data_stored":92011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:53:45 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.42199999999999999,"15min":0.34999999999999998},"min":{"1min":0.255,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":3.73,"5min":3.73,"15min":3.73},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.44,"15min":0.38200000000000001},"min":{"1min":0.27400000000000002,"5min":0.254,"15min":0.254},"max":{"1min":3.1600000000000001,"5min":3.1600000000000001,"15min":3.1600000000000001},"last":0.30299999999999999}]},{"osd":1,"last update":"Wed May 8 21:53:45 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.39600000000000002,"15min":0.36199999999999999},"min":{"1min":0.23999999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":3.1930000000000001,"5min":3.1930000000000001,"15min":3.1930000000000001},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.40100000000000002,"15min":0.375},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":2.1299999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":0.33100000000000002}]},{"osd":3,"last update":"Wed May 8 21:53:45 2024","interfaces":[{"interface":"back","average":{"1min":4.0759999999999996,"5min":1.1160000000000001,"15min":0.60699999999999998},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":60.899000000000001,"5min":60.899000000000001,"15min":60.899000000000001},"last":0.27700000000000002},{"interface":"front","average":{"1min":1.1140000000000001,"5min":0.53900000000000003,"15min":0.437},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":9.7469999999999999,"5min":9.7469999999999999,"15min":9.7469999999999999},"last":0.38700000000000001}]},{"osd":4,"last update":"Wed May 8 21:53:45 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":0.69099999999999995,"15min":0.63600000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":7.8499999999999996,"5min":7.8499999999999996,"15min":7.8499999999999996},"last":0.68200000000000005},{"interface":"front","average":{"1min":1.123,"5min":0.72399999999999998,"15min":0.66000000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":8.1189999999999998,"5min":8.1189999999999998,"15min":8.1189999999999998},"last":0.61099999999999999}]},{"osd":5,"last update":"Wed May 8 21:53:45 2024","interfaces":[{"interface":"back","average":{"1min":1.462,"5min":0.77100000000000002,"15min":0.65100000000000002},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":11.326000000000001,"5min":11.326000000000001,"15min":11.326000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":1.1259999999999999,"5min":0.69199999999999995,"15min":0.628},"min":{"1min":0.375,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":7.8860000000000001,"5min":7.8860000000000001,"15min":7.8860000000000001},"last":0.64100000000000001}]},{"osd":6,"last update":"Wed May 8 21:53:45 2024","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":0.69799999999999995,"15min":0.63800000000000001},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":8.1709999999999994,"5min":8.1709999999999994,"15min":8.1709999999999994},"last":0.54900000000000004},{"interface":"front","average":{"1min":1.421,"5min":0.76700000000000002,"15min":0.66000000000000003},"min":{"1min":0.40300000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":10.41,"5min":10.41,"15min":10.41},"last":0.625}]},{"osd":7,"last update":"Wed May 8 21:53:45 2024","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.67000000000000004,"15min":0.62},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":5.2699999999999996,"5min":5.2699999999999996,"15min":5.2699999999999996},"last":0.66500000000000004},{"interface":"front","average":{"1min":1.1679999999999999,"5min":0.72799999999999998,"15min":0.65200000000000002},"min":{"1min":0.42899999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":7.5810000000000004,"5min":7.5810000000000004,"15min":7.5810000000000004},"last":0.58099999999999996}]}]},{"osd":3,"up_from":15,"seq":64424509493,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1879028,"kb_used_data":1847916,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":92492812,"statfs":{"total":96636764160,"available":94712639488,"internally_reserved":0,"allocated":1892265984,"data_stored":1892100330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:53:42 2024","interfaces":[{"interface":"back","average":{"1min":2.0739999999999998,"5min":0.69299999999999995,"15min":0.47899999999999998},"min":{"1min":0.21299999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":39.470999999999997,"5min":39.470999999999997,"15min":39.470999999999997},"last":0.23799999999999999},{"interface":"front","average":{"1min":1.9750000000000001,"5min":0.68400000000000005,"15min":0.48099999999999998},"min":{"1min":0.25700000000000001,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":32.802,"5min":32.802,"15min":32.802},"last":0.31900000000000001}]},{"osd":1,"last update":"Wed May 8 21:53:42 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.38500000000000001,"15min":0.38700000000000001},"min":{"1min":0.252,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.34599999999999997},{"interface":"front","average":{"1min":2.48,"5min":0.82799999999999996,"15min":0.56399999999999995},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":43.493000000000002,"5min":43.493000000000002,"15min":43.493000000000002},"last":0.29799999999999999}]},{"osd":2,"last update":"Wed May 8 21:53:42 2024","interfaces":[{"interface":"back","average":{"1min":2.4969999999999999,"5min":0.85099999999999998,"15min":0.59299999999999997},"min":{"1min":0.318,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":43.445999999999998,"5min":43.445999999999998,"15min":43.445999999999998},"last":0.33800000000000002},{"interface":"front","average":{"1min":2.3530000000000002,"5min":0.83799999999999997,"15min":0.59599999999999997},"min":{"1min":0.34499999999999997,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":39.569000000000003,"5min":39.569000000000003,"15min":39.569000000000003},"last":0.35899999999999999}]},{"osd":4,"last update":"Wed May 8 21:53:42 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.629,"15min":0.61499999999999999},"min":{"1min":0.41199999999999998,"5min":0.377,"15min":0.377},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":0.54100000000000004},{"interface":"front","average":{"1min":1.821,"5min":0.85699999999999998,"15min":0.70399999999999996},"min":{"1min":0.375,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":19.024999999999999,"5min":19.024999999999999,"15min":19.024999999999999},"last":0.60899999999999999}]},{"osd":5,"last update":"Wed May 8 21:53:42 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.63200000000000001,"15min":0.627},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.833,"5min":1.833,"15min":1.833},"last":0.75},{"interface":"front","average":{"1min":2.0470000000000002,"5min":0.91900000000000004,"15min":0.72099999999999997},"min":{"1min":0.46700000000000003,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":27.678999999999998,"5min":27.678999999999998,"15min":27.678999999999998},"last":0.71799999999999997}]},{"osd":6,"last update":"Wed May 8 21:53:42 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.65400000000000003,"15min":0.64400000000000002},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.915,"5min":1.915,"15min":1.915},"last":0.73299999999999998},{"interface":"front","average":{"1min":2.2530000000000001,"5min":0.96299999999999997,"15min":0.77100000000000002},"min":{"1min":0.46500000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":32.655000000000001,"5min":32.655000000000001,"15min":32.655000000000001},"last":0.56100000000000005}]},{"osd":7,"last update":"Wed May 8 21:53:42 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.68700000000000006,"15min":0.66700000000000004},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":3.4089999999999998,"5min":3.4089999999999998,"15min":3.4089999999999998},"last":0.70799999999999996},{"interface":"front","average":{"1min":1.653,"5min":0.88800000000000001,"15min":0.72299999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":18.939,"5min":18.939,"15min":18.939},"last":0.57899999999999996}]}]},{"osd":4,"up_from":15,"seq":64424509494,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31364,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340476,"statfs":{"total":96636764160,"available":96604647424,"internally_reserved":0,"allocated":258048,"data_stored":91834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:53:44 2024","interfaces":[{"interface":"back","average":{"1min":2.1030000000000002,"5min":0.82299999999999995,"15min":0.59999999999999998},"min":{"1min":0.29399999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":21.042999999999999,"5min":21.042999999999999,"15min":21.042999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":2.1970000000000001,"5min":0.874,"15min":0.65200000000000002},"min":{"1min":0.46200000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":21.478999999999999,"5min":21.478999999999999,"15min":21.478999999999999},"last":0.53800000000000003}]},{"osd":1,"last update":"Wed May 8 21:53:44 2024","interfaces":[{"interface":"back","average":{"1min":1.986,"5min":0.83699999999999997,"15min":0.63100000000000001},"min":{"1min":0.372,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":14.555999999999999,"5min":14.555999999999999,"15min":14.555999999999999},"last":0.495},{"interface":"front","average":{"1min":1.1100000000000001,"5min":0.63700000000000001,"15min":0.55500000000000005},"min":{"1min":0.40799999999999997,"5min":0.314,"15min":0.314},"max":{"1min":7.7140000000000004,"5min":7.7140000000000004,"15min":7.7140000000000004},"last":0.52900000000000003}]},{"osd":2,"last update":"Wed May 8 21:53:44 2024","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":0.69399999999999995,"15min":0.58199999999999996},"min":{"1min":0.41899999999999998,"5min":0.377,"15min":0.377},"max":{"1min":11.724,"5min":11.724,"15min":11.724},"last":0.56799999999999995},{"interface":"front","average":{"1min":1.089,"5min":0.65700000000000003,"15min":0.58899999999999997},"min":{"1min":0.44600000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":4.6740000000000004,"5min":4.6740000000000004,"15min":4.6740000000000004},"last":0.45100000000000001}]},{"osd":3,"last update":"Wed May 8 21:53:44 2024","interfaces":[{"interface":"back","average":{"1min":2.4849999999999999,"5min":0.93700000000000006,"15min":0.68300000000000005},"min":{"1min":0.39400000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":30.84,"5min":30.84,"15min":30.84},"last":0.55800000000000005},{"interface":"front","average":{"1min":2.0739999999999998,"5min":0.89000000000000001,"15min":0.69099999999999995},"min":{"1min":0.41499999999999998,"5min":0.37,"15min":0.37},"max":{"1min":21.754000000000001,"5min":21.754000000000001,"15min":21.754000000000001},"last":0.52100000000000002}]},{"osd":5,"last update":"Wed May 8 21:53:44 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.52200000000000002,"15min":0.51200000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":4.4660000000000002,"5min":4.4660000000000002,"15min":4.4660000000000002},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.56899999999999995,"15min":0.56599999999999995},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":5.2190000000000003,"5min":5.2190000000000003,"15min":5.2190000000000003},"last":0.504}]},{"osd":6,"last update":"Wed May 8 21:53:44 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.61299999999999999,"15min":0.59499999999999997},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":4.9720000000000004,"5min":4.9720000000000004,"15min":4.9720000000000004},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.60599999999999998,"15min":0.60699999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":4.4100000000000001,"5min":4.4100000000000001,"15min":4.4100000000000001},"last":0.58399999999999996}]},{"osd":7,"last update":"Wed May 8 21:53:44 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.60399999999999998,"15min":0.61399999999999999},"min":{"1min":0.34699999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":4.444,"5min":4.444,"15min":4.444},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.877,"5min":0.67900000000000005,"15min":0.66100000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":5.0430000000000001,"5min":5.0430000000000001,"15min":5.0430000000000001},"last":0.67500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":389120,"data_stored":377518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":382276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1291845632,"data_stored":1291845632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":2436890624,"data_stored":2436890624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T21:53:52.845 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-08T21:53:52.845 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T21:53:53.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.001+0000 7f099f48f700 1 Processor -- start 2024-05-08T21:53:53.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.001+0000 7f099f48f700 1 -- start start 2024-05-08T21:53:53.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.002+0000 7f099f48f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0998072980 0x7f099806f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:53.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.002+0000 7f099f48f700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0998072260 0x7f0998159d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:53.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.002+0000 7f099f48f700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f099815dfc0 con 0x7f0998072d60 2024-05-08T21:53:53.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.002+0000 7f099f48f700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0998070120 con 0x7f0998072260 2024-05-08T21:53:53.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.002+0000 7f099f48f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f099806feb0 con 0x7f0998072980 2024-05-08T21:53:53.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.002+0000 7f099ca2a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0998072260 0x7f0998159d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:53.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.002+0000 7f099d22b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0998072980 0x7f099806f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:53.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.002+0000 7f099da2c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f0998072d60 0x7f0998153860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.73:40824/0 (socket says 172.21.15.73:40824) 2024-05-08T21:53:53.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.002+0000 7f099da2c700 1 -- 172.21.15.73:0/175775276 learned_addr learned my addr 172.21.15.73:0/175775276 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:53:53.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.002+0000 7f099d22b700 1 -- 172.21.15.73:0/175775276 >> v2:172.21.15.115:3300/0 conn(0x7f0998072260 msgr2=0x7f0998159d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:53:53.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.002+0000 7f099d22b700 1 --2- 172.21.15.73:0/175775276 >> v2:172.21.15.115:3300/0 conn(0x7f0998072260 0x7f0998159d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:53.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.002+0000 7f099d22b700 1 -- 172.21.15.73:0/175775276 >> v1:172.21.15.115:6789/0 conn(0x7f0998072d60 legacy=0x7f0998153860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:53.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.002+0000 7f099d22b700 1 -- 172.21.15.73:0/175775276 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f099815d3b0 con 0x7f0998072980 2024-05-08T21:53:53.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.002+0000 7f099ca2a700 1 --2- 172.21.15.73:0/175775276 >> v2:172.21.15.115:3300/0 conn(0x7f0998072260 0x7f0998159d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:53:53.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.002+0000 7f099d22b700 1 --2- 172.21.15.73:0/175775276 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0998072980 0x7f099806f970 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0994009840 tx=0x7f0994009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64e60c3ce2c42eba server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:53.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.003+0000 7f098ffff700 1 -- 172.21.15.73:0/175775276 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0994011830 con 0x7f0998072980 2024-05-08T21:53:53.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.003+0000 7f098ffff700 1 -- 172.21.15.73:0/175775276 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0994011990 con 0x7f0998072980 2024-05-08T21:53:53.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.003+0000 7f098ffff700 1 -- 172.21.15.73:0/175775276 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0994011d20 con 0x7f0998072980 2024-05-08T21:53:53.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.003+0000 7f099f48f700 1 -- 172.21.15.73:0/175775276 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0998072980 msgr2=0x7f099806f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:53.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.003+0000 7f099f48f700 1 --2- 172.21.15.73:0/175775276 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0998072980 0x7f099806f970 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0994009840 tx=0x7f0994009b50 comp rx=0 tx=0).stop 2024-05-08T21:53:53.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.003+0000 7f099f48f700 1 -- 172.21.15.73:0/175775276 shutdown_connections 2024-05-08T21:53:53.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.003+0000 7f099f48f700 1 --2- 172.21.15.73:0/175775276 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0998072980 0x7f099806f970 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:53.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.003+0000 7f099f48f700 1 --2- 172.21.15.73:0/175775276 >> v2:172.21.15.115:3300/0 conn(0x7f0998072260 0x7f0998159d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:53.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.003+0000 7f099f48f700 1 -- 172.21.15.73:0/175775276 >> 172.21.15.73:0/175775276 conn(0x7f0998066cf0 msgr2=0x7f099806bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:53:53.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.003+0000 7f099f48f700 1 -- 172.21.15.73:0/175775276 shutdown_connections 2024-05-08T21:53:53.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.003+0000 7f099f48f700 1 -- 172.21.15.73:0/175775276 wait complete. 2024-05-08T21:53:53.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.004+0000 7f099f48f700 1 Processor -- start 2024-05-08T21:53:53.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.004+0000 7f099f48f700 1 -- start start 2024-05-08T21:53:53.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.005+0000 7f099f48f700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0998072260 0x7f09980ca290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:53.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.005+0000 7f099f48f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0998072980 0x7f099814f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:53.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.005+0000 7f099f48f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0998072d60 0x7f09981ef860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:53.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.005+0000 7f099f48f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0998151c90 con 0x7f0998072d60 2024-05-08T21:53:53.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.005+0000 7f099f48f700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0998151330 con 0x7f0998072260 2024-05-08T21:53:53.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.005+0000 7f099f48f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09981f0460 con 0x7f0998072980 2024-05-08T21:53:53.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.005+0000 7f099da2c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0998072d60 0x7f09981ef860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:53.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.005+0000 7f099da2c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0998072d60 0x7f09981ef860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56510/0 (socket says 172.21.15.73:56510) 2024-05-08T21:53:53.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.005+0000 7f099da2c700 1 -- 172.21.15.73:0/1169713403 learned_addr learned my addr 172.21.15.73:0/1169713403 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:53:53.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.005+0000 7f099d22b700 1 --2- 172.21.15.73:0/1169713403 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0998072260 0x7f09980ca290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:53.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.005+0000 7f099ca2a700 1 --2- 172.21.15.73:0/1169713403 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0998072980 0x7f099814f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:53.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.006+0000 7f099da2c700 1 -- 172.21.15.73:0/1169713403 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0998072980 msgr2=0x7f099814f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:53.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.006+0000 7f099da2c700 1 --2- 172.21.15.73:0/1169713403 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0998072980 0x7f099814f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:53.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.006+0000 7f099da2c700 1 -- 172.21.15.73:0/1169713403 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0998072260 msgr2=0x7f09980ca290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:53.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.006+0000 7f099da2c700 1 --2- 172.21.15.73:0/1169713403 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0998072260 0x7f09980ca290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:53.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.006+0000 7f099da2c700 1 -- 172.21.15.73:0/1169713403 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09880094a0 con 0x7f0998072d60 2024-05-08T21:53:53.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.006+0000 7f099da2c700 1 --2- 172.21.15.73:0/1169713403 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0998072d60 0x7f09981ef860 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f099000caa0 tx=0x7f099000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:53.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.006+0000 7f098dffb700 1 -- 172.21.15.73:0/1169713403 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099000a9e0 con 0x7f0998072d60 2024-05-08T21:53:53.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.006+0000 7f098dffb700 1 -- 172.21.15.73:0/1169713403 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f099000ab40 con 0x7f0998072d60 2024-05-08T21:53:53.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.006+0000 7f098dffb700 1 -- 172.21.15.73:0/1169713403 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0990012400 con 0x7f0998072d60 2024-05-08T21:53:53.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.006+0000 7f099f48f700 1 -- 172.21.15.73:0/1169713403 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09940094a0 con 0x7f0998072d60 2024-05-08T21:53:53.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.006+0000 7f099f48f700 1 -- 172.21.15.73:0/1169713403 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09981518b0 con 0x7f0998072d60 2024-05-08T21:53:53.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.007+0000 7f099f48f700 1 -- 172.21.15.73:0/1169713403 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0998151dd0 con 0x7f0998072d60 2024-05-08T21:53:53.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.007+0000 7f098dffb700 1 -- 172.21.15.73:0/1169713403 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f099001b3b0 con 0x7f0998072d60 2024-05-08T21:53:53.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.008+0000 7f098dffb700 1 --2- 172.21.15.73:0/1169713403 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f097c06ac90 0x7f097c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:53.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.008+0000 7f098dffb700 1 -- 172.21.15.73:0/1169713403 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5969+0+0 (secure 0 0 0) 0x7f0990088e40 con 0x7f0998072d60 2024-05-08T21:53:53.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.008+0000 7f099d22b700 1 --2- 172.21.15.73:0/1169713403 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f097c06ac90 0x7f097c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:53.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.008+0000 7f099d22b700 1 --2- 172.21.15.73:0/1169713403 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f097c06ac90 0x7f097c06d150 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0994000c00 tx=0x7f0994008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:53.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.012+0000 7f098dffb700 1 -- 172.21.15.73:0/1169713403 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f0998151dd0 con 0x7f0998072d60 2024-05-08T21:53:53.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.205+0000 7f099f48f700 1 -- 172.21.15.73:0/1169713403 --> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f09980c3f10 con 0x7f097c06ac90 2024-05-08T21:53:53.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.212+0000 7f098dffb700 1 -- 172.21.15.73:0/1169713403 <== mgr.4104 v2:172.21.15.73:6832/46949 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289872 (secure 0 0 0) 0x7f09980c3f10 con 0x7f097c06ac90 2024-05-08T21:53:53.217 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:53:53.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.216+0000 7f099f48f700 1 -- 172.21.15.73:0/1169713403 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f097c06ac90 msgr2=0x7f097c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:53.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.216+0000 7f099f48f700 1 --2- 172.21.15.73:0/1169713403 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f097c06ac90 0x7f097c06d150 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0994000c00 tx=0x7f0994008030 comp rx=0 tx=0).stop 2024-05-08T21:53:53.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.216+0000 7f099f48f700 1 -- 172.21.15.73:0/1169713403 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0998072d60 msgr2=0x7f09981ef860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:53.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.216+0000 7f099f48f700 1 --2- 172.21.15.73:0/1169713403 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0998072d60 0x7f09981ef860 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f099000caa0 tx=0x7f099000cdb0 comp rx=0 tx=0).stop 2024-05-08T21:53:53.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.216+0000 7f099f48f700 1 -- 172.21.15.73:0/1169713403 shutdown_connections 2024-05-08T21:53:53.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.216+0000 7f099f48f700 1 --2- 172.21.15.73:0/1169713403 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f097c06ac90 0x7f097c06d150 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:53.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.216+0000 7f099f48f700 1 --2- 172.21.15.73:0/1169713403 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0998072d60 0x7f09981ef860 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:53.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.216+0000 7f099f48f700 1 --2- 172.21.15.73:0/1169713403 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0998072260 0x7f09980ca290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:53.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.216+0000 7f099f48f700 1 --2- 172.21.15.73:0/1169713403 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0998072980 0x7f099814f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:53.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.216+0000 7f099f48f700 1 -- 172.21.15.73:0/1169713403 >> 172.21.15.73:0/1169713403 conn(0x7f0998066cf0 msgr2=0x7f0998149200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:53:53.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.216+0000 7f099f48f700 1 -- 172.21.15.73:0/1169713403 shutdown_connections 2024-05-08T21:53:53.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.216+0000 7f099f48f700 1 -- 172.21.15.73:0/1169713403 wait complete. 2024-05-08T21:53:53.220 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-05-08T21:53:53.229 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":145,"stamp":"2024-05-08T21:53:52.017183+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2173623217,"num_objects":543,"num_object_clones":0,"num_object_copies":1086,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":543,"num_whiteouts":0,"num_read":198,"num_read_kb":190,"num_write":9104,"num_write_kb":25168788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10207,"ondisk_log_size":10207,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":7183216,"kb_used_data":6926128,"kb_used_omap":12,"kb_used_meta":248819,"kb_avail":747791504,"statfs":{"total":773094113280,"available":765738500096,"internally_reserved":0,"allocated":7092355072,"data_stored":7091049853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":254791226},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8564758204,"num_objects":-2042,"num_object_clones":0,"num_object_copies":-4084,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2042,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2050,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002900"},"pg_stats":[{"pgid":"3.3f","version":"24'159","reported_seq":173,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.976255+0000","last_change":"2024-05-08T21:49:43.775912+0000","last_active":"2024-05-08T21:53:48.976255+0000","last_peered":"2024-05-08T21:53:48.976255+0000","last_clean":"2024-05-08T21:53:48.976255+0000","last_became_active":"2024-05-08T21:49:43.775657+0000","last_became_peered":"2024-05-08T21:49:43.775657+0000","last_unstale":"2024-05-08T21:53:48.976255+0000","last_undegraded":"2024-05-08T21:53:48.976255+0000","last_fullsized":"2024-05-08T21:53:48.976255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:10:07.209965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"24'148","reported_seq":162,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.979741+0000","last_change":"2024-05-08T21:49:43.766984+0000","last_active":"2024-05-08T21:53:48.979741+0000","last_peered":"2024-05-08T21:53:48.979741+0000","last_clean":"2024-05-08T21:53:48.979741+0000","last_became_active":"2024-05-08T21:49:43.765995+0000","last_became_peered":"2024-05-08T21:49:43.765995+0000","last_unstale":"2024-05-08T21:53:48.979741+0000","last_undegraded":"2024-05-08T21:53:48.979741+0000","last_fullsized":"2024-05-08T21:53:48.979741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:21:41.238890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"24'157","reported_seq":171,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.757121+0000","last_change":"2024-05-08T21:49:43.766107+0000","last_active":"2024-05-08T21:53:48.757121+0000","last_peered":"2024-05-08T21:53:48.757121+0000","last_clean":"2024-05-08T21:53:48.757121+0000","last_became_active":"2024-05-08T21:49:43.765874+0000","last_became_peered":"2024-05-08T21:49:43.765874+0000","last_unstale":"2024-05-08T21:53:48.757121+0000","last_undegraded":"2024-05-08T21:53:48.757121+0000","last_fullsized":"2024-05-08T21:53:48.757121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:06:50.769169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"24'137","reported_seq":152,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:47.651414+0000","last_change":"2024-05-08T21:49:43.766355+0000","last_active":"2024-05-08T21:53:47.651414+0000","last_peered":"2024-05-08T21:53:47.651414+0000","last_clean":"2024-05-08T21:53:47.651414+0000","last_became_active":"2024-05-08T21:49:43.765507+0000","last_became_peered":"2024-05-08T21:49:43.765507+0000","last_unstale":"2024-05-08T21:53:47.651414+0000","last_undegraded":"2024-05-08T21:53:47.651414+0000","last_fullsized":"2024-05-08T21:53:47.651414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:09:09.676078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159383552,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"24'170","reported_seq":182,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.982792+0000","last_change":"2024-05-08T21:50:33.104253+0000","last_active":"2024-05-08T21:53:48.982792+0000","last_peered":"2024-05-08T21:53:48.982792+0000","last_clean":"2024-05-08T21:53:48.982792+0000","last_became_active":"2024-05-08T21:50:33.103943+0000","last_became_peered":"2024-05-08T21:50:33.103943+0000","last_unstale":"2024-05-08T21:53:48.982792+0000","last_undegraded":"2024-05-08T21:53:48.982792+0000","last_fullsized":"2024-05-08T21:53:48.982792+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:22:41.503872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"24'110","reported_seq":124,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:47.605360+0000","last_change":"2024-05-08T21:49:43.771390+0000","last_active":"2024-05-08T21:53:47.605360+0000","last_peered":"2024-05-08T21:53:47.605360+0000","last_clean":"2024-05-08T21:53:47.605360+0000","last_became_active":"2024-05-08T21:49:43.770893+0000","last_became_peered":"2024-05-08T21:49:43.770893+0000","last_unstale":"2024-05-08T21:53:47.605360+0000","last_undegraded":"2024-05-08T21:53:47.605360+0000","last_fullsized":"2024-05-08T21:53:47.605360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:28.979468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"24'183","reported_seq":197,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.935714+0000","last_change":"2024-05-08T21:49:43.769981+0000","last_active":"2024-05-08T21:53:48.935714+0000","last_peered":"2024-05-08T21:53:48.935714+0000","last_clean":"2024-05-08T21:53:48.935714+0000","last_became_active":"2024-05-08T21:49:43.769667+0000","last_became_peered":"2024-05-08T21:49:43.769667+0000","last_unstale":"2024-05-08T21:53:48.935714+0000","last_undegraded":"2024-05-08T21:53:48.935714+0000","last_fullsized":"2024-05-08T21:53:48.935714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:12:00.381761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"24'161","reported_seq":175,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.068085+0000","last_change":"2024-05-08T21:49:43.771078+0000","last_active":"2024-05-08T21:53:48.068085+0000","last_peered":"2024-05-08T21:53:48.068085+0000","last_clean":"2024-05-08T21:53:48.068085+0000","last_became_active":"2024-05-08T21:49:43.770912+0000","last_became_peered":"2024-05-08T21:49:43.770912+0000","last_unstale":"2024-05-08T21:53:48.068085+0000","last_undegraded":"2024-05-08T21:53:48.068085+0000","last_fullsized":"2024-05-08T21:53:48.068085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:12:00.381761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":483328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"24'167","reported_seq":189,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.950277+0000","last_change":"2024-05-08T21:50:33.106461+0000","last_active":"2024-05-08T21:53:48.950277+0000","last_peered":"2024-05-08T21:53:48.950277+0000","last_clean":"2024-05-08T21:53:48.950277+0000","last_became_active":"2024-05-08T21:50:33.106142+0000","last_became_peered":"2024-05-08T21:50:33.106142+0000","last_unstale":"2024-05-08T21:53:48.950277+0000","last_undegraded":"2024-05-08T21:53:48.950277+0000","last_fullsized":"2024-05-08T21:53:48.950277+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:18:29.982214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"24'175","reported_seq":189,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.986601+0000","last_change":"2024-05-08T21:49:43.772784+0000","last_active":"2024-05-08T21:53:48.986601+0000","last_peered":"2024-05-08T21:53:48.986601+0000","last_clean":"2024-05-08T21:53:48.986601+0000","last_became_active":"2024-05-08T21:49:43.772505+0000","last_became_peered":"2024-05-08T21:49:43.772505+0000","last_unstale":"2024-05-08T21:53:48.986601+0000","last_undegraded":"2024-05-08T21:53:48.986601+0000","last_fullsized":"2024-05-08T21:53:48.986601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:19:28.925404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"24'208","reported_seq":222,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.995969+0000","last_change":"2024-05-08T21:49:43.771781+0000","last_active":"2024-05-08T21:53:48.995969+0000","last_peered":"2024-05-08T21:53:48.995969+0000","last_clean":"2024-05-08T21:53:48.995969+0000","last_became_active":"2024-05-08T21:49:43.771457+0000","last_became_peered":"2024-05-08T21:49:43.771457+0000","last_unstale":"2024-05-08T21:53:48.995969+0000","last_undegraded":"2024-05-08T21:53:48.995969+0000","last_fullsized":"2024-05-08T21:53:48.995969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:43.798909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"24'159","reported_seq":173,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:49.006621+0000","last_change":"2024-05-08T21:49:43.764249+0000","last_active":"2024-05-08T21:53:49.006621+0000","last_peered":"2024-05-08T21:53:49.006621+0000","last_clean":"2024-05-08T21:53:49.006621+0000","last_became_active":"2024-05-08T21:49:43.763986+0000","last_became_peered":"2024-05-08T21:49:43.763986+0000","last_unstale":"2024-05-08T21:53:49.006621+0000","last_undegraded":"2024-05-08T21:53:49.006621+0000","last_fullsized":"2024-05-08T21:53:49.006621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:33:13.833915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"24'141","reported_seq":155,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.165586+0000","last_change":"2024-05-08T21:49:43.761127+0000","last_active":"2024-05-08T21:53:48.165586+0000","last_peered":"2024-05-08T21:53:48.165586+0000","last_clean":"2024-05-08T21:53:48.165586+0000","last_became_active":"2024-05-08T21:49:43.760874+0000","last_became_peered":"2024-05-08T21:49:43.760874+0000","last_unstale":"2024-05-08T21:53:48.165586+0000","last_undegraded":"2024-05-08T21:53:48.165586+0000","last_fullsized":"2024-05-08T21:53:48.165586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:17:34.570817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"24'156","reported_seq":170,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.768707+0000","last_change":"2024-05-08T21:49:43.765829+0000","last_active":"2024-05-08T21:53:48.768707+0000","last_peered":"2024-05-08T21:53:48.768707+0000","last_clean":"2024-05-08T21:53:48.768707+0000","last_became_active":"2024-05-08T21:49:43.765566+0000","last_became_peered":"2024-05-08T21:49:43.765566+0000","last_unstale":"2024-05-08T21:53:48.768707+0000","last_undegraded":"2024-05-08T21:53:48.768707+0000","last_fullsized":"2024-05-08T21:53:48.768707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:39.954320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"24'170","reported_seq":184,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.988387+0000","last_change":"2024-05-08T21:49:43.765080+0000","last_active":"2024-05-08T21:53:48.988387+0000","last_peered":"2024-05-08T21:53:48.988387+0000","last_clean":"2024-05-08T21:53:48.988387+0000","last_became_active":"2024-05-08T21:49:43.764810+0000","last_became_peered":"2024-05-08T21:49:43.764810+0000","last_unstale":"2024-05-08T21:53:48.988387+0000","last_undegraded":"2024-05-08T21:53:48.988387+0000","last_fullsized":"2024-05-08T21:53:48.988387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:24:11.223913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"24'119","reported_seq":133,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:47.642980+0000","last_change":"2024-05-08T21:49:43.766717+0000","last_active":"2024-05-08T21:53:47.642980+0000","last_peered":"2024-05-08T21:53:47.642980+0000","last_clean":"2024-05-08T21:53:47.642980+0000","last_became_active":"2024-05-08T21:49:43.766427+0000","last_became_peered":"2024-05-08T21:49:43.766427+0000","last_unstale":"2024-05-08T21:53:47.642980+0000","last_undegraded":"2024-05-08T21:53:47.642980+0000","last_fullsized":"2024-05-08T21:53:47.642980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:49:22.833820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"24'114","reported_seq":128,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:47.597062+0000","last_change":"2024-05-08T21:49:43.776929+0000","last_active":"2024-05-08T21:53:47.597062+0000","last_peered":"2024-05-08T21:53:47.597062+0000","last_clean":"2024-05-08T21:53:47.597062+0000","last_became_active":"2024-05-08T21:49:43.776509+0000","last_became_peered":"2024-05-08T21:49:43.776509+0000","last_unstale":"2024-05-08T21:53:47.597062+0000","last_undegraded":"2024-05-08T21:53:47.597062+0000","last_fullsized":"2024-05-08T21:53:47.597062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:26.199459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"24'169","reported_seq":183,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.988290+0000","last_change":"2024-05-08T21:49:43.762646+0000","last_active":"2024-05-08T21:53:48.988290+0000","last_peered":"2024-05-08T21:53:48.988290+0000","last_clean":"2024-05-08T21:53:48.988290+0000","last_became_active":"2024-05-08T21:49:43.762237+0000","last_became_peered":"2024-05-08T21:49:43.762237+0000","last_unstale":"2024-05-08T21:53:48.988290+0000","last_undegraded":"2024-05-08T21:53:48.988290+0000","last_fullsized":"2024-05-08T21:53:48.988290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:46:08.821947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"24'198","reported_seq":212,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.997405+0000","last_change":"2024-05-08T21:49:43.774729+0000","last_active":"2024-05-08T21:53:48.997405+0000","last_peered":"2024-05-08T21:53:48.997405+0000","last_clean":"2024-05-08T21:53:48.997405+0000","last_became_active":"2024-05-08T21:49:43.774450+0000","last_became_peered":"2024-05-08T21:49:43.774450+0000","last_unstale":"2024-05-08T21:53:48.997405+0000","last_undegraded":"2024-05-08T21:53:48.997405+0000","last_fullsized":"2024-05-08T21:53:48.997405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:25.661350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"24'5","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:11.012373+0000","last_change":"2024-05-08T21:49:43.219461+0000","last_active":"2024-05-08T21:52:11.012373+0000","last_peered":"2024-05-08T21:52:11.012373+0000","last_clean":"2024-05-08T21:52:11.012373+0000","last_became_active":"2024-05-08T21:49:43.219161+0000","last_became_peered":"2024-05-08T21:49:43.219161+0000","last_unstale":"2024-05-08T21:52:11.012373+0000","last_undegraded":"2024-05-08T21:52:11.012373+0000","last_fullsized":"2024-05-08T21:52:11.012373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:02:45.778415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"24'137","reported_seq":152,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.165338+0000","last_change":"2024-05-08T21:49:43.764252+0000","last_active":"2024-05-08T21:53:48.165338+0000","last_peered":"2024-05-08T21:53:48.165338+0000","last_clean":"2024-05-08T21:53:48.165338+0000","last_became_active":"2024-05-08T21:49:43.764045+0000","last_became_peered":"2024-05-08T21:49:43.764045+0000","last_unstale":"2024-05-08T21:53:48.165338+0000","last_undegraded":"2024-05-08T21:53:48.165338+0000","last_fullsized":"2024-05-08T21:53:48.165338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:43.798909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:11.012823+0000","last_change":"2024-05-08T21:49:43.221599+0000","last_active":"2024-05-08T21:52:11.012823+0000","last_peered":"2024-05-08T21:52:11.012823+0000","last_clean":"2024-05-08T21:52:11.012823+0000","last_became_active":"2024-05-08T21:49:43.221309+0000","last_became_peered":"2024-05-08T21:49:43.221309+0000","last_unstale":"2024-05-08T21:52:11.012823+0000","last_undegraded":"2024-05-08T21:52:11.012823+0000","last_fullsized":"2024-05-08T21:52:11.012823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:17.379362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"24'145","reported_seq":159,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.797613+0000","last_change":"2024-05-08T21:49:43.771523+0000","last_active":"2024-05-08T21:53:48.797613+0000","last_peered":"2024-05-08T21:53:48.797613+0000","last_clean":"2024-05-08T21:53:48.797613+0000","last_became_active":"2024-05-08T21:49:43.771295+0000","last_became_peered":"2024-05-08T21:49:43.771295+0000","last_unstale":"2024-05-08T21:53:48.797613+0000","last_undegraded":"2024-05-08T21:53:48.797613+0000","last_fullsized":"2024-05-08T21:53:48.797613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:53:14.774835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"24'3","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:26.315599+0000","last_change":"2024-05-08T21:49:43.226637+0000","last_active":"2024-05-08T21:52:26.315599+0000","last_peered":"2024-05-08T21:52:26.315599+0000","last_clean":"2024-05-08T21:52:26.315599+0000","last_became_active":"2024-05-08T21:49:43.226284+0000","last_became_peered":"2024-05-08T21:49:43.226284+0000","last_unstale":"2024-05-08T21:52:26.315599+0000","last_undegraded":"2024-05-08T21:52:26.315599+0000","last_fullsized":"2024-05-08T21:52:26.315599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:01.844011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"24'117","reported_seq":131,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:47.604436+0000","last_change":"2024-05-08T21:49:43.766694+0000","last_active":"2024-05-08T21:53:47.604436+0000","last_peered":"2024-05-08T21:53:47.604436+0000","last_clean":"2024-05-08T21:53:47.604436+0000","last_became_active":"2024-05-08T21:49:43.766079+0000","last_became_peered":"2024-05-08T21:49:43.766079+0000","last_unstale":"2024-05-08T21:53:47.604436+0000","last_undegraded":"2024-05-08T21:53:47.604436+0000","last_fullsized":"2024-05-08T21:53:47.604436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:01:16.682080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:26.310680+0000","last_change":"2024-05-08T21:49:43.230152+0000","last_active":"2024-05-08T21:52:26.310680+0000","last_peered":"2024-05-08T21:52:26.310680+0000","last_clean":"2024-05-08T21:52:26.310680+0000","last_became_active":"2024-05-08T21:49:43.229891+0000","last_became_peered":"2024-05-08T21:49:43.229891+0000","last_unstale":"2024-05-08T21:52:26.310680+0000","last_undegraded":"2024-05-08T21:52:26.310680+0000","last_fullsized":"2024-05-08T21:52:26.310680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:33:12.827218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"24'190","reported_seq":202,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.997217+0000","last_change":"2024-05-08T21:50:33.113046+0000","last_active":"2024-05-08T21:53:48.997217+0000","last_peered":"2024-05-08T21:53:48.997217+0000","last_clean":"2024-05-08T21:53:48.997217+0000","last_became_active":"2024-05-08T21:50:33.112776+0000","last_became_peered":"2024-05-08T21:50:33.112776+0000","last_unstale":"2024-05-08T21:53:48.997217+0000","last_undegraded":"2024-05-08T21:53:48.997217+0000","last_fullsized":"2024-05-08T21:53:48.997217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:27:54.132637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":458752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"24'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:11.012352+0000","last_change":"2024-05-08T21:49:43.220418+0000","last_active":"2024-05-08T21:52:11.012352+0000","last_peered":"2024-05-08T21:52:11.012352+0000","last_clean":"2024-05-08T21:52:11.012352+0000","last_became_active":"2024-05-08T21:49:43.220090+0000","last_became_peered":"2024-05-08T21:49:43.220090+0000","last_unstale":"2024-05-08T21:52:11.012352+0000","last_undegraded":"2024-05-08T21:52:11.012352+0000","last_fullsized":"2024-05-08T21:52:11.012352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:33:28.074468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"24'142","reported_seq":154,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.960004+0000","last_change":"2024-05-08T21:50:33.103551+0000","last_active":"2024-05-08T21:53:48.960004+0000","last_peered":"2024-05-08T21:53:48.960004+0000","last_clean":"2024-05-08T21:53:48.960004+0000","last_became_active":"2024-05-08T21:50:33.103147+0000","last_became_peered":"2024-05-08T21:50:33.103147+0000","last_unstale":"2024-05-08T21:53:48.960004+0000","last_undegraded":"2024-05-08T21:53:48.960004+0000","last_fullsized":"2024-05-08T21:53:48.960004+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:50.167387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"24'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:11.012089+0000","last_change":"2024-05-08T21:49:43.220518+0000","last_active":"2024-05-08T21:52:11.012089+0000","last_peered":"2024-05-08T21:52:11.012089+0000","last_clean":"2024-05-08T21:52:11.012089+0000","last_became_active":"2024-05-08T21:49:43.218473+0000","last_became_peered":"2024-05-08T21:49:43.218473+0000","last_unstale":"2024-05-08T21:52:11.012089+0000","last_undegraded":"2024-05-08T21:52:11.012089+0000","last_fullsized":"2024-05-08T21:52:11.012089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:10.497167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"24'150","reported_seq":164,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.811305+0000","last_change":"2024-05-08T21:49:43.770935+0000","last_active":"2024-05-08T21:53:48.811305+0000","last_peered":"2024-05-08T21:53:48.811305+0000","last_clean":"2024-05-08T21:53:48.811305+0000","last_became_active":"2024-05-08T21:49:43.770677+0000","last_became_peered":"2024-05-08T21:49:43.770677+0000","last_unstale":"2024-05-08T21:53:48.811305+0000","last_undegraded":"2024-05-08T21:53:48.811305+0000","last_fullsized":"2024-05-08T21:53:48.811305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:04:14.416894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:06.001782+0000","last_change":"2024-05-08T21:49:43.221027+0000","last_active":"2024-05-08T21:52:06.001782+0000","last_peered":"2024-05-08T21:52:06.001782+0000","last_clean":"2024-05-08T21:52:06.001782+0000","last_became_active":"2024-05-08T21:49:43.220780+0000","last_became_peered":"2024-05-08T21:49:43.220780+0000","last_unstale":"2024-05-08T21:52:06.001782+0000","last_undegraded":"2024-05-08T21:52:06.001782+0000","last_fullsized":"2024-05-08T21:52:06.001782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:20:34.123736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"24'182","reported_seq":194,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.989238+0000","last_change":"2024-05-08T21:50:33.305422+0000","last_active":"2024-05-08T21:53:48.989238+0000","last_peered":"2024-05-08T21:53:48.989238+0000","last_clean":"2024-05-08T21:53:48.989238+0000","last_became_active":"2024-05-08T21:50:33.305037+0000","last_became_peered":"2024-05-08T21:50:33.305037+0000","last_unstale":"2024-05-08T21:53:48.989238+0000","last_undegraded":"2024-05-08T21:53:48.989238+0000","last_fullsized":"2024-05-08T21:53:48.989238+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:20:06.560937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:06.619556+0000","last_change":"2024-05-08T21:49:43.225299+0000","last_active":"2024-05-08T21:52:06.619556+0000","last_peered":"2024-05-08T21:52:06.619556+0000","last_clean":"2024-05-08T21:52:06.619556+0000","last_became_active":"2024-05-08T21:49:43.225057+0000","last_became_peered":"2024-05-08T21:49:43.225057+0000","last_unstale":"2024-05-08T21:52:06.619556+0000","last_undegraded":"2024-05-08T21:52:06.619556+0000","last_fullsized":"2024-05-08T21:52:06.619556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:38:43.069159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"24'177","reported_seq":191,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.994522+0000","last_change":"2024-05-08T21:49:43.757361+0000","last_active":"2024-05-08T21:53:48.994522+0000","last_peered":"2024-05-08T21:53:48.994522+0000","last_clean":"2024-05-08T21:53:48.994522+0000","last_became_active":"2024-05-08T21:49:43.757092+0000","last_became_peered":"2024-05-08T21:49:43.757092+0000","last_unstale":"2024-05-08T21:53:48.994522+0000","last_undegraded":"2024-05-08T21:53:48.994522+0000","last_fullsized":"2024-05-08T21:53:48.994522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:24:02.741766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"24'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:08.039542+0000","last_change":"2024-05-08T21:49:43.229405+0000","last_active":"2024-05-08T21:52:08.039542+0000","last_peered":"2024-05-08T21:52:08.039542+0000","last_clean":"2024-05-08T21:52:08.039542+0000","last_became_active":"2024-05-08T21:49:43.229105+0000","last_became_peered":"2024-05-08T21:49:43.229105+0000","last_unstale":"2024-05-08T21:52:08.039542+0000","last_undegraded":"2024-05-08T21:52:08.039542+0000","last_fullsized":"2024-05-08T21:52:08.039542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:18:58.164159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"24'178","reported_seq":192,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:47.651834+0000","last_change":"2024-05-08T21:49:43.773243+0000","last_active":"2024-05-08T21:53:47.651834+0000","last_peered":"2024-05-08T21:53:47.651834+0000","last_clean":"2024-05-08T21:53:47.651834+0000","last_became_active":"2024-05-08T21:49:43.772944+0000","last_became_peered":"2024-05-08T21:49:43.772944+0000","last_unstale":"2024-05-08T21:53:47.651834+0000","last_undegraded":"2024-05-08T21:53:47.651834+0000","last_fullsized":"2024-05-08T21:53:47.651834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:21:41.238890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":213909504,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":598016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:06.620035+0000","last_change":"2024-05-08T21:49:43.224999+0000","last_active":"2024-05-08T21:52:06.620035+0000","last_peered":"2024-05-08T21:52:06.620035+0000","last_clean":"2024-05-08T21:52:06.620035+0000","last_became_active":"2024-05-08T21:49:43.223476+0000","last_became_peered":"2024-05-08T21:49:43.223476+0000","last_unstale":"2024-05-08T21:52:06.620035+0000","last_undegraded":"2024-05-08T21:52:06.620035+0000","last_fullsized":"2024-05-08T21:52:06.620035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:09:12.983430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"24'146","reported_seq":160,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.772198+0000","last_change":"2024-05-08T21:49:43.771526+0000","last_active":"2024-05-08T21:53:48.772198+0000","last_peered":"2024-05-08T21:53:48.772198+0000","last_clean":"2024-05-08T21:53:48.772198+0000","last_became_active":"2024-05-08T21:49:43.771279+0000","last_became_peered":"2024-05-08T21:49:43.771279+0000","last_unstale":"2024-05-08T21:53:48.772198+0000","last_undegraded":"2024-05-08T21:53:48.772198+0000","last_fullsized":"2024-05-08T21:53:48.772198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:41:45.602022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"24'7","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:08.589052+0000","last_change":"2024-05-08T21:49:43.224378+0000","last_active":"2024-05-08T21:53:08.589052+0000","last_peered":"2024-05-08T21:53:08.589052+0000","last_clean":"2024-05-08T21:53:08.589052+0000","last_became_active":"2024-05-08T21:49:43.224164+0000","last_became_peered":"2024-05-08T21:49:43.224164+0000","last_unstale":"2024-05-08T21:53:08.589052+0000","last_undegraded":"2024-05-08T21:53:08.589052+0000","last_fullsized":"2024-05-08T21:53:08.589052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:06:10.276907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"24'157","reported_seq":171,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.942200+0000","last_change":"2024-05-08T21:49:43.772948+0000","last_active":"2024-05-08T21:53:48.942200+0000","last_peered":"2024-05-08T21:53:48.942200+0000","last_clean":"2024-05-08T21:53:48.942200+0000","last_became_active":"2024-05-08T21:49:43.772685+0000","last_became_peered":"2024-05-08T21:49:43.772685+0000","last_unstale":"2024-05-08T21:53:48.942200+0000","last_undegraded":"2024-05-08T21:53:48.942200+0000","last_fullsized":"2024-05-08T21:53:48.942200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:02.850708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"24'179","reported_seq":200,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:49.442985+0000","last_change":"2024-05-08T21:49:43.222308+0000","last_active":"2024-05-08T21:53:49.442985+0000","last_peered":"2024-05-08T21:53:49.442985+0000","last_clean":"2024-05-08T21:53:49.442985+0000","last_became_active":"2024-05-08T21:49:43.221844+0000","last_became_peered":"2024-05-08T21:49:43.221844+0000","last_unstale":"2024-05-08T21:53:49.442985+0000","last_undegraded":"2024-05-08T21:53:49.442985+0000","last_fullsized":"2024-05-08T21:53:49.442985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:17.379362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":382276,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":177,"num_write_kb":522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"24'170","reported_seq":184,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.988815+0000","last_change":"2024-05-08T21:49:43.773923+0000","last_active":"2024-05-08T21:53:48.988815+0000","last_peered":"2024-05-08T21:53:48.988815+0000","last_clean":"2024-05-08T21:53:48.988815+0000","last_became_active":"2024-05-08T21:49:43.772037+0000","last_became_peered":"2024-05-08T21:49:43.772037+0000","last_unstale":"2024-05-08T21:53:48.988815+0000","last_undegraded":"2024-05-08T21:53:48.988815+0000","last_fullsized":"2024-05-08T21:53:48.988815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:52:32.629407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:11.006373+0000","last_change":"2024-05-08T21:49:43.219473+0000","last_active":"2024-05-08T21:52:11.006373+0000","last_peered":"2024-05-08T21:52:11.006373+0000","last_clean":"2024-05-08T21:52:11.006373+0000","last_became_active":"2024-05-08T21:49:43.219186+0000","last_became_peered":"2024-05-08T21:49:43.219186+0000","last_unstale":"2024-05-08T21:52:11.006373+0000","last_undegraded":"2024-05-08T21:52:11.006373+0000","last_fullsized":"2024-05-08T21:52:11.006373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:20:34.123736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"24'165","reported_seq":179,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.793723+0000","last_change":"2024-05-08T21:49:43.775135+0000","last_active":"2024-05-08T21:53:48.793723+0000","last_peered":"2024-05-08T21:53:48.793723+0000","last_clean":"2024-05-08T21:53:48.793723+0000","last_became_active":"2024-05-08T21:49:43.774919+0000","last_became_peered":"2024-05-08T21:49:43.774919+0000","last_unstale":"2024-05-08T21:53:48.793723+0000","last_undegraded":"2024-05-08T21:53:48.793723+0000","last_fullsized":"2024-05-08T21:53:48.793723+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:01:00.614249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T21:52:06.031614+0000","last_change":"2024-05-08T21:49:43.227386+0000","last_active":"2024-05-08T21:52:06.031614+0000","last_peered":"2024-05-08T21:52:06.031614+0000","last_clean":"2024-05-08T21:52:06.031614+0000","last_became_active":"2024-05-08T21:49:43.227065+0000","last_became_peered":"2024-05-08T21:49:43.227065+0000","last_unstale":"2024-05-08T21:52:06.031614+0000","last_undegraded":"2024-05-08T21:52:06.031614+0000","last_fullsized":"2024-05-08T21:52:06.031614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:43:48.019170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"24'186","reported_seq":200,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.993574+0000","last_change":"2024-05-08T21:49:43.770509+0000","last_active":"2024-05-08T21:53:48.993574+0000","last_peered":"2024-05-08T21:53:48.993574+0000","last_clean":"2024-05-08T21:53:48.993574+0000","last_became_active":"2024-05-08T21:49:43.770180+0000","last_became_peered":"2024-05-08T21:49:43.770180+0000","last_unstale":"2024-05-08T21:53:48.993574+0000","last_undegraded":"2024-05-08T21:53:48.993574+0000","last_fullsized":"2024-05-08T21:53:48.993574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:00:38.941899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T21:52:03.038898+0000","last_change":"2024-05-08T21:49:43.220942+0000","last_active":"2024-05-08T21:52:03.038898+0000","last_peered":"2024-05-08T21:52:03.038898+0000","last_clean":"2024-05-08T21:52:03.038898+0000","last_became_active":"2024-05-08T21:49:43.220641+0000","last_became_peered":"2024-05-08T21:49:43.220641+0000","last_unstale":"2024-05-08T21:52:03.038898+0000","last_undegraded":"2024-05-08T21:52:03.038898+0000","last_fullsized":"2024-05-08T21:52:03.038898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:52.323917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"24'191","reported_seq":205,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.997366+0000","last_change":"2024-05-08T21:49:43.766269+0000","last_active":"2024-05-08T21:53:48.997366+0000","last_peered":"2024-05-08T21:53:48.997366+0000","last_clean":"2024-05-08T21:53:48.997366+0000","last_became_active":"2024-05-08T21:49:43.765945+0000","last_became_peered":"2024-05-08T21:49:43.765945+0000","last_unstale":"2024-05-08T21:53:48.997366+0000","last_undegraded":"2024-05-08T21:53:48.997366+0000","last_fullsized":"2024-05-08T21:53:48.997366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:17:34.570817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:26.314118+0000","last_change":"2024-05-08T21:49:43.208328+0000","last_active":"2024-05-08T21:52:26.314118+0000","last_peered":"2024-05-08T21:52:26.314118+0000","last_clean":"2024-05-08T21:52:26.314118+0000","last_became_active":"2024-05-08T21:49:43.208013+0000","last_became_peered":"2024-05-08T21:49:43.208013+0000","last_unstale":"2024-05-08T21:52:26.314118+0000","last_undegraded":"2024-05-08T21:52:26.314118+0000","last_fullsized":"2024-05-08T21:52:26.314118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:10.497167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"24'209","reported_seq":223,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.939563+0000","last_change":"2024-05-08T21:49:43.774210+0000","last_active":"2024-05-08T21:53:48.939563+0000","last_peered":"2024-05-08T21:53:48.939563+0000","last_clean":"2024-05-08T21:53:48.939563+0000","last_became_active":"2024-05-08T21:49:43.773933+0000","last_became_peered":"2024-05-08T21:49:43.773933+0000","last_unstale":"2024-05-08T21:53:48.939563+0000","last_undegraded":"2024-05-08T21:53:48.939563+0000","last_fullsized":"2024-05-08T21:53:48.939563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:10:25.398535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:07.434727+0000","last_change":"2024-05-08T21:49:43.217456+0000","last_active":"2024-05-08T21:52:07.434727+0000","last_peered":"2024-05-08T21:52:07.434727+0000","last_clean":"2024-05-08T21:52:07.434727+0000","last_became_active":"2024-05-08T21:49:43.216822+0000","last_became_peered":"2024-05-08T21:49:43.216822+0000","last_unstale":"2024-05-08T21:52:07.434727+0000","last_undegraded":"2024-05-08T21:52:07.434727+0000","last_fullsized":"2024-05-08T21:52:07.434727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:41:35.881003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"24'170","reported_seq":184,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:49.012486+0000","last_change":"2024-05-08T21:49:43.770066+0000","last_active":"2024-05-08T21:53:49.012486+0000","last_peered":"2024-05-08T21:53:49.012486+0000","last_clean":"2024-05-08T21:53:49.012486+0000","last_became_active":"2024-05-08T21:49:43.769762+0000","last_became_peered":"2024-05-08T21:49:43.769762+0000","last_unstale":"2024-05-08T21:53:49.012486+0000","last_undegraded":"2024-05-08T21:53:49.012486+0000","last_fullsized":"2024-05-08T21:53:49.012486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:40:20.301747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T21:51:51.029492+0000","last_change":"2024-05-08T21:49:43.215293+0000","last_active":"2024-05-08T21:51:51.029492+0000","last_peered":"2024-05-08T21:51:51.029492+0000","last_clean":"2024-05-08T21:51:51.029492+0000","last_became_active":"2024-05-08T21:49:43.215048+0000","last_became_peered":"2024-05-08T21:49:43.215048+0000","last_unstale":"2024-05-08T21:51:51.029492+0000","last_undegraded":"2024-05-08T21:51:51.029492+0000","last_fullsized":"2024-05-08T21:51:51.029492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:43:48.019170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"24'115","reported_seq":129,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:47.503014+0000","last_change":"2024-05-08T21:49:43.770326+0000","last_active":"2024-05-08T21:53:47.503014+0000","last_peered":"2024-05-08T21:53:47.503014+0000","last_clean":"2024-05-08T21:53:47.503014+0000","last_became_active":"2024-05-08T21:49:43.770029+0000","last_became_peered":"2024-05-08T21:49:43.770029+0000","last_unstale":"2024-05-08T21:53:47.503014+0000","last_undegraded":"2024-05-08T21:53:47.503014+0000","last_fullsized":"2024-05-08T21:53:47.503014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:33:33.642847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T21:51:51.029535+0000","last_change":"2024-05-08T21:49:43.227710+0000","last_active":"2024-05-08T21:51:51.029535+0000","last_peered":"2024-05-08T21:51:51.029535+0000","last_clean":"2024-05-08T21:51:51.029535+0000","last_became_active":"2024-05-08T21:49:43.227430+0000","last_became_peered":"2024-05-08T21:49:43.227430+0000","last_unstale":"2024-05-08T21:51:51.029535+0000","last_undegraded":"2024-05-08T21:51:51.029535+0000","last_fullsized":"2024-05-08T21:51:51.029535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:05:58.875400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"24'170","reported_seq":184,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:49.009057+0000","last_change":"2024-05-08T21:49:43.768588+0000","last_active":"2024-05-08T21:53:49.009057+0000","last_peered":"2024-05-08T21:53:49.009057+0000","last_clean":"2024-05-08T21:53:49.009057+0000","last_became_active":"2024-05-08T21:49:43.768307+0000","last_became_peered":"2024-05-08T21:49:43.768307+0000","last_unstale":"2024-05-08T21:53:49.009057+0000","last_undegraded":"2024-05-08T21:53:49.009057+0000","last_fullsized":"2024-05-08T21:53:49.009057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:04.968184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"24'157","reported_seq":172,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.998860+0000","last_change":"2024-05-08T21:49:43.758618+0000","last_active":"2024-05-08T21:53:48.998860+0000","last_peered":"2024-05-08T21:53:48.998860+0000","last_clean":"2024-05-08T21:53:48.998860+0000","last_became_active":"2024-05-08T21:49:43.758367+0000","last_became_peered":"2024-05-08T21:49:43.758367+0000","last_unstale":"2024-05-08T21:53:48.998860+0000","last_undegraded":"2024-05-08T21:53:48.998860+0000","last_fullsized":"2024-05-08T21:53:48.998860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:30:06.569971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"24'4","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:47.358418+0000","last_change":"2024-05-08T21:49:43.217410+0000","last_active":"2024-05-08T21:53:47.358418+0000","last_peered":"2024-05-08T21:53:47.358418+0000","last_clean":"2024-05-08T21:53:47.358418+0000","last_became_active":"2024-05-08T21:49:43.217133+0000","last_became_peered":"2024-05-08T21:49:43.217133+0000","last_unstale":"2024-05-08T21:53:47.358418+0000","last_undegraded":"2024-05-08T21:53:47.358418+0000","last_fullsized":"2024-05-08T21:53:47.358418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:17.379362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":303,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"24'138","reported_seq":152,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.100219+0000","last_change":"2024-05-08T21:49:43.771651+0000","last_active":"2024-05-08T21:53:48.100219+0000","last_peered":"2024-05-08T21:53:48.100219+0000","last_clean":"2024-05-08T21:53:48.100219+0000","last_became_active":"2024-05-08T21:49:43.771451+0000","last_became_peered":"2024-05-08T21:49:43.771451+0000","last_unstale":"2024-05-08T21:53:48.100219+0000","last_undegraded":"2024-05-08T21:53:48.100219+0000","last_fullsized":"2024-05-08T21:53:48.100219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:00:38.941899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T21:51:51.029553+0000","last_change":"2024-05-08T21:49:43.224929+0000","last_active":"2024-05-08T21:51:51.029553+0000","last_peered":"2024-05-08T21:51:51.029553+0000","last_clean":"2024-05-08T21:51:51.029553+0000","last_became_active":"2024-05-08T21:49:43.223469+0000","last_became_peered":"2024-05-08T21:49:43.223469+0000","last_unstale":"2024-05-08T21:51:51.029553+0000","last_undegraded":"2024-05-08T21:51:51.029553+0000","last_fullsized":"2024-05-08T21:51:51.029553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:27.504127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":169,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:06.294108+0000","last_change":"2024-05-08T21:49:38.626519+0000","last_active":"2024-05-08T21:52:06.294108+0000","last_peered":"2024-05-08T21:52:06.294108+0000","last_clean":"2024-05-08T21:52:06.294108+0000","last_became_active":"2024-05-08T21:49:38.626159+0000","last_became_peered":"2024-05-08T21:49:38.626159+0000","last_unstale":"2024-05-08T21:52:06.294108+0000","last_undegraded":"2024-05-08T21:52:06.294108+0000","last_fullsized":"2024-05-08T21:52:06.294108+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:36.031649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:36.031649+0000","last_clean_scrub_stamp":"2024-05-08T21:49:36.031649+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:12:04.846500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"24'151","reported_seq":165,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.795812+0000","last_change":"2024-05-08T21:49:43.770966+0000","last_active":"2024-05-08T21:53:48.795812+0000","last_peered":"2024-05-08T21:53:48.795812+0000","last_clean":"2024-05-08T21:53:48.795812+0000","last_became_active":"2024-05-08T21:49:43.770711+0000","last_became_peered":"2024-05-08T21:49:43.770711+0000","last_unstale":"2024-05-08T21:53:48.795812+0000","last_undegraded":"2024-05-08T21:53:48.795812+0000","last_fullsized":"2024-05-08T21:53:48.795812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:17:34.570817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:06.294247+0000","last_change":"2024-05-08T21:49:43.221086+0000","last_active":"2024-05-08T21:52:06.294247+0000","last_peered":"2024-05-08T21:52:06.294247+0000","last_clean":"2024-05-08T21:52:06.294247+0000","last_became_active":"2024-05-08T21:49:43.220539+0000","last_became_peered":"2024-05-08T21:49:43.220539+0000","last_unstale":"2024-05-08T21:52:06.294247+0000","last_undegraded":"2024-05-08T21:52:06.294247+0000","last_fullsized":"2024-05-08T21:52:06.294247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:52.323917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T21:51:48.035134+0000","last_change":"2024-05-08T21:49:43.222410+0000","last_active":"2024-05-08T21:51:48.035134+0000","last_peered":"2024-05-08T21:51:48.035134+0000","last_clean":"2024-05-08T21:51:48.035134+0000","last_became_active":"2024-05-08T21:49:43.222131+0000","last_became_peered":"2024-05-08T21:49:43.222131+0000","last_unstale":"2024-05-08T21:51:48.035134+0000","last_undegraded":"2024-05-08T21:51:48.035134+0000","last_fullsized":"2024-05-08T21:51:48.035134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:18:58.164159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"24'153","reported_seq":167,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:49.002757+0000","last_change":"2024-05-08T21:49:43.758424+0000","last_active":"2024-05-08T21:53:49.002757+0000","last_peered":"2024-05-08T21:53:49.002757+0000","last_clean":"2024-05-08T21:53:49.002757+0000","last_became_active":"2024-05-08T21:49:43.758140+0000","last_became_peered":"2024-05-08T21:49:43.758140+0000","last_unstale":"2024-05-08T21:53:49.002757+0000","last_undegraded":"2024-05-08T21:53:49.002757+0000","last_fullsized":"2024-05-08T21:53:49.002757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:10.795540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"24'13","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:26.917117+0000","last_change":"2024-05-08T21:49:43.218241+0000","last_active":"2024-05-08T21:53:26.917117+0000","last_peered":"2024-05-08T21:53:26.917117+0000","last_clean":"2024-05-08T21:53:26.917117+0000","last_became_active":"2024-05-08T21:49:43.217780+0000","last_became_peered":"2024-05-08T21:49:43.217780+0000","last_unstale":"2024-05-08T21:53:26.917117+0000","last_undegraded":"2024-05-08T21:53:26.917117+0000","last_fullsized":"2024-05-08T21:53:26.917117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:27.504127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":25,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"24'128","reported_seq":142,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.068226+0000","last_change":"2024-05-08T21:49:43.770491+0000","last_active":"2024-05-08T21:53:48.068226+0000","last_peered":"2024-05-08T21:53:48.068226+0000","last_clean":"2024-05-08T21:53:48.068226+0000","last_became_active":"2024-05-08T21:49:43.770221+0000","last_became_peered":"2024-05-08T21:49:43.770221+0000","last_unstale":"2024-05-08T21:53:48.068226+0000","last_undegraded":"2024-05-08T21:53:48.068226+0000","last_fullsized":"2024-05-08T21:53:48.068226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:25.661350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:26.312014+0000","last_change":"2024-05-08T21:49:43.221345+0000","last_active":"2024-05-08T21:52:26.312014+0000","last_peered":"2024-05-08T21:52:26.312014+0000","last_clean":"2024-05-08T21:52:26.312014+0000","last_became_active":"2024-05-08T21:49:43.220953+0000","last_became_peered":"2024-05-08T21:49:43.220953+0000","last_unstale":"2024-05-08T21:52:26.312014+0000","last_undegraded":"2024-05-08T21:52:26.312014+0000","last_fullsized":"2024-05-08T21:52:26.312014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:33:28.074468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"24'165","reported_seq":179,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.797008+0000","last_change":"2024-05-08T21:49:43.765001+0000","last_active":"2024-05-08T21:53:48.797008+0000","last_peered":"2024-05-08T21:53:48.797008+0000","last_clean":"2024-05-08T21:53:48.797008+0000","last_became_active":"2024-05-08T21:49:43.764740+0000","last_became_peered":"2024-05-08T21:49:43.764740+0000","last_unstale":"2024-05-08T21:53:48.797008+0000","last_undegraded":"2024-05-08T21:53:48.797008+0000","last_fullsized":"2024-05-08T21:53:48.797008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:18:58.836430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T21:51:53.035540+0000","last_change":"2024-05-08T21:49:43.221251+0000","last_active":"2024-05-08T21:51:53.035540+0000","last_peered":"2024-05-08T21:51:53.035540+0000","last_clean":"2024-05-08T21:51:53.035540+0000","last_became_active":"2024-05-08T21:49:43.220839+0000","last_became_peered":"2024-05-08T21:49:43.220839+0000","last_unstale":"2024-05-08T21:51:53.035540+0000","last_undegraded":"2024-05-08T21:51:53.035540+0000","last_fullsized":"2024-05-08T21:51:53.035540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:10.497167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"24'160","reported_seq":174,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:49.008663+0000","last_change":"2024-05-08T21:49:43.762511+0000","last_active":"2024-05-08T21:53:49.008663+0000","last_peered":"2024-05-08T21:53:49.008663+0000","last_clean":"2024-05-08T21:53:49.008663+0000","last_became_active":"2024-05-08T21:49:43.762170+0000","last_became_peered":"2024-05-08T21:49:43.762170+0000","last_unstale":"2024-05-08T21:53:49.008663+0000","last_undegraded":"2024-05-08T21:53:49.008663+0000","last_fullsized":"2024-05-08T21:53:49.008663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:11.503864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T21:51:56.029980+0000","last_change":"2024-05-08T21:49:43.215361+0000","last_active":"2024-05-08T21:51:56.029980+0000","last_peered":"2024-05-08T21:51:56.029980+0000","last_clean":"2024-05-08T21:51:56.029980+0000","last_became_active":"2024-05-08T21:49:43.215162+0000","last_became_peered":"2024-05-08T21:49:43.215162+0000","last_unstale":"2024-05-08T21:51:56.029980+0000","last_undegraded":"2024-05-08T21:51:56.029980+0000","last_fullsized":"2024-05-08T21:51:56.029980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:05:58.875400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"24'132","reported_seq":146,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.145508+0000","last_change":"2024-05-08T21:49:43.757512+0000","last_active":"2024-05-08T21:53:48.145508+0000","last_peered":"2024-05-08T21:53:48.145508+0000","last_clean":"2024-05-08T21:53:48.145508+0000","last_became_active":"2024-05-08T21:49:43.757233+0000","last_became_peered":"2024-05-08T21:49:43.757233+0000","last_unstale":"2024-05-08T21:53:48.145508+0000","last_undegraded":"2024-05-08T21:53:48.145508+0000","last_fullsized":"2024-05-08T21:53:48.145508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:53:14.774835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T21:51:56.030001+0000","last_change":"2024-05-08T21:49:43.217935+0000","last_active":"2024-05-08T21:51:56.030001+0000","last_peered":"2024-05-08T21:51:56.030001+0000","last_clean":"2024-05-08T21:51:56.030001+0000","last_became_active":"2024-05-08T21:49:43.217595+0000","last_became_peered":"2024-05-08T21:49:43.217595+0000","last_unstale":"2024-05-08T21:51:56.030001+0000","last_undegraded":"2024-05-08T21:51:56.030001+0000","last_fullsized":"2024-05-08T21:51:56.030001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:38:43.069159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"24'126","reported_seq":140,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.068793+0000","last_change":"2024-05-08T21:49:43.766816+0000","last_active":"2024-05-08T21:53:48.068793+0000","last_peered":"2024-05-08T21:53:48.068793+0000","last_clean":"2024-05-08T21:53:48.068793+0000","last_became_active":"2024-05-08T21:49:43.766596+0000","last_became_peered":"2024-05-08T21:49:43.766596+0000","last_unstale":"2024-05-08T21:53:48.068793+0000","last_undegraded":"2024-05-08T21:53:48.068793+0000","last_fullsized":"2024-05-08T21:53:48.068793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:01:00.614249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"24'4","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:11.011988+0000","last_change":"2024-05-08T21:49:43.224243+0000","last_active":"2024-05-08T21:52:11.011988+0000","last_peered":"2024-05-08T21:52:11.011988+0000","last_clean":"2024-05-08T21:52:11.011988+0000","last_became_active":"2024-05-08T21:49:43.223974+0000","last_became_peered":"2024-05-08T21:49:43.223974+0000","last_unstale":"2024-05-08T21:52:11.011988+0000","last_undegraded":"2024-05-08T21:52:11.011988+0000","last_fullsized":"2024-05-08T21:52:11.011988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:03.961487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"24'149","reported_seq":163,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:49.000712+0000","last_change":"2024-05-08T21:49:43.764377+0000","last_active":"2024-05-08T21:53:49.000712+0000","last_peered":"2024-05-08T21:53:49.000712+0000","last_clean":"2024-05-08T21:53:49.000712+0000","last_became_active":"2024-05-08T21:49:43.764075+0000","last_became_peered":"2024-05-08T21:49:43.764075+0000","last_unstale":"2024-05-08T21:53:49.000712+0000","last_undegraded":"2024-05-08T21:53:49.000712+0000","last_fullsized":"2024-05-08T21:53:49.000712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:41:45.602022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T21:51:58.034698+0000","last_change":"2024-05-08T21:49:43.229414+0000","last_active":"2024-05-08T21:51:58.034698+0000","last_peered":"2024-05-08T21:51:58.034698+0000","last_clean":"2024-05-08T21:51:58.034698+0000","last_became_active":"2024-05-08T21:49:43.229121+0000","last_became_peered":"2024-05-08T21:49:43.229121+0000","last_unstale":"2024-05-08T21:51:58.034698+0000","last_undegraded":"2024-05-08T21:51:58.034698+0000","last_fullsized":"2024-05-08T21:51:58.034698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:33:28.074468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"24'168","reported_seq":182,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.974981+0000","last_change":"2024-05-08T21:49:43.774111+0000","last_active":"2024-05-08T21:53:48.974981+0000","last_peered":"2024-05-08T21:53:48.974981+0000","last_clean":"2024-05-08T21:53:48.974981+0000","last_became_active":"2024-05-08T21:49:43.772528+0000","last_became_peered":"2024-05-08T21:49:43.772528+0000","last_unstale":"2024-05-08T21:53:48.974981+0000","last_undegraded":"2024-05-08T21:53:48.974981+0000","last_fullsized":"2024-05-08T21:53:48.974981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:28.983476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:06.001179+0000","last_change":"2024-05-08T21:49:43.208581+0000","last_active":"2024-05-08T21:52:06.001179+0000","last_peered":"2024-05-08T21:52:06.001179+0000","last_clean":"2024-05-08T21:52:06.001179+0000","last_became_active":"2024-05-08T21:49:43.208326+0000","last_became_peered":"2024-05-08T21:49:43.208326+0000","last_unstale":"2024-05-08T21:52:06.001179+0000","last_undegraded":"2024-05-08T21:52:06.001179+0000","last_fullsized":"2024-05-08T21:52:06.001179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:13:35.461791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"24'111","reported_seq":125,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:47.658001+0000","last_change":"2024-05-08T21:49:43.766519+0000","last_active":"2024-05-08T21:53:47.658001+0000","last_peered":"2024-05-08T21:53:47.658001+0000","last_clean":"2024-05-08T21:53:47.658001+0000","last_became_active":"2024-05-08T21:49:43.765789+0000","last_became_peered":"2024-05-08T21:49:43.765789+0000","last_unstale":"2024-05-08T21:53:47.658001+0000","last_undegraded":"2024-05-08T21:53:47.658001+0000","last_fullsized":"2024-05-08T21:53:47.658001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:23.674986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:26.311376+0000","last_change":"2024-05-08T21:49:43.218079+0000","last_active":"2024-05-08T21:52:26.311376+0000","last_peered":"2024-05-08T21:52:26.311376+0000","last_clean":"2024-05-08T21:52:26.311376+0000","last_became_active":"2024-05-08T21:49:43.217814+0000","last_became_peered":"2024-05-08T21:49:43.217814+0000","last_unstale":"2024-05-08T21:52:26.311376+0000","last_undegraded":"2024-05-08T21:52:26.311376+0000","last_fullsized":"2024-05-08T21:52:26.311376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:18:58.164159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"24'153","reported_seq":167,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.919653+0000","last_change":"2024-05-08T21:49:43.775713+0000","last_active":"2024-05-08T21:53:48.919653+0000","last_peered":"2024-05-08T21:53:48.919653+0000","last_clean":"2024-05-08T21:53:48.919653+0000","last_became_active":"2024-05-08T21:49:43.775361+0000","last_became_peered":"2024-05-08T21:49:43.775361+0000","last_unstale":"2024-05-08T21:53:48.919653+0000","last_undegraded":"2024-05-08T21:53:48.919653+0000","last_fullsized":"2024-05-08T21:53:48.919653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:48:24.482146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"24'171","reported_seq":185,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.995797+0000","last_change":"2024-05-08T21:49:43.767129+0000","last_active":"2024-05-08T21:53:48.995797+0000","last_peered":"2024-05-08T21:53:48.995797+0000","last_clean":"2024-05-08T21:53:48.995797+0000","last_became_active":"2024-05-08T21:49:43.766789+0000","last_became_peered":"2024-05-08T21:49:43.766789+0000","last_unstale":"2024-05-08T21:53:48.995797+0000","last_undegraded":"2024-05-08T21:53:48.995797+0000","last_fullsized":"2024-05-08T21:53:48.995797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:39.954320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"24'146","reported_seq":168,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.938359+0000","last_change":"2024-05-08T21:50:33.103563+0000","last_active":"2024-05-08T21:53:48.938359+0000","last_peered":"2024-05-08T21:53:48.938359+0000","last_clean":"2024-05-08T21:53:48.938359+0000","last_became_active":"2024-05-08T21:50:33.103289+0000","last_became_peered":"2024-05-08T21:50:33.103289+0000","last_unstale":"2024-05-08T21:53:48.938359+0000","last_undegraded":"2024-05-08T21:53:48.938359+0000","last_fullsized":"2024-05-08T21:53:48.938359+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:01:29.931035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"24'107","reported_seq":121,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:47.572706+0000","last_change":"2024-05-08T21:49:43.768929+0000","last_active":"2024-05-08T21:53:47.572706+0000","last_peered":"2024-05-08T21:53:47.572706+0000","last_clean":"2024-05-08T21:53:47.572706+0000","last_became_active":"2024-05-08T21:49:43.767606+0000","last_became_peered":"2024-05-08T21:49:43.767606+0000","last_unstale":"2024-05-08T21:53:47.572706+0000","last_undegraded":"2024-05-08T21:53:47.572706+0000","last_fullsized":"2024-05-08T21:53:47.572706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:13:06.426154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"24'118","reported_seq":132,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.770518+0000","last_change":"2024-05-08T21:49:43.774673+0000","last_active":"2024-05-08T21:53:48.770518+0000","last_peered":"2024-05-08T21:53:48.770518+0000","last_clean":"2024-05-08T21:53:48.770518+0000","last_became_active":"2024-05-08T21:49:43.774406+0000","last_became_peered":"2024-05-08T21:49:43.774406+0000","last_unstale":"2024-05-08T21:53:48.770518+0000","last_undegraded":"2024-05-08T21:53:48.770518+0000","last_fullsized":"2024-05-08T21:53:48.770518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:43.798909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"24'121","reported_seq":135,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.020457+0000","last_change":"2024-05-08T21:49:43.764222+0000","last_active":"2024-05-08T21:53:48.020457+0000","last_peered":"2024-05-08T21:53:48.020457+0000","last_clean":"2024-05-08T21:53:48.020457+0000","last_became_active":"2024-05-08T21:49:43.763937+0000","last_became_peered":"2024-05-08T21:49:43.763937+0000","last_unstale":"2024-05-08T21:53:48.020457+0000","last_undegraded":"2024-05-08T21:53:48.020457+0000","last_fullsized":"2024-05-08T21:53:48.020457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:04:14.416894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"24'160","reported_seq":174,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.980127+0000","last_change":"2024-05-08T21:49:43.757318+0000","last_active":"2024-05-08T21:53:48.980127+0000","last_peered":"2024-05-08T21:53:48.980127+0000","last_clean":"2024-05-08T21:53:48.980127+0000","last_became_active":"2024-05-08T21:49:43.757083+0000","last_became_peered":"2024-05-08T21:49:43.757083+0000","last_unstale":"2024-05-08T21:53:48.980127+0000","last_undegraded":"2024-05-08T21:53:48.980127+0000","last_fullsized":"2024-05-08T21:53:48.980127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:47.551474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"24'202","reported_seq":216,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.922778+0000","last_change":"2024-05-08T21:49:43.773491+0000","last_active":"2024-05-08T21:53:48.922778+0000","last_peered":"2024-05-08T21:53:48.922778+0000","last_clean":"2024-05-08T21:53:48.922778+0000","last_became_active":"2024-05-08T21:49:43.773203+0000","last_became_peered":"2024-05-08T21:49:43.773203+0000","last_unstale":"2024-05-08T21:53:48.922778+0000","last_undegraded":"2024-05-08T21:53:48.922778+0000","last_fullsized":"2024-05-08T21:53:48.922778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:53:14.774835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"24'122","reported_seq":136,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.126669+0000","last_change":"2024-05-08T21:49:43.761926+0000","last_active":"2024-05-08T21:53:48.126669+0000","last_peered":"2024-05-08T21:53:48.126669+0000","last_clean":"2024-05-08T21:53:48.126669+0000","last_became_active":"2024-05-08T21:49:43.761645+0000","last_became_peered":"2024-05-08T21:49:43.761645+0000","last_unstale":"2024-05-08T21:53:48.126669+0000","last_undegraded":"2024-05-08T21:53:48.126669+0000","last_fullsized":"2024-05-08T21:53:48.126669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:10:07.209965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"24'144","reported_seq":158,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:47.663192+0000","last_change":"2024-05-08T21:49:43.768942+0000","last_active":"2024-05-08T21:53:47.663192+0000","last_peered":"2024-05-08T21:53:47.663192+0000","last_clean":"2024-05-08T21:53:47.663192+0000","last_became_active":"2024-05-08T21:49:43.768673+0000","last_became_peered":"2024-05-08T21:49:43.768673+0000","last_unstale":"2024-05-08T21:53:47.663192+0000","last_undegraded":"2024-05-08T21:53:47.663192+0000","last_fullsized":"2024-05-08T21:53:47.663192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:15:41.869107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155189248,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":475136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"24'121","reported_seq":135,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.158009+0000","last_change":"2024-05-08T21:49:43.766452+0000","last_active":"2024-05-08T21:53:48.158009+0000","last_peered":"2024-05-08T21:53:48.158009+0000","last_clean":"2024-05-08T21:53:48.158009+0000","last_became_active":"2024-05-08T21:49:43.765723+0000","last_became_peered":"2024-05-08T21:49:43.765723+0000","last_unstale":"2024-05-08T21:53:48.158009+0000","last_undegraded":"2024-05-08T21:53:48.158009+0000","last_fullsized":"2024-05-08T21:53:48.158009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:19:28.925404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"24'140","reported_seq":154,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:47.640672+0000","last_change":"2024-05-08T21:49:43.775098+0000","last_active":"2024-05-08T21:53:47.640672+0000","last_peered":"2024-05-08T21:53:47.640672+0000","last_clean":"2024-05-08T21:53:47.640672+0000","last_became_active":"2024-05-08T21:49:43.774808+0000","last_became_peered":"2024-05-08T21:49:43.774808+0000","last_unstale":"2024-05-08T21:53:47.640672+0000","last_undegraded":"2024-05-08T21:53:47.640672+0000","last_fullsized":"2024-05-08T21:53:47.640672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:51:15.152611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"24'138","reported_seq":152,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:48.811522+0000","last_change":"2024-05-08T21:49:43.775129+0000","last_active":"2024-05-08T21:53:48.811522+0000","last_peered":"2024-05-08T21:53:48.811522+0000","last_clean":"2024-05-08T21:53:48.811522+0000","last_became_active":"2024-05-08T21:49:43.774881+0000","last_became_peered":"2024-05-08T21:49:43.774881+0000","last_unstale":"2024-05-08T21:53:48.811522+0000","last_undegraded":"2024-05-08T21:53:48.811522+0000","last_fullsized":"2024-05-08T21:53:48.811522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:19:28.925404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"24'171","reported_seq":185,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:49.003450+0000","last_change":"2024-05-08T21:49:43.764163+0000","last_active":"2024-05-08T21:53:49.003450+0000","last_peered":"2024-05-08T21:53:49.003450+0000","last_clean":"2024-05-08T21:53:49.003450+0000","last_became_active":"2024-05-08T21:49:43.763907+0000","last_became_peered":"2024-05-08T21:49:43.763907+0000","last_unstale":"2024-05-08T21:53:49.003450+0000","last_undegraded":"2024-05-08T21:53:49.003450+0000","last_fullsized":"2024-05-08T21:53:49.003450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:01:00.614249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":417792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2172649472,"num_objects":518,"num_object_clones":0,"num_object_copies":1036,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":518,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8698,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3728736256,"data_stored":3728736256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9850,"ondisk_log_size":9850,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":383377,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":82,"num_read_kb":90,"num_write":247,"num_write_kb":548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":827392,"data_stored":761693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":240,"ondisk_log_size":240,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509495,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31936,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339904,"statfs":{"total":96636764160,"available":96604061696,"internally_reserved":0,"allocated":843776,"data_stored":682658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.61299999999999999,"15min":0.60599999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":3.5680000000000001,"5min":3.5680000000000001,"15min":3.5680000000000001},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.64800000000000002,"15min":0.61799999999999999},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":3.6469999999999998,"5min":3.6469999999999998,"15min":3.6469999999999998},"last":0.5}]},{"osd":1,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.60299999999999998,"15min":0.56499999999999995},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":3.2669999999999999,"5min":3.2669999999999999,"15min":3.2669999999999999},"last":0.32600000000000001},{"interface":"front","average":{"1min":1.0980000000000001,"5min":0.65900000000000003,"15min":0.59399999999999997},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":5.5330000000000004,"5min":5.5330000000000004,"15min":5.5330000000000004},"last":0.46600000000000003}]},{"osd":2,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.61299999999999999,"15min":0.57699999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":5.0730000000000004,"5min":5.0730000000000004,"15min":5.0730000000000004},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.745,"5min":0.60299999999999998,"15min":0.57199999999999995},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":4.0250000000000004,"5min":4.0250000000000004,"15min":4.0250000000000004},"last":0.38100000000000001}]},{"osd":3,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":1.603,"5min":0.78000000000000003,"15min":0.64800000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":20.791,"5min":20.791,"15min":20.791},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.60199999999999998,"15min":0.60399999999999998},"min":{"1min":0.40899999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.69199999999999995}]},{"osd":4,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.52400000000000002,"15min":0.50600000000000001},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":4.0979999999999999,"5min":4.0979999999999999,"15min":4.0979999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.52500000000000002,"15min":0.52700000000000002},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":1.133}]},{"osd":5,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.52400000000000002,"15min":0.53200000000000003},"min":{"1min":0.32600000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.81899999999999995,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.626,"15min":0.59599999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":7.0890000000000004,"5min":7.0890000000000004,"15min":7.0890000000000004},"last":0.59599999999999997}]},{"osd":6,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.61299999999999999,"15min":0.60899999999999999},"min":{"1min":0.40100000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":2.2440000000000002,"5min":2.2440000000000002,"15min":2.2440000000000002},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.57999999999999996,"15min":0.59599999999999997},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.33600000000000002}]}]},{"osd":6,"up_from":15,"seq":64424509495,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31736,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340104,"statfs":{"total":96636764160,"available":96604266496,"internally_reserved":0,"allocated":638976,"data_stored":473984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.91800000000000004,"15min":0.66300000000000003},"min":{"1min":0.39200000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":5.2839999999999998,"5min":23.625,"15min":23.625},"last":0.39800000000000002},{"interface":"front","average":{"1min":2.2090000000000001,"5min":2.2730000000000001,"15min":1.131},"min":{"1min":0.32600000000000001,"5min":0.308,"15min":0.308},"max":{"1min":23.975999999999999,"5min":73.831999999999994,"15min":73.831999999999994},"last":0.54400000000000004}]},{"osd":1,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":1.897,"5min":0.86599999999999999,"15min":0.74399999999999999},"min":{"1min":0.33400000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":11.552,"5min":11.552,"15min":11.552},"last":0.44800000000000001},{"interface":"front","average":{"1min":1.8180000000000001,"5min":1.012,"15min":0.73199999999999998},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":11.619999999999999,"5min":11.619999999999999,"15min":11.619999999999999},"last":0.63900000000000001}]},{"osd":2,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":2.3220000000000001,"5min":1.552,"15min":0.88400000000000001},"min":{"1min":0.36599999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":23.77,"5min":36.951000000000001,"15min":36.951000000000001},"last":0.502},{"interface":"front","average":{"1min":1.986,"5min":0.86899999999999999,"15min":0.69499999999999995},"min":{"1min":0.35899999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":20.956,"5min":20.956,"15min":20.956},"last":0.52500000000000002}]},{"osd":3,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":1.55,"5min":0.79400000000000004,"15min":0.68200000000000005},"min":{"1min":0.41199999999999998,"5min":0.38,"15min":0.38},"max":{"1min":7.9690000000000003,"5min":7.9690000000000003,"15min":7.9690000000000003},"last":0.59599999999999997},{"interface":"front","average":{"1min":1.54,"5min":0.78500000000000003,"15min":0.66900000000000004},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":8.0709999999999997,"5min":8.0709999999999997,"15min":8.0709999999999997},"last":0.57799999999999996}]},{"osd":4,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.53500000000000003,"15min":0.505},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":5.1840000000000002,"5min":5.1840000000000002,"15min":5.1840000000000002},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.749,"5min":0.55500000000000005,"15min":0.53100000000000003},"min":{"1min":0.34899999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":2.976,"5min":2.976,"15min":2.976},"last":0.66200000000000003}]},{"osd":5,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.53200000000000003,"15min":0.498},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":3.0369999999999999,"5min":3.0369999999999999,"15min":3.0369999999999999},"last":0.62},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.60199999999999998,"15min":0.56999999999999995},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":5.1219999999999999,"5min":5.1219999999999999,"15min":5.1219999999999999},"last":0.56499999999999995}]},{"osd":7,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.61899999999999999,"15min":0.56999999999999995},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":4.0389999999999997,"5min":4.0389999999999997,"15min":4.0389999999999997},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.60099999999999998,"15min":0.56799999999999995},"min":{"1min":0.40100000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":2.883,"5min":2.883,"15min":2.883},"last":0.64800000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574901,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3164796,"kb_used_data":3133684,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":91207044,"statfs":{"total":96636764160,"available":93396013056,"internally_reserved":0,"allocated":3208892416,"data_stored":3208734358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:52:49 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55300000000000005,"15min":0.57299999999999995},"min":{"1min":0.33900000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.93700000000000006,"5min":1.97,"15min":1.97},"last":0.627},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.57899999999999996,"15min":0.59699999999999998},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.91500000000000004,"5min":2.161,"15min":2.161},"last":0.59099999999999997}]},{"osd":1,"last update":"Wed May 8 21:53:44 2024","interfaces":[{"interface":"back","average":{"1min":4.1360000000000001,"5min":1.294,"15min":0.84299999999999997},"min":{"1min":0.41699999999999998,"5min":0.313,"15min":0.313},"max":{"1min":53.069000000000003,"5min":53.069000000000003,"15min":53.069000000000003},"last":0.63900000000000001},{"interface":"front","average":{"1min":6.2969999999999997,"5min":1.681,"15min":0.88500000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":80.463999999999999,"5min":80.463999999999999,"15min":80.463999999999999},"last":0.55600000000000005}]},{"osd":2,"last update":"Wed May 8 21:52:49 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.61399999999999999,"15min":0.63},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.72199999999999998,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.59099999999999997,"15min":0.58299999999999996},"min":{"1min":0.46200000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":2.238,"5min":2.238,"15min":2.238},"last":0.64900000000000002}]},{"osd":3,"last update":"Wed May 8 21:52:49 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.55900000000000005,"15min":0.54500000000000004},"min":{"1min":0.36099999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":2.2719999999999998,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.59399999999999997,"15min":0.61199999999999999},"min":{"1min":0.38300000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.96699999999999997,"5min":1.883,"15min":1.883},"last":0.65800000000000003}]},{"osd":4,"last update":"Wed May 8 21:52:49 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.51000000000000001,"15min":0.52800000000000002},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.78200000000000003,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.55800000000000005,"15min":0.59199999999999997},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.68300000000000005,"5min":2.3239999999999998,"15min":2.3239999999999998},"last":0.53900000000000003}]},{"osd":6,"last update":"Wed May 8 21:52:49 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.52400000000000002,"15min":0.52800000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":2.1509999999999998,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.56399999999999995,"15min":0.58799999999999997},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.88700000000000001,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.56499999999999995}]},{"osd":7,"last update":"Wed May 8 21:52:49 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58799999999999997,"15min":0.60399999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.8640000000000001,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.56699999999999995,"15min":0.56200000000000006},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.52000000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574901,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31360,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340480,"statfs":{"total":96636764160,"available":96604651520,"internally_reserved":0,"allocated":253952,"data_stored":91868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":9.1020000000000003,"5min":2.2200000000000002,"15min":1.1719999999999999},"min":{"1min":0.26100000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":119.55200000000001,"5min":119.55200000000001,"15min":119.55200000000001},"last":0.29299999999999998},{"interface":"front","average":{"1min":2.9020000000000001,"5min":1.028,"15min":0.83999999999999997},"min":{"1min":0.24099999999999999,"5min":0.192,"15min":0.192},"max":{"1min":23.457999999999998,"5min":23.457999999999998,"15min":23.457999999999998},"last":0.24099999999999999}]},{"osd":2,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":3.9689999999999999,"5min":1.125,"15min":0.68300000000000005},"min":{"1min":0.255,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":33.259,"5min":33.259,"15min":33.259},"last":0.28000000000000003},{"interface":"front","average":{"1min":4.3860000000000001,"5min":1.343,"15min":0.97299999999999998},"min":{"1min":0.249,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":43.167000000000002,"5min":43.167000000000002,"15min":43.167000000000002},"last":0.34200000000000003}]},{"osd":3,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":4.6210000000000004,"5min":1.26,"15min":0.71399999999999997},"min":{"1min":0.254,"5min":0.247,"15min":0.247},"max":{"1min":43.131,"5min":43.131,"15min":43.131},"last":0.254},{"interface":"front","average":{"1min":7.319,"5min":1.7949999999999999,"15min":0.88100000000000001},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":52.923999999999999,"5min":52.923999999999999,"15min":52.923999999999999},"last":0.32600000000000001}]},{"osd":4,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":2.7330000000000001,"5min":1.0549999999999999,"15min":0.78700000000000003},"min":{"1min":0.41599999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":16.914000000000001,"5min":16.914000000000001,"15min":16.914000000000001},"last":0.45300000000000001},{"interface":"front","average":{"1min":4.056,"5min":1.2929999999999999,"15min":0.83299999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":43.078000000000003,"5min":43.078000000000003,"15min":43.078000000000003},"last":0.38100000000000001}]},{"osd":5,"last update":"Wed May 8 21:53:38 2024","interfaces":[{"interface":"back","average":{"1min":3.8370000000000002,"5min":1.28,"15min":0.86199999999999999},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":33.198,"5min":33.198,"15min":33.198},"last":0.41799999999999998},{"interface":"front","average":{"1min":1.6990000000000001,"5min":1.002,"15min":1.0169999999999999},"min":{"1min":0.48899999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":7.6139999999999999,"5min":9.2400000000000002,"15min":9.2400000000000002},"last":0.49299999999999999}]},{"osd":6,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":1.665,"5min":0.98199999999999998,"15min":0.98799999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":7.5449999999999999,"5min":9.202,"15min":9.202},"last":0.433},{"interface":"front","average":{"1min":3.5529999999999999,"5min":1.2450000000000001,"15min":0.86899999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":33.283000000000001,"5min":33.283000000000001,"15min":33.283000000000001},"last":0.39300000000000002}]},{"osd":7,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":1.6319999999999999,"5min":0.98499999999999999,"15min":1.0049999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":7.6669999999999998,"5min":9.2249999999999996,"15min":9.2249999999999996},"last":0.40300000000000002},{"interface":"front","average":{"1min":3.2189999999999999,"5min":1.1799999999999999,"15min":0.85599999999999998},"min":{"1min":0.44400000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":16.981000000000002,"5min":16.981000000000002,"15min":16.981000000000002},"last":0.48399999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509493,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1981640,"kb_used_data":1942336,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":92390200,"statfs":{"total":96636764160,"available":94607564800,"internally_reserved":0,"allocated":1988952064,"data_stored":1988782810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":1.6599999999999999,"5min":0.63500000000000001,"15min":0.46899999999999997},"min":{"1min":0.26100000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":27.239999999999998,"5min":27.239999999999998,"15min":27.239999999999998},"last":0.505},{"interface":"front","average":{"1min":2.0640000000000001,"5min":0.73299999999999998,"15min":0.52500000000000002},"min":{"1min":0.26100000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":27.643000000000001,"5min":27.643000000000001,"15min":27.643000000000001},"last":0.46800000000000003}]},{"osd":2,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":1.583,"5min":0.63,"15min":0.48499999999999999},"min":{"1min":0.24299999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":25.739000000000001,"5min":25.739000000000001,"15min":25.739000000000001},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.47399999999999998,"15min":0.43099999999999999},"min":{"1min":0.28000000000000003,"5min":0.253,"15min":0.253},"max":{"1min":4.9989999999999997,"5min":4.9989999999999997,"15min":4.9989999999999997},"last":0.495}]},{"osd":3,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":1.952,"5min":0.71599999999999997,"15min":0.52200000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":13.685,"5min":13.685,"15min":13.685},"last":0.438},{"interface":"front","average":{"1min":1.8500000000000001,"5min":0.71799999999999997,"15min":0.54300000000000004},"min":{"1min":0.27400000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":28.379999999999999,"5min":28.379999999999999,"15min":28.379999999999999},"last":0.45000000000000001}]},{"osd":4,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":0.69599999999999995,"15min":0.626},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":5.6790000000000003,"5min":5.6790000000000003,"15min":5.6790000000000003},"last":0.64500000000000002},{"interface":"front","average":{"1min":1.8600000000000001,"5min":0.82499999999999996,"15min":0.64900000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":13.794,"5min":13.794,"15min":13.794},"last":0.747}]},{"osd":5,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":1.877,"5min":0.84599999999999997,"15min":0.67200000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":13.827,"5min":13.827,"15min":13.827},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.66300000000000003,"15min":0.64900000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":4.9240000000000004,"5min":4.9240000000000004,"15min":4.9240000000000004},"last":0.75600000000000001}]},{"osd":6,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":0.70999999999999996,"15min":0.65400000000000003},"min":{"1min":0.379,"5min":0.376,"15min":0.376},"max":{"1min":8.3379999999999992,"5min":8.3379999999999992,"15min":8.3379999999999992},"last":0.70999999999999996},{"interface":"front","average":{"1min":1.1359999999999999,"5min":0.70199999999999996,"15min":0.63400000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":5.6500000000000004,"5min":5.6500000000000004,"15min":5.6500000000000004},"last":0.66200000000000003}]},{"osd":7,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":0.76500000000000001,"15min":0.68000000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":9.1950000000000003,"5min":9.1950000000000003,"15min":9.1950000000000003},"last":0.69999999999999996},{"interface":"front","average":{"1min":1.8799999999999999,"5min":0.86799999999999999,"15min":0.70799999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":13.756,"5min":13.756,"15min":13.756},"last":0.65300000000000002}]}]},{"osd":2,"up_from":15,"seq":64424509495,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31356,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340484,"statfs":{"total":96636764160,"available":96604655616,"internally_reserved":0,"allocated":249856,"data_stored":92011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:53:45 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.42199999999999999,"15min":0.34999999999999998},"min":{"1min":0.255,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":3.73,"5min":3.73,"15min":3.73},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.44,"15min":0.38200000000000001},"min":{"1min":0.27400000000000002,"5min":0.254,"15min":0.254},"max":{"1min":3.1600000000000001,"5min":3.1600000000000001,"15min":3.1600000000000001},"last":0.30299999999999999}]},{"osd":1,"last update":"Wed May 8 21:53:45 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.39600000000000002,"15min":0.36199999999999999},"min":{"1min":0.23999999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":3.1930000000000001,"5min":3.1930000000000001,"15min":3.1930000000000001},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.40100000000000002,"15min":0.375},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":2.1299999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":0.33100000000000002}]},{"osd":3,"last update":"Wed May 8 21:53:45 2024","interfaces":[{"interface":"back","average":{"1min":4.0759999999999996,"5min":1.1160000000000001,"15min":0.60699999999999998},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":60.899000000000001,"5min":60.899000000000001,"15min":60.899000000000001},"last":0.27700000000000002},{"interface":"front","average":{"1min":1.1140000000000001,"5min":0.53900000000000003,"15min":0.437},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":9.7469999999999999,"5min":9.7469999999999999,"15min":9.7469999999999999},"last":0.38700000000000001}]},{"osd":4,"last update":"Wed May 8 21:53:45 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":0.69099999999999995,"15min":0.63600000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":7.8499999999999996,"5min":7.8499999999999996,"15min":7.8499999999999996},"last":0.68200000000000005},{"interface":"front","average":{"1min":1.123,"5min":0.72399999999999998,"15min":0.66000000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":8.1189999999999998,"5min":8.1189999999999998,"15min":8.1189999999999998},"last":0.61099999999999999}]},{"osd":5,"last update":"Wed May 8 21:53:45 2024","interfaces":[{"interface":"back","average":{"1min":1.462,"5min":0.77100000000000002,"15min":0.65100000000000002},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":11.326000000000001,"5min":11.326000000000001,"15min":11.326000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":1.1259999999999999,"5min":0.69199999999999995,"15min":0.628},"min":{"1min":0.375,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":7.8860000000000001,"5min":7.8860000000000001,"15min":7.8860000000000001},"last":0.64100000000000001}]},{"osd":6,"last update":"Wed May 8 21:53:45 2024","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":0.69799999999999995,"15min":0.63800000000000001},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":8.1709999999999994,"5min":8.1709999999999994,"15min":8.1709999999999994},"last":0.54900000000000004},{"interface":"front","average":{"1min":1.421,"5min":0.76700000000000002,"15min":0.66000000000000003},"min":{"1min":0.40300000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":10.41,"5min":10.41,"15min":10.41},"last":0.625}]},{"osd":7,"last update":"Wed May 8 21:53:45 2024","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.67000000000000004,"15min":0.62},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":5.2699999999999996,"5min":5.2699999999999996,"15min":5.2699999999999996},"last":0.66500000000000004},{"interface":"front","average":{"1min":1.1679999999999999,"5min":0.72799999999999998,"15min":0.65200000000000002},"min":{"1min":0.42899999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":7.5810000000000004,"5min":7.5810000000000004,"15min":7.5810000000000004},"last":0.58099999999999996}]}]},{"osd":3,"up_from":15,"seq":64424509493,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1879028,"kb_used_data":1847916,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":92492812,"statfs":{"total":96636764160,"available":94712639488,"internally_reserved":0,"allocated":1892265984,"data_stored":1892100330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:53:42 2024","interfaces":[{"interface":"back","average":{"1min":2.0739999999999998,"5min":0.69299999999999995,"15min":0.47899999999999998},"min":{"1min":0.21299999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":39.470999999999997,"5min":39.470999999999997,"15min":39.470999999999997},"last":0.23799999999999999},{"interface":"front","average":{"1min":1.9750000000000001,"5min":0.68400000000000005,"15min":0.48099999999999998},"min":{"1min":0.25700000000000001,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":32.802,"5min":32.802,"15min":32.802},"last":0.31900000000000001}]},{"osd":1,"last update":"Wed May 8 21:53:42 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.38500000000000001,"15min":0.38700000000000001},"min":{"1min":0.252,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.34599999999999997},{"interface":"front","average":{"1min":2.48,"5min":0.82799999999999996,"15min":0.56399999999999995},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":43.493000000000002,"5min":43.493000000000002,"15min":43.493000000000002},"last":0.29799999999999999}]},{"osd":2,"last update":"Wed May 8 21:53:42 2024","interfaces":[{"interface":"back","average":{"1min":2.4969999999999999,"5min":0.85099999999999998,"15min":0.59299999999999997},"min":{"1min":0.318,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":43.445999999999998,"5min":43.445999999999998,"15min":43.445999999999998},"last":0.33800000000000002},{"interface":"front","average":{"1min":2.3530000000000002,"5min":0.83799999999999997,"15min":0.59599999999999997},"min":{"1min":0.34499999999999997,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":39.569000000000003,"5min":39.569000000000003,"15min":39.569000000000003},"last":0.35899999999999999}]},{"osd":4,"last update":"Wed May 8 21:53:42 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.629,"15min":0.61499999999999999},"min":{"1min":0.41199999999999998,"5min":0.377,"15min":0.377},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":0.54100000000000004},{"interface":"front","average":{"1min":1.821,"5min":0.85699999999999998,"15min":0.70399999999999996},"min":{"1min":0.375,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":19.024999999999999,"5min":19.024999999999999,"15min":19.024999999999999},"last":0.60899999999999999}]},{"osd":5,"last update":"Wed May 8 21:53:42 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.63200000000000001,"15min":0.627},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.833,"5min":1.833,"15min":1.833},"last":0.75},{"interface":"front","average":{"1min":2.0470000000000002,"5min":0.91900000000000004,"15min":0.72099999999999997},"min":{"1min":0.46700000000000003,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":27.678999999999998,"5min":27.678999999999998,"15min":27.678999999999998},"last":0.71799999999999997}]},{"osd":6,"last update":"Wed May 8 21:53:42 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.65400000000000003,"15min":0.64400000000000002},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.915,"5min":1.915,"15min":1.915},"last":0.73299999999999998},{"interface":"front","average":{"1min":2.2530000000000001,"5min":0.96299999999999997,"15min":0.77100000000000002},"min":{"1min":0.46500000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":32.655000000000001,"5min":32.655000000000001,"15min":32.655000000000001},"last":0.56100000000000005}]},{"osd":7,"last update":"Wed May 8 21:53:42 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.68700000000000006,"15min":0.66700000000000004},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":3.4089999999999998,"5min":3.4089999999999998,"15min":3.4089999999999998},"last":0.70799999999999996},{"interface":"front","average":{"1min":1.653,"5min":0.88800000000000001,"15min":0.72299999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":18.939,"5min":18.939,"15min":18.939},"last":0.57899999999999996}]}]},{"osd":4,"up_from":15,"seq":64424509494,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31364,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340476,"statfs":{"total":96636764160,"available":96604647424,"internally_reserved":0,"allocated":258048,"data_stored":91834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:53:44 2024","interfaces":[{"interface":"back","average":{"1min":2.1030000000000002,"5min":0.82299999999999995,"15min":0.59999999999999998},"min":{"1min":0.29399999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":21.042999999999999,"5min":21.042999999999999,"15min":21.042999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":2.1970000000000001,"5min":0.874,"15min":0.65200000000000002},"min":{"1min":0.46200000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":21.478999999999999,"5min":21.478999999999999,"15min":21.478999999999999},"last":0.53800000000000003}]},{"osd":1,"last update":"Wed May 8 21:53:44 2024","interfaces":[{"interface":"back","average":{"1min":1.986,"5min":0.83699999999999997,"15min":0.63100000000000001},"min":{"1min":0.372,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":14.555999999999999,"5min":14.555999999999999,"15min":14.555999999999999},"last":0.495},{"interface":"front","average":{"1min":1.1100000000000001,"5min":0.63700000000000001,"15min":0.55500000000000005},"min":{"1min":0.40799999999999997,"5min":0.314,"15min":0.314},"max":{"1min":7.7140000000000004,"5min":7.7140000000000004,"15min":7.7140000000000004},"last":0.52900000000000003}]},{"osd":2,"last update":"Wed May 8 21:53:44 2024","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":0.69399999999999995,"15min":0.58199999999999996},"min":{"1min":0.41899999999999998,"5min":0.377,"15min":0.377},"max":{"1min":11.724,"5min":11.724,"15min":11.724},"last":0.56799999999999995},{"interface":"front","average":{"1min":1.089,"5min":0.65700000000000003,"15min":0.58899999999999997},"min":{"1min":0.44600000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":4.6740000000000004,"5min":4.6740000000000004,"15min":4.6740000000000004},"last":0.45100000000000001}]},{"osd":3,"last update":"Wed May 8 21:53:44 2024","interfaces":[{"interface":"back","average":{"1min":2.4849999999999999,"5min":0.93700000000000006,"15min":0.68300000000000005},"min":{"1min":0.39400000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":30.84,"5min":30.84,"15min":30.84},"last":0.55800000000000005},{"interface":"front","average":{"1min":2.0739999999999998,"5min":0.89000000000000001,"15min":0.69099999999999995},"min":{"1min":0.41499999999999998,"5min":0.37,"15min":0.37},"max":{"1min":21.754000000000001,"5min":21.754000000000001,"15min":21.754000000000001},"last":0.52100000000000002}]},{"osd":5,"last update":"Wed May 8 21:53:44 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.52200000000000002,"15min":0.51200000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":4.4660000000000002,"5min":4.4660000000000002,"15min":4.4660000000000002},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.56899999999999995,"15min":0.56599999999999995},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":5.2190000000000003,"5min":5.2190000000000003,"15min":5.2190000000000003},"last":0.504}]},{"osd":6,"last update":"Wed May 8 21:53:44 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.61299999999999999,"15min":0.59499999999999997},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":4.9720000000000004,"5min":4.9720000000000004,"15min":4.9720000000000004},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.60599999999999998,"15min":0.60699999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":4.4100000000000001,"5min":4.4100000000000001,"15min":4.4100000000000001},"last":0.58399999999999996}]},{"osd":7,"last update":"Wed May 8 21:53:44 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.60399999999999998,"15min":0.61399999999999999},"min":{"1min":0.34699999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":4.444,"5min":4.444,"15min":4.444},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.877,"5min":0.67900000000000005,"15min":0.66100000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":5.0430000000000001,"5min":5.0430000000000001,"15min":5.0430000000000001},"last":0.67500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":389120,"data_stored":377518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":382276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1291845632,"data_stored":1291845632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":2436890624,"data_stored":2436890624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T21:53:53.234 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T21:53:53.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.391+0000 7f5b9fd22700 1 Processor -- start 2024-05-08T21:53:53.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.391+0000 7f5b9fd22700 1 -- start start 2024-05-08T21:53:53.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.392+0000 7f5b9fd22700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b980c4540 0x7f5b980c8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:53.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.392+0000 7f5b9fd22700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b980c2570 con 0x7f5b98151bd0 2024-05-08T21:53:53.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.392+0000 7f5b9fd22700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b9806f4e0 con 0x7f5b980b28b0 2024-05-08T21:53:53.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.392+0000 7f5b9fd22700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b980c2e80 con 0x7f5b980c4540 2024-05-08T21:53:53.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.392+0000 7f5b9dabe700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f5b98151bd0 0x7f5b980cd4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:33600/0 (socket says 172.21.15.73:33600) 2024-05-08T21:53:53.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.392+0000 7f5b9dabe700 1 -- 172.21.15.73:0/464785998 learned_addr learned my addr 172.21.15.73:0/464785998 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:53:53.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.392+0000 7f5b9d2bd700 1 --2- 172.21.15.73:0/464785998 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b980c4540 0x7f5b980c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:53.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.392+0000 7f5b9cabc700 1 -- 172.21.15.73:0/464785998 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4002884585 0 0) 0x7f5b980c2570 con 0x7f5b98151bd0 2024-05-08T21:53:53.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.392+0000 7f5b9cabc700 1 -- 172.21.15.73:0/464785998 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b840035b0 con 0x7f5b98151bd0 2024-05-08T21:53:53.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.392+0000 7f5b9cabc700 1 -- 172.21.15.73:0/464785998 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 196579325 0 0) 0x7f5b9806f4e0 con 0x7f5b980b28b0 2024-05-08T21:53:53.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.392+0000 7f5b9cabc700 1 -- 172.21.15.73:0/464785998 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b980c2570 con 0x7f5b980b28b0 2024-05-08T21:53:53.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.392+0000 7f5b9cabc700 1 -- 172.21.15.73:0/464785998 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1009645391 0 0) 0x7f5b840035b0 con 0x7f5b98151bd0 2024-05-08T21:53:53.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.392+0000 7f5b9cabc700 1 -- 172.21.15.73:0/464785998 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b980c4540 msgr2=0x7f5b980c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:53:53.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.392+0000 7f5b9cabc700 1 --2- 172.21.15.73:0/464785998 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b980c4540 0x7f5b980c8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:53.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.392+0000 7f5b9cabc700 1 -- 172.21.15.73:0/464785998 >> v1:172.21.15.115:6789/0 conn(0x7f5b980b28b0 legacy=0x7f5b98162410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:53.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.392+0000 7f5b9cabc700 1 -- 172.21.15.73:0/464785998 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b9806f7c0 con 0x7f5b98151bd0 2024-05-08T21:53:53.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.392+0000 7f5b9cabc700 1 -- 172.21.15.73:0/464785998 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 953298616 0 0) 0x7f5b94001670 con 0x7f5b98151bd0 2024-05-08T21:53:53.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.392+0000 7f5b9d2bd700 1 --2- 172.21.15.73:0/464785998 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b980c4540 0x7f5b980c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:53:53.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.392+0000 7f5b9cabc700 1 -- 172.21.15.73:0/464785998 >> v1:172.21.15.73:6789/0 conn(0x7f5b98151bd0 legacy=0x7f5b980cd4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:53.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.392+0000 7f5b9cabc700 1 --2- 172.21.15.73:0/464785998 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b84003bc0 0x7f5b84003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:53.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.392+0000 7f5b9cabc700 1 --2- 172.21.15.73:0/464785998 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b980c4540 0x7f5b84004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:53.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.392+0000 7f5b9cabc700 1 --2- 172.21.15.73:0/464785998 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b84004d90 0x7f5b84005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:53.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.393+0000 7f5b9cabc700 1 -- 172.21.15.73:0/464785998 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b980c2e80 con 0x7f5b84004d90 2024-05-08T21:53:53.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.393+0000 7f5b9cabc700 1 -- 172.21.15.73:0/464785998 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8400bb50 con 0x7f5b84003bc0 2024-05-08T21:53:53.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.393+0000 7f5b9cabc700 1 -- 172.21.15.73:0/464785998 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8400bd10 con 0x7f5b980c4540 2024-05-08T21:53:53.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.393+0000 7f5b9e2bf700 1 --2- 172.21.15.73:0/464785998 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b84004d90 0x7f5b84005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:53.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.393+0000 7f5b9d2bd700 1 --2- 172.21.15.73:0/464785998 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b980c4540 0x7f5b84004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:53.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.393+0000 7f5b9dabe700 1 --2- 172.21.15.73:0/464785998 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b84003bc0 0x7f5b84003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:53.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.393+0000 7f5b9e2bf700 1 -- 172.21.15.73:0/464785998 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b980c4540 msgr2=0x7f5b84004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:53:53.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.393+0000 7f5b9e2bf700 1 --2- 172.21.15.73:0/464785998 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b980c4540 0x7f5b84004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:53.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.393+0000 7f5b9e2bf700 1 -- 172.21.15.73:0/464785998 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b84003bc0 msgr2=0x7f5b84003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:53:53.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.393+0000 7f5b9e2bf700 1 --2- 172.21.15.73:0/464785998 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b84003bc0 0x7f5b84003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:53.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.393+0000 7f5b9e2bf700 1 -- 172.21.15.73:0/464785998 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b880094a0 con 0x7f5b84004d90 2024-05-08T21:53:53.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.393+0000 7f5b9e2bf700 1 --2- 172.21.15.73:0/464785998 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b84004d90 0x7f5b84005210 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f5b90002230 tx=0x7f5b84005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ac5af9405ff328c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:53.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.393+0000 7f5b9cabc700 1 -- 172.21.15.73:0/464785998 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b90001f30 con 0x7f5b84004d90 2024-05-08T21:53:53.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.393+0000 7f5b9cabc700 1 -- 172.21.15.73:0/464785998 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b9000ce60 con 0x7f5b84004d90 2024-05-08T21:53:53.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.393+0000 7f5b9cabc700 1 -- 172.21.15.73:0/464785998 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b90003c40 con 0x7f5b84004d90 2024-05-08T21:53:53.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.394+0000 7f5b9fd22700 1 -- 172.21.15.73:0/464785998 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b84004d90 msgr2=0x7f5b84005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:53.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.394+0000 7f5b9fd22700 1 --2- 172.21.15.73:0/464785998 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b84004d90 0x7f5b84005210 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f5b90002230 tx=0x7f5b84005880 comp rx=0 tx=0).stop 2024-05-08T21:53:53.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.394+0000 7f5b9e2bf700 1 -- 172.21.15.73:0/464785998 reap_dead start 2024-05-08T21:53:53.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.394+0000 7f5b9fd22700 1 -- 172.21.15.73:0/464785998 shutdown_connections 2024-05-08T21:53:53.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.394+0000 7f5b9fd22700 1 -- 172.21.15.73:0/464785998 >> 172.21.15.73:0/464785998 conn(0x7f5b9806ae10 msgr2=0x7f5b980666c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:53:53.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.394+0000 7f5b9fd22700 1 -- 172.21.15.73:0/464785998 shutdown_connections 2024-05-08T21:53:53.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.394+0000 7f5b9fd22700 1 -- 172.21.15.73:0/464785998 wait complete. 2024-05-08T21:53:53.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.395+0000 7f5b9fd22700 1 Processor -- start 2024-05-08T21:53:53.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.395+0000 7f5b9fd22700 1 -- start start 2024-05-08T21:53:53.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.396+0000 7f5b9fd22700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b98146120 0x7f5b98141280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:53.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.396+0000 7f5b9fd22700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b981dfe00 0x7f5b981e0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:53.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.396+0000 7f5b9fd22700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b981e1000 0x7f5b981f17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:53.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.396+0000 7f5b9fd22700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b981403a0 con 0x7f5b98146120 2024-05-08T21:53:53.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.396+0000 7f5b9fd22700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9814b710 con 0x7f5b981dfe00 2024-05-08T21:53:53.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.396+0000 7f5b9fd22700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b98140640 con 0x7f5b981e1000 2024-05-08T21:53:53.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.396+0000 7f5b9dabe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b98146120 0x7f5b98141280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:53.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.396+0000 7f5b9dabe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b98146120 0x7f5b98141280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56526/0 (socket says 172.21.15.73:56526) 2024-05-08T21:53:53.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.396+0000 7f5b9dabe700 1 -- 172.21.15.73:0/3175015548 learned_addr learned my addr 172.21.15.73:0/3175015548 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:53:53.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.396+0000 7f5b9d2bd700 1 --2- 172.21.15.73:0/3175015548 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b981dfe00 0x7f5b981e0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:53.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.396+0000 7f5b9e2bf700 1 --2- 172.21.15.73:0/3175015548 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b981e1000 0x7f5b981f17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:53.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.396+0000 7f5b9dabe700 1 -- 172.21.15.73:0/3175015548 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b981e1000 msgr2=0x7f5b981f17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:53.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.396+0000 7f5b9dabe700 1 --2- 172.21.15.73:0/3175015548 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b981e1000 0x7f5b981f17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:53.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.396+0000 7f5b9dabe700 1 -- 172.21.15.73:0/3175015548 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b981dfe00 msgr2=0x7f5b981e0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:53.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.396+0000 7f5b9dabe700 1 --2- 172.21.15.73:0/3175015548 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b981dfe00 0x7f5b981e0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:53.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.396+0000 7f5b9dabe700 1 -- 172.21.15.73:0/3175015548 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b981e02c0 con 0x7f5b98146120 2024-05-08T21:53:53.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.396+0000 7f5b9d2bd700 1 --2- 172.21.15.73:0/3175015548 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b981dfe00 0x7f5b981e0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:53:53.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.396+0000 7f5b9dabe700 1 --2- 172.21.15.73:0/3175015548 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b98146120 0x7f5b98141280 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f5b94001790 tx=0x7f5b940073f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:53.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.396+0000 7f5b8e7fc700 1 -- 172.21.15.73:0/3175015548 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b940010d0 con 0x7f5b98146120 2024-05-08T21:53:53.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.396+0000 7f5b8e7fc700 1 -- 172.21.15.73:0/3175015548 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b94011580 con 0x7f5b98146120 2024-05-08T21:53:53.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.396+0000 7f5b9fd22700 1 -- 172.21.15.73:0/3175015548 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b981e05a0 con 0x7f5b98146120 2024-05-08T21:53:53.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.396+0000 7f5b8e7fc700 1 -- 172.21.15.73:0/3175015548 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b94011930 con 0x7f5b98146120 2024-05-08T21:53:53.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.396+0000 7f5b9fd22700 1 -- 172.21.15.73:0/3175015548 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b981e19e0 con 0x7f5b98146120 2024-05-08T21:53:53.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.397+0000 7f5b9fd22700 1 -- 172.21.15.73:0/3175015548 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b981e07e0 con 0x7f5b98146120 2024-05-08T21:53:53.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.398+0000 7f5b8e7fc700 1 -- 172.21.15.73:0/3175015548 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5b94011a90 con 0x7f5b98146120 2024-05-08T21:53:53.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.398+0000 7f5b8e7fc700 1 --2- 172.21.15.73:0/3175015548 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f5b7c06ac90 0x7f5b7c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:53.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.398+0000 7f5b8e7fc700 1 -- 172.21.15.73:0/3175015548 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5969+0+0 (secure 0 0 0) 0x7f5b940894d0 con 0x7f5b98146120 2024-05-08T21:53:53.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.398+0000 7f5b9d2bd700 1 --2- 172.21.15.73:0/3175015548 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f5b7c06ac90 0x7f5b7c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:53.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.399+0000 7f5b9d2bd700 1 --2- 172.21.15.73:0/3175015548 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f5b7c06ac90 0x7f5b7c06d150 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5b98145970 tx=0x7f5b88008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:53.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.403+0000 7f5b8e7fc700 1 -- 172.21.15.73:0/3175015548 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f5b981e07e0 con 0x7f5b98146120 2024-05-08T21:53:53.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.603+0000 7f5b9fd22700 1 -- 172.21.15.73:0/3175015548 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5b981e07e0 con 0x7f5b98146120 2024-05-08T21:53:53.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.604+0000 7f5b8e7fc700 1 -- 172.21.15.73:0/3175015548 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16510 (secure 0 0 0) 0x7f5b94057f90 con 0x7f5b98146120 2024-05-08T21:53:53.606 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:53:53.606 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":24,"fsid":"143164b7-c9c7-4737-a494-7dafa5a3320c","created":"2024-05-08T21:49:26.221909+0000","modified":"2024-05-08T21:52:05.996447+0000","last_up_change":"2024-05-08T21:49:37.118386+0000","last_in_change":"2024-05-08T21:49:28.836944+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T21:49:35.998578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T21:49:42.171760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T21:49:42.576293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6b7439c1-daaa-44af-8333-a455f9e9dc67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":47228},{"type":"v1","addr":"172.21.15.73:6809","nonce":47228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":47228},{"type":"v1","addr":"172.21.15.73:6811","nonce":47228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":47228},{"type":"v1","addr":"172.21.15.73:6815","nonce":47228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":47228},{"type":"v1","addr":"172.21.15.73:6813","nonce":47228}]},"public_addr":"172.21.15.73:6809/47228","cluster_addr":"172.21.15.73:6811/47228","heartbeat_back_addr":"172.21.15.73:6815/47228","heartbeat_front_addr":"172.21.15.73:6813/47228","state":["exists","up"]},{"osd":1,"uuid":"fb67886a-d7f7-45ac-832f-36c871c8a208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":47227},{"type":"v1","addr":"172.21.15.73:6801","nonce":47227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":47227},{"type":"v1","addr":"172.21.15.73:6803","nonce":47227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":47227},{"type":"v1","addr":"172.21.15.73:6807","nonce":47227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":47227},{"type":"v1","addr":"172.21.15.73:6805","nonce":47227}]},"public_addr":"172.21.15.73:6801/47227","cluster_addr":"172.21.15.73:6803/47227","heartbeat_back_addr":"172.21.15.73:6807/47227","heartbeat_front_addr":"172.21.15.73:6805/47227","state":["exists","up"]},{"osd":2,"uuid":"a5cd6e98-6621-473a-bfb8-5c648abbb563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":47229},{"type":"v1","addr":"172.21.15.73:6817","nonce":47229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":47229},{"type":"v1","addr":"172.21.15.73:6819","nonce":47229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":47229},{"type":"v1","addr":"172.21.15.73:6823","nonce":47229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":47229},{"type":"v1","addr":"172.21.15.73:6821","nonce":47229}]},"public_addr":"172.21.15.73:6817/47229","cluster_addr":"172.21.15.73:6819/47229","heartbeat_back_addr":"172.21.15.73:6823/47229","heartbeat_front_addr":"172.21.15.73:6821/47229","state":["exists","up"]},{"osd":3,"uuid":"36927c20-4241-4f3b-91b5-a6a6f27598e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":47232},{"type":"v1","addr":"172.21.15.73:6825","nonce":47232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":47232},{"type":"v1","addr":"172.21.15.73:6827","nonce":47232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":47232},{"type":"v1","addr":"172.21.15.73:6831","nonce":47232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":47232},{"type":"v1","addr":"172.21.15.73:6829","nonce":47232}]},"public_addr":"172.21.15.73:6825/47232","cluster_addr":"172.21.15.73:6827/47232","heartbeat_back_addr":"172.21.15.73:6831/47232","heartbeat_front_addr":"172.21.15.73:6829/47232","state":["exists","up"]},{"osd":4,"uuid":"4ebe0a18-8216-4815-878a-39c39a6cd3fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":47200},{"type":"v1","addr":"172.21.15.115:6801","nonce":47200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":47200},{"type":"v1","addr":"172.21.15.115:6803","nonce":47200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":47200},{"type":"v1","addr":"172.21.15.115:6807","nonce":47200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":47200},{"type":"v1","addr":"172.21.15.115:6805","nonce":47200}]},"public_addr":"172.21.15.115:6801/47200","cluster_addr":"172.21.15.115:6803/47200","heartbeat_back_addr":"172.21.15.115:6807/47200","heartbeat_front_addr":"172.21.15.115:6805/47200","state":["exists","up"]},{"osd":5,"uuid":"957f0ac1-5f26-4f02-8c05-488e6b67ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":47201},{"type":"v1","addr":"172.21.15.115:6809","nonce":47201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":47201},{"type":"v1","addr":"172.21.15.115:6811","nonce":47201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":47201},{"type":"v1","addr":"172.21.15.115:6815","nonce":47201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":47201},{"type":"v1","addr":"172.21.15.115:6813","nonce":47201}]},"public_addr":"172.21.15.115:6809/47201","cluster_addr":"172.21.15.115:6811/47201","heartbeat_back_addr":"172.21.15.115:6815/47201","heartbeat_front_addr":"172.21.15.115:6813/47201","state":["exists","up"]},{"osd":6,"uuid":"f5a6768f-ba7f-4f66-b335-0c303b158e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":47202},{"type":"v1","addr":"172.21.15.115:6817","nonce":47202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":47202},{"type":"v1","addr":"172.21.15.115:6819","nonce":47202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":47202},{"type":"v1","addr":"172.21.15.115:6823","nonce":47202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":47202},{"type":"v1","addr":"172.21.15.115:6821","nonce":47202}]},"public_addr":"172.21.15.115:6817/47202","cluster_addr":"172.21.15.115:6819/47202","heartbeat_back_addr":"172.21.15.115:6823/47202","heartbeat_front_addr":"172.21.15.115:6821/47202","state":["exists","up"]},{"osd":7,"uuid":"f4187743-f9e6-42e6-aca9-0604a58db1ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":47211},{"type":"v1","addr":"172.21.15.115:6825","nonce":47211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":47211},{"type":"v1","addr":"172.21.15.115:6827","nonce":47211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":47211},{"type":"v1","addr":"172.21.15.115:6831","nonce":47211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":47211},{"type":"v1","addr":"172.21.15.115:6829","nonce":47211}]},"public_addr":"172.21.15.115:6825/47211","cluster_addr":"172.21.15.115:6827/47211","heartbeat_back_addr":"172.21.15.115:6831/47211","heartbeat_front_addr":"172.21.15.115:6829/47211","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:33.996335+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:33.687451+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:34.072549+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:33.997588+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:34.047260+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:34.876272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:33.965472+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:34.038637+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.18","mappings":[{"from":3,"to":2}]},{"pgid":"3.1a","mappings":[{"from":4,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.3b","mappings":[{"from":7,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:6839/1477468490":"2024-05-09T21:52:05.996377+0000","172.21.15.73:6838/1477468490":"2024-05-09T21:52:05.996377+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T21:53:53.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.606+0000 7f5b9fd22700 1 -- 172.21.15.73:0/3175015548 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f5b7c06ac90 msgr2=0x7f5b7c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:53.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.606+0000 7f5b9fd22700 1 --2- 172.21.15.73:0/3175015548 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f5b7c06ac90 0x7f5b7c06d150 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5b98145970 tx=0x7f5b88008040 comp rx=0 tx=0).stop 2024-05-08T21:53:53.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.606+0000 7f5b9fd22700 1 -- 172.21.15.73:0/3175015548 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b98146120 msgr2=0x7f5b98141280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:53.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.606+0000 7f5b9fd22700 1 --2- 172.21.15.73:0/3175015548 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b98146120 0x7f5b98141280 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f5b94001790 tx=0x7f5b940073f0 comp rx=0 tx=0).stop 2024-05-08T21:53:53.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.606+0000 7f5b9fd22700 1 -- 172.21.15.73:0/3175015548 shutdown_connections 2024-05-08T21:53:53.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.607+0000 7f5b9fd22700 1 --2- 172.21.15.73:0/3175015548 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f5b7c06ac90 0x7f5b7c06d150 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:53.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.607+0000 7f5b9fd22700 1 --2- 172.21.15.73:0/3175015548 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b981e1000 0x7f5b981f17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:53.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.607+0000 7f5b9fd22700 1 --2- 172.21.15.73:0/3175015548 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b98146120 0x7f5b98141280 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:53.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.607+0000 7f5b9fd22700 1 --2- 172.21.15.73:0/3175015548 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b981dfe00 0x7f5b981e0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:53.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.607+0000 7f5b9fd22700 1 -- 172.21.15.73:0/3175015548 >> 172.21.15.73:0/3175015548 conn(0x7f5b9806ae10 msgr2=0x7f5b980cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:53:53.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.607+0000 7f5b9fd22700 1 -- 172.21.15.73:0/3175015548 shutdown_connections 2024-05-08T21:53:53.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:53.607+0000 7f5b9fd22700 1 -- 172.21.15.73:0/3175015548 wait complete. 2024-05-08T21:53:54.621 INFO:tasks.ceph:Scrubbing osd.0 2024-05-08T21:53:54.621 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-05-08T21:53:54.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.762+0000 7fd897220700 1 Processor -- start 2024-05-08T21:53:54.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.762+0000 7fd897220700 1 -- start start 2024-05-08T21:53:54.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.763+0000 7fd897220700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd89006b580 0x7fd8900c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:54.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.763+0000 7fd897220700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd8900719f0 0x7fd8901623a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:54.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.763+0000 7fd897220700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8901584a0 con 0x7fd8900c5b30 2024-05-08T21:53:54.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.763+0000 7fd897220700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8900c6450 con 0x7fd89006b580 2024-05-08T21:53:54.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.763+0000 7fd897220700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd890070300 con 0x7fd8900719f0 2024-05-08T21:53:54.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.763+0000 7fd894fbc700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fd8900c5b30 0x7fd89006fbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:33614/0 (socket says 172.21.15.73:33614) 2024-05-08T21:53:54.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.763+0000 7fd894fbc700 1 -- 172.21.15.73:0/751969711 learned_addr learned my addr 172.21.15.73:0/751969711 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:53:54.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.763+0000 7fd88ffff700 1 --2- 172.21.15.73:0/751969711 >> v2:172.21.15.115:3300/0 conn(0x7fd89006b580 0x7fd8900c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:54.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.763+0000 7fd8957bd700 1 --2- 172.21.15.73:0/751969711 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd8900719f0 0x7fd8901623a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:54.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.764+0000 7fd88f7fe700 1 -- 172.21.15.73:0/751969711 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3933273648 0 0) 0x7fd8901584a0 con 0x7fd8900c5b30 2024-05-08T21:53:54.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.764+0000 7fd88f7fe700 1 -- 172.21.15.73:0/751969711 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8800035b0 con 0x7fd8900c5b30 2024-05-08T21:53:54.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.764+0000 7fd88f7fe700 1 -- 172.21.15.73:0/751969711 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4126352037 0 0) 0x7fd8800035b0 con 0x7fd8900c5b30 2024-05-08T21:53:54.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.764+0000 7fd88f7fe700 1 -- 172.21.15.73:0/751969711 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd8900719f0 msgr2=0x7fd8901623a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:53:54.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.764+0000 7fd88f7fe700 1 --2- 172.21.15.73:0/751969711 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd8900719f0 0x7fd8901623a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:54.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.764+0000 7fd88f7fe700 1 -- 172.21.15.73:0/751969711 >> v2:172.21.15.115:3300/0 conn(0x7fd89006b580 msgr2=0x7fd8900c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:53:54.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.764+0000 7fd88f7fe700 1 --2- 172.21.15.73:0/751969711 >> v2:172.21.15.115:3300/0 conn(0x7fd89006b580 0x7fd8900c5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:54.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.764+0000 7fd88f7fe700 1 -- 172.21.15.73:0/751969711 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd890158740 con 0x7fd8900c5b30 2024-05-08T21:53:54.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.764+0000 7fd88f7fe700 1 -- 172.21.15.73:0/751969711 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 953298616 0 0) 0x7fd884001670 con 0x7fd8900c5b30 2024-05-08T21:53:54.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.764+0000 7fd88f7fe700 1 -- 172.21.15.73:0/751969711 >> v1:172.21.15.73:6789/0 conn(0x7fd8900c5b30 legacy=0x7fd89006fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:54.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.764+0000 7fd88f7fe700 1 --2- 172.21.15.73:0/751969711 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd8900719f0 0x7fd880003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:54.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.764+0000 7fd88f7fe700 1 --2- 172.21.15.73:0/751969711 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd880003f80 0x7fd880004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:54.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.764+0000 7fd88f7fe700 1 --2- 172.21.15.73:0/751969711 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd880004d90 0x7fd880005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:54.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.764+0000 7fd88f7fe700 1 -- 172.21.15.73:0/751969711 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8900c6450 con 0x7fd880003f80 2024-05-08T21:53:54.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.764+0000 7fd88f7fe700 1 -- 172.21.15.73:0/751969711 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd890070300 con 0x7fd880004d90 2024-05-08T21:53:54.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.764+0000 7fd88f7fe700 1 -- 172.21.15.73:0/751969711 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd88000ba60 con 0x7fd8900719f0 2024-05-08T21:53:54.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.764+0000 7fd88ffff700 1 --2- 172.21.15.73:0/751969711 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd880003f80 0x7fd880004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:54.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.764+0000 7fd894fbc700 1 --2- 172.21.15.73:0/751969711 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd8900719f0 0x7fd880003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:54.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.764+0000 7fd8957bd700 1 --2- 172.21.15.73:0/751969711 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd880004d90 0x7fd880005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:54.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.764+0000 7fd88ffff700 1 -- 172.21.15.73:0/751969711 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd8900719f0 msgr2=0x7fd880003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:53:54.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.764+0000 7fd88ffff700 1 --2- 172.21.15.73:0/751969711 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd8900719f0 0x7fd880003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:54.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.764+0000 7fd88ffff700 1 -- 172.21.15.73:0/751969711 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd880004d90 msgr2=0x7fd880005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:53:54.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.764+0000 7fd88ffff700 1 --2- 172.21.15.73:0/751969711 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd880004d90 0x7fd880005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:54.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.764+0000 7fd88ffff700 1 -- 172.21.15.73:0/751969711 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8800035b0 con 0x7fd880003f80 2024-05-08T21:53:54.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.764+0000 7fd88ffff700 1 --2- 172.21.15.73:0/751969711 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd880003f80 0x7fd880004850 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd87c009b90 tx=0x7fd880005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb546cc6da151a76 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:54.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.765+0000 7fd88f7fe700 1 -- 172.21.15.73:0/751969711 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd87c00e6c0 con 0x7fd880003f80 2024-05-08T21:53:54.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.765+0000 7fd88f7fe700 1 -- 172.21.15.73:0/751969711 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd87c00e820 con 0x7fd880003f80 2024-05-08T21:53:54.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.765+0000 7fd88f7fe700 1 -- 172.21.15.73:0/751969711 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd87c00eb90 con 0x7fd880003f80 2024-05-08T21:53:54.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.765+0000 7fd897220700 1 -- 172.21.15.73:0/751969711 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd880003f80 msgr2=0x7fd880004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:54.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.765+0000 7fd897220700 1 --2- 172.21.15.73:0/751969711 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd880003f80 0x7fd880004850 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd87c009b90 tx=0x7fd880005880 comp rx=0 tx=0).stop 2024-05-08T21:53:54.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.765+0000 7fd8957bd700 1 -- 172.21.15.73:0/751969711 reap_dead start 2024-05-08T21:53:54.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.765+0000 7fd897220700 1 -- 172.21.15.73:0/751969711 shutdown_connections 2024-05-08T21:53:54.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.765+0000 7fd897220700 1 -- 172.21.15.73:0/751969711 >> 172.21.15.73:0/751969711 conn(0x7fd89006bad0 msgr2=0x7fd89006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:53:54.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.765+0000 7fd897220700 1 -- 172.21.15.73:0/751969711 shutdown_connections 2024-05-08T21:53:54.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.765+0000 7fd897220700 1 -- 172.21.15.73:0/751969711 wait complete. 2024-05-08T21:53:54.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.766+0000 7fd897220700 1 Processor -- start 2024-05-08T21:53:54.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.766+0000 7fd897220700 1 -- start start 2024-05-08T21:53:54.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.767+0000 7fd897220700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd880003f80 0x7fd8901f0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:54.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.767+0000 7fd897220700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd890152ee0 0x7fd890153340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:54.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.767+0000 7fd897220700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd890144d80 0x7fd890145200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:54.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.767+0000 7fd897220700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8900cc830 con 0x7fd880003f80 2024-05-08T21:53:54.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.767+0000 7fd897220700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8900cba40 con 0x7fd890144d80 2024-05-08T21:53:54.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.767+0000 7fd897220700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd890153880 con 0x7fd890152ee0 2024-05-08T21:53:54.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.767+0000 7fd894fbc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd880003f80 0x7fd8901f0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:54.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.767+0000 7fd894fbc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd880003f80 0x7fd8901f0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56538/0 (socket says 172.21.15.73:56538) 2024-05-08T21:53:54.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.767+0000 7fd894fbc700 1 -- 172.21.15.73:0/3112568128 learned_addr learned my addr 172.21.15.73:0/3112568128 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:53:54.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.768+0000 7fd894fbc700 1 -- 172.21.15.73:0/3112568128 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd890152ee0 msgr2=0x7fd890153340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:54.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.768+0000 7fd894fbc700 1 --2- 172.21.15.73:0/3112568128 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd890152ee0 0x7fd890153340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:54.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.768+0000 7fd894fbc700 1 -- 172.21.15.73:0/3112568128 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd890144d80 msgr2=0x7fd890145200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:54.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.768+0000 7fd8957bd700 1 --2- 172.21.15.73:0/3112568128 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd890144d80 0x7fd890145200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:54.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.768+0000 7fd894fbc700 1 --2- 172.21.15.73:0/3112568128 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd890144d80 0x7fd890145200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:54.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.768+0000 7fd894fbc700 1 -- 172.21.15.73:0/3112568128 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd89014d5c0 con 0x7fd880003f80 2024-05-08T21:53:54.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.768+0000 7fd894fbc700 1 --2- 172.21.15.73:0/3112568128 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd880003f80 0x7fd8901f0070 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd884007310 tx=0x7fd884007620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:54.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.768+0000 7fd88d7fa700 1 -- 172.21.15.73:0/3112568128 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd884007800 con 0x7fd880003f80 2024-05-08T21:53:54.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.768+0000 7fd88d7fa700 1 -- 172.21.15.73:0/3112568128 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd88400f8d0 con 0x7fd880003f80 2024-05-08T21:53:54.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.768+0000 7fd897220700 1 -- 172.21.15.73:0/3112568128 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8901549c0 con 0x7fd880003f80 2024-05-08T21:53:54.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.768+0000 7fd88d7fa700 1 -- 172.21.15.73:0/3112568128 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88400fc40 con 0x7fd880003f80 2024-05-08T21:53:54.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.768+0000 7fd897220700 1 -- 172.21.15.73:0/3112568128 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8900ccc60 con 0x7fd880003f80 2024-05-08T21:53:54.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.769+0000 7fd897220700 1 -- 172.21.15.73:0/3112568128 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd890072320 con 0x7fd880003f80 2024-05-08T21:53:54.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.769+0000 7fd88d7fa700 1 -- 172.21.15.73:0/3112568128 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd88401d460 con 0x7fd880003f80 2024-05-08T21:53:54.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.770+0000 7fd88d7fa700 1 --2- 172.21.15.73:0/3112568128 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fd87406ac90 0x7fd87406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:54.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.770+0000 7fd88d7fa700 1 -- 172.21.15.73:0/3112568128 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5969+0+0 (secure 0 0 0) 0x7fd884089520 con 0x7fd880003f80 2024-05-08T21:53:54.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.770+0000 7fd88ffff700 1 --2- 172.21.15.73:0/3112568128 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fd87406ac90 0x7fd87406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:54.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.770+0000 7fd88d7fa700 1 --2- 172.21.15.73:0/3112568128 >> [v2:172.21.15.73:6808/47228,v1:172.21.15.73:6809/47228] conn(0x7fd874073150 0x7fd8740755f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:54.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.770+0000 7fd88d7fa700 1 -- 172.21.15.73:0/3112568128 --> [v2:172.21.15.73:6808/47228,v1:172.21.15.73:6809/47228] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd874075cc0 con 0x7fd874073150 2024-05-08T21:53:54.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.770+0000 7fd88d7fa700 1 -- 172.21.15.73:0/3112568128 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd88408bb80 con 0x7fd880003f80 2024-05-08T21:53:54.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.770+0000 7fd8957bd700 1 --2- 172.21.15.73:0/3112568128 >> [v2:172.21.15.73:6808/47228,v1:172.21.15.73:6809/47228] conn(0x7fd874073150 0x7fd8740755f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:54.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.770+0000 7fd88ffff700 1 --2- 172.21.15.73:0/3112568128 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fd87406ac90 0x7fd87406d150 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd89014c1d0 tx=0x7fd87c013000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:54.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.770+0000 7fd8957bd700 1 --2- 172.21.15.73:0/3112568128 >> [v2:172.21.15.73:6808/47228,v1:172.21.15.73:6809/47228] conn(0x7fd874073150 0x7fd8740755f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:54.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.771+0000 7fd88d7fa700 1 -- 172.21.15.73:0/3112568128 <== osd.0 v2:172.21.15.73:6808/47228 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fd874075cc0 con 0x7fd874073150 2024-05-08T21:53:54.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.786+0000 7fd897220700 1 -- 172.21.15.73:0/3112568128 --> [v2:172.21.15.73:6808/47228,v1:172.21.15.73:6809/47228] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd8900c7280 con 0x7fd874073150 2024-05-08T21:53:54.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.786+0000 7fd88d7fa700 1 -- 172.21.15.73:0/3112568128 <== osd.0 v2:172.21.15.73:6808/47228 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fd88800f040 con 0x7fd874073150 2024-05-08T21:53:54.787 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-05-08T21:53:54.788 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T21:53:54.788 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-05-08T21:53:54.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.786+0000 7fd897220700 1 -- 172.21.15.73:0/3112568128 >> [v2:172.21.15.73:6808/47228,v1:172.21.15.73:6809/47228] conn(0x7fd874073150 msgr2=0x7fd8740755f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:54.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.786+0000 7fd897220700 1 --2- 172.21.15.73:0/3112568128 >> [v2:172.21.15.73:6808/47228,v1:172.21.15.73:6809/47228] conn(0x7fd874073150 0x7fd8740755f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:54.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.786+0000 7fd897220700 1 -- 172.21.15.73:0/3112568128 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fd87406ac90 msgr2=0x7fd87406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:54.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.786+0000 7fd897220700 1 --2- 172.21.15.73:0/3112568128 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fd87406ac90 0x7fd87406d150 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd89014c1d0 tx=0x7fd87c013000 comp rx=0 tx=0).stop 2024-05-08T21:53:54.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.786+0000 7fd897220700 1 -- 172.21.15.73:0/3112568128 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd880003f80 msgr2=0x7fd8901f0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:54.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.786+0000 7fd897220700 1 --2- 172.21.15.73:0/3112568128 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd880003f80 0x7fd8901f0070 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd884007310 tx=0x7fd884007620 comp rx=0 tx=0).stop 2024-05-08T21:53:54.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.787+0000 7fd8957bd700 1 -- 172.21.15.73:0/3112568128 reap_dead start 2024-05-08T21:53:54.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.787+0000 7fd897220700 1 -- 172.21.15.73:0/3112568128 shutdown_connections 2024-05-08T21:53:54.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.787+0000 7fd897220700 1 -- 172.21.15.73:0/3112568128 >> 172.21.15.73:0/3112568128 conn(0x7fd89006bad0 msgr2=0x7fd89006fbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:53:54.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.787+0000 7fd897220700 1 -- 172.21.15.73:0/3112568128 shutdown_connections 2024-05-08T21:53:54.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.787+0000 7fd897220700 1 -- 172.21.15.73:0/3112568128 wait complete. 2024-05-08T21:53:54.800 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-05-08T21:53:54.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.921+0000 7f6a634e5700 1 Processor -- start 2024-05-08T21:53:54.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.921+0000 7f6a634e5700 1 -- start start 2024-05-08T21:53:54.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.922+0000 7f6a634e5700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a5c150b40 0x7f6a5c1571f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:54.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.922+0000 7f6a634e5700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6a5c0c65d0 0x7f6a5c0cc390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:54.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.922+0000 7f6a634e5700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a5c156d60 con 0x7f6a5c071db0 2024-05-08T21:53:54.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.922+0000 7f6a634e5700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a5c0722f0 con 0x7f6a5c0c65d0 2024-05-08T21:53:54.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.922+0000 7f6a634e5700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5c0c39c0 con 0x7f6a5c150b40 2024-05-08T21:53:54.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.922+0000 7f6a61a82700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f6a5c071db0 0x7f6a5c159ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:33624/0 (socket says 172.21.15.73:33624) 2024-05-08T21:53:54.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.922+0000 7f6a61a82700 1 -- 172.21.15.73:0/1759340717 learned_addr learned my addr 172.21.15.73:0/1759340717 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:53:54.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.922+0000 7f6a60a80700 1 --2- 172.21.15.73:0/1759340717 >> v2:172.21.15.115:3300/0 conn(0x7f6a5c0c65d0 0x7f6a5c0cc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:54.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.922+0000 7f6a61281700 1 --2- 172.21.15.73:0/1759340717 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a5c150b40 0x7f6a5c1571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:54.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.922+0000 7f6a53fff700 1 -- 172.21.15.73:0/1759340717 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3118393835 0 0) 0x7f6a5c156d60 con 0x7f6a5c071db0 2024-05-08T21:53:54.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.922+0000 7f6a53fff700 1 -- 172.21.15.73:0/1759340717 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a480057c0 con 0x7f6a5c071db0 2024-05-08T21:53:54.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.922+0000 7f6a60a80700 1 -- 172.21.15.73:0/1759340717 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a5c150b40 msgr2=0x7f6a5c1571f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:53:54.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.922+0000 7f6a60a80700 1 --2- 172.21.15.73:0/1759340717 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a5c150b40 0x7f6a5c1571f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:54.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.922+0000 7f6a60a80700 1 -- 172.21.15.73:0/1759340717 >> v1:172.21.15.73:6789/0 conn(0x7f6a5c071db0 legacy=0x7f6a5c159ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:54.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.922+0000 7f6a60a80700 1 -- 172.21.15.73:0/1759340717 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a5c0c3ca0 con 0x7f6a5c0c65d0 2024-05-08T21:53:54.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.923+0000 7f6a60a80700 1 --2- 172.21.15.73:0/1759340717 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a5c0c65d0 0x7f6a5c0cc390 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c009840 tx=0x7f6a4c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d049ebf2093fc67 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:54.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.923+0000 7f6a53fff700 1 -- 172.21.15.73:0/1759340717 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c011830 con 0x7f6a5c0c65d0 2024-05-08T21:53:54.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.923+0000 7f6a53fff700 1 -- 172.21.15.73:0/1759340717 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a4c011990 con 0x7f6a5c0c65d0 2024-05-08T21:53:54.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.923+0000 7f6a53fff700 1 -- 172.21.15.73:0/1759340717 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c011d00 con 0x7f6a5c0c65d0 2024-05-08T21:53:54.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.923+0000 7f6a634e5700 1 -- 172.21.15.73:0/1759340717 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a5c0c65d0 msgr2=0x7f6a5c0cc390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:54.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.923+0000 7f6a634e5700 1 --2- 172.21.15.73:0/1759340717 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a5c0c65d0 0x7f6a5c0cc390 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c009840 tx=0x7f6a4c009b50 comp rx=0 tx=0).stop 2024-05-08T21:53:54.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.923+0000 7f6a634e5700 1 -- 172.21.15.73:0/1759340717 shutdown_connections 2024-05-08T21:53:54.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.923+0000 7f6a634e5700 1 --2- 172.21.15.73:0/1759340717 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a5c150b40 0x7f6a5c1571f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:54.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.923+0000 7f6a634e5700 1 --2- 172.21.15.73:0/1759340717 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a5c0c65d0 0x7f6a5c0cc390 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:54.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.923+0000 7f6a634e5700 1 -- 172.21.15.73:0/1759340717 >> 172.21.15.73:0/1759340717 conn(0x7f6a5c066ab0 msgr2=0x7f6a5c06f550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:53:54.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.923+0000 7f6a634e5700 1 -- 172.21.15.73:0/1759340717 shutdown_connections 2024-05-08T21:53:54.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.923+0000 7f6a634e5700 1 -- 172.21.15.73:0/1759340717 wait complete. 2024-05-08T21:53:54.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.924+0000 7f6a634e5700 1 Processor -- start 2024-05-08T21:53:54.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.925+0000 7f6a634e5700 1 -- start start 2024-05-08T21:53:54.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.925+0000 7f6a634e5700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a5c071db0 0x7f6a5c1ebb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:54.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.925+0000 7f6a634e5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a5c0c65d0 0x7f6a5c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:54.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.925+0000 7f6a634e5700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a5c150b40 0x7f6a5c0cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:54.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.925+0000 7f6a634e5700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5c1ec0b0 con 0x7f6a5c0c65d0 2024-05-08T21:53:54.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.925+0000 7f6a634e5700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5c06a9c0 con 0x7f6a5c150b40 2024-05-08T21:53:54.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.925+0000 7f6a634e5700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5c06b950 con 0x7f6a5c071db0 2024-05-08T21:53:54.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.925+0000 7f6a60a80700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a5c0c65d0 0x7f6a5c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:54.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.925+0000 7f6a60a80700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a5c0c65d0 0x7f6a5c06b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56542/0 (socket says 172.21.15.73:56542) 2024-05-08T21:53:54.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.925+0000 7f6a60a80700 1 -- 172.21.15.73:0/2164593152 learned_addr learned my addr 172.21.15.73:0/2164593152 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:53:54.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.925+0000 7f6a61a82700 1 --2- 172.21.15.73:0/2164593152 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a5c150b40 0x7f6a5c0cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:54.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.926+0000 7f6a61281700 1 --2- 172.21.15.73:0/2164593152 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a5c071db0 0x7f6a5c1ebb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:54.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.926+0000 7f6a60a80700 1 -- 172.21.15.73:0/2164593152 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a5c071db0 msgr2=0x7f6a5c1ebb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:54.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.926+0000 7f6a60a80700 1 --2- 172.21.15.73:0/2164593152 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a5c071db0 0x7f6a5c1ebb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:54.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.926+0000 7f6a60a80700 1 -- 172.21.15.73:0/2164593152 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a5c150b40 msgr2=0x7f6a5c0cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:54.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.926+0000 7f6a60a80700 1 --2- 172.21.15.73:0/2164593152 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a5c150b40 0x7f6a5c0cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:54.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.926+0000 7f6a60a80700 1 -- 172.21.15.73:0/2164593152 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a4c0094a0 con 0x7f6a5c0c65d0 2024-05-08T21:53:54.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.926+0000 7f6a61a82700 1 --2- 172.21.15.73:0/2164593152 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a5c150b40 0x7f6a5c0cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:53:54.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.926+0000 7f6a61281700 1 --2- 172.21.15.73:0/2164593152 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a5c071db0 0x7f6a5c1ebb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:53:54.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.926+0000 7f6a60a80700 1 --2- 172.21.15.73:0/2164593152 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a5c0c65d0 0x7f6a5c06b410 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c0090b0 tx=0x7f6a4c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:54.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.926+0000 7f6a51ffb700 1 -- 172.21.15.73:0/2164593152 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c0045d0 con 0x7f6a5c0c65d0 2024-05-08T21:53:54.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.926+0000 7f6a51ffb700 1 -- 172.21.15.73:0/2164593152 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a4c01f070 con 0x7f6a5c0c65d0 2024-05-08T21:53:54.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.926+0000 7f6a51ffb700 1 -- 172.21.15.73:0/2164593152 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c0038a0 con 0x7f6a5c0c65d0 2024-05-08T21:53:54.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.926+0000 7f6a634e5700 1 -- 172.21.15.73:0/2164593152 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a5c06c180 con 0x7f6a5c0c65d0 2024-05-08T21:53:54.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.926+0000 7f6a634e5700 1 -- 172.21.15.73:0/2164593152 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a5c06c740 con 0x7f6a5c0c65d0 2024-05-08T21:53:54.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.927+0000 7f6a634e5700 1 -- 172.21.15.73:0/2164593152 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a5c068b80 con 0x7f6a5c0c65d0 2024-05-08T21:53:54.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.927+0000 7f6a51ffb700 1 -- 172.21.15.73:0/2164593152 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6a4c003a00 con 0x7f6a5c0c65d0 2024-05-08T21:53:54.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.928+0000 7f6a51ffb700 1 --2- 172.21.15.73:0/2164593152 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f6a4006ac90 0x7f6a4006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:54.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.928+0000 7f6a51ffb700 1 -- 172.21.15.73:0/2164593152 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5969+0+0 (secure 0 0 0) 0x7f6a4c021070 con 0x7f6a5c0c65d0 2024-05-08T21:53:54.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.928+0000 7f6a61281700 1 --2- 172.21.15.73:0/2164593152 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f6a4006ac90 0x7f6a4006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:54.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.928+0000 7f6a61281700 1 --2- 172.21.15.73:0/2164593152 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f6a4006ac90 0x7f6a4006d150 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6a58009b90 tx=0x7f6a58008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:54.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:54.933+0000 7f6a51ffb700 1 -- 172.21.15.73:0/2164593152 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f6a4c055e10 con 0x7f6a5c0c65d0 2024-05-08T21:53:55.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.135+0000 7f6a634e5700 1 -- 172.21.15.73:0/2164593152 --> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f6a5c15ae90 con 0x7f6a4006ac90 2024-05-08T21:53:55.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.135+0000 7f6a51ffb700 1 -- 172.21.15.73:0/2164593152 <== mgr.4104 v2:172.21.15.73:6832/46949 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6a5c15ae90 con 0x7f6a4006ac90 2024-05-08T21:53:55.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.138+0000 7f6a634e5700 1 -- 172.21.15.73:0/2164593152 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f6a4006ac90 msgr2=0x7f6a4006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:55.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.138+0000 7f6a634e5700 1 --2- 172.21.15.73:0/2164593152 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f6a4006ac90 0x7f6a4006d150 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6a58009b90 tx=0x7f6a58008040 comp rx=0 tx=0).stop 2024-05-08T21:53:55.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.138+0000 7f6a634e5700 1 -- 172.21.15.73:0/2164593152 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a5c0c65d0 msgr2=0x7f6a5c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:55.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.138+0000 7f6a634e5700 1 --2- 172.21.15.73:0/2164593152 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a5c0c65d0 0x7f6a5c06b410 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c0090b0 tx=0x7f6a4c004750 comp rx=0 tx=0).stop 2024-05-08T21:53:55.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.138+0000 7f6a634e5700 1 -- 172.21.15.73:0/2164593152 shutdown_connections 2024-05-08T21:53:55.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.138+0000 7f6a634e5700 1 --2- 172.21.15.73:0/2164593152 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f6a4006ac90 0x7f6a4006d150 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:55.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.138+0000 7f6a634e5700 1 --2- 172.21.15.73:0/2164593152 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a5c150b40 0x7f6a5c0cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:55.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.138+0000 7f6a634e5700 1 --2- 172.21.15.73:0/2164593152 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a5c071db0 0x7f6a5c1ebb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:55.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.138+0000 7f6a634e5700 1 --2- 172.21.15.73:0/2164593152 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a5c0c65d0 0x7f6a5c06b410 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:55.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.138+0000 7f6a634e5700 1 -- 172.21.15.73:0/2164593152 >> 172.21.15.73:0/2164593152 conn(0x7f6a5c066ab0 msgr2=0x7f6a5c14f020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:53:55.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.138+0000 7f6a634e5700 1 -- 172.21.15.73:0/2164593152 shutdown_connections 2024-05-08T21:53:55.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.138+0000 7f6a634e5700 1 -- 172.21.15.73:0/2164593152 wait complete. 2024-05-08T21:53:55.140 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 0 to deep-scrub 2024-05-08T21:53:55.151 INFO:tasks.ceph:Scrubbing osd.1 2024-05-08T21:53:55.151 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-05-08T21:53:55.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.275+0000 7f9c7fa76700 1 Processor -- start 2024-05-08T21:53:55.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.275+0000 7f9c7fa76700 1 -- start start 2024-05-08T21:53:55.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.276+0000 7f9c7fa76700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9c7806c070 0x7f9c780ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:55.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.276+0000 7f9c7fa76700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9c780cbf20 0x7f9c780cc390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:55.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.276+0000 7f9c7fa76700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c78154320 con 0x7f9c78153f40 2024-05-08T21:53:55.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.276+0000 7f9c7fa76700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c7815acb0 con 0x7f9c780cbf20 2024-05-08T21:53:55.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.276+0000 7f9c7fa76700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c7815a410 con 0x7f9c7806c070 2024-05-08T21:53:55.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.276+0000 7f9c7e013700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9c780cbf20 0x7f9c780cc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:55.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.276+0000 7f9c7e013700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9c780cbf20 0x7f9c780cc390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56546/0 (socket says 172.21.15.73:56546) 2024-05-08T21:53:55.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.276+0000 7f9c7e013700 1 -- 172.21.15.73:0/1721657507 learned_addr learned my addr 172.21.15.73:0/1721657507 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:53:55.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.276+0000 7f9c7d011700 1 --2- 172.21.15.73:0/1721657507 >> v2:172.21.15.115:3300/0 conn(0x7f9c7806c070 0x7f9c780ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:55.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.276+0000 7f9c7e013700 1 -- 172.21.15.73:0/1721657507 >> v2:172.21.15.115:3300/0 conn(0x7f9c7806c070 msgr2=0x7f9c780ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:53:55.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.276+0000 7f9c7e013700 1 --2- 172.21.15.73:0/1721657507 >> v2:172.21.15.115:3300/0 conn(0x7f9c7806c070 0x7f9c780ca490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:55.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.276+0000 7f9c7e013700 1 -- 172.21.15.73:0/1721657507 >> v1:172.21.15.115:6789/0 conn(0x7f9c78153f40 legacy=0x7f9c78159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:55.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.276+0000 7f9c7e013700 1 -- 172.21.15.73:0/1721657507 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c7815a6f0 con 0x7f9c780cbf20 2024-05-08T21:53:55.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.276+0000 7f9c7e013700 1 --2- 172.21.15.73:0/1721657507 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c780cbf20 0x7f9c780cc390 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9c7808d630 tx=0x7f9c7000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de8b6520290e51a9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:55.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.277+0000 7f9c7c810700 1 -- 172.21.15.73:0/1721657507 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7000e070 con 0x7f9c780cbf20 2024-05-08T21:53:55.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.277+0000 7f9c7c810700 1 -- 172.21.15.73:0/1721657507 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c7000b910 con 0x7f9c780cbf20 2024-05-08T21:53:55.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.278+0000 7f9c7c810700 1 -- 172.21.15.73:0/1721657507 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7000bcc0 con 0x7f9c780cbf20 2024-05-08T21:53:55.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.278+0000 7f9c7fa76700 1 -- 172.21.15.73:0/1721657507 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c780cbf20 msgr2=0x7f9c780cc390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:55.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.278+0000 7f9c7fa76700 1 --2- 172.21.15.73:0/1721657507 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c780cbf20 0x7f9c780cc390 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9c7808d630 tx=0x7f9c7000b330 comp rx=0 tx=0).stop 2024-05-08T21:53:55.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.278+0000 7f9c7fa76700 1 -- 172.21.15.73:0/1721657507 shutdown_connections 2024-05-08T21:53:55.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.278+0000 7f9c7fa76700 1 --2- 172.21.15.73:0/1721657507 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c780cbf20 0x7f9c780cc390 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:55.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.278+0000 7f9c7fa76700 1 --2- 172.21.15.73:0/1721657507 >> v2:172.21.15.115:3300/0 conn(0x7f9c7806c070 0x7f9c780ca490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:55.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.278+0000 7f9c7fa76700 1 -- 172.21.15.73:0/1721657507 >> 172.21.15.73:0/1721657507 conn(0x7f9c780666c0 msgr2=0x7f9c78066ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:53:55.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.278+0000 7f9c7fa76700 1 -- 172.21.15.73:0/1721657507 shutdown_connections 2024-05-08T21:53:55.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.278+0000 7f9c7fa76700 1 -- 172.21.15.73:0/1721657507 wait complete. 2024-05-08T21:53:55.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.279+0000 7f9c7fa76700 1 Processor -- start 2024-05-08T21:53:55.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.279+0000 7f9c7fa76700 1 -- start start 2024-05-08T21:53:55.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.280+0000 7f9c7fa76700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9c7806c070 0x7f9c780c5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:55.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.280+0000 7f9c7fa76700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c780cbf20 0x7f9c780c5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:55.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.280+0000 7f9c7fa76700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c78153f40 0x7f9c780b3450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:55.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.280+0000 7f9c7fa76700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c78158140 con 0x7f9c78153f40 2024-05-08T21:53:55.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.280+0000 7f9c7fa76700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c78158810 con 0x7f9c780cbf20 2024-05-08T21:53:55.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.280+0000 7f9c7fa76700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c78158ab0 con 0x7f9c7806c070 2024-05-08T21:53:55.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.280+0000 7f9c7e013700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c78153f40 0x7f9c780b3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:55.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.280+0000 7f9c7e013700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c78153f40 0x7f9c780b3450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56558/0 (socket says 172.21.15.73:56558) 2024-05-08T21:53:55.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.280+0000 7f9c7e013700 1 -- 172.21.15.73:0/1664347141 learned_addr learned my addr 172.21.15.73:0/1664347141 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:53:55.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.280+0000 7f9c7d812700 1 --2- 172.21.15.73:0/1664347141 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9c7806c070 0x7f9c780c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:55.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.280+0000 7f9c7d011700 1 --2- 172.21.15.73:0/1664347141 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c780cbf20 0x7f9c780c5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:55.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.280+0000 7f9c7e013700 1 -- 172.21.15.73:0/1664347141 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9c7806c070 msgr2=0x7f9c780c5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:55.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.280+0000 7f9c7e013700 1 --2- 172.21.15.73:0/1664347141 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9c7806c070 0x7f9c780c5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:55.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.280+0000 7f9c7e013700 1 -- 172.21.15.73:0/1664347141 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c780cbf20 msgr2=0x7f9c780c5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:55.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.280+0000 7f9c7e013700 1 --2- 172.21.15.73:0/1664347141 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c780cbf20 0x7f9c780c5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:55.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.280+0000 7f9c7e013700 1 -- 172.21.15.73:0/1664347141 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c70009b30 con 0x7f9c78153f40 2024-05-08T21:53:55.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.280+0000 7f9c7d011700 1 --2- 172.21.15.73:0/1664347141 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c780cbf20 0x7f9c780c5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:53:55.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.281+0000 7f9c7e013700 1 --2- 172.21.15.73:0/1664347141 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c78153f40 0x7f9c780b3450 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9c780cce20 tx=0x7f9c70004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:55.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.281+0000 7f9c6e7fc700 1 -- 172.21.15.73:0/1664347141 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c700099b0 con 0x7f9c78153f40 2024-05-08T21:53:55.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.281+0000 7f9c6e7fc700 1 -- 172.21.15.73:0/1664347141 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c700092e0 con 0x7f9c78153f40 2024-05-08T21:53:55.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.281+0000 7f9c7fa76700 1 -- 172.21.15.73:0/1664347141 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c781ef7a0 con 0x7f9c78153f40 2024-05-08T21:53:55.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.281+0000 7f9c6e7fc700 1 -- 172.21.15.73:0/1664347141 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7001c640 con 0x7f9c78153f40 2024-05-08T21:53:55.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.281+0000 7f9c7fa76700 1 -- 172.21.15.73:0/1664347141 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c781efd60 con 0x7f9c78153f40 2024-05-08T21:53:55.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.282+0000 7f9c7fa76700 1 -- 172.21.15.73:0/1664347141 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9c7806bb50 con 0x7f9c78153f40 2024-05-08T21:53:55.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.282+0000 7f9c6e7fc700 1 -- 172.21.15.73:0/1664347141 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9c7001c7a0 con 0x7f9c78153f40 2024-05-08T21:53:55.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.282+0000 7f9c6e7fc700 1 --2- 172.21.15.73:0/1664347141 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f9c5c06ac90 0x7f9c5c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:55.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.283+0000 7f9c6e7fc700 1 -- 172.21.15.73:0/1664347141 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5969+0+0 (secure 0 0 0) 0x7f9c7008ad90 con 0x7f9c78153f40 2024-05-08T21:53:55.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.283+0000 7f9c7d812700 1 --2- 172.21.15.73:0/1664347141 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f9c5c06ac90 0x7f9c5c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:55.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.283+0000 7f9c6e7fc700 1 --2- 172.21.15.73:0/1664347141 >> [v2:172.21.15.73:6800/47227,v1:172.21.15.73:6801/47227] conn(0x7f9c5c073150 0x7f9c5c0755f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:55.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.283+0000 7f9c6e7fc700 1 -- 172.21.15.73:0/1664347141 --> [v2:172.21.15.73:6800/47227,v1:172.21.15.73:6801/47227] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9c5c075cc0 con 0x7f9c5c073150 2024-05-08T21:53:55.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.283+0000 7f9c6e7fc700 1 -- 172.21.15.73:0/1664347141 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9c7008d450 con 0x7f9c78153f40 2024-05-08T21:53:55.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.283+0000 7f9c7d011700 1 --2- 172.21.15.73:0/1664347141 >> [v2:172.21.15.73:6800/47227,v1:172.21.15.73:6801/47227] conn(0x7f9c5c073150 0x7f9c5c0755f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:55.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.283+0000 7f9c7d812700 1 --2- 172.21.15.73:0/1664347141 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f9c5c06ac90 0x7f9c5c06d150 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9c74000f60 tx=0x7f9c74009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:55.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.283+0000 7f9c7d011700 1 --2- 172.21.15.73:0/1664347141 >> [v2:172.21.15.73:6800/47227,v1:172.21.15.73:6801/47227] conn(0x7f9c5c073150 0x7f9c5c0755f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:55.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.284+0000 7f9c6e7fc700 1 -- 172.21.15.73:0/1664347141 <== osd.1 v2:172.21.15.73:6800/47227 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f9c5c075cc0 con 0x7f9c5c073150 2024-05-08T21:53:55.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.298+0000 7f9c7fa76700 1 -- 172.21.15.73:0/1664347141 --> [v2:172.21.15.73:6800/47227,v1:172.21.15.73:6801/47227] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9c7806b870 con 0x7f9c5c073150 2024-05-08T21:53:55.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.298+0000 7f9c6e7fc700 1 -- 172.21.15.73:0/1664347141 <== osd.1 v2:172.21.15.73:6800/47227 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f9c68009bf0 con 0x7f9c5c073150 2024-05-08T21:53:55.299 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-05-08T21:53:55.300 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T21:53:55.300 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-05-08T21:53:55.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.298+0000 7f9c7fa76700 1 -- 172.21.15.73:0/1664347141 >> [v2:172.21.15.73:6800/47227,v1:172.21.15.73:6801/47227] conn(0x7f9c5c073150 msgr2=0x7f9c5c0755f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:55.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.298+0000 7f9c7fa76700 1 --2- 172.21.15.73:0/1664347141 >> [v2:172.21.15.73:6800/47227,v1:172.21.15.73:6801/47227] conn(0x7f9c5c073150 0x7f9c5c0755f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:55.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.298+0000 7f9c7fa76700 1 -- 172.21.15.73:0/1664347141 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f9c5c06ac90 msgr2=0x7f9c5c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:55.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.298+0000 7f9c7fa76700 1 --2- 172.21.15.73:0/1664347141 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f9c5c06ac90 0x7f9c5c06d150 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9c74000f60 tx=0x7f9c74009040 comp rx=0 tx=0).stop 2024-05-08T21:53:55.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.298+0000 7f9c7fa76700 1 -- 172.21.15.73:0/1664347141 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c78153f40 msgr2=0x7f9c780b3450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:55.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.298+0000 7f9c7fa76700 1 --2- 172.21.15.73:0/1664347141 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c78153f40 0x7f9c780b3450 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9c780cce20 tx=0x7f9c70004ad0 comp rx=0 tx=0).stop 2024-05-08T21:53:55.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.298+0000 7f9c7e013700 1 -- 172.21.15.73:0/1664347141 reap_dead start 2024-05-08T21:53:55.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.298+0000 7f9c7fa76700 1 -- 172.21.15.73:0/1664347141 shutdown_connections 2024-05-08T21:53:55.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.298+0000 7f9c7fa76700 1 -- 172.21.15.73:0/1664347141 >> 172.21.15.73:0/1664347141 conn(0x7f9c780666c0 msgr2=0x7f9c780cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:53:55.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.299+0000 7f9c7fa76700 1 -- 172.21.15.73:0/1664347141 shutdown_connections 2024-05-08T21:53:55.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.299+0000 7f9c7fa76700 1 -- 172.21.15.73:0/1664347141 wait complete. 2024-05-08T21:53:55.311 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-05-08T21:53:55.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.433+0000 7f55fd65b700 1 Processor -- start 2024-05-08T21:53:55.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.433+0000 7f55fd65b700 1 -- start start 2024-05-08T21:53:55.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.434+0000 7f55fd65b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f55f8153c00 0x7f55f80720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:55.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.434+0000 7f55fd65b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f55f80cb690 0x7f55f80c9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:55.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.434+0000 7f55fd65b700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55f80729f0 con 0x7f55f80ca3a0 2024-05-08T21:53:55.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.434+0000 7f55fd65b700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55f80ca7b0 con 0x7f55f80cb690 2024-05-08T21:53:55.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.434+0000 7f55fd65b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55f8153fe0 con 0x7f55f8153c00 2024-05-08T21:53:55.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.434+0000 7f55f67fc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f55f80cb690 0x7f55f80c9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:55.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.434+0000 7f55f6ffd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f55f8153c00 0x7f55f80720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:55.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.434+0000 7f55f67fc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f55f80cb690 0x7f55f80c9e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.73:60544/0 (socket says 172.21.15.73:60544) 2024-05-08T21:53:55.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.434+0000 7f55f67fc700 1 -- 172.21.15.73:0/1482392124 learned_addr learned my addr 172.21.15.73:0/1482392124 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:53:55.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.434+0000 7f55f77fe700 1 --1- 172.21.15.73:0/1482392124 >> v1:172.21.15.115:6789/0 conn(0x7f55f80ca3a0 0x7f55f815d170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.73:40854/0 (socket says 172.21.15.73:40854) 2024-05-08T21:53:55.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.434+0000 7f55f6ffd700 1 -- 172.21.15.73:0/1482392124 >> v2:172.21.15.115:3300/0 conn(0x7f55f80cb690 msgr2=0x7f55f80c9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:53:55.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.434+0000 7f55f6ffd700 1 --2- 172.21.15.73:0/1482392124 >> v2:172.21.15.115:3300/0 conn(0x7f55f80cb690 0x7f55f80c9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:55.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.434+0000 7f55f6ffd700 1 -- 172.21.15.73:0/1482392124 >> v1:172.21.15.115:6789/0 conn(0x7f55f80ca3a0 legacy=0x7f55f815d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:55.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.434+0000 7f55f6ffd700 1 -- 172.21.15.73:0/1482392124 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f815a800 con 0x7f55f8153c00 2024-05-08T21:53:55.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.434+0000 7f55f67fc700 1 --2- 172.21.15.73:0/1482392124 >> v2:172.21.15.115:3300/0 conn(0x7f55f80cb690 0x7f55f80c9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:53:55.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.435+0000 7f55f6ffd700 1 --2- 172.21.15.73:0/1482392124 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f55f8153c00 0x7f55f80720f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f55ec009840 tx=0x7f55ec009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=106fc27a70d3396c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:55.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.435+0000 7f55f5ffb700 1 -- 172.21.15.73:0/1482392124 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ec011830 con 0x7f55f8153c00 2024-05-08T21:53:55.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.435+0000 7f55f5ffb700 1 -- 172.21.15.73:0/1482392124 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55ec011990 con 0x7f55f8153c00 2024-05-08T21:53:55.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.435+0000 7f55f5ffb700 1 -- 172.21.15.73:0/1482392124 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ec011d20 con 0x7f55f8153c00 2024-05-08T21:53:55.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.435+0000 7f55fd65b700 1 -- 172.21.15.73:0/1482392124 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f55f8153c00 msgr2=0x7f55f80720f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:55.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.435+0000 7f55fd65b700 1 --2- 172.21.15.73:0/1482392124 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f55f8153c00 0x7f55f80720f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f55ec009840 tx=0x7f55ec009b50 comp rx=0 tx=0).stop 2024-05-08T21:53:55.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.435+0000 7f55fd65b700 1 -- 172.21.15.73:0/1482392124 shutdown_connections 2024-05-08T21:53:55.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.435+0000 7f55fd65b700 1 --2- 172.21.15.73:0/1482392124 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f55f8153c00 0x7f55f80720f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:55.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.435+0000 7f55fd65b700 1 --2- 172.21.15.73:0/1482392124 >> v2:172.21.15.115:3300/0 conn(0x7f55f80cb690 0x7f55f80c9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:55.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.435+0000 7f55fd65b700 1 -- 172.21.15.73:0/1482392124 >> 172.21.15.73:0/1482392124 conn(0x7f55f806be70 msgr2=0x7f55f806c380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:53:55.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.435+0000 7f55fd65b700 1 -- 172.21.15.73:0/1482392124 shutdown_connections 2024-05-08T21:53:55.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.435+0000 7f55fd65b700 1 -- 172.21.15.73:0/1482392124 wait complete. 2024-05-08T21:53:55.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.437+0000 7f55fd65b700 1 Processor -- start 2024-05-08T21:53:55.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.437+0000 7f55fd65b700 1 -- start start 2024-05-08T21:53:55.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.437+0000 7f55fd65b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55f80ca3a0 0x7f55f80ce520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:55.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.437+0000 7f55fd65b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f55f80cb690 0x7f55f81efc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:55.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.437+0000 7f55fd65b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55f8153c00 0x7f55f81f01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:55.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.437+0000 7f55fd65b700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f81480a0 con 0x7f55f80ca3a0 2024-05-08T21:53:55.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.437+0000 7f55fd65b700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f8148380 con 0x7f55f8153c00 2024-05-08T21:53:55.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.437+0000 7f55fd65b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55f8149d90 con 0x7f55f80cb690 2024-05-08T21:53:55.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.438+0000 7f55f6ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55f80ca3a0 0x7f55f80ce520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:55.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.438+0000 7f55f6ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55f80ca3a0 0x7f55f80ce520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56566/0 (socket says 172.21.15.73:56566) 2024-05-08T21:53:55.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.438+0000 7f55f6ffd700 1 -- 172.21.15.73:0/4167766937 learned_addr learned my addr 172.21.15.73:0/4167766937 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:53:55.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.438+0000 7f55f77fe700 1 --2- 172.21.15.73:0/4167766937 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55f8153c00 0x7f55f81f01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:55.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.438+0000 7f55f67fc700 1 --2- 172.21.15.73:0/4167766937 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f55f80cb690 0x7f55f81efc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:55.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.438+0000 7f55f6ffd700 1 -- 172.21.15.73:0/4167766937 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f55f80cb690 msgr2=0x7f55f81efc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:55.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.438+0000 7f55f6ffd700 1 --2- 172.21.15.73:0/4167766937 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f55f80cb690 0x7f55f81efc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:55.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.438+0000 7f55f6ffd700 1 -- 172.21.15.73:0/4167766937 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55f8153c00 msgr2=0x7f55f81f01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:55.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.438+0000 7f55f6ffd700 1 --2- 172.21.15.73:0/4167766937 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55f8153c00 0x7f55f81f01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:55.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.438+0000 7f55f6ffd700 1 -- 172.21.15.73:0/4167766937 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55e8009550 con 0x7f55f80ca3a0 2024-05-08T21:53:55.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.438+0000 7f55f6ffd700 1 --2- 172.21.15.73:0/4167766937 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55f80ca3a0 0x7f55f80ce520 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f55ec009fd0 tx=0x7f55ec004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:55.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.438+0000 7f55df7fe700 1 -- 172.21.15.73:0/4167766937 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ec0036a0 con 0x7f55f80ca3a0 2024-05-08T21:53:55.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.438+0000 7f55df7fe700 1 -- 172.21.15.73:0/4167766937 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55ec01f070 con 0x7f55f80ca3a0 2024-05-08T21:53:55.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.438+0000 7f55fd65b700 1 -- 172.21.15.73:0/4167766937 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55ec0094a0 con 0x7f55f80ca3a0 2024-05-08T21:53:55.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.438+0000 7f55df7fe700 1 -- 172.21.15.73:0/4167766937 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ec003a20 con 0x7f55f80ca3a0 2024-05-08T21:53:55.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.438+0000 7f55fd65b700 1 -- 172.21.15.73:0/4167766937 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55f814a350 con 0x7f55f80ca3a0 2024-05-08T21:53:55.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.439+0000 7f55fd65b700 1 -- 172.21.15.73:0/4167766937 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55f81582e0 con 0x7f55f80ca3a0 2024-05-08T21:53:55.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.439+0000 7f55df7fe700 1 -- 172.21.15.73:0/4167766937 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f55ec003b80 con 0x7f55f80ca3a0 2024-05-08T21:53:55.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.440+0000 7f55df7fe700 1 --2- 172.21.15.73:0/4167766937 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f55e406ac90 0x7f55e406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:55.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.440+0000 7f55df7fe700 1 -- 172.21.15.73:0/4167766937 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5969+0+0 (secure 0 0 0) 0x7f55ec021070 con 0x7f55f80ca3a0 2024-05-08T21:53:55.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.440+0000 7f55f67fc700 1 --2- 172.21.15.73:0/4167766937 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f55e406ac90 0x7f55e406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:55.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.440+0000 7f55f67fc700 1 --2- 172.21.15.73:0/4167766937 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f55e406ac90 0x7f55e406d150 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f55f814d3d0 tx=0x7f55e8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:55.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.444+0000 7f55df7fe700 1 -- 172.21.15.73:0/4167766937 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f55ec055840 con 0x7f55f80ca3a0 2024-05-08T21:53:55.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.642+0000 7f55fd65b700 1 -- 172.21.15.73:0/4167766937 --> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f55f8159f30 con 0x7f55e406ac90 2024-05-08T21:53:55.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.642+0000 7f55df7fe700 1 -- 172.21.15.73:0/4167766937 <== mgr.4104 v2:172.21.15.73:6832/46949 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f55e8009e00 con 0x7f55e406ac90 2024-05-08T21:53:55.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.645+0000 7f55fd65b700 1 -- 172.21.15.73:0/4167766937 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f55e406ac90 msgr2=0x7f55e406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:55.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.645+0000 7f55fd65b700 1 --2- 172.21.15.73:0/4167766937 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f55e406ac90 0x7f55e406d150 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f55f814d3d0 tx=0x7f55e8008040 comp rx=0 tx=0).stop 2024-05-08T21:53:55.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.645+0000 7f55fd65b700 1 -- 172.21.15.73:0/4167766937 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55f80ca3a0 msgr2=0x7f55f80ce520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:55.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.645+0000 7f55fd65b700 1 --2- 172.21.15.73:0/4167766937 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55f80ca3a0 0x7f55f80ce520 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f55ec009fd0 tx=0x7f55ec004750 comp rx=0 tx=0).stop 2024-05-08T21:53:55.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.645+0000 7f55fd65b700 1 -- 172.21.15.73:0/4167766937 shutdown_connections 2024-05-08T21:53:55.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.645+0000 7f55fd65b700 1 --2- 172.21.15.73:0/4167766937 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f55e406ac90 0x7f55e406d150 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:55.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.645+0000 7f55fd65b700 1 --2- 172.21.15.73:0/4167766937 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55f8153c00 0x7f55f81f01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:55.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.645+0000 7f55fd65b700 1 --2- 172.21.15.73:0/4167766937 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55f80ca3a0 0x7f55f80ce520 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:55.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.645+0000 7f55fd65b700 1 --2- 172.21.15.73:0/4167766937 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f55f80cb690 0x7f55f81efc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:55.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.645+0000 7f55fd65b700 1 -- 172.21.15.73:0/4167766937 >> 172.21.15.73:0/4167766937 conn(0x7f55f806be70 msgr2=0x7f55f8158700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:53:55.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.645+0000 7f55fd65b700 1 -- 172.21.15.73:0/4167766937 shutdown_connections 2024-05-08T21:53:55.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.645+0000 7f55fd65b700 1 -- 172.21.15.73:0/4167766937 wait complete. 2024-05-08T21:53:55.649 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 1 to deep-scrub 2024-05-08T21:53:55.658 INFO:tasks.ceph:Scrubbing osd.2 2024-05-08T21:53:55.658 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-05-08T21:53:55.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.784+0000 7ff27e92b700 1 Processor -- start 2024-05-08T21:53:55.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.784+0000 7ff27e92b700 1 -- start start 2024-05-08T21:53:55.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.784+0000 7ff27e92b700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff278153eb0 0x7ff27806fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:55.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.784+0000 7ff27e92b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff278154290 0x7ff2780c8e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:55.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.785+0000 7ff27e92b700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2780c85f0 con 0x7ff27806ee90 2024-05-08T21:53:55.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.785+0000 7ff27e92b700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff27806f410 con 0x7ff278153eb0 2024-05-08T21:53:55.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.785+0000 7ff27e92b700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff27806f6b0 con 0x7ff278154290 2024-05-08T21:53:55.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.785+0000 7ff277fff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff278153eb0 0x7ff27806fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:55.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.785+0000 7ff277fff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff278153eb0 0x7ff27806fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56582/0 (socket says 172.21.15.73:56582) 2024-05-08T21:53:55.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.785+0000 7ff27cec8700 1 --1- 172.21.15.73:0/6910925 >> v1:172.21.15.73:6789/0 conn(0x7ff27806ee90 0x7ff278159d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:33640/0 (socket says 172.21.15.73:33640) 2024-05-08T21:53:55.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.785+0000 7ff277fff700 1 -- 172.21.15.73:0/6910925 learned_addr learned my addr 172.21.15.73:0/6910925 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:53:55.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.785+0000 7ff2777fe700 1 --2- 172.21.15.73:0/6910925 >> v2:172.21.15.115:3300/0 conn(0x7ff278154290 0x7ff2780c8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:55.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.785+0000 7ff277fff700 1 -- 172.21.15.73:0/6910925 >> v2:172.21.15.115:3300/0 conn(0x7ff278154290 msgr2=0x7ff2780c8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:53:55.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.785+0000 7ff277fff700 1 --2- 172.21.15.73:0/6910925 >> v2:172.21.15.115:3300/0 conn(0x7ff278154290 0x7ff2780c8e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:55.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.785+0000 7ff277fff700 1 -- 172.21.15.73:0/6910925 >> v1:172.21.15.73:6789/0 conn(0x7ff27806ee90 legacy=0x7ff278159d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:55.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.785+0000 7ff277fff700 1 -- 172.21.15.73:0/6910925 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff27806f970 con 0x7ff278153eb0 2024-05-08T21:53:55.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.785+0000 7ff277fff700 1 --2- 172.21.15.73:0/6910925 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff278153eb0 0x7ff27806fc80 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff27806cab0 tx=0x7ff268009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=974960fdc7da6a26 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:55.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.785+0000 7ff276ffd700 1 -- 172.21.15.73:0/6910925 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26800b870 con 0x7ff278153eb0 2024-05-08T21:53:55.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.785+0000 7ff276ffd700 1 -- 172.21.15.73:0/6910925 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff26800b9d0 con 0x7ff278153eb0 2024-05-08T21:53:55.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.785+0000 7ff276ffd700 1 -- 172.21.15.73:0/6910925 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26800bd60 con 0x7ff278153eb0 2024-05-08T21:53:55.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.786+0000 7ff27e92b700 1 -- 172.21.15.73:0/6910925 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff278153eb0 msgr2=0x7ff27806fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:55.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.786+0000 7ff27e92b700 1 --2- 172.21.15.73:0/6910925 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff278153eb0 0x7ff27806fc80 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff27806cab0 tx=0x7ff268009bd0 comp rx=0 tx=0).stop 2024-05-08T21:53:55.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.786+0000 7ff27e92b700 1 -- 172.21.15.73:0/6910925 shutdown_connections 2024-05-08T21:53:55.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.786+0000 7ff27e92b700 1 --2- 172.21.15.73:0/6910925 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff278153eb0 0x7ff27806fc80 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:55.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.786+0000 7ff27e92b700 1 --2- 172.21.15.73:0/6910925 >> v2:172.21.15.115:3300/0 conn(0x7ff278154290 0x7ff2780c8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:55.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.786+0000 7ff27e92b700 1 -- 172.21.15.73:0/6910925 >> 172.21.15.73:0/6910925 conn(0x7ff27806bad0 msgr2=0x7ff27806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:53:55.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.786+0000 7ff27e92b700 1 -- 172.21.15.73:0/6910925 shutdown_connections 2024-05-08T21:53:55.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.786+0000 7ff27e92b700 1 -- 172.21.15.73:0/6910925 wait complete. 2024-05-08T21:53:55.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.787+0000 7ff27e92b700 1 Processor -- start 2024-05-08T21:53:55.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.787+0000 7ff27e92b700 1 -- start start 2024-05-08T21:53:55.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.788+0000 7ff27e92b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff27806ee90 0x7ff2781f01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:55.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.788+0000 7ff27e92b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff278153eb0 0x7ff278150800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:55.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.788+0000 7ff27e92b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff278158590 0x7ff2780cc910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:55.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.788+0000 7ff27e92b700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2781f0720 con 0x7ff278153eb0 2024-05-08T21:53:55.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.788+0000 7ff27e92b700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2781efd50 con 0x7ff278158590 2024-05-08T21:53:55.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.788+0000 7ff27e92b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff278158990 con 0x7ff27806ee90 2024-05-08T21:53:55.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.788+0000 7ff2777fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff278153eb0 0x7ff278150800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:55.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.788+0000 7ff2777fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff278153eb0 0x7ff278150800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56586/0 (socket says 172.21.15.73:56586) 2024-05-08T21:53:55.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.788+0000 7ff2777fe700 1 -- 172.21.15.73:0/2480853617 learned_addr learned my addr 172.21.15.73:0/2480853617 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:53:55.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.788+0000 7ff27cec8700 1 --2- 172.21.15.73:0/2480853617 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff278158590 0x7ff2780cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:55.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.788+0000 7ff277fff700 1 --2- 172.21.15.73:0/2480853617 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff27806ee90 0x7ff2781f01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:55.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.788+0000 7ff2777fe700 1 -- 172.21.15.73:0/2480853617 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff27806ee90 msgr2=0x7ff2781f01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:55.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.788+0000 7ff2777fe700 1 --2- 172.21.15.73:0/2480853617 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff27806ee90 0x7ff2781f01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:55.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.788+0000 7ff2777fe700 1 -- 172.21.15.73:0/2480853617 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff278158590 msgr2=0x7ff2780cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:55.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.788+0000 7ff2777fe700 1 --2- 172.21.15.73:0/2480853617 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff278158590 0x7ff2780cc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:55.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.788+0000 7ff2777fe700 1 -- 172.21.15.73:0/2480853617 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff268009550 con 0x7ff278153eb0 2024-05-08T21:53:55.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.788+0000 7ff277fff700 1 --2- 172.21.15.73:0/2480853617 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff27806ee90 0x7ff2781f01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:53:55.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.789+0000 7ff2777fe700 1 --2- 172.21.15.73:0/2480853617 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff278153eb0 0x7ff278150800 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff26c00d800 tx=0x7ff26c00dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:55.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.789+0000 7ff274ff9700 1 -- 172.21.15.73:0/2480853617 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26c0125f0 con 0x7ff278153eb0 2024-05-08T21:53:55.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.789+0000 7ff274ff9700 1 -- 172.21.15.73:0/2480853617 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff26c012750 con 0x7ff278153eb0 2024-05-08T21:53:55.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.789+0000 7ff27e92b700 1 -- 172.21.15.73:0/2480853617 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff278151320 con 0x7ff278153eb0 2024-05-08T21:53:55.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.789+0000 7ff274ff9700 1 -- 172.21.15.73:0/2480853617 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26c012b00 con 0x7ff278153eb0 2024-05-08T21:53:55.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.789+0000 7ff27e92b700 1 -- 172.21.15.73:0/2480853617 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff278158bf0 con 0x7ff278153eb0 2024-05-08T21:53:55.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.790+0000 7ff27e92b700 1 -- 172.21.15.73:0/2480853617 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff2780c7df0 con 0x7ff278153eb0 2024-05-08T21:53:55.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.790+0000 7ff274ff9700 1 -- 172.21.15.73:0/2480853617 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff26c012c60 con 0x7ff278153eb0 2024-05-08T21:53:55.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.791+0000 7ff274ff9700 1 --2- 172.21.15.73:0/2480853617 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7ff26406ac90 0x7ff26406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:55.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.791+0000 7ff274ff9700 1 -- 172.21.15.73:0/2480853617 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5969+0+0 (secure 0 0 0) 0x7ff26c0895a0 con 0x7ff278153eb0 2024-05-08T21:53:55.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.791+0000 7ff277fff700 1 --2- 172.21.15.73:0/2480853617 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7ff26406ac90 0x7ff26406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:55.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.791+0000 7ff274ff9700 1 --2- 172.21.15.73:0/2480853617 >> [v2:172.21.15.73:6816/47229,v1:172.21.15.73:6817/47229] conn(0x7ff264073150 0x7ff2640755f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:55.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.791+0000 7ff274ff9700 1 -- 172.21.15.73:0/2480853617 --> [v2:172.21.15.73:6816/47229,v1:172.21.15.73:6817/47229] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff264075cc0 con 0x7ff264073150 2024-05-08T21:53:55.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.791+0000 7ff274ff9700 1 -- 172.21.15.73:0/2480853617 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff26c08bb80 con 0x7ff278153eb0 2024-05-08T21:53:55.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.791+0000 7ff27cec8700 1 --2- 172.21.15.73:0/2480853617 >> [v2:172.21.15.73:6816/47229,v1:172.21.15.73:6817/47229] conn(0x7ff264073150 0x7ff2640755f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:55.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.791+0000 7ff277fff700 1 --2- 172.21.15.73:0/2480853617 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7ff26406ac90 0x7ff26406d150 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff268009130 tx=0x7ff268008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:55.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.791+0000 7ff27cec8700 1 --2- 172.21.15.73:0/2480853617 >> [v2:172.21.15.73:6816/47229,v1:172.21.15.73:6817/47229] conn(0x7ff264073150 0x7ff2640755f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:55.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.792+0000 7ff274ff9700 1 -- 172.21.15.73:0/2480853617 <== osd.2 v2:172.21.15.73:6816/47229 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7ff264075cc0 con 0x7ff264073150 2024-05-08T21:53:55.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.806+0000 7ff27e92b700 1 -- 172.21.15.73:0/2480853617 --> [v2:172.21.15.73:6816/47229,v1:172.21.15.73:6817/47229] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff2780c7b10 con 0x7ff264073150 2024-05-08T21:53:55.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.806+0000 7ff274ff9700 1 -- 172.21.15.73:0/2480853617 <== osd.2 v2:172.21.15.73:6816/47229 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7ff270007130 con 0x7ff264073150 2024-05-08T21:53:55.807 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-05-08T21:53:55.808 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T21:53:55.808 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-05-08T21:53:55.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.807+0000 7ff27e92b700 1 -- 172.21.15.73:0/2480853617 >> [v2:172.21.15.73:6816/47229,v1:172.21.15.73:6817/47229] conn(0x7ff264073150 msgr2=0x7ff2640755f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:55.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.807+0000 7ff27e92b700 1 --2- 172.21.15.73:0/2480853617 >> [v2:172.21.15.73:6816/47229,v1:172.21.15.73:6817/47229] conn(0x7ff264073150 0x7ff2640755f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:55.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.807+0000 7ff27e92b700 1 -- 172.21.15.73:0/2480853617 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7ff26406ac90 msgr2=0x7ff26406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:55.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.807+0000 7ff27e92b700 1 --2- 172.21.15.73:0/2480853617 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7ff26406ac90 0x7ff26406d150 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff268009130 tx=0x7ff268008030 comp rx=0 tx=0).stop 2024-05-08T21:53:55.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.807+0000 7ff27e92b700 1 -- 172.21.15.73:0/2480853617 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff278153eb0 msgr2=0x7ff278150800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:55.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.807+0000 7ff27e92b700 1 --2- 172.21.15.73:0/2480853617 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff278153eb0 0x7ff278150800 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff26c00d800 tx=0x7ff26c00dbc0 comp rx=0 tx=0).stop 2024-05-08T21:53:55.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.807+0000 7ff27cec8700 1 -- 172.21.15.73:0/2480853617 reap_dead start 2024-05-08T21:53:55.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.807+0000 7ff27e92b700 1 -- 172.21.15.73:0/2480853617 shutdown_connections 2024-05-08T21:53:55.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.807+0000 7ff27e92b700 1 -- 172.21.15.73:0/2480853617 >> 172.21.15.73:0/2480853617 conn(0x7ff27806bad0 msgr2=0x7ff27814e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:53:55.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.807+0000 7ff27e92b700 1 -- 172.21.15.73:0/2480853617 shutdown_connections 2024-05-08T21:53:55.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.807+0000 7ff27e92b700 1 -- 172.21.15.73:0/2480853617 wait complete. 2024-05-08T21:53:55.820 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-05-08T21:53:55.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.940+0000 7f509e3d0700 1 Processor -- start 2024-05-08T21:53:55.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.941+0000 7f509e3d0700 1 -- start start 2024-05-08T21:53:55.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.941+0000 7f509e3d0700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5098153eb0 0x7f5098071a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:55.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.941+0000 7f509e3d0700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f50980725a0 0x7f5098071fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:55.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.941+0000 7f509e3d0700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f509806adc0 0x7f509806b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:55.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.941+0000 7f509e3d0700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50980c3ca0 con 0x7f5098153eb0 2024-05-08T21:53:55.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.941+0000 7f509e3d0700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5098159c10 con 0x7f509806adc0 2024-05-08T21:53:55.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.941+0000 7f509e3d0700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f509806b950 con 0x7f50980725a0 2024-05-08T21:53:55.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.941+0000 7f5097fff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5098153eb0 0x7f5098071a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:55.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.941+0000 7f5097fff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5098153eb0 0x7f5098071a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56598/0 (socket says 172.21.15.73:56598) 2024-05-08T21:53:55.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.941+0000 7f5097fff700 1 -- 172.21.15.73:0/1913812772 learned_addr learned my addr 172.21.15.73:0/1913812772 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:53:55.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.942+0000 7f50977fe700 1 --2- 172.21.15.73:0/1913812772 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f50980725a0 0x7f5098071fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:55.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.942+0000 7f509c96d700 1 --2- 172.21.15.73:0/1913812772 >> v2:172.21.15.115:3300/0 conn(0x7f509806adc0 0x7f509806b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:55.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.942+0000 7f5097fff700 1 -- 172.21.15.73:0/1913812772 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f50980725a0 msgr2=0x7f5098071fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:53:55.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.942+0000 7f5097fff700 1 --2- 172.21.15.73:0/1913812772 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f50980725a0 0x7f5098071fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:55.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.942+0000 7f5097fff700 1 -- 172.21.15.73:0/1913812772 >> v2:172.21.15.115:3300/0 conn(0x7f509806adc0 msgr2=0x7f509806b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:53:55.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.942+0000 7f5097fff700 1 --2- 172.21.15.73:0/1913812772 >> v2:172.21.15.115:3300/0 conn(0x7f509806adc0 0x7f509806b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:55.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.942+0000 7f5097fff700 1 -- 172.21.15.73:0/1913812772 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5098159e20 con 0x7f5098153eb0 2024-05-08T21:53:55.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.942+0000 7f5097fff700 1 --2- 172.21.15.73:0/1913812772 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5098153eb0 0x7f5098071a60 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f509806d0d0 tx=0x7f5088009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b82da67c9987310 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:55.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.942+0000 7f5096ffd700 1 -- 172.21.15.73:0/1913812772 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f508800b860 con 0x7f5098153eb0 2024-05-08T21:53:55.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.942+0000 7f5096ffd700 1 -- 172.21.15.73:0/1913812772 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f508800b9c0 con 0x7f5098153eb0 2024-05-08T21:53:55.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.942+0000 7f5096ffd700 1 -- 172.21.15.73:0/1913812772 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f508800bd50 con 0x7f5098153eb0 2024-05-08T21:53:55.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.943+0000 7f509e3d0700 1 -- 172.21.15.73:0/1913812772 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5098153eb0 msgr2=0x7f5098071a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:55.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.943+0000 7f509e3d0700 1 --2- 172.21.15.73:0/1913812772 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5098153eb0 0x7f5098071a60 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f509806d0d0 tx=0x7f5088009c00 comp rx=0 tx=0).stop 2024-05-08T21:53:55.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.943+0000 7f509e3d0700 1 -- 172.21.15.73:0/1913812772 shutdown_connections 2024-05-08T21:53:55.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.943+0000 7f509e3d0700 1 --2- 172.21.15.73:0/1913812772 >> v2:172.21.15.115:3300/0 conn(0x7f509806adc0 0x7f509806b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:55.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.943+0000 7f509e3d0700 1 --2- 172.21.15.73:0/1913812772 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5098153eb0 0x7f5098071a60 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:55.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.943+0000 7f509e3d0700 1 --2- 172.21.15.73:0/1913812772 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f50980725a0 0x7f5098071fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:55.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.943+0000 7f509e3d0700 1 -- 172.21.15.73:0/1913812772 >> 172.21.15.73:0/1913812772 conn(0x7f5098066ab0 msgr2=0x7f509806f550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:53:55.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.943+0000 7f509e3d0700 1 -- 172.21.15.73:0/1913812772 shutdown_connections 2024-05-08T21:53:55.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.943+0000 7f509e3d0700 1 -- 172.21.15.73:0/1913812772 wait complete. 2024-05-08T21:53:55.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.944+0000 7f509e3d0700 1 Processor -- start 2024-05-08T21:53:55.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.944+0000 7f509e3d0700 1 -- start start 2024-05-08T21:53:55.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.945+0000 7f509e3d0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f509806adc0 0x7f50981f0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:55.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.945+0000 7f509e3d0700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f50980725a0 0x7f50980c5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:55.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.945+0000 7f509e3d0700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5098153eb0 0x7f50981f2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:55.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.945+0000 7f509e3d0700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f509814d9e0 con 0x7f509806adc0 2024-05-08T21:53:55.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.945+0000 7f509e3d0700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5098156b20 con 0x7f5098153eb0 2024-05-08T21:53:55.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.945+0000 7f509e3d0700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5098151500 con 0x7f50980725a0 2024-05-08T21:53:55.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.945+0000 7f5097fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f509806adc0 0x7f50981f0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:55.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.945+0000 7f5097fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f509806adc0 0x7f50981f0320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56614/0 (socket says 172.21.15.73:56614) 2024-05-08T21:53:55.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.945+0000 7f5097fff700 1 -- 172.21.15.73:0/4120575332 learned_addr learned my addr 172.21.15.73:0/4120575332 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:53:55.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.945+0000 7f509c96d700 1 --2- 172.21.15.73:0/4120575332 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5098153eb0 0x7f50981f2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:55.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.945+0000 7f50977fe700 1 --2- 172.21.15.73:0/4120575332 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f50980725a0 0x7f50980c5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:55.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.945+0000 7f5097fff700 1 -- 172.21.15.73:0/4120575332 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f50980725a0 msgr2=0x7f50980c5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:55.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.945+0000 7f5097fff700 1 --2- 172.21.15.73:0/4120575332 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f50980725a0 0x7f50980c5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:55.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.945+0000 7f5097fff700 1 -- 172.21.15.73:0/4120575332 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5098153eb0 msgr2=0x7f50981f2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:55.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.945+0000 7f5097fff700 1 --2- 172.21.15.73:0/4120575332 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5098153eb0 0x7f50981f2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:55.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.945+0000 7f5097fff700 1 -- 172.21.15.73:0/4120575332 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5088009550 con 0x7f509806adc0 2024-05-08T21:53:55.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.945+0000 7f5097fff700 1 --2- 172.21.15.73:0/4120575332 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f509806adc0 0x7f50981f0320 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5088009130 tx=0x7f5088004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:55.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.945+0000 7f5094ff9700 1 -- 172.21.15.73:0/4120575332 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5088004450 con 0x7f509806adc0 2024-05-08T21:53:55.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.945+0000 7f5094ff9700 1 -- 172.21.15.73:0/4120575332 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f508801e070 con 0x7f509806adc0 2024-05-08T21:53:55.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.945+0000 7f509e3d0700 1 -- 172.21.15.73:0/4120575332 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5098151220 con 0x7f509806adc0 2024-05-08T21:53:55.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.945+0000 7f5094ff9700 1 -- 172.21.15.73:0/4120575332 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50880038a0 con 0x7f509806adc0 2024-05-08T21:53:55.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.946+0000 7f509e3d0700 1 -- 172.21.15.73:0/4120575332 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5098156460 con 0x7f509806adc0 2024-05-08T21:53:55.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.947+0000 7f509e3d0700 1 -- 172.21.15.73:0/4120575332 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5098068b80 con 0x7f509806adc0 2024-05-08T21:53:55.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.947+0000 7f5094ff9700 1 -- 172.21.15.73:0/4120575332 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5088003a00 con 0x7f509806adc0 2024-05-08T21:53:55.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.947+0000 7f5094ff9700 1 --2- 172.21.15.73:0/4120575332 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f508406ac90 0x7f508406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:55.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.947+0000 7f5094ff9700 1 -- 172.21.15.73:0/4120575332 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5969+0+0 (secure 0 0 0) 0x7f5088020070 con 0x7f509806adc0 2024-05-08T21:53:55.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.947+0000 7f50977fe700 1 --2- 172.21.15.73:0/4120575332 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f508406ac90 0x7f508406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:55.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.948+0000 7f50977fe700 1 --2- 172.21.15.73:0/4120575332 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f508406ac90 0x7f508406d150 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5098149900 tx=0x7f508c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:55.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:55.952+0000 7f5094ff9700 1 -- 172.21.15.73:0/4120575332 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f50880558c0 con 0x7f509806adc0 2024-05-08T21:53:56.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.149+0000 7f509e3d0700 1 -- 172.21.15.73:0/4120575332 --> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f509815a3a0 con 0x7f508406ac90 2024-05-08T21:53:56.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.149+0000 7f5094ff9700 1 -- 172.21.15.73:0/4120575332 <== mgr.4104 v2:172.21.15.73:6832/46949 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f508c009e40 con 0x7f508406ac90 2024-05-08T21:53:56.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.151+0000 7f509e3d0700 1 -- 172.21.15.73:0/4120575332 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f508406ac90 msgr2=0x7f508406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:56.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.151+0000 7f509e3d0700 1 --2- 172.21.15.73:0/4120575332 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f508406ac90 0x7f508406d150 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5098149900 tx=0x7f508c008040 comp rx=0 tx=0).stop 2024-05-08T21:53:56.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.151+0000 7f509e3d0700 1 -- 172.21.15.73:0/4120575332 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f509806adc0 msgr2=0x7f50981f0320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:56.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.151+0000 7f509e3d0700 1 --2- 172.21.15.73:0/4120575332 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f509806adc0 0x7f50981f0320 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5088009130 tx=0x7f5088004750 comp rx=0 tx=0).stop 2024-05-08T21:53:56.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.151+0000 7f509e3d0700 1 -- 172.21.15.73:0/4120575332 shutdown_connections 2024-05-08T21:53:56.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.151+0000 7f509e3d0700 1 --2- 172.21.15.73:0/4120575332 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f508406ac90 0x7f508406d150 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:56.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.151+0000 7f509e3d0700 1 --2- 172.21.15.73:0/4120575332 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5098153eb0 0x7f50981f2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:56.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.151+0000 7f509e3d0700 1 --2- 172.21.15.73:0/4120575332 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f509806adc0 0x7f50981f0320 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:56.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.151+0000 7f509e3d0700 1 --2- 172.21.15.73:0/4120575332 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f50980725a0 0x7f50980c5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:56.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.151+0000 7f509e3d0700 1 -- 172.21.15.73:0/4120575332 >> 172.21.15.73:0/4120575332 conn(0x7f5098066ab0 msgr2=0x7f50980c8d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:53:56.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.151+0000 7f509e3d0700 1 -- 172.21.15.73:0/4120575332 shutdown_connections 2024-05-08T21:53:56.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.151+0000 7f509e3d0700 1 -- 172.21.15.73:0/4120575332 wait complete. 2024-05-08T21:53:56.154 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 2 to deep-scrub 2024-05-08T21:53:56.165 INFO:tasks.ceph:Scrubbing osd.3 2024-05-08T21:53:56.166 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-05-08T21:53:56.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.290+0000 7fc887780700 1 Processor -- start 2024-05-08T21:53:56.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.290+0000 7fc887780700 1 -- start start 2024-05-08T21:53:56.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.291+0000 7fc887780700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc880070c40 0x7fc8800c25e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:56.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.291+0000 7fc887780700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8800c9220 con 0x7fc8801520c0 2024-05-08T21:53:56.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.291+0000 7fc887780700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8800c94c0 con 0x7fc880071020 2024-05-08T21:53:56.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.291+0000 7fc887780700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8800c9760 con 0x7fc880070c40 2024-05-08T21:53:56.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.291+0000 7fc885d1d700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fc8801520c0 0x7fc880158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:33656/0 (socket says 172.21.15.73:33656) 2024-05-08T21:53:56.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.291+0000 7fc885d1d700 1 -- 172.21.15.73:0/3615764677 learned_addr learned my addr 172.21.15.73:0/3615764677 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:53:56.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.291+0000 7fc88551c700 1 --2- 172.21.15.73:0/3615764677 >> v2:172.21.15.115:3300/0 conn(0x7fc880070c40 0x7fc8800c25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:56.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.291+0000 7fc877fff700 1 -- 172.21.15.73:0/3615764677 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 396087749 0 0) 0x7fc8800c9220 con 0x7fc8801520c0 2024-05-08T21:53:56.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.292+0000 7fc877fff700 1 -- 172.21.15.73:0/3615764677 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc86c0035b0 con 0x7fc8801520c0 2024-05-08T21:53:56.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.292+0000 7fc877fff700 1 -- 172.21.15.73:0/3615764677 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2940926331 0 0) 0x7fc86c0035b0 con 0x7fc8801520c0 2024-05-08T21:53:56.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.292+0000 7fc877fff700 1 -- 172.21.15.73:0/3615764677 >> v2:172.21.15.115:3300/0 conn(0x7fc880070c40 msgr2=0x7fc8800c25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:53:56.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.292+0000 7fc877fff700 1 --2- 172.21.15.73:0/3615764677 >> v2:172.21.15.115:3300/0 conn(0x7fc880070c40 0x7fc8800c25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:56.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.292+0000 7fc877fff700 1 -- 172.21.15.73:0/3615764677 >> v1:172.21.15.115:6789/0 conn(0x7fc880071020 legacy=0x7fc8801519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:56.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.292+0000 7fc877fff700 1 -- 172.21.15.73:0/3615764677 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8800c9a20 con 0x7fc8801520c0 2024-05-08T21:53:56.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.292+0000 7fc877fff700 1 -- 172.21.15.73:0/3615764677 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 953298616 0 0) 0x7fc8780019f0 con 0x7fc8801520c0 2024-05-08T21:53:56.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.292+0000 7fc88551c700 1 --2- 172.21.15.73:0/3615764677 >> v2:172.21.15.115:3300/0 conn(0x7fc880070c40 0x7fc8800c25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:53:56.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.292+0000 7fc877fff700 1 -- 172.21.15.73:0/3615764677 >> v1:172.21.15.73:6789/0 conn(0x7fc8801520c0 legacy=0x7fc880158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:56.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.292+0000 7fc877fff700 1 --2- 172.21.15.73:0/3615764677 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc86c003a00 0x7fc86c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:56.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.292+0000 7fc877fff700 1 --2- 172.21.15.73:0/3615764677 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc86c004850 0x7fc86c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:56.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.292+0000 7fc877fff700 1 --2- 172.21.15.73:0/3615764677 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc86c005210 0x7fc86c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:56.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.292+0000 7fc877fff700 1 -- 172.21.15.73:0/3615764677 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8800c9760 con 0x7fc86c004850 2024-05-08T21:53:56.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.292+0000 7fc877fff700 1 -- 172.21.15.73:0/3615764677 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc86c00c0c0 con 0x7fc86c005210 2024-05-08T21:53:56.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.292+0000 7fc877fff700 1 -- 172.21.15.73:0/3615764677 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc86c00c280 con 0x7fc86c003a00 2024-05-08T21:53:56.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.292+0000 7fc884d1b700 1 --2- 172.21.15.73:0/3615764677 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc86c004850 0x7fc86c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:56.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.292+0000 7fc88551c700 1 --2- 172.21.15.73:0/3615764677 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc86c003a00 0x7fc86c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:56.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.292+0000 7fc885d1d700 1 --2- 172.21.15.73:0/3615764677 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc86c005210 0x7fc86c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:56.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.292+0000 7fc884d1b700 1 -- 172.21.15.73:0/3615764677 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc86c003a00 msgr2=0x7fc86c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:53:56.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.292+0000 7fc884d1b700 1 --2- 172.21.15.73:0/3615764677 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc86c003a00 0x7fc86c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:56.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.292+0000 7fc884d1b700 1 -- 172.21.15.73:0/3615764677 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc86c005210 msgr2=0x7fc86c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:53:56.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.292+0000 7fc884d1b700 1 --2- 172.21.15.73:0/3615764677 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc86c005210 0x7fc86c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:56.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.292+0000 7fc884d1b700 1 -- 172.21.15.73:0/3615764677 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc86c0035b0 con 0x7fc86c004850 2024-05-08T21:53:56.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.292+0000 7fc885d1d700 1 -- 172.21.15.73:0/3615764677 reap_dead start 2024-05-08T21:53:56.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.292+0000 7fc884d1b700 1 --2- 172.21.15.73:0/3615764677 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc86c004850 0x7fc86c004cd0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc880071430 tx=0x7fc86c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29d8c7f606fde0b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:56.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.293+0000 7fc877fff700 1 -- 172.21.15.73:0/3615764677 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc87c0052d0 con 0x7fc86c004850 2024-05-08T21:53:56.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.293+0000 7fc877fff700 1 -- 172.21.15.73:0/3615764677 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc87c005450 con 0x7fc86c004850 2024-05-08T21:53:56.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.293+0000 7fc877fff700 1 -- 172.21.15.73:0/3615764677 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc87c0038c0 con 0x7fc86c004850 2024-05-08T21:53:56.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.293+0000 7fc887780700 1 -- 172.21.15.73:0/3615764677 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc86c004850 msgr2=0x7fc86c004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:56.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.293+0000 7fc887780700 1 --2- 172.21.15.73:0/3615764677 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc86c004850 0x7fc86c004cd0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc880071430 tx=0x7fc86c005880 comp rx=0 tx=0).stop 2024-05-08T21:53:56.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.293+0000 7fc887780700 1 -- 172.21.15.73:0/3615764677 shutdown_connections 2024-05-08T21:53:56.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.293+0000 7fc887780700 1 --2- 172.21.15.73:0/3615764677 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc86c004850 0x7fc86c004cd0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:56.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.293+0000 7fc887780700 1 -- 172.21.15.73:0/3615764677 >> 172.21.15.73:0/3615764677 conn(0x7fc88006aff0 msgr2=0x7fc88006ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:53:56.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.293+0000 7fc887780700 1 -- 172.21.15.73:0/3615764677 shutdown_connections 2024-05-08T21:53:56.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.293+0000 7fc887780700 1 -- 172.21.15.73:0/3615764677 wait complete. 2024-05-08T21:53:56.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.294+0000 7fc887780700 1 Processor -- start 2024-05-08T21:53:56.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.294+0000 7fc887780700 1 -- start start 2024-05-08T21:53:56.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.295+0000 7fc887780700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc86c004850 0x7fc8800cc510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:56.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.295+0000 7fc887780700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc8800cca50 0x7fc8801527a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:56.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.295+0000 7fc887780700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc880152ce0 0x7fc8801f0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:56.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.295+0000 7fc887780700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8801ddd90 con 0x7fc86c004850 2024-05-08T21:53:56.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.295+0000 7fc887780700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8801edaa0 con 0x7fc880152ce0 2024-05-08T21:53:56.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.295+0000 7fc887780700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8800cc080 con 0x7fc8800cca50 2024-05-08T21:53:56.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.295+0000 7fc88551c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc86c004850 0x7fc8800cc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:56.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.295+0000 7fc88551c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc86c004850 0x7fc8800cc510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56634/0 (socket says 172.21.15.73:56634) 2024-05-08T21:53:56.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.295+0000 7fc88551c700 1 -- 172.21.15.73:0/2507253168 learned_addr learned my addr 172.21.15.73:0/2507253168 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:53:56.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.295+0000 7fc885d1d700 1 --2- 172.21.15.73:0/2507253168 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc880152ce0 0x7fc8801f0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:56.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.295+0000 7fc884d1b700 1 --2- 172.21.15.73:0/2507253168 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc8800cca50 0x7fc8801527a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:56.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.295+0000 7fc88551c700 1 -- 172.21.15.73:0/2507253168 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc8800cca50 msgr2=0x7fc8801527a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:56.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.295+0000 7fc88551c700 1 --2- 172.21.15.73:0/2507253168 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc8800cca50 0x7fc8801527a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:56.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.295+0000 7fc88551c700 1 -- 172.21.15.73:0/2507253168 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc880152ce0 msgr2=0x7fc8801f0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:56.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.295+0000 7fc88551c700 1 --2- 172.21.15.73:0/2507253168 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc880152ce0 0x7fc8801f0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:56.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.295+0000 7fc88551c700 1 -- 172.21.15.73:0/2507253168 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8800cced0 con 0x7fc86c004850 2024-05-08T21:53:56.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.295+0000 7fc884d1b700 1 --2- 172.21.15.73:0/2507253168 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc8800cca50 0x7fc8801527a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:53:56.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.296+0000 7fc88551c700 1 --2- 172.21.15.73:0/2507253168 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc86c004850 0x7fc8800cc510 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc870011cd0 tx=0x7fc87000f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:56.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.296+0000 7fc875ffb700 1 -- 172.21.15.73:0/2507253168 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc87000fb30 con 0x7fc86c004850 2024-05-08T21:53:56.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.296+0000 7fc875ffb700 1 -- 172.21.15.73:0/2507253168 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc87000fc90 con 0x7fc86c004850 2024-05-08T21:53:56.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.296+0000 7fc887780700 1 -- 172.21.15.73:0/2507253168 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8801edf90 con 0x7fc86c004850 2024-05-08T21:53:56.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.296+0000 7fc875ffb700 1 -- 172.21.15.73:0/2507253168 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc870004020 con 0x7fc86c004850 2024-05-08T21:53:56.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.296+0000 7fc887780700 1 -- 172.21.15.73:0/2507253168 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8801edcd0 con 0x7fc86c004850 2024-05-08T21:53:56.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.297+0000 7fc887780700 1 -- 172.21.15.73:0/2507253168 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc880157bc0 con 0x7fc86c004850 2024-05-08T21:53:56.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.297+0000 7fc875ffb700 1 -- 172.21.15.73:0/2507253168 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc870004180 con 0x7fc86c004850 2024-05-08T21:53:56.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.298+0000 7fc875ffb700 1 --2- 172.21.15.73:0/2507253168 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fc86406ac90 0x7fc86406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:56.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.298+0000 7fc875ffb700 1 -- 172.21.15.73:0/2507253168 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5969+0+0 (secure 0 0 0) 0x7fc870089fc0 con 0x7fc86c004850 2024-05-08T21:53:56.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.298+0000 7fc884d1b700 1 --2- 172.21.15.73:0/2507253168 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fc86406ac90 0x7fc86406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:56.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.298+0000 7fc875ffb700 1 --2- 172.21.15.73:0/2507253168 >> [v2:172.21.15.73:6824/47232,v1:172.21.15.73:6825/47232] conn(0x7fc864073150 0x7fc8640755f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:56.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.298+0000 7fc875ffb700 1 -- 172.21.15.73:0/2507253168 --> [v2:172.21.15.73:6824/47232,v1:172.21.15.73:6825/47232] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc864075cc0 con 0x7fc864073150 2024-05-08T21:53:56.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.298+0000 7fc875ffb700 1 -- 172.21.15.73:0/2507253168 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc87008a330 con 0x7fc86c004850 2024-05-08T21:53:56.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.298+0000 7fc885d1d700 1 --2- 172.21.15.73:0/2507253168 >> [v2:172.21.15.73:6824/47232,v1:172.21.15.73:6825/47232] conn(0x7fc864073150 0x7fc8640755f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:56.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.298+0000 7fc884d1b700 1 --2- 172.21.15.73:0/2507253168 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fc86406ac90 0x7fc86406d150 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc8800cd260 tx=0x7fc87c009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:56.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.298+0000 7fc885d1d700 1 --2- 172.21.15.73:0/2507253168 >> [v2:172.21.15.73:6824/47232,v1:172.21.15.73:6825/47232] conn(0x7fc864073150 0x7fc8640755f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:56.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.299+0000 7fc875ffb700 1 -- 172.21.15.73:0/2507253168 <== osd.3 v2:172.21.15.73:6824/47232 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fc864075cc0 con 0x7fc864073150 2024-05-08T21:53:56.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.315+0000 7fc887780700 1 -- 172.21.15.73:0/2507253168 --> [v2:172.21.15.73:6824/47232,v1:172.21.15.73:6825/47232] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc8800cc1c0 con 0x7fc864073150 2024-05-08T21:53:56.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.315+0000 7fc875ffb700 1 -- 172.21.15.73:0/2507253168 <== osd.3 v2:172.21.15.73:6824/47232 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fc878001250 con 0x7fc864073150 2024-05-08T21:53:56.316 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-05-08T21:53:56.316 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T21:53:56.316 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-05-08T21:53:56.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.315+0000 7fc887780700 1 -- 172.21.15.73:0/2507253168 >> [v2:172.21.15.73:6824/47232,v1:172.21.15.73:6825/47232] conn(0x7fc864073150 msgr2=0x7fc8640755f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:56.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.315+0000 7fc887780700 1 --2- 172.21.15.73:0/2507253168 >> [v2:172.21.15.73:6824/47232,v1:172.21.15.73:6825/47232] conn(0x7fc864073150 0x7fc8640755f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:56.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.315+0000 7fc887780700 1 -- 172.21.15.73:0/2507253168 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fc86406ac90 msgr2=0x7fc86406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:56.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.315+0000 7fc887780700 1 --2- 172.21.15.73:0/2507253168 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fc86406ac90 0x7fc86406d150 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc8800cd260 tx=0x7fc87c009030 comp rx=0 tx=0).stop 2024-05-08T21:53:56.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.315+0000 7fc887780700 1 -- 172.21.15.73:0/2507253168 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc86c004850 msgr2=0x7fc8800cc510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:56.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.315+0000 7fc887780700 1 --2- 172.21.15.73:0/2507253168 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc86c004850 0x7fc8800cc510 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc870011cd0 tx=0x7fc87000f520 comp rx=0 tx=0).stop 2024-05-08T21:53:56.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.315+0000 7fc885d1d700 1 -- 172.21.15.73:0/2507253168 reap_dead start 2024-05-08T21:53:56.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.315+0000 7fc887780700 1 -- 172.21.15.73:0/2507253168 shutdown_connections 2024-05-08T21:53:56.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.315+0000 7fc887780700 1 -- 172.21.15.73:0/2507253168 >> 172.21.15.73:0/2507253168 conn(0x7fc88006aff0 msgr2=0x7fc8800ca240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:53:56.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.315+0000 7fc887780700 1 -- 172.21.15.73:0/2507253168 shutdown_connections 2024-05-08T21:53:56.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.315+0000 7fc887780700 1 -- 172.21.15.73:0/2507253168 wait complete. 2024-05-08T21:53:56.328 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-05-08T21:53:56.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.449+0000 7fb2e1338700 1 Processor -- start 2024-05-08T21:53:56.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.449+0000 7fb2e1338700 1 -- start start 2024-05-08T21:53:56.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.450+0000 7fb2e1338700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb2dc153a50 0x7fb2dc15a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:56.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.450+0000 7fb2e1338700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb2dc0c9e70 0x7fb2dc0720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:56.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.450+0000 7fb2e1338700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2dc0caaf0 con 0x7fb2dc072630 2024-05-08T21:53:56.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.450+0000 7fb2e1338700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2dc15d0e0 con 0x7fb2dc0c9e70 2024-05-08T21:53:56.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.450+0000 7fb2e1338700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2dc15aad0 con 0x7fb2dc153a50 2024-05-08T21:53:56.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.450+0000 7fb2da7fc700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb2dc0c9e70 0x7fb2dc0720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:56.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.450+0000 7fb2da7fc700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb2dc0c9e70 0x7fb2dc0720f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56640/0 (socket says 172.21.15.73:56640) 2024-05-08T21:53:56.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.450+0000 7fb2da7fc700 1 -- 172.21.15.73:0/3079106304 learned_addr learned my addr 172.21.15.73:0/3079106304 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:53:56.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.450+0000 7fb2da7fc700 1 -- 172.21.15.73:0/3079106304 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb2dc153a50 msgr2=0x7fb2dc15a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:53:56.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.450+0000 7fb2da7fc700 1 --2- 172.21.15.73:0/3079106304 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb2dc153a50 0x7fb2dc15a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:56.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.450+0000 7fb2da7fc700 1 -- 172.21.15.73:0/3079106304 >> v1:172.21.15.115:6789/0 conn(0x7fb2dc072630 legacy=0x7fb2dc0caf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:53:56.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.450+0000 7fb2da7fc700 1 -- 172.21.15.73:0/3079106304 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2dc15d330 con 0x7fb2dc0c9e70 2024-05-08T21:53:56.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.450+0000 7fb2da7fc700 1 --2- 172.21.15.73:0/3079106304 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb2dc0c9e70 0x7fb2dc0720f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc0098f0 tx=0x7fb2cc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b674fb079a482f03 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:56.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.450+0000 7fb2d9ffb700 1 -- 172.21.15.73:0/3079106304 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2cc004230 con 0x7fb2dc0c9e70 2024-05-08T21:53:56.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.451+0000 7fb2d9ffb700 1 -- 172.21.15.73:0/3079106304 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2cc004390 con 0x7fb2dc0c9e70 2024-05-08T21:53:56.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.451+0000 7fb2d9ffb700 1 -- 172.21.15.73:0/3079106304 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2cc0036a0 con 0x7fb2dc0c9e70 2024-05-08T21:53:56.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.451+0000 7fb2e1338700 1 -- 172.21.15.73:0/3079106304 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb2dc0c9e70 msgr2=0x7fb2dc0720f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:56.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.451+0000 7fb2e1338700 1 --2- 172.21.15.73:0/3079106304 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb2dc0c9e70 0x7fb2dc0720f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc0098f0 tx=0x7fb2cc009c00 comp rx=0 tx=0).stop 2024-05-08T21:53:56.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.451+0000 7fb2e1338700 1 -- 172.21.15.73:0/3079106304 shutdown_connections 2024-05-08T21:53:56.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.451+0000 7fb2e1338700 1 --2- 172.21.15.73:0/3079106304 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb2dc153a50 0x7fb2dc15a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:56.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.451+0000 7fb2e1338700 1 --2- 172.21.15.73:0/3079106304 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb2dc0c9e70 0x7fb2dc0720f0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:56.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.451+0000 7fb2e1338700 1 -- 172.21.15.73:0/3079106304 >> 172.21.15.73:0/3079106304 conn(0x7fb2dc06bee0 msgr2=0x7fb2dc06c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:53:56.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.451+0000 7fb2e1338700 1 -- 172.21.15.73:0/3079106304 shutdown_connections 2024-05-08T21:53:56.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.451+0000 7fb2e1338700 1 -- 172.21.15.73:0/3079106304 wait complete. 2024-05-08T21:53:56.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.452+0000 7fb2e1338700 1 Processor -- start 2024-05-08T21:53:56.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.452+0000 7fb2e1338700 1 -- start start 2024-05-08T21:53:56.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.453+0000 7fb2e1338700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb2dc072630 0x7fb2dc1f3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:56.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.453+0000 7fb2e1338700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb2dc0c9e70 0x7fb2dc1592d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:56.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.453+0000 7fb2e1338700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2dc153a50 0x7fb2dc15c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:56.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.453+0000 7fb2e1338700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2dc15b550 con 0x7fb2dc072630 2024-05-08T21:53:56.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.453+0000 7fb2e1338700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2dc15be20 con 0x7fb2dc153a50 2024-05-08T21:53:56.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.453+0000 7fb2e1338700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2dc1e39a0 con 0x7fb2dc0c9e70 2024-05-08T21:53:56.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.453+0000 7fb2daffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb2dc072630 0x7fb2dc1f3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:56.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.453+0000 7fb2daffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb2dc072630 0x7fb2dc1f3a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56646/0 (socket says 172.21.15.73:56646) 2024-05-08T21:53:56.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.453+0000 7fb2daffd700 1 -- 172.21.15.73:0/1374093107 learned_addr learned my addr 172.21.15.73:0/1374093107 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:53:56.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.453+0000 7fb2db7fe700 1 --2- 172.21.15.73:0/1374093107 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2dc153a50 0x7fb2dc15c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:56.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.453+0000 7fb2da7fc700 1 --2- 172.21.15.73:0/1374093107 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb2dc0c9e70 0x7fb2dc1592d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:56.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.453+0000 7fb2daffd700 1 -- 172.21.15.73:0/1374093107 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb2dc0c9e70 msgr2=0x7fb2dc1592d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:56.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.453+0000 7fb2daffd700 1 --2- 172.21.15.73:0/1374093107 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb2dc0c9e70 0x7fb2dc1592d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:56.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.453+0000 7fb2daffd700 1 -- 172.21.15.73:0/1374093107 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2dc153a50 msgr2=0x7fb2dc15c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:56.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.453+0000 7fb2daffd700 1 --2- 172.21.15.73:0/1374093107 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2dc153a50 0x7fb2dc15c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:56.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.454+0000 7fb2daffd700 1 -- 172.21.15.73:0/1374093107 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2cc009550 con 0x7fb2dc072630 2024-05-08T21:53:56.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.454+0000 7fb2db7fe700 1 --2- 172.21.15.73:0/1374093107 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2dc153a50 0x7fb2dc15c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:53:56.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.454+0000 7fb2daffd700 1 --2- 172.21.15.73:0/1374093107 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb2dc072630 0x7fb2dc1f3a20 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb2d000b4d0 tx=0x7fb2d000b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:56.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.454+0000 7fb2c37fe700 1 -- 172.21.15.73:0/1374093107 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d0011830 con 0x7fb2dc072630 2024-05-08T21:53:56.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.454+0000 7fb2c37fe700 1 -- 172.21.15.73:0/1374093107 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d0011990 con 0x7fb2dc072630 2024-05-08T21:53:56.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.454+0000 7fb2c37fe700 1 -- 172.21.15.73:0/1374093107 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d0011d40 con 0x7fb2dc072630 2024-05-08T21:53:56.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.454+0000 7fb2e1338700 1 -- 172.21.15.73:0/1374093107 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2dc15acb0 con 0x7fb2dc072630 2024-05-08T21:53:56.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.454+0000 7fb2e1338700 1 -- 172.21.15.73:0/1374093107 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2dc15b270 con 0x7fb2dc072630 2024-05-08T21:53:56.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.455+0000 7fb2e1338700 1 -- 172.21.15.73:0/1374093107 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2dc067a20 con 0x7fb2dc072630 2024-05-08T21:53:56.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.455+0000 7fb2c37fe700 1 -- 172.21.15.73:0/1374093107 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb2d001a400 con 0x7fb2dc072630 2024-05-08T21:53:56.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.456+0000 7fb2c37fe700 1 --2- 172.21.15.73:0/1374093107 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fb2c806ac90 0x7fb2c806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:56.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.456+0000 7fb2c37fe700 1 -- 172.21.15.73:0/1374093107 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5969+0+0 (secure 0 0 0) 0x7fb2d0089470 con 0x7fb2dc072630 2024-05-08T21:53:56.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.456+0000 7fb2da7fc700 1 --2- 172.21.15.73:0/1374093107 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fb2c806ac90 0x7fb2c806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:56.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.456+0000 7fb2da7fc700 1 --2- 172.21.15.73:0/1374093107 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fb2c806ac90 0x7fb2c806d150 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc1f40d0 tx=0x7fb2cc008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:56.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.460+0000 7fb2c37fe700 1 -- 172.21.15.73:0/1374093107 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fb2d0054550 con 0x7fb2dc072630 2024-05-08T21:53:56.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.655+0000 7fb2e1338700 1 -- 172.21.15.73:0/1374093107 --> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fb2dc15dbd0 con 0x7fb2c806ac90 2024-05-08T21:53:56.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.656+0000 7fb2c37fe700 1 -- 172.21.15.73:0/1374093107 <== mgr.4104 v2:172.21.15.73:6832/46949 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb2cc020070 con 0x7fb2c806ac90 2024-05-08T21:53:56.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.658+0000 7fb2e1338700 1 -- 172.21.15.73:0/1374093107 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fb2c806ac90 msgr2=0x7fb2c806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:56.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.658+0000 7fb2e1338700 1 --2- 172.21.15.73:0/1374093107 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fb2c806ac90 0x7fb2c806d150 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc1f40d0 tx=0x7fb2cc008030 comp rx=0 tx=0).stop 2024-05-08T21:53:56.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.658+0000 7fb2e1338700 1 -- 172.21.15.73:0/1374093107 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb2dc072630 msgr2=0x7fb2dc1f3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:56.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.658+0000 7fb2e1338700 1 --2- 172.21.15.73:0/1374093107 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb2dc072630 0x7fb2dc1f3a20 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb2d000b4d0 tx=0x7fb2d000b890 comp rx=0 tx=0).stop 2024-05-08T21:53:56.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.658+0000 7fb2e1338700 1 -- 172.21.15.73:0/1374093107 shutdown_connections 2024-05-08T21:53:56.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.658+0000 7fb2e1338700 1 --2- 172.21.15.73:0/1374093107 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fb2c806ac90 0x7fb2c806d150 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:56.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.658+0000 7fb2e1338700 1 --2- 172.21.15.73:0/1374093107 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2dc153a50 0x7fb2dc15c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:56.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.658+0000 7fb2e1338700 1 --2- 172.21.15.73:0/1374093107 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb2dc072630 0x7fb2dc1f3a20 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:56.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.658+0000 7fb2e1338700 1 --2- 172.21.15.73:0/1374093107 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb2dc0c9e70 0x7fb2dc1592d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:56.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.658+0000 7fb2e1338700 1 -- 172.21.15.73:0/1374093107 >> 172.21.15.73:0/1374093107 conn(0x7fb2dc06bee0 msgr2=0x7fb2dc0666c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:53:56.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.658+0000 7fb2e1338700 1 -- 172.21.15.73:0/1374093107 shutdown_connections 2024-05-08T21:53:56.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.658+0000 7fb2e1338700 1 -- 172.21.15.73:0/1374093107 wait complete. 2024-05-08T21:53:56.660 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 3 to deep-scrub 2024-05-08T21:53:56.671 INFO:tasks.ceph:Scrubbing osd.4 2024-05-08T21:53:56.671 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-05-08T21:53:56.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.796+0000 7fca09a26700 1 Processor -- start 2024-05-08T21:53:56.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.796+0000 7fca09a26700 1 -- start start 2024-05-08T21:53:56.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.796+0000 7fca09a26700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fca041540d0 0x7fca0406c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:56.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.796+0000 7fca09a26700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fca040c4850 0x7fca040cbf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:56.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.796+0000 7fca09a26700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca0406bdc0 con 0x7fca040cb610 2024-05-08T21:53:56.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.796+0000 7fca09a26700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca0406c790 con 0x7fca040c4850 2024-05-08T21:53:56.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.797+0000 7fca09a26700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca040ca530 con 0x7fca041540d0 2024-05-08T21:53:56.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.797+0000 7fca02ffd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fca041540d0 0x7fca0406c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:56.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.797+0000 7fca037fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fca040c4850 0x7fca040cbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:56.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.797+0000 7fca037fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fca040c4850 0x7fca040cbf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.73:60646/0 (socket says 172.21.15.73:60646) 2024-05-08T21:53:56.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.797+0000 7fca037fe700 1 -- 172.21.15.73:0/3898371582 learned_addr learned my addr 172.21.15.73:0/3898371582 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:53:56.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.797+0000 7fca02ffd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fca041540d0 0x7fca0406c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.73:40646/0 (socket says 172.21.15.73:40646) 2024-05-08T21:53:56.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.797+0000 7fca027fc700 1 --1- 172.21.15.73:0/3898371582 >> v1:172.21.15.115:6789/0 conn(0x7fca040cb610 0x7fca0415a6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.73:40880/0 (socket says 172.21.15.73:40880) 2024-05-08T21:53:56.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.797+0000 7fca037fe700 1 -- 172.21.15.73:0/3898371582 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fca041540d0 msgr2=0x7fca0406c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:53:56.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.797+0000 7fca037fe700 1 --2- 172.21.15.73:0/3898371582 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fca041540d0 0x7fca0406c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:56.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.797+0000 7fca037fe700 1 -- 172.21.15.73:0/3898371582 >> v1:172.21.15.115:6789/0 conn(0x7fca040cb610 legacy=0x7fca0415a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:56.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.797+0000 7fca037fe700 1 -- 172.21.15.73:0/3898371582 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca040ca810 con 0x7fca040c4850 2024-05-08T21:53:56.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.797+0000 7fca02ffd700 1 --2- 172.21.15.73:0/3898371582 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fca041540d0 0x7fca0406c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:53:56.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.797+0000 7fca037fe700 1 --2- 172.21.15.73:0/3898371582 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca040c4850 0x7fca040cbf20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc009e50 tx=0x7fc9fc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35112ac09fd796e0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:56.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.798+0000 7fca01ffb700 1 -- 172.21.15.73:0/3898371582 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc00e070 con 0x7fca040c4850 2024-05-08T21:53:56.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.798+0000 7fca01ffb700 1 -- 172.21.15.73:0/3898371582 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9fc00b910 con 0x7fca040c4850 2024-05-08T21:53:56.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.798+0000 7fca01ffb700 1 -- 172.21.15.73:0/3898371582 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc00bcc0 con 0x7fca040c4850 2024-05-08T21:53:56.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.798+0000 7fca09a26700 1 -- 172.21.15.73:0/3898371582 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca040c4850 msgr2=0x7fca040cbf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:56.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.798+0000 7fca09a26700 1 --2- 172.21.15.73:0/3898371582 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca040c4850 0x7fca040cbf20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc009e50 tx=0x7fc9fc00b330 comp rx=0 tx=0).stop 2024-05-08T21:53:56.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.798+0000 7fca09a26700 1 -- 172.21.15.73:0/3898371582 shutdown_connections 2024-05-08T21:53:56.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.798+0000 7fca09a26700 1 --2- 172.21.15.73:0/3898371582 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fca041540d0 0x7fca0406c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:56.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.798+0000 7fca09a26700 1 --2- 172.21.15.73:0/3898371582 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca040c4850 0x7fca040cbf20 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:56.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.798+0000 7fca09a26700 1 -- 172.21.15.73:0/3898371582 >> 172.21.15.73:0/3898371582 conn(0x7fca040666c0 msgr2=0x7fca04066ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:53:56.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.798+0000 7fca09a26700 1 -- 172.21.15.73:0/3898371582 shutdown_connections 2024-05-08T21:53:56.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.798+0000 7fca09a26700 1 -- 172.21.15.73:0/3898371582 wait complete. 2024-05-08T21:53:56.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.799+0000 7fca09a26700 1 Processor -- start 2024-05-08T21:53:56.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.800+0000 7fca09a26700 1 -- start start 2024-05-08T21:53:56.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.800+0000 7fca09a26700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca040c4850 0x7fca0414d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:56.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.800+0000 7fca09a26700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fca040cb610 0x7fca040c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:56.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.800+0000 7fca09a26700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca041540d0 0x7fca04149b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:56.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.800+0000 7fca09a26700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca0414dc10 con 0x7fca040c4850 2024-05-08T21:53:56.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.800+0000 7fca09a26700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca04154550 con 0x7fca041540d0 2024-05-08T21:53:56.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.800+0000 7fca09a26700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca04154d40 con 0x7fca040cb610 2024-05-08T21:53:56.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.800+0000 7fca02ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca040c4850 0x7fca0414d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:56.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.800+0000 7fca02ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca040c4850 0x7fca0414d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56648/0 (socket says 172.21.15.73:56648) 2024-05-08T21:53:56.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.800+0000 7fca02ffd700 1 -- 172.21.15.73:0/3047015269 learned_addr learned my addr 172.21.15.73:0/3047015269 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:53:56.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.801+0000 7fca037fe700 1 --2- 172.21.15.73:0/3047015269 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca041540d0 0x7fca04149b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:56.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.801+0000 7fca027fc700 1 --2- 172.21.15.73:0/3047015269 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fca040cb610 0x7fca040c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:56.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.801+0000 7fca02ffd700 1 -- 172.21.15.73:0/3047015269 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fca040cb610 msgr2=0x7fca040c7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:56.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.801+0000 7fca02ffd700 1 --2- 172.21.15.73:0/3047015269 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fca040cb610 0x7fca040c7ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:56.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.801+0000 7fca02ffd700 1 -- 172.21.15.73:0/3047015269 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca041540d0 msgr2=0x7fca04149b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:56.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.801+0000 7fca02ffd700 1 --2- 172.21.15.73:0/3047015269 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca041540d0 0x7fca04149b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:56.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.801+0000 7fca02ffd700 1 -- 172.21.15.73:0/3047015269 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9f40094a0 con 0x7fca040c4850 2024-05-08T21:53:56.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.801+0000 7fca037fe700 1 --2- 172.21.15.73:0/3047015269 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca041540d0 0x7fca04149b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:53:56.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.801+0000 7fca02ffd700 1 --2- 172.21.15.73:0/3047015269 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca040c4850 0x7fca0414d590 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc9f400ebe0 tx=0x7fc9f4009e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:56.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.801+0000 7fc9ebfff700 1 -- 172.21.15.73:0/3047015269 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f400c8b0 con 0x7fca040c4850 2024-05-08T21:53:56.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.801+0000 7fc9ebfff700 1 -- 172.21.15.73:0/3047015269 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9f400ca10 con 0x7fca040c4850 2024-05-08T21:53:56.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.801+0000 7fca09a26700 1 -- 172.21.15.73:0/3047015269 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9fc009b30 con 0x7fca040c4850 2024-05-08T21:53:56.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.801+0000 7fc9ebfff700 1 -- 172.21.15.73:0/3047015269 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f400cda0 con 0x7fca040c4850 2024-05-08T21:53:56.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.801+0000 7fca09a26700 1 -- 172.21.15.73:0/3047015269 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca04154a60 con 0x7fca040c4850 2024-05-08T21:53:56.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.802+0000 7fca09a26700 1 -- 172.21.15.73:0/3047015269 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fca0406ba50 con 0x7fca040c4850 2024-05-08T21:53:56.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.803+0000 7fc9ebfff700 1 -- 172.21.15.73:0/3047015269 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc9f4026480 con 0x7fca040c4850 2024-05-08T21:53:56.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.803+0000 7fc9ebfff700 1 --2- 172.21.15.73:0/3047015269 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fc9f006ac90 0x7fc9f006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:56.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.803+0000 7fc9ebfff700 1 -- 172.21.15.73:0/3047015269 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5969+0+0 (secure 0 0 0) 0x7fc9f4089d20 con 0x7fca040c4850 2024-05-08T21:53:56.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.803+0000 7fca027fc700 1 --2- 172.21.15.73:0/3047015269 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fc9f006ac90 0x7fc9f006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:56.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.803+0000 7fc9ebfff700 1 --2- 172.21.15.73:0/3047015269 >> [v2:172.21.15.115:6800/47200,v1:172.21.15.115:6801/47200] conn(0x7fc9f0073150 0x7fc9f00755f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:56.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.803+0000 7fc9ebfff700 1 -- 172.21.15.73:0/3047015269 --> [v2:172.21.15.115:6800/47200,v1:172.21.15.115:6801/47200] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc9f0075cc0 con 0x7fc9f0073150 2024-05-08T21:53:56.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.803+0000 7fc9ebfff700 1 -- 172.21.15.73:0/3047015269 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc9f408a170 con 0x7fca040c4850 2024-05-08T21:53:56.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.803+0000 7fca027fc700 1 --2- 172.21.15.73:0/3047015269 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fc9f006ac90 0x7fc9f006d150 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fca0414ef90 tx=0x7fc9f8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:56.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.804+0000 7fca037fe700 1 --2- 172.21.15.73:0/3047015269 >> [v2:172.21.15.115:6800/47200,v1:172.21.15.115:6801/47200] conn(0x7fc9f0073150 0x7fc9f00755f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:56.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.804+0000 7fca037fe700 1 --2- 172.21.15.73:0/3047015269 >> [v2:172.21.15.115:6800/47200,v1:172.21.15.115:6801/47200] conn(0x7fc9f0073150 0x7fc9f00755f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:56.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.805+0000 7fc9ebfff700 1 -- 172.21.15.73:0/3047015269 <== osd.4 v2:172.21.15.115:6800/47200 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fc9f0075cc0 con 0x7fc9f0073150 2024-05-08T21:53:56.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.819+0000 7fca09a26700 1 -- 172.21.15.73:0/3047015269 --> [v2:172.21.15.115:6800/47200,v1:172.21.15.115:6801/47200] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fca0406b770 con 0x7fc9f0073150 2024-05-08T21:53:56.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.819+0000 7fc9ebfff700 1 -- 172.21.15.73:0/3047015269 <== osd.4 v2:172.21.15.115:6800/47200 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fc9fc009300 con 0x7fc9f0073150 2024-05-08T21:53:56.821 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-05-08T21:53:56.821 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T21:53:56.821 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-05-08T21:53:56.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.820+0000 7fca09a26700 1 -- 172.21.15.73:0/3047015269 >> [v2:172.21.15.115:6800/47200,v1:172.21.15.115:6801/47200] conn(0x7fc9f0073150 msgr2=0x7fc9f00755f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:56.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.820+0000 7fca09a26700 1 --2- 172.21.15.73:0/3047015269 >> [v2:172.21.15.115:6800/47200,v1:172.21.15.115:6801/47200] conn(0x7fc9f0073150 0x7fc9f00755f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:56.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.820+0000 7fca09a26700 1 -- 172.21.15.73:0/3047015269 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fc9f006ac90 msgr2=0x7fc9f006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:56.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.820+0000 7fca09a26700 1 --2- 172.21.15.73:0/3047015269 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fc9f006ac90 0x7fc9f006d150 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fca0414ef90 tx=0x7fc9f8009040 comp rx=0 tx=0).stop 2024-05-08T21:53:56.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.820+0000 7fca09a26700 1 -- 172.21.15.73:0/3047015269 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca040c4850 msgr2=0x7fca0414d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:56.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.820+0000 7fca09a26700 1 --2- 172.21.15.73:0/3047015269 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca040c4850 0x7fca0414d590 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc9f400ebe0 tx=0x7fc9f4009e20 comp rx=0 tx=0).stop 2024-05-08T21:53:56.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.820+0000 7fca037fe700 1 -- 172.21.15.73:0/3047015269 reap_dead start 2024-05-08T21:53:56.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.820+0000 7fca09a26700 1 -- 172.21.15.73:0/3047015269 shutdown_connections 2024-05-08T21:53:56.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.820+0000 7fca09a26700 1 -- 172.21.15.73:0/3047015269 >> 172.21.15.73:0/3047015269 conn(0x7fca040666c0 msgr2=0x7fca04066aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:53:56.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.820+0000 7fca09a26700 1 -- 172.21.15.73:0/3047015269 shutdown_connections 2024-05-08T21:53:56.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.820+0000 7fca09a26700 1 -- 172.21.15.73:0/3047015269 wait complete. 2024-05-08T21:53:56.833 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-05-08T21:53:56.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.954+0000 7f7287d74700 1 Processor -- start 2024-05-08T21:53:56.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.955+0000 7f7287d74700 1 -- start start 2024-05-08T21:53:56.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.955+0000 7f7287d74700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f72800c9ec0 0x7f728006a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:56.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.955+0000 7f7287d74700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f72800c7df0 0x7f7280150260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:56.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.955+0000 7f7287d74700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72801507a0 con 0x7f72800666c0 2024-05-08T21:53:56.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.955+0000 7f7287d74700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72800c39f0 con 0x7f72800c7df0 2024-05-08T21:53:56.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.955+0000 7f7287d74700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72800ca470 con 0x7f72800c9ec0 2024-05-08T21:53:56.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.955+0000 7f728530f700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f72800c7df0 0x7f7280150260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:56.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.956+0000 7f728530f700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f72800c7df0 0x7f7280150260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56650/0 (socket says 172.21.15.73:56650) 2024-05-08T21:53:56.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.956+0000 7f728530f700 1 -- 172.21.15.73:0/1775937364 learned_addr learned my addr 172.21.15.73:0/1775937364 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:53:56.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.956+0000 7f7285b10700 1 --2- 172.21.15.73:0/1775937364 >> v2:172.21.15.115:3300/0 conn(0x7f72800c9ec0 0x7f728006a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:56.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.956+0000 7f728530f700 1 -- 172.21.15.73:0/1775937364 >> v2:172.21.15.115:3300/0 conn(0x7f72800c9ec0 msgr2=0x7f728006a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:53:56.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.956+0000 7f728530f700 1 --2- 172.21.15.73:0/1775937364 >> v2:172.21.15.115:3300/0 conn(0x7f72800c9ec0 0x7f728006a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:56.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.956+0000 7f728530f700 1 -- 172.21.15.73:0/1775937364 >> v1:172.21.15.115:6789/0 conn(0x7f72800666c0 legacy=0x7f7280159660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:53:56.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.956+0000 7f728530f700 1 -- 172.21.15.73:0/1775937364 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72800c8240 con 0x7f72800c7df0 2024-05-08T21:53:56.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.956+0000 7f728530f700 1 --2- 172.21.15.73:0/1775937364 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72800c7df0 0x7f7280150260 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f728006fb50 tx=0x7f727c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1935ae054191799a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:56.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.956+0000 7f7284b0e700 1 -- 172.21.15.73:0/1775937364 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727c004230 con 0x7f72800c7df0 2024-05-08T21:53:56.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.956+0000 7f7284b0e700 1 -- 172.21.15.73:0/1775937364 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f727c004390 con 0x7f72800c7df0 2024-05-08T21:53:56.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.956+0000 7f7284b0e700 1 -- 172.21.15.73:0/1775937364 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727c0036a0 con 0x7f72800c7df0 2024-05-08T21:53:56.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.957+0000 7f7287d74700 1 -- 172.21.15.73:0/1775937364 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72800c7df0 msgr2=0x7f7280150260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:56.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.957+0000 7f7287d74700 1 --2- 172.21.15.73:0/1775937364 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72800c7df0 0x7f7280150260 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f728006fb50 tx=0x7f727c009bd0 comp rx=0 tx=0).stop 2024-05-08T21:53:56.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.957+0000 7f7287d74700 1 -- 172.21.15.73:0/1775937364 shutdown_connections 2024-05-08T21:53:56.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.957+0000 7f7287d74700 1 --2- 172.21.15.73:0/1775937364 >> v2:172.21.15.115:3300/0 conn(0x7f72800c9ec0 0x7f728006a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:56.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.957+0000 7f7287d74700 1 --2- 172.21.15.73:0/1775937364 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72800c7df0 0x7f7280150260 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:56.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.957+0000 7f7287d74700 1 -- 172.21.15.73:0/1775937364 >> 172.21.15.73:0/1775937364 conn(0x7f728006eb90 msgr2=0x7f728006ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:53:56.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.957+0000 7f7287d74700 1 -- 172.21.15.73:0/1775937364 shutdown_connections 2024-05-08T21:53:56.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.957+0000 7f7287d74700 1 -- 172.21.15.73:0/1775937364 wait complete. 2024-05-08T21:53:56.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.958+0000 7f7287d74700 1 Processor -- start 2024-05-08T21:53:56.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.958+0000 7f7287d74700 1 -- start start 2024-05-08T21:53:56.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.959+0000 7f7287d74700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f72800666c0 0x7f7280142b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:56.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.959+0000 7f7287d74700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72800c7df0 0x7f72800c62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:56.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.959+0000 7f7287d74700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72800c9ec0 0x7f7280144350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:56.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.959+0000 7f7287d74700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72801517d0 con 0x7f72800c7df0 2024-05-08T21:53:56.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.959+0000 7f7287d74700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72801f15e0 con 0x7f72800c9ec0 2024-05-08T21:53:56.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.959+0000 7f7287d74700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72801f1b10 con 0x7f72800666c0 2024-05-08T21:53:56.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.959+0000 7f728530f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72800c7df0 0x7f72800c62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:56.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.959+0000 7f728530f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72800c7df0 0x7f72800c62b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56660/0 (socket says 172.21.15.73:56660) 2024-05-08T21:53:56.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.959+0000 7f728530f700 1 -- 172.21.15.73:0/1839538876 learned_addr learned my addr 172.21.15.73:0/1839538876 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:53:56.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.959+0000 7f7286311700 1 --2- 172.21.15.73:0/1839538876 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72800c9ec0 0x7f7280144350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:56.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.959+0000 7f7285b10700 1 --2- 172.21.15.73:0/1839538876 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f72800666c0 0x7f7280142b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:56.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.959+0000 7f728530f700 1 -- 172.21.15.73:0/1839538876 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f72800666c0 msgr2=0x7f7280142b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:56.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.959+0000 7f728530f700 1 --2- 172.21.15.73:0/1839538876 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f72800666c0 0x7f7280142b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:56.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.959+0000 7f728530f700 1 -- 172.21.15.73:0/1839538876 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72800c9ec0 msgr2=0x7f7280144350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:56.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.959+0000 7f728530f700 1 --2- 172.21.15.73:0/1839538876 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72800c9ec0 0x7f7280144350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:56.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.959+0000 7f728530f700 1 -- 172.21.15.73:0/1839538876 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f727c009550 con 0x7f72800c7df0 2024-05-08T21:53:56.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.959+0000 7f728530f700 1 --2- 172.21.15.73:0/1839538876 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72800c7df0 0x7f72800c62b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f7280150930 tx=0x7f727c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:56.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.959+0000 7f72767fc700 1 -- 172.21.15.73:0/1839538876 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727c003b90 con 0x7f72800c7df0 2024-05-08T21:53:56.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.959+0000 7f72767fc700 1 -- 172.21.15.73:0/1839538876 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f727c01f070 con 0x7f72800c7df0 2024-05-08T21:53:56.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.959+0000 7f7287d74700 1 -- 172.21.15.73:0/1839538876 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7280143ec0 con 0x7f72800c7df0 2024-05-08T21:53:56.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.959+0000 7f72767fc700 1 -- 172.21.15.73:0/1839538876 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727c011630 con 0x7f72800c7df0 2024-05-08T21:53:56.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.959+0000 7f7287d74700 1 -- 172.21.15.73:0/1839538876 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f728014b090 con 0x7f72800c7df0 2024-05-08T21:53:56.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.960+0000 7f7287d74700 1 -- 172.21.15.73:0/1839538876 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72800c35b0 con 0x7f72800c7df0 2024-05-08T21:53:56.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.961+0000 7f72767fc700 1 -- 172.21.15.73:0/1839538876 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f727c021030 con 0x7f72800c7df0 2024-05-08T21:53:56.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.961+0000 7f72767fc700 1 --2- 172.21.15.73:0/1839538876 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f726406ac90 0x7f726406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:56.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.961+0000 7f72767fc700 1 -- 172.21.15.73:0/1839538876 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5969+0+0 (secure 0 0 0) 0x7f727c08a730 con 0x7f72800c7df0 2024-05-08T21:53:56.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.961+0000 7f7285b10700 1 --2- 172.21.15.73:0/1839538876 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f726406ac90 0x7f726406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:56.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.962+0000 7f7285b10700 1 --2- 172.21.15.73:0/1839538876 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f726406ac90 0x7f726406d150 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7270006b20 tx=0x7f7270008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:56.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:56.966+0000 7f72767fc700 1 -- 172.21.15.73:0/1839538876 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f727c055930 con 0x7f72800c7df0 2024-05-08T21:53:57.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.164+0000 7f7287d74700 1 -- 172.21.15.73:0/1839538876 --> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f72800c7310 con 0x7f726406ac90 2024-05-08T21:53:57.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.164+0000 7f72767fc700 1 -- 172.21.15.73:0/1839538876 <== mgr.4104 v2:172.21.15.73:6832/46949 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f72700076b0 con 0x7f726406ac90 2024-05-08T21:53:57.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.166+0000 7f7287d74700 1 -- 172.21.15.73:0/1839538876 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f726406ac90 msgr2=0x7f726406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:57.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.166+0000 7f7287d74700 1 --2- 172.21.15.73:0/1839538876 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f726406ac90 0x7f726406d150 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7270006b20 tx=0x7f7270008040 comp rx=0 tx=0).stop 2024-05-08T21:53:57.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.166+0000 7f7287d74700 1 -- 172.21.15.73:0/1839538876 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72800c7df0 msgr2=0x7f72800c62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:57.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.166+0000 7f7287d74700 1 --2- 172.21.15.73:0/1839538876 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72800c7df0 0x7f72800c62b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f7280150930 tx=0x7f727c004750 comp rx=0 tx=0).stop 2024-05-08T21:53:57.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.166+0000 7f7287d74700 1 -- 172.21.15.73:0/1839538876 shutdown_connections 2024-05-08T21:53:57.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.166+0000 7f7287d74700 1 --2- 172.21.15.73:0/1839538876 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f726406ac90 0x7f726406d150 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:57.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.166+0000 7f7287d74700 1 --2- 172.21.15.73:0/1839538876 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72800c9ec0 0x7f7280144350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:57.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.166+0000 7f7287d74700 1 --2- 172.21.15.73:0/1839538876 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f72800666c0 0x7f7280142b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:57.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.166+0000 7f7287d74700 1 --2- 172.21.15.73:0/1839538876 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72800c7df0 0x7f72800c62b0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:57.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.166+0000 7f7287d74700 1 -- 172.21.15.73:0/1839538876 >> 172.21.15.73:0/1839538876 conn(0x7f728006eb90 msgr2=0x7f728006ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:53:57.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.166+0000 7f7287d74700 1 -- 172.21.15.73:0/1839538876 shutdown_connections 2024-05-08T21:53:57.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.166+0000 7f7287d74700 1 -- 172.21.15.73:0/1839538876 wait complete. 2024-05-08T21:53:57.169 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 4 to deep-scrub 2024-05-08T21:53:57.179 INFO:tasks.ceph:Scrubbing osd.5 2024-05-08T21:53:57.180 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-05-08T21:53:57.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.304+0000 7f854d730700 1 Processor -- start 2024-05-08T21:53:57.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.304+0000 7f854d730700 1 -- start start 2024-05-08T21:53:57.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.305+0000 7f854d730700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f854806c070 0x7f85480ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:57.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.305+0000 7f854d730700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f85480cbf20 0x7f85480cc390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:57.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.305+0000 7f854d730700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8548154320 con 0x7f8548153f40 2024-05-08T21:53:57.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.305+0000 7f854d730700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f854815acb0 con 0x7f854806c070 2024-05-08T21:53:57.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.305+0000 7f854d730700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f854815a410 con 0x7f85480cbf20 2024-05-08T21:53:57.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.305+0000 7f85467fc700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f854806c070 0x7f85480ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:57.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.305+0000 7f85467fc700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f854806c070 0x7f85480ca490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56676/0 (socket says 172.21.15.73:56676) 2024-05-08T21:53:57.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.305+0000 7f85467fc700 1 -- 172.21.15.73:0/1107578243 learned_addr learned my addr 172.21.15.73:0/1107578243 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:53:57.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.305+0000 7f85477fe700 1 --2- 172.21.15.73:0/1107578243 >> v2:172.21.15.115:3300/0 conn(0x7f85480cbf20 0x7f85480cc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:57.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.305+0000 7f85467fc700 1 -- 172.21.15.73:0/1107578243 >> v2:172.21.15.115:3300/0 conn(0x7f85480cbf20 msgr2=0x7f85480cc390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:53:57.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.305+0000 7f85467fc700 1 --2- 172.21.15.73:0/1107578243 >> v2:172.21.15.115:3300/0 conn(0x7f85480cbf20 0x7f85480cc390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:57.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.305+0000 7f85467fc700 1 -- 172.21.15.73:0/1107578243 >> v1:172.21.15.73:6789/0 conn(0x7f8548153f40 legacy=0x7f8548159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:57.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.305+0000 7f85467fc700 1 -- 172.21.15.73:0/1107578243 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f854815a6f0 con 0x7f854806c070 2024-05-08T21:53:57.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.305+0000 7f85467fc700 1 --2- 172.21.15.73:0/1107578243 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f854806c070 0x7f85480ca490 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f854808d4f0 tx=0x7f853c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30f855c2bbac0740 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:57.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.305+0000 7f8545ffb700 1 -- 172.21.15.73:0/1107578243 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853c00b870 con 0x7f854806c070 2024-05-08T21:53:57.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.305+0000 7f8545ffb700 1 -- 172.21.15.73:0/1107578243 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f853c00b9d0 con 0x7f854806c070 2024-05-08T21:53:57.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.305+0000 7f8545ffb700 1 -- 172.21.15.73:0/1107578243 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853c00bd60 con 0x7f854806c070 2024-05-08T21:53:57.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.306+0000 7f854d730700 1 -- 172.21.15.73:0/1107578243 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f854806c070 msgr2=0x7f85480ca490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:57.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.306+0000 7f854d730700 1 --2- 172.21.15.73:0/1107578243 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f854806c070 0x7f85480ca490 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f854808d4f0 tx=0x7f853c009bd0 comp rx=0 tx=0).stop 2024-05-08T21:53:57.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.306+0000 7f854d730700 1 -- 172.21.15.73:0/1107578243 shutdown_connections 2024-05-08T21:53:57.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.306+0000 7f854d730700 1 --2- 172.21.15.73:0/1107578243 >> v2:172.21.15.115:3300/0 conn(0x7f85480cbf20 0x7f85480cc390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:57.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.306+0000 7f854d730700 1 --2- 172.21.15.73:0/1107578243 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f854806c070 0x7f85480ca490 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:57.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.306+0000 7f854d730700 1 -- 172.21.15.73:0/1107578243 >> 172.21.15.73:0/1107578243 conn(0x7f85480666c0 msgr2=0x7f8548066ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:53:57.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.306+0000 7f854d730700 1 -- 172.21.15.73:0/1107578243 shutdown_connections 2024-05-08T21:53:57.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.306+0000 7f854d730700 1 -- 172.21.15.73:0/1107578243 wait complete. 2024-05-08T21:53:57.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.307+0000 7f854d730700 1 Processor -- start 2024-05-08T21:53:57.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.307+0000 7f854d730700 1 -- start start 2024-05-08T21:53:57.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.308+0000 7f854d730700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f854806c070 0x7f854814cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:57.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.308+0000 7f854d730700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f85480cbf20 0x7f8548159680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:57.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.308+0000 7f854d730700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8548153f40 0x7f8548159bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:57.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.308+0000 7f854d730700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85480c7330 con 0x7f8548153f40 2024-05-08T21:53:57.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.308+0000 7f854d730700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85481f05c0 con 0x7f854806c070 2024-05-08T21:53:57.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.308+0000 7f854d730700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85480c7580 con 0x7f85480cbf20 2024-05-08T21:53:57.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.308+0000 7f85477fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8548153f40 0x7f8548159bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:57.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.308+0000 7f85477fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8548153f40 0x7f8548159bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56678/0 (socket says 172.21.15.73:56678) 2024-05-08T21:53:57.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.308+0000 7f85477fe700 1 -- 172.21.15.73:0/3440635142 learned_addr learned my addr 172.21.15.73:0/3440635142 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:53:57.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.308+0000 7f8546ffd700 1 --2- 172.21.15.73:0/3440635142 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f854806c070 0x7f854814cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:57.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.308+0000 7f85467fc700 1 --2- 172.21.15.73:0/3440635142 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f85480cbf20 0x7f8548159680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:57.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.308+0000 7f85477fe700 1 -- 172.21.15.73:0/3440635142 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f85480cbf20 msgr2=0x7f8548159680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:57.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.308+0000 7f85477fe700 1 --2- 172.21.15.73:0/3440635142 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f85480cbf20 0x7f8548159680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:57.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.308+0000 7f85477fe700 1 -- 172.21.15.73:0/3440635142 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f854806c070 msgr2=0x7f854814cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:57.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.308+0000 7f85477fe700 1 --2- 172.21.15.73:0/3440635142 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f854806c070 0x7f854814cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:57.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.308+0000 7f85477fe700 1 -- 172.21.15.73:0/3440635142 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f853c009550 con 0x7f8548153f40 2024-05-08T21:53:57.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.309+0000 7f85477fe700 1 --2- 172.21.15.73:0/3440635142 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8548153f40 0x7f8548159bc0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f8540007e40 tx=0x7f854000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:57.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.309+0000 7f852f7fe700 1 -- 172.21.15.73:0/3440635142 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854000ed30 con 0x7f8548153f40 2024-05-08T21:53:57.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.309+0000 7f852f7fe700 1 -- 172.21.15.73:0/3440635142 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8540014420 con 0x7f8548153f40 2024-05-08T21:53:57.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.309+0000 7f854d730700 1 -- 172.21.15.73:0/3440635142 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85480c7860 con 0x7f8548153f40 2024-05-08T21:53:57.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.309+0000 7f852f7fe700 1 -- 172.21.15.73:0/3440635142 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85400147d0 con 0x7f8548153f40 2024-05-08T21:53:57.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.309+0000 7f854d730700 1 -- 172.21.15.73:0/3440635142 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85480c6b90 con 0x7f8548153f40 2024-05-08T21:53:57.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.309+0000 7f854d730700 1 -- 172.21.15.73:0/3440635142 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8548068b80 con 0x7f8548153f40 2024-05-08T21:53:57.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.310+0000 7f852f7fe700 1 -- 172.21.15.73:0/3440635142 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8540014930 con 0x7f8548153f40 2024-05-08T21:53:57.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.311+0000 7f852f7fe700 1 --2- 172.21.15.73:0/3440635142 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f853406ac90 0x7f853406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:57.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.311+0000 7f852f7fe700 1 -- 172.21.15.73:0/3440635142 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5969+0+0 (secure 0 0 0) 0x7f8540089af0 con 0x7f8548153f40 2024-05-08T21:53:57.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.311+0000 7f8546ffd700 1 --2- 172.21.15.73:0/3440635142 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f853406ac90 0x7f853406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:57.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.311+0000 7f852f7fe700 1 --2- 172.21.15.73:0/3440635142 >> [v2:172.21.15.115:6808/47201,v1:172.21.15.115:6809/47201] conn(0x7f8534073150 0x7f85340755f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:57.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.311+0000 7f852f7fe700 1 -- 172.21.15.73:0/3440635142 --> [v2:172.21.15.115:6808/47201,v1:172.21.15.115:6809/47201] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8534075cc0 con 0x7f8534073150 2024-05-08T21:53:57.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.311+0000 7f852f7fe700 1 -- 172.21.15.73:0/3440635142 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f854008e2c0 con 0x7f8548153f40 2024-05-08T21:53:57.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.311+0000 7f8546ffd700 1 --2- 172.21.15.73:0/3440635142 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f853406ac90 0x7f853406d150 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8538001800 tx=0x7f8538009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:57.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.311+0000 7f85467fc700 1 --2- 172.21.15.73:0/3440635142 >> [v2:172.21.15.115:6808/47201,v1:172.21.15.115:6809/47201] conn(0x7f8534073150 0x7f85340755f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:57.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.312+0000 7f85467fc700 1 --2- 172.21.15.73:0/3440635142 >> [v2:172.21.15.115:6808/47201,v1:172.21.15.115:6809/47201] conn(0x7f8534073150 0x7f85340755f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:57.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.312+0000 7f852f7fe700 1 -- 172.21.15.73:0/3440635142 <== osd.5 v2:172.21.15.115:6808/47201 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f8534075cc0 con 0x7f8534073150 2024-05-08T21:53:57.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.327+0000 7f854d730700 1 -- 172.21.15.73:0/3440635142 --> [v2:172.21.15.115:6808/47201,v1:172.21.15.115:6809/47201] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f85480c76f0 con 0x7f8534073150 2024-05-08T21:53:57.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.327+0000 7f852f7fe700 1 -- 172.21.15.73:0/3440635142 <== osd.5 v2:172.21.15.115:6808/47201 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f85480c76f0 con 0x7f8534073150 2024-05-08T21:53:57.328 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-05-08T21:53:57.328 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T21:53:57.328 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-05-08T21:53:57.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.327+0000 7f854d730700 1 -- 172.21.15.73:0/3440635142 >> [v2:172.21.15.115:6808/47201,v1:172.21.15.115:6809/47201] conn(0x7f8534073150 msgr2=0x7f85340755f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:57.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.327+0000 7f854d730700 1 --2- 172.21.15.73:0/3440635142 >> [v2:172.21.15.115:6808/47201,v1:172.21.15.115:6809/47201] conn(0x7f8534073150 0x7f85340755f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:57.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.327+0000 7f854d730700 1 -- 172.21.15.73:0/3440635142 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f853406ac90 msgr2=0x7f853406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:57.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.327+0000 7f854d730700 1 --2- 172.21.15.73:0/3440635142 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f853406ac90 0x7f853406d150 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8538001800 tx=0x7f8538009040 comp rx=0 tx=0).stop 2024-05-08T21:53:57.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.327+0000 7f854d730700 1 -- 172.21.15.73:0/3440635142 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8548153f40 msgr2=0x7f8548159bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:57.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.327+0000 7f854d730700 1 --2- 172.21.15.73:0/3440635142 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8548153f40 0x7f8548159bc0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f8540007e40 tx=0x7f854000e3c0 comp rx=0 tx=0).stop 2024-05-08T21:53:57.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.327+0000 7f85477fe700 1 -- 172.21.15.73:0/3440635142 reap_dead start 2024-05-08T21:53:57.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.327+0000 7f854d730700 1 -- 172.21.15.73:0/3440635142 shutdown_connections 2024-05-08T21:53:57.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.327+0000 7f854d730700 1 -- 172.21.15.73:0/3440635142 >> 172.21.15.73:0/3440635142 conn(0x7f85480666c0 msgr2=0x7f8548149d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:53:57.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.328+0000 7f854d730700 1 -- 172.21.15.73:0/3440635142 shutdown_connections 2024-05-08T21:53:57.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.328+0000 7f854d730700 1 -- 172.21.15.73:0/3440635142 wait complete. 2024-05-08T21:53:57.340 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-05-08T21:53:57.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.462+0000 7fcb7d0f9700 1 Processor -- start 2024-05-08T21:53:57.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.462+0000 7fcb7d0f9700 1 -- start start 2024-05-08T21:53:57.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.463+0000 7fcb7d0f9700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcb7815dd50 0x7fcb780cd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:57.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.463+0000 7fcb7d0f9700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcb7806ff30 0x7fcb780c8750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:57.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.463+0000 7fcb7d0f9700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb7806f310 con 0x7fcb7806d820 2024-05-08T21:53:57.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.463+0000 7fcb7d0f9700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb7806d240 con 0x7fcb7806ff30 2024-05-08T21:53:57.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.463+0000 7fcb7d0f9700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb780cd530 con 0x7fcb7815dd50 2024-05-08T21:53:57.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.463+0000 7fcb7659c700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcb7806ff30 0x7fcb780c8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:57.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.463+0000 7fcb7659c700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcb7806ff30 0x7fcb780c8750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56692/0 (socket says 172.21.15.73:56692) 2024-05-08T21:53:57.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.463+0000 7fcb7659c700 1 -- 172.21.15.73:0/3216987848 learned_addr learned my addr 172.21.15.73:0/3216987848 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:53:57.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.463+0000 7fcb76d9d700 1 --2- 172.21.15.73:0/3216987848 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcb7815dd50 0x7fcb780cd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:57.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.463+0000 7fcb7659c700 1 -- 172.21.15.73:0/3216987848 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcb7815dd50 msgr2=0x7fcb780cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:53:57.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.463+0000 7fcb7659c700 1 --2- 172.21.15.73:0/3216987848 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcb7815dd50 0x7fcb780cd9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:57.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.463+0000 7fcb7659c700 1 -- 172.21.15.73:0/3216987848 >> v1:172.21.15.115:6789/0 conn(0x7fcb7806d820 legacy=0x7fcb780ca050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:57.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.463+0000 7fcb7659c700 1 -- 172.21.15.73:0/3216987848 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb780c81d0 con 0x7fcb7806ff30 2024-05-08T21:53:57.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.463+0000 7fcb76d9d700 1 --2- 172.21.15.73:0/3216987848 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcb7815dd50 0x7fcb780cd9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:53:57.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.463+0000 7fcb7659c700 1 --2- 172.21.15.73:0/3216987848 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb7806ff30 0x7fcb780c8750 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fcb680098f0 tx=0x7fcb68009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=457dc1b6707bb022 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:57.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.464+0000 7fcb75d9b700 1 -- 172.21.15.73:0/3216987848 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6800b8a0 con 0x7fcb7806ff30 2024-05-08T21:53:57.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.464+0000 7fcb75d9b700 1 -- 172.21.15.73:0/3216987848 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb6800ba00 con 0x7fcb7806ff30 2024-05-08T21:53:57.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.464+0000 7fcb75d9b700 1 -- 172.21.15.73:0/3216987848 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6800bd90 con 0x7fcb7806ff30 2024-05-08T21:53:57.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.464+0000 7fcb7d0f9700 1 -- 172.21.15.73:0/3216987848 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb7806ff30 msgr2=0x7fcb780c8750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:57.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.464+0000 7fcb7d0f9700 1 --2- 172.21.15.73:0/3216987848 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb7806ff30 0x7fcb780c8750 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fcb680098f0 tx=0x7fcb68009c00 comp rx=0 tx=0).stop 2024-05-08T21:53:57.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.464+0000 7fcb7d0f9700 1 -- 172.21.15.73:0/3216987848 shutdown_connections 2024-05-08T21:53:57.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.464+0000 7fcb7d0f9700 1 --2- 172.21.15.73:0/3216987848 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcb7815dd50 0x7fcb780cd9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:57.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.464+0000 7fcb7d0f9700 1 --2- 172.21.15.73:0/3216987848 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb7806ff30 0x7fcb780c8750 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:57.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.464+0000 7fcb7d0f9700 1 -- 172.21.15.73:0/3216987848 >> 172.21.15.73:0/3216987848 conn(0x7fcb7806aff0 msgr2=0x7fcb780666c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:53:57.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.464+0000 7fcb7d0f9700 1 -- 172.21.15.73:0/3216987848 shutdown_connections 2024-05-08T21:53:57.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.464+0000 7fcb7d0f9700 1 -- 172.21.15.73:0/3216987848 wait complete. 2024-05-08T21:53:57.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.466+0000 7fcb7d0f9700 1 Processor -- start 2024-05-08T21:53:57.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.466+0000 7fcb7d0f9700 1 -- start start 2024-05-08T21:53:57.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.466+0000 7fcb7d0f9700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcb7806d820 0x7fcb781e6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:57.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.466+0000 7fcb7d0f9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb7806ff30 0x7fcb78070d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:57.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.466+0000 7fcb7d0f9700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb7815dd50 0x7fcb781efb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:57.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.466+0000 7fcb7d0f9700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb780c6260 con 0x7fcb7806ff30 2024-05-08T21:53:57.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.466+0000 7fcb7d0f9700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb780c6d30 con 0x7fcb7815dd50 2024-05-08T21:53:57.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.466+0000 7fcb7d0f9700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb780b1e20 con 0x7fcb7806d820 2024-05-08T21:53:57.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.467+0000 7fcb7659c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb7806ff30 0x7fcb78070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:57.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.467+0000 7fcb7659c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb7806ff30 0x7fcb78070d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56700/0 (socket says 172.21.15.73:56700) 2024-05-08T21:53:57.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.467+0000 7fcb7659c700 1 -- 172.21.15.73:0/731656283 learned_addr learned my addr 172.21.15.73:0/731656283 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:53:57.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.467+0000 7fcb76d9d700 1 --2- 172.21.15.73:0/731656283 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcb7806d820 0x7fcb781e6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:57.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.467+0000 7fcb7759e700 1 --2- 172.21.15.73:0/731656283 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb7815dd50 0x7fcb781efb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:57.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.467+0000 7fcb7659c700 1 -- 172.21.15.73:0/731656283 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcb7806d820 msgr2=0x7fcb781e6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:57.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.467+0000 7fcb7659c700 1 --2- 172.21.15.73:0/731656283 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcb7806d820 0x7fcb781e6870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:57.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.467+0000 7fcb7659c700 1 -- 172.21.15.73:0/731656283 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb7815dd50 msgr2=0x7fcb781efb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:57.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.467+0000 7fcb7659c700 1 --2- 172.21.15.73:0/731656283 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb7815dd50 0x7fcb781efb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:57.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.467+0000 7fcb7659c700 1 -- 172.21.15.73:0/731656283 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb68009550 con 0x7fcb7806ff30 2024-05-08T21:53:57.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.467+0000 7fcb7659c700 1 --2- 172.21.15.73:0/731656283 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb7806ff30 0x7fcb78070d20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fcb68000c00 tx=0x7fcb68004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:57.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.467+0000 7fcb5f7fe700 1 -- 172.21.15.73:0/731656283 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb68004480 con 0x7fcb7806ff30 2024-05-08T21:53:57.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.467+0000 7fcb5f7fe700 1 -- 172.21.15.73:0/731656283 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb6801f070 con 0x7fcb7806ff30 2024-05-08T21:53:57.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.467+0000 7fcb5f7fe700 1 -- 172.21.15.73:0/731656283 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb680038a0 con 0x7fcb7806ff30 2024-05-08T21:53:57.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.467+0000 7fcb7d0f9700 1 -- 172.21.15.73:0/731656283 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb780b20c0 con 0x7fcb7806ff30 2024-05-08T21:53:57.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.467+0000 7fcb7d0f9700 1 -- 172.21.15.73:0/731656283 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb780b2680 con 0x7fcb7806ff30 2024-05-08T21:53:57.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.468+0000 7fcb7d0f9700 1 -- 172.21.15.73:0/731656283 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb78068b80 con 0x7fcb7806ff30 2024-05-08T21:53:57.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.469+0000 7fcb5f7fe700 1 -- 172.21.15.73:0/731656283 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fcb68021030 con 0x7fcb7806ff30 2024-05-08T21:53:57.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.469+0000 7fcb5f7fe700 1 --2- 172.21.15.73:0/731656283 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fcb6406ac90 0x7fcb6406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:57.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.469+0000 7fcb5f7fe700 1 -- 172.21.15.73:0/731656283 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5969+0+0 (secure 0 0 0) 0x7fcb6808a6f0 con 0x7fcb7806ff30 2024-05-08T21:53:57.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.469+0000 7fcb76d9d700 1 --2- 172.21.15.73:0/731656283 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fcb6406ac90 0x7fcb6406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:57.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.469+0000 7fcb76d9d700 1 --2- 172.21.15.73:0/731656283 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fcb6406ac90 0x7fcb6406d150 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c00d8b0 tx=0x7fcb6c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:57.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.473+0000 7fcb5f7fe700 1 -- 172.21.15.73:0/731656283 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fcb68055850 con 0x7fcb7806ff30 2024-05-08T21:53:57.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.671+0000 7fcb7d0f9700 1 -- 172.21.15.73:0/731656283 --> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fcb7806be50 con 0x7fcb6406ac90 2024-05-08T21:53:57.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.672+0000 7fcb5f7fe700 1 -- 172.21.15.73:0/731656283 <== mgr.4104 v2:172.21.15.73:6832/46949 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fcb6c013400 con 0x7fcb6406ac90 2024-05-08T21:53:57.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.674+0000 7fcb7d0f9700 1 -- 172.21.15.73:0/731656283 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fcb6406ac90 msgr2=0x7fcb6406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:57.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.674+0000 7fcb7d0f9700 1 --2- 172.21.15.73:0/731656283 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fcb6406ac90 0x7fcb6406d150 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c00d8b0 tx=0x7fcb6c008040 comp rx=0 tx=0).stop 2024-05-08T21:53:57.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.674+0000 7fcb7d0f9700 1 -- 172.21.15.73:0/731656283 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb7806ff30 msgr2=0x7fcb78070d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:57.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.674+0000 7fcb7d0f9700 1 --2- 172.21.15.73:0/731656283 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb7806ff30 0x7fcb78070d20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fcb68000c00 tx=0x7fcb68004750 comp rx=0 tx=0).stop 2024-05-08T21:53:57.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.674+0000 7fcb7d0f9700 1 -- 172.21.15.73:0/731656283 shutdown_connections 2024-05-08T21:53:57.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.674+0000 7fcb7d0f9700 1 --2- 172.21.15.73:0/731656283 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fcb6406ac90 0x7fcb6406d150 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:57.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.674+0000 7fcb7d0f9700 1 --2- 172.21.15.73:0/731656283 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb7815dd50 0x7fcb781efb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:57.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.674+0000 7fcb7d0f9700 1 --2- 172.21.15.73:0/731656283 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcb7806d820 0x7fcb781e6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:57.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.674+0000 7fcb7d0f9700 1 --2- 172.21.15.73:0/731656283 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb7806ff30 0x7fcb78070d20 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:57.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.674+0000 7fcb7d0f9700 1 -- 172.21.15.73:0/731656283 >> 172.21.15.73:0/731656283 conn(0x7fcb7806aff0 msgr2=0x7fcb780c8650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:53:57.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.674+0000 7fcb7d0f9700 1 -- 172.21.15.73:0/731656283 shutdown_connections 2024-05-08T21:53:57.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.674+0000 7fcb7d0f9700 1 -- 172.21.15.73:0/731656283 wait complete. 2024-05-08T21:53:57.676 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 5 to deep-scrub 2024-05-08T21:53:57.687 INFO:tasks.ceph:Scrubbing osd.6 2024-05-08T21:53:57.687 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-05-08T21:53:57.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.813+0000 7fd3a0121700 1 Processor -- start 2024-05-08T21:53:57.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.813+0000 7fd3a0121700 1 -- start start 2024-05-08T21:53:57.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.814+0000 7fd3a0121700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd398151f00 0x7fd39815bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:57.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.814+0000 7fd3a0121700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd39806eb30 0x7fd398157a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:57.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.814+0000 7fd3a0121700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd398157fd0 con 0x7fd3980b2890 2024-05-08T21:53:57.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.814+0000 7fd3a0121700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3980c8030 con 0x7fd398151f00 2024-05-08T21:53:57.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.814+0000 7fd3a0121700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3980c8310 con 0x7fd39806eb30 2024-05-08T21:53:57.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.814+0000 7fd39debd700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd398151f00 0x7fd39815bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:57.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.814+0000 7fd39debd700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd398151f00 0x7fd39815bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56716/0 (socket says 172.21.15.73:56716) 2024-05-08T21:53:57.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.814+0000 7fd39debd700 1 -- 172.21.15.73:0/386829408 learned_addr learned my addr 172.21.15.73:0/386829408 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:53:57.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.814+0000 7fd39e6be700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fd3980b2890 0x7fd3980c2650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:33682/0 (socket says 172.21.15.73:33682) 2024-05-08T21:53:57.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.814+0000 7fd39d6bc700 1 --2- 172.21.15.73:0/386829408 >> v2:172.21.15.115:3300/0 conn(0x7fd39806eb30 0x7fd398157a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:57.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.814+0000 7fd39debd700 1 -- 172.21.15.73:0/386829408 >> v2:172.21.15.115:3300/0 conn(0x7fd39806eb30 msgr2=0x7fd398157a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:53:57.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.814+0000 7fd39debd700 1 --2- 172.21.15.73:0/386829408 >> v2:172.21.15.115:3300/0 conn(0x7fd39806eb30 0x7fd398157a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:57.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.814+0000 7fd39debd700 1 -- 172.21.15.73:0/386829408 >> v1:172.21.15.73:6789/0 conn(0x7fd3980b2890 legacy=0x7fd3980c2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:57.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.814+0000 7fd39debd700 1 -- 172.21.15.73:0/386829408 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3980c85f0 con 0x7fd398151f00 2024-05-08T21:53:57.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.815+0000 7fd39debd700 1 --2- 172.21.15.73:0/386829408 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd398151f00 0x7fd39815bae0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd3980676a0 tx=0x7fd388009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b9ba537008a3b0d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:57.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.815+0000 7fd39cebb700 1 -- 172.21.15.73:0/386829408 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd388011830 con 0x7fd398151f00 2024-05-08T21:53:57.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.815+0000 7fd39cebb700 1 -- 172.21.15.73:0/386829408 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd388011990 con 0x7fd398151f00 2024-05-08T21:53:57.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.815+0000 7fd39cebb700 1 -- 172.21.15.73:0/386829408 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd388011d20 con 0x7fd398151f00 2024-05-08T21:53:57.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.815+0000 7fd3a0121700 1 -- 172.21.15.73:0/386829408 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd398151f00 msgr2=0x7fd39815bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:57.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.815+0000 7fd3a0121700 1 --2- 172.21.15.73:0/386829408 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd398151f00 0x7fd39815bae0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd3980676a0 tx=0x7fd388009bd0 comp rx=0 tx=0).stop 2024-05-08T21:53:57.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.815+0000 7fd3a0121700 1 -- 172.21.15.73:0/386829408 shutdown_connections 2024-05-08T21:53:57.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.815+0000 7fd3a0121700 1 --2- 172.21.15.73:0/386829408 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd398151f00 0x7fd39815bae0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:57.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.815+0000 7fd3a0121700 1 --2- 172.21.15.73:0/386829408 >> v2:172.21.15.115:3300/0 conn(0x7fd39806eb30 0x7fd398157a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:57.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.815+0000 7fd3a0121700 1 -- 172.21.15.73:0/386829408 >> 172.21.15.73:0/386829408 conn(0x7fd39806ade0 msgr2=0x7fd3980666c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:53:57.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.815+0000 7fd3a0121700 1 -- 172.21.15.73:0/386829408 shutdown_connections 2024-05-08T21:53:57.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.815+0000 7fd3a0121700 1 -- 172.21.15.73:0/386829408 wait complete. 2024-05-08T21:53:57.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.817+0000 7fd3a0121700 1 Processor -- start 2024-05-08T21:53:57.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.817+0000 7fd3a0121700 1 -- start start 2024-05-08T21:53:57.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.817+0000 7fd3a0121700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd39806eb30 0x7fd3981f0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:57.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.817+0000 7fd3a0121700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3980b2890 0x7fd3981550a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:57.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.817+0000 7fd3a0121700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd398151f00 0x7fd3980c9d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:57.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.817+0000 7fd3a0121700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd398153150 con 0x7fd39806eb30 2024-05-08T21:53:57.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.817+0000 7fd3a0121700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd398154c80 con 0x7fd3980b2890 2024-05-08T21:53:57.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.817+0000 7fd3a0121700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3980cadb0 con 0x7fd398151f00 2024-05-08T21:53:57.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.817+0000 7fd39debd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd39806eb30 0x7fd3981f0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:57.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.817+0000 7fd39debd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd39806eb30 0x7fd3981f0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56730/0 (socket says 172.21.15.73:56730) 2024-05-08T21:53:57.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.817+0000 7fd39debd700 1 -- 172.21.15.73:0/2051154674 learned_addr learned my addr 172.21.15.73:0/2051154674 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:53:57.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.818+0000 7fd39d6bc700 1 --2- 172.21.15.73:0/2051154674 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3980b2890 0x7fd3981550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:57.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.818+0000 7fd39debd700 1 -- 172.21.15.73:0/2051154674 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd398151f00 msgr2=0x7fd3980c9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:57.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.818+0000 7fd39e6be700 1 --2- 172.21.15.73:0/2051154674 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd398151f00 0x7fd3980c9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:57.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.818+0000 7fd39debd700 1 --2- 172.21.15.73:0/2051154674 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd398151f00 0x7fd3980c9d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:57.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.818+0000 7fd39debd700 1 -- 172.21.15.73:0/2051154674 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3980b2890 msgr2=0x7fd3981550a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:57.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.818+0000 7fd39debd700 1 --2- 172.21.15.73:0/2051154674 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3980b2890 0x7fd3981550a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:57.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.818+0000 7fd39debd700 1 -- 172.21.15.73:0/2051154674 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd388009550 con 0x7fd39806eb30 2024-05-08T21:53:57.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.818+0000 7fd39d6bc700 1 --2- 172.21.15.73:0/2051154674 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3980b2890 0x7fd3981550a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:53:57.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.818+0000 7fd39debd700 1 --2- 172.21.15.73:0/2051154674 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd39806eb30 0x7fd3981f0410 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd388014040 tx=0x7fd388004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:57.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.818+0000 7fd38e7fc700 1 -- 172.21.15.73:0/2051154674 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3880036a0 con 0x7fd39806eb30 2024-05-08T21:53:57.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.818+0000 7fd38e7fc700 1 -- 172.21.15.73:0/2051154674 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd38801e070 con 0x7fd39806eb30 2024-05-08T21:53:57.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.818+0000 7fd3a0121700 1 -- 172.21.15.73:0/2051154674 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd39815a4c0 con 0x7fd39806eb30 2024-05-08T21:53:57.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.818+0000 7fd38e7fc700 1 -- 172.21.15.73:0/2051154674 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd388003a60 con 0x7fd39806eb30 2024-05-08T21:53:57.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.818+0000 7fd3a0121700 1 -- 172.21.15.73:0/2051154674 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3980caad0 con 0x7fd39806eb30 2024-05-08T21:53:57.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.819+0000 7fd3a0121700 1 -- 172.21.15.73:0/2051154674 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd39815b5c0 con 0x7fd39806eb30 2024-05-08T21:53:57.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.819+0000 7fd38e7fc700 1 -- 172.21.15.73:0/2051154674 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd388003bc0 con 0x7fd39806eb30 2024-05-08T21:53:57.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.820+0000 7fd38e7fc700 1 --2- 172.21.15.73:0/2051154674 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fd37c06ac90 0x7fd37c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:57.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.820+0000 7fd38e7fc700 1 -- 172.21.15.73:0/2051154674 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5969+0+0 (secure 0 0 0) 0x7fd38808a340 con 0x7fd39806eb30 2024-05-08T21:53:57.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.820+0000 7fd39d6bc700 1 --2- 172.21.15.73:0/2051154674 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fd37c06ac90 0x7fd37c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:57.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.820+0000 7fd38e7fc700 1 --2- 172.21.15.73:0/2051154674 >> [v2:172.21.15.115:6816/47202,v1:172.21.15.115:6817/47202] conn(0x7fd37c073150 0x7fd37c0755f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:57.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.820+0000 7fd38e7fc700 1 -- 172.21.15.73:0/2051154674 --> [v2:172.21.15.115:6816/47202,v1:172.21.15.115:6817/47202] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd37c075cc0 con 0x7fd37c073150 2024-05-08T21:53:57.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.820+0000 7fd38e7fc700 1 -- 172.21.15.73:0/2051154674 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd38808ca00 con 0x7fd39806eb30 2024-05-08T21:53:57.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.820+0000 7fd39e6be700 1 --2- 172.21.15.73:0/2051154674 >> [v2:172.21.15.115:6816/47202,v1:172.21.15.115:6817/47202] conn(0x7fd37c073150 0x7fd37c0755f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:57.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.820+0000 7fd39d6bc700 1 --2- 172.21.15.73:0/2051154674 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fd37c06ac90 0x7fd37c06d150 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd39815a920 tx=0x7fd394008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:57.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.821+0000 7fd39e6be700 1 --2- 172.21.15.73:0/2051154674 >> [v2:172.21.15.115:6816/47202,v1:172.21.15.115:6817/47202] conn(0x7fd37c073150 0x7fd37c0755f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:57.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.821+0000 7fd38e7fc700 1 -- 172.21.15.73:0/2051154674 <== osd.6 v2:172.21.15.115:6816/47202 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fd37c075cc0 con 0x7fd37c073150 2024-05-08T21:53:57.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.836+0000 7fd3a0121700 1 -- 172.21.15.73:0/2051154674 --> [v2:172.21.15.115:6816/47202,v1:172.21.15.115:6817/47202] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd39815b2e0 con 0x7fd37c073150 2024-05-08T21:53:57.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.836+0000 7fd38e7fc700 1 -- 172.21.15.73:0/2051154674 <== osd.6 v2:172.21.15.115:6816/47202 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fd3900070e0 con 0x7fd37c073150 2024-05-08T21:53:57.837 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-05-08T21:53:57.837 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T21:53:57.837 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-05-08T21:53:57.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.837+0000 7fd3a0121700 1 -- 172.21.15.73:0/2051154674 >> [v2:172.21.15.115:6816/47202,v1:172.21.15.115:6817/47202] conn(0x7fd37c073150 msgr2=0x7fd37c0755f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:57.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.837+0000 7fd3a0121700 1 --2- 172.21.15.73:0/2051154674 >> [v2:172.21.15.115:6816/47202,v1:172.21.15.115:6817/47202] conn(0x7fd37c073150 0x7fd37c0755f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:57.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.837+0000 7fd3a0121700 1 -- 172.21.15.73:0/2051154674 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fd37c06ac90 msgr2=0x7fd37c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:57.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.837+0000 7fd3a0121700 1 --2- 172.21.15.73:0/2051154674 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fd37c06ac90 0x7fd37c06d150 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd39815a920 tx=0x7fd394008040 comp rx=0 tx=0).stop 2024-05-08T21:53:57.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.837+0000 7fd3a0121700 1 -- 172.21.15.73:0/2051154674 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd39806eb30 msgr2=0x7fd3981f0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:57.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.837+0000 7fd3a0121700 1 --2- 172.21.15.73:0/2051154674 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd39806eb30 0x7fd3981f0410 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd388014040 tx=0x7fd388004750 comp rx=0 tx=0).stop 2024-05-08T21:53:57.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.837+0000 7fd39e6be700 1 -- 172.21.15.73:0/2051154674 reap_dead start 2024-05-08T21:53:57.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.837+0000 7fd3a0121700 1 -- 172.21.15.73:0/2051154674 shutdown_connections 2024-05-08T21:53:57.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.837+0000 7fd3a0121700 1 -- 172.21.15.73:0/2051154674 >> 172.21.15.73:0/2051154674 conn(0x7fd39806ade0 msgr2=0x7fd3980666c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:53:57.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.837+0000 7fd3a0121700 1 -- 172.21.15.73:0/2051154674 shutdown_connections 2024-05-08T21:53:57.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.837+0000 7fd3a0121700 1 -- 172.21.15.73:0/2051154674 wait complete. 2024-05-08T21:53:57.849 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-05-08T21:53:57.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.970+0000 7f7c0b485700 1 Processor -- start 2024-05-08T21:53:57.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.970+0000 7f7c0b485700 1 -- start start 2024-05-08T21:53:57.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.971+0000 7f7c0b485700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7c04153d20 0x7f7c040c8020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:57.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.971+0000 7f7c0b485700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7c040c64f0 0x7f7c04159b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:57.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.971+0000 7f7c0b485700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c0406b1f0 con 0x7f7c0406ad80 2024-05-08T21:53:57.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.971+0000 7f7c0b485700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c04072670 con 0x7f7c04153d20 2024-05-08T21:53:57.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.971+0000 7f7c0b485700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c04072910 con 0x7f7c040c64f0 2024-05-08T21:53:57.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.971+0000 7f7c09221700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7c04153d20 0x7f7c040c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:57.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.971+0000 7f7c09221700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7c04153d20 0x7f7c040c8020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56734/0 (socket says 172.21.15.73:56734) 2024-05-08T21:53:57.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.971+0000 7f7c09221700 1 -- 172.21.15.73:0/3119396588 learned_addr learned my addr 172.21.15.73:0/3119396588 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:53:57.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.971+0000 7f7c08a20700 1 --2- 172.21.15.73:0/3119396588 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7c040c64f0 0x7f7c04159b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:57.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.971+0000 7f7c09221700 1 -- 172.21.15.73:0/3119396588 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7c040c64f0 msgr2=0x7f7c04159b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:53:57.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.971+0000 7f7c09221700 1 --2- 172.21.15.73:0/3119396588 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7c040c64f0 0x7f7c04159b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:57.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.971+0000 7f7c09221700 1 -- 172.21.15.73:0/3119396588 >> v1:172.21.15.115:6789/0 conn(0x7f7c0406ad80 legacy=0x7f7c040719b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:57.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.971+0000 7f7c09221700 1 -- 172.21.15.73:0/3119396588 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c040c7820 con 0x7f7c04153d20 2024-05-08T21:53:57.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.971+0000 7f7c08a20700 1 --2- 172.21.15.73:0/3119396588 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7c040c64f0 0x7f7c04159b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:53:57.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.972+0000 7f7c09221700 1 --2- 172.21.15.73:0/3119396588 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c04153d20 0x7f7c040c8020 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7bf40098f0 tx=0x7f7bf4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6ece4197936bae1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:57.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.972+0000 7f7bfbfff700 1 -- 172.21.15.73:0/3119396588 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf400b8a0 con 0x7f7c04153d20 2024-05-08T21:53:57.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.972+0000 7f7bfbfff700 1 -- 172.21.15.73:0/3119396588 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bf400ba00 con 0x7f7c04153d20 2024-05-08T21:53:57.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.972+0000 7f7bfbfff700 1 -- 172.21.15.73:0/3119396588 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf400bd90 con 0x7f7c04153d20 2024-05-08T21:53:57.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.972+0000 7f7c0b485700 1 -- 172.21.15.73:0/3119396588 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c04153d20 msgr2=0x7f7c040c8020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:57.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.972+0000 7f7c0b485700 1 --2- 172.21.15.73:0/3119396588 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c04153d20 0x7f7c040c8020 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7bf40098f0 tx=0x7f7bf4009c00 comp rx=0 tx=0).stop 2024-05-08T21:53:57.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.972+0000 7f7c0b485700 1 -- 172.21.15.73:0/3119396588 shutdown_connections 2024-05-08T21:53:57.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.972+0000 7f7c0b485700 1 --2- 172.21.15.73:0/3119396588 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c04153d20 0x7f7c040c8020 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:57.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.972+0000 7f7c0b485700 1 --2- 172.21.15.73:0/3119396588 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7c040c64f0 0x7f7c04159b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:57.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.972+0000 7f7c0b485700 1 -- 172.21.15.73:0/3119396588 >> 172.21.15.73:0/3119396588 conn(0x7f7c04066ab0 msgr2=0x7f7c0406f550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:53:57.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.972+0000 7f7c0b485700 1 -- 172.21.15.73:0/3119396588 shutdown_connections 2024-05-08T21:53:57.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.972+0000 7f7c0b485700 1 -- 172.21.15.73:0/3119396588 wait complete. 2024-05-08T21:53:57.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.974+0000 7f7c0b485700 1 Processor -- start 2024-05-08T21:53:57.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.974+0000 7f7c0b485700 1 -- start start 2024-05-08T21:53:57.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.975+0000 7f7c0b485700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7c0406ad80 0x7f7c04154e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:57.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.975+0000 7f7c0b485700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c040c64f0 0x7f7c040cb610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:57.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.975+0000 7f7c0b485700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7c04153d20 0x7f7c04155440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:57.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.975+0000 7f7c0b485700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c041e6e90 con 0x7f7c040c64f0 2024-05-08T21:53:57.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.975+0000 7f7c0b485700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c041594c0 con 0x7f7c0406ad80 2024-05-08T21:53:57.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.975+0000 7f7c0b485700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c041f00c0 con 0x7f7c04153d20 2024-05-08T21:53:57.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.975+0000 7f7c08a20700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c040c64f0 0x7f7c040cb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:57.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.975+0000 7f7c08a20700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c040c64f0 0x7f7c040cb610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56736/0 (socket says 172.21.15.73:56736) 2024-05-08T21:53:57.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.975+0000 7f7c08a20700 1 -- 172.21.15.73:0/754524421 learned_addr learned my addr 172.21.15.73:0/754524421 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:53:57.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.975+0000 7f7c09221700 1 --2- 172.21.15.73:0/754524421 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7c0406ad80 0x7f7c04154e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:57.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.975+0000 7f7c09a22700 1 --2- 172.21.15.73:0/754524421 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7c04153d20 0x7f7c04155440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:57.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.975+0000 7f7c08a20700 1 -- 172.21.15.73:0/754524421 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7c04153d20 msgr2=0x7f7c04155440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:57.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.975+0000 7f7c08a20700 1 --2- 172.21.15.73:0/754524421 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7c04153d20 0x7f7c04155440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:57.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.975+0000 7f7c08a20700 1 -- 172.21.15.73:0/754524421 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7c0406ad80 msgr2=0x7f7c04154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:57.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.975+0000 7f7c08a20700 1 --2- 172.21.15.73:0/754524421 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7c0406ad80 0x7f7c04154e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:57.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.975+0000 7f7c08a20700 1 -- 172.21.15.73:0/754524421 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf4009550 con 0x7f7c040c64f0 2024-05-08T21:53:57.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.975+0000 7f7c08a20700 1 --2- 172.21.15.73:0/754524421 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c040c64f0 0x7f7c040cb610 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7c0000c780 tx=0x7f7c0000ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:57.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.975+0000 7f7bf9ffb700 1 -- 172.21.15.73:0/754524421 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c00011800 con 0x7f7c040c64f0 2024-05-08T21:53:57.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.975+0000 7f7bf9ffb700 1 -- 172.21.15.73:0/754524421 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c00011960 con 0x7f7c040c64f0 2024-05-08T21:53:57.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.975+0000 7f7c0b485700 1 -- 172.21.15.73:0/754524421 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c041f0550 con 0x7f7c040c64f0 2024-05-08T21:53:57.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.976+0000 7f7bf9ffb700 1 -- 172.21.15.73:0/754524421 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c00011cd0 con 0x7f7c040c64f0 2024-05-08T21:53:57.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.976+0000 7f7c0b485700 1 -- 172.21.15.73:0/754524421 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c041ef790 con 0x7f7c040c64f0 2024-05-08T21:53:57.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.977+0000 7f7c0b485700 1 -- 172.21.15.73:0/754524421 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c04068b80 con 0x7f7c040c64f0 2024-05-08T21:53:57.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.977+0000 7f7bf9ffb700 1 -- 172.21.15.73:0/754524421 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7c00021350 con 0x7f7c040c64f0 2024-05-08T21:53:57.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.977+0000 7f7bf9ffb700 1 --2- 172.21.15.73:0/754524421 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f7be806ac90 0x7f7be806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:57.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.977+0000 7f7bf9ffb700 1 -- 172.21.15.73:0/754524421 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5969+0+0 (secure 0 0 0) 0x7f7c000891f0 con 0x7f7c040c64f0 2024-05-08T21:53:57.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.977+0000 7f7c09221700 1 --2- 172.21.15.73:0/754524421 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f7be806ac90 0x7f7be806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:57.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.978+0000 7f7c09221700 1 --2- 172.21.15.73:0/754524421 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f7be806ac90 0x7f7be806d150 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7bf4014040 tx=0x7f7bf4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:57.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:57.982+0000 7f7bf9ffb700 1 -- 172.21.15.73:0/754524421 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f7c00054350 con 0x7f7c040c64f0 2024-05-08T21:53:58.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.181+0000 7f7c0b485700 1 -- 172.21.15.73:0/754524421 --> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f7c040c3cc0 con 0x7f7be806ac90 2024-05-08T21:53:58.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.181+0000 7f7bf9ffb700 1 -- 172.21.15.73:0/754524421 <== mgr.4104 v2:172.21.15.73:6832/46949 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7c040c3cc0 con 0x7f7be806ac90 2024-05-08T21:53:58.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.183+0000 7f7c0b485700 1 -- 172.21.15.73:0/754524421 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f7be806ac90 msgr2=0x7f7be806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:58.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.184+0000 7f7c0b485700 1 --2- 172.21.15.73:0/754524421 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f7be806ac90 0x7f7be806d150 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7bf4014040 tx=0x7f7bf4008030 comp rx=0 tx=0).stop 2024-05-08T21:53:58.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.184+0000 7f7c0b485700 1 -- 172.21.15.73:0/754524421 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c040c64f0 msgr2=0x7f7c040cb610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:58.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.184+0000 7f7c0b485700 1 --2- 172.21.15.73:0/754524421 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c040c64f0 0x7f7c040cb610 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7c0000c780 tx=0x7f7c0000ca90 comp rx=0 tx=0).stop 2024-05-08T21:53:58.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.184+0000 7f7c0b485700 1 -- 172.21.15.73:0/754524421 shutdown_connections 2024-05-08T21:53:58.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.184+0000 7f7c0b485700 1 --2- 172.21.15.73:0/754524421 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f7be806ac90 0x7f7be806d150 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:58.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.184+0000 7f7c0b485700 1 --2- 172.21.15.73:0/754524421 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7c04153d20 0x7f7c04155440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:58.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.184+0000 7f7c0b485700 1 --2- 172.21.15.73:0/754524421 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7c0406ad80 0x7f7c04154e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:58.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.184+0000 7f7c0b485700 1 --2- 172.21.15.73:0/754524421 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c040c64f0 0x7f7c040cb610 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:58.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.184+0000 7f7c0b485700 1 -- 172.21.15.73:0/754524421 >> 172.21.15.73:0/754524421 conn(0x7f7c04066ab0 msgr2=0x7f7c0406f530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:53:58.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.184+0000 7f7c0b485700 1 -- 172.21.15.73:0/754524421 shutdown_connections 2024-05-08T21:53:58.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.184+0000 7f7c0b485700 1 -- 172.21.15.73:0/754524421 wait complete. 2024-05-08T21:53:58.186 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 6 to deep-scrub 2024-05-08T21:53:58.197 INFO:tasks.ceph:Scrubbing osd.7 2024-05-08T21:53:58.197 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-05-08T21:53:58.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.323+0000 7f625affe700 1 Processor -- start 2024-05-08T21:53:58.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.324+0000 7f625affe700 1 -- start start 2024-05-08T21:53:58.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.324+0000 7f625affe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f62540c3420 0x7f62540c57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:58.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.324+0000 7f625affe700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62540c6fe0 con 0x7f6254150d00 2024-05-08T21:53:58.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.324+0000 7f625affe700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6254072460 con 0x7f62540c5d30 2024-05-08T21:53:58.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.324+0000 7f625affe700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62540c3ae0 con 0x7f62540c3420 2024-05-08T21:53:58.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.324+0000 7f6258d9a700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f6254150d00 0x7f62541569d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54260/0 (socket says 172.21.15.73:54260) 2024-05-08T21:53:58.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.324+0000 7f6258d9a700 1 -- 172.21.15.73:0/4014080441 learned_addr learned my addr 172.21.15.73:0/4014080441 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:53:58.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.325+0000 7f62537fe700 1 -- 172.21.15.73:0/4014080441 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4097061895 0 0) 0x7f62540c6fe0 con 0x7f6254150d00 2024-05-08T21:53:58.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.325+0000 7f62537fe700 1 -- 172.21.15.73:0/4014080441 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62440035b0 con 0x7f6254150d00 2024-05-08T21:53:58.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.325+0000 7f6253fff700 1 --2- 172.21.15.73:0/4014080441 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f62540c3420 0x7f62540c57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:58.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.325+0000 7f62537fe700 1 -- 172.21.15.73:0/4014080441 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3753221460 0 0) 0x7f62440035b0 con 0x7f6254150d00 2024-05-08T21:53:58.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.325+0000 7f62537fe700 1 -- 172.21.15.73:0/4014080441 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f62540c3420 msgr2=0x7f62540c57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:53:58.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.325+0000 7f62537fe700 1 --2- 172.21.15.73:0/4014080441 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f62540c3420 0x7f62540c57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:58.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.325+0000 7f62537fe700 1 -- 172.21.15.73:0/4014080441 >> v1:172.21.15.115:6789/0 conn(0x7f62540c5d30 legacy=0x7f62541612d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:58.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.325+0000 7f62537fe700 1 -- 172.21.15.73:0/4014080441 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62540c7230 con 0x7f6254150d00 2024-05-08T21:53:58.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.325+0000 7f62537fe700 1 -- 172.21.15.73:0/4014080441 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 953298616 0 0) 0x7f6248001670 con 0x7f6254150d00 2024-05-08T21:53:58.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.325+0000 7f62537fe700 1 -- 172.21.15.73:0/4014080441 >> v1:172.21.15.73:6789/0 conn(0x7f6254150d00 legacy=0x7f62541569d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:58.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.325+0000 7f62537fe700 1 --2- 172.21.15.73:0/4014080441 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6244003a30 0x7f6244003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:58.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.325+0000 7f62537fe700 1 --2- 172.21.15.73:0/4014080441 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f62540c3420 0x7f6244004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:58.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.325+0000 7f62537fe700 1 --2- 172.21.15.73:0/4014080441 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6244004d90 0x7f6244005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:58.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.325+0000 7f62537fe700 1 -- 172.21.15.73:0/4014080441 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62540c3ae0 con 0x7f6244004d90 2024-05-08T21:53:58.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.325+0000 7f62537fe700 1 -- 172.21.15.73:0/4014080441 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f624400bba0 con 0x7f6244003a30 2024-05-08T21:53:58.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.325+0000 7f62537fe700 1 -- 172.21.15.73:0/4014080441 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f624400bd30 con 0x7f62540c3420 2024-05-08T21:53:58.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.325+0000 7f625959b700 1 --2- 172.21.15.73:0/4014080441 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6244004d90 0x7f6244005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:58.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.325+0000 7f6258d9a700 1 --2- 172.21.15.73:0/4014080441 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6244003a30 0x7f6244003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:58.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.325+0000 7f6253fff700 1 --2- 172.21.15.73:0/4014080441 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f62540c3420 0x7f6244004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:58.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.325+0000 7f625959b700 1 -- 172.21.15.73:0/4014080441 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f62540c3420 msgr2=0x7f6244004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:53:58.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.325+0000 7f625959b700 1 --2- 172.21.15.73:0/4014080441 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f62540c3420 0x7f6244004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:58.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.325+0000 7f625959b700 1 -- 172.21.15.73:0/4014080441 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6244003a30 msgr2=0x7f6244003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:53:58.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.325+0000 7f625959b700 1 --2- 172.21.15.73:0/4014080441 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6244003a30 0x7f6244003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:58.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.325+0000 7f625959b700 1 -- 172.21.15.73:0/4014080441 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62440035b0 con 0x7f6244004d90 2024-05-08T21:53:58.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.326+0000 7f625959b700 1 --2- 172.21.15.73:0/4014080441 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6244004d90 0x7f6244005210 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f624c00c1c0 tx=0x7f6244005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e99538ca6135cbc5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:58.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.326+0000 7f62537fe700 1 -- 172.21.15.73:0/4014080441 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624c001db0 con 0x7f6244004d90 2024-05-08T21:53:58.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.326+0000 7f62537fe700 1 -- 172.21.15.73:0/4014080441 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f624c00ccc0 con 0x7f6244004d90 2024-05-08T21:53:58.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.326+0000 7f62537fe700 1 -- 172.21.15.73:0/4014080441 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624c003c40 con 0x7f6244004d90 2024-05-08T21:53:58.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.326+0000 7f625affe700 1 -- 172.21.15.73:0/4014080441 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6244004d90 msgr2=0x7f6244005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:58.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.326+0000 7f625affe700 1 --2- 172.21.15.73:0/4014080441 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6244004d90 0x7f6244005210 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f624c00c1c0 tx=0x7f6244005880 comp rx=0 tx=0).stop 2024-05-08T21:53:58.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.326+0000 7f625959b700 1 -- 172.21.15.73:0/4014080441 reap_dead start 2024-05-08T21:53:58.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.326+0000 7f625affe700 1 -- 172.21.15.73:0/4014080441 shutdown_connections 2024-05-08T21:53:58.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.326+0000 7f625affe700 1 -- 172.21.15.73:0/4014080441 >> 172.21.15.73:0/4014080441 conn(0x7f625406bad0 msgr2=0x7f625406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:53:58.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.326+0000 7f625affe700 1 -- 172.21.15.73:0/4014080441 shutdown_connections 2024-05-08T21:53:58.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.326+0000 7f625affe700 1 -- 172.21.15.73:0/4014080441 wait complete. 2024-05-08T21:53:58.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.327+0000 7f625affe700 1 Processor -- start 2024-05-08T21:53:58.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.328+0000 7f625affe700 1 -- start start 2024-05-08T21:53:58.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.328+0000 7f625affe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62541453d0 0x7f62541ef6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:58.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.328+0000 7f625affe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f625414c1f0 0x7f625414b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:58.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.328+0000 7f625affe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f625414cc00 0x7f62540c2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:58.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.328+0000 7f625affe700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f625414caa0 con 0x7f62541453d0 2024-05-08T21:53:58.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.328+0000 7f625affe700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6254156560 con 0x7f625414c1f0 2024-05-08T21:53:58.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.328+0000 7f625affe700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62541457b0 con 0x7f625414cc00 2024-05-08T21:53:58.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.328+0000 7f6258d9a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62541453d0 0x7f62541ef6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:58.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.328+0000 7f6258d9a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62541453d0 0x7f62541ef6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53186/0 (socket says 172.21.15.73:53186) 2024-05-08T21:53:58.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.328+0000 7f6258d9a700 1 -- 172.21.15.73:0/1823000831 learned_addr learned my addr 172.21.15.73:0/1823000831 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:53:58.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.329+0000 7f6253fff700 1 --2- 172.21.15.73:0/1823000831 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f625414c1f0 0x7f625414b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:58.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.329+0000 7f625959b700 1 --2- 172.21.15.73:0/1823000831 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f625414cc00 0x7f62540c2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:58.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.329+0000 7f6258d9a700 1 -- 172.21.15.73:0/1823000831 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f625414cc00 msgr2=0x7f62540c2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:58.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.329+0000 7f6258d9a700 1 --2- 172.21.15.73:0/1823000831 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f625414cc00 0x7f62540c2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:58.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.329+0000 7f6258d9a700 1 -- 172.21.15.73:0/1823000831 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f625414c1f0 msgr2=0x7f625414b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:58.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.329+0000 7f6258d9a700 1 --2- 172.21.15.73:0/1823000831 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f625414c1f0 0x7f625414b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:58.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.329+0000 7f6258d9a700 1 -- 172.21.15.73:0/1823000831 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62540cb700 con 0x7f62541453d0 2024-05-08T21:53:58.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.329+0000 7f6253fff700 1 --2- 172.21.15.73:0/1823000831 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f625414c1f0 0x7f625414b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:53:58.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.329+0000 7f625959b700 1 --2- 172.21.15.73:0/1823000831 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f625414cc00 0x7f62540c2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:53:58.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.329+0000 7f6258d9a700 1 --2- 172.21.15.73:0/1823000831 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62541453d0 0x7f62541ef6e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f62480072c0 tx=0x7f6248007680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:58.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.329+0000 7f62517fa700 1 -- 172.21.15.73:0/1823000831 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624800f870 con 0x7f62541453d0 2024-05-08T21:53:58.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.329+0000 7f62517fa700 1 -- 172.21.15.73:0/1823000831 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f624800f9d0 con 0x7f62541453d0 2024-05-08T21:53:58.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.329+0000 7f625affe700 1 -- 172.21.15.73:0/1823000831 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62540cb9e0 con 0x7f62541453d0 2024-05-08T21:53:58.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.329+0000 7f62517fa700 1 -- 172.21.15.73:0/1823000831 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624800fd60 con 0x7f62541453d0 2024-05-08T21:53:58.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.329+0000 7f625affe700 1 -- 172.21.15.73:0/1823000831 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62540cbfa0 con 0x7f62541453d0 2024-05-08T21:53:58.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.330+0000 7f625affe700 1 -- 172.21.15.73:0/1823000831 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f62540c3cf0 con 0x7f62541453d0 2024-05-08T21:53:58.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.330+0000 7f62517fa700 1 -- 172.21.15.73:0/1823000831 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f624801d460 con 0x7f62541453d0 2024-05-08T21:53:58.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.331+0000 7f62517fa700 1 --2- 172.21.15.73:0/1823000831 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f623806abc0 0x7f623806d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:58.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.331+0000 7f62517fa700 1 -- 172.21.15.73:0/1823000831 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5969+0+0 (secure 0 0 0) 0x7f62480895f0 con 0x7f62541453d0 2024-05-08T21:53:58.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.331+0000 7f6253fff700 1 --2- 172.21.15.73:0/1823000831 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f623806abc0 0x7f623806d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:58.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.331+0000 7f62517fa700 1 --2- 172.21.15.73:0/1823000831 >> [v2:172.21.15.115:6824/47211,v1:172.21.15.115:6825/47211] conn(0x7f6238073080 0x7f6238075520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:58.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.331+0000 7f62517fa700 1 -- 172.21.15.73:0/1823000831 --> [v2:172.21.15.115:6824/47211,v1:172.21.15.115:6825/47211] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6238075bf0 con 0x7f6238073080 2024-05-08T21:53:58.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.331+0000 7f62517fa700 1 -- 172.21.15.73:0/1823000831 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f624808bc50 con 0x7f62541453d0 2024-05-08T21:53:58.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.331+0000 7f6253fff700 1 --2- 172.21.15.73:0/1823000831 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f623806abc0 0x7f623806d080 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6254148be0 tx=0x7f6240008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:58.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.331+0000 7f625959b700 1 --2- 172.21.15.73:0/1823000831 >> [v2:172.21.15.115:6824/47211,v1:172.21.15.115:6825/47211] conn(0x7f6238073080 0x7f6238075520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:58.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.332+0000 7f625959b700 1 --2- 172.21.15.73:0/1823000831 >> [v2:172.21.15.115:6824/47211,v1:172.21.15.115:6825/47211] conn(0x7f6238073080 0x7f6238075520 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:58.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.333+0000 7f62517fa700 1 -- 172.21.15.73:0/1823000831 <== osd.7 v2:172.21.15.115:6824/47211 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f6238075bf0 con 0x7f6238073080 2024-05-08T21:53:58.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.347+0000 7f625affe700 1 -- 172.21.15.73:0/1823000831 --> [v2:172.21.15.115:6824/47211,v1:172.21.15.115:6825/47211] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f62540c4210 con 0x7f6238073080 2024-05-08T21:53:58.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.347+0000 7f62517fa700 1 -- 172.21.15.73:0/1823000831 <== osd.7 v2:172.21.15.115:6824/47211 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f624c00cac0 con 0x7f6238073080 2024-05-08T21:53:58.348 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-05-08T21:53:58.348 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T21:53:58.348 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-05-08T21:53:58.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.347+0000 7f625affe700 1 -- 172.21.15.73:0/1823000831 >> [v2:172.21.15.115:6824/47211,v1:172.21.15.115:6825/47211] conn(0x7f6238073080 msgr2=0x7f6238075520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:58.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.348+0000 7f625affe700 1 --2- 172.21.15.73:0/1823000831 >> [v2:172.21.15.115:6824/47211,v1:172.21.15.115:6825/47211] conn(0x7f6238073080 0x7f6238075520 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:58.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.348+0000 7f625affe700 1 -- 172.21.15.73:0/1823000831 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f623806abc0 msgr2=0x7f623806d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:58.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.348+0000 7f625affe700 1 --2- 172.21.15.73:0/1823000831 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f623806abc0 0x7f623806d080 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6254148be0 tx=0x7f6240008040 comp rx=0 tx=0).stop 2024-05-08T21:53:58.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.348+0000 7f625affe700 1 -- 172.21.15.73:0/1823000831 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62541453d0 msgr2=0x7f62541ef6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:58.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.348+0000 7f625affe700 1 --2- 172.21.15.73:0/1823000831 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62541453d0 0x7f62541ef6e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f62480072c0 tx=0x7f6248007680 comp rx=0 tx=0).stop 2024-05-08T21:53:58.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.348+0000 7f625959b700 1 -- 172.21.15.73:0/1823000831 reap_dead start 2024-05-08T21:53:58.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.348+0000 7f625affe700 1 -- 172.21.15.73:0/1823000831 shutdown_connections 2024-05-08T21:53:58.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.348+0000 7f625affe700 1 -- 172.21.15.73:0/1823000831 >> 172.21.15.73:0/1823000831 conn(0x7f625406bad0 msgr2=0x7f625406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:53:58.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.348+0000 7f625affe700 1 -- 172.21.15.73:0/1823000831 shutdown_connections 2024-05-08T21:53:58.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.348+0000 7f625affe700 1 -- 172.21.15.73:0/1823000831 wait complete. 2024-05-08T21:53:58.360 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-05-08T21:53:58.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.482+0000 7fe92140d700 1 Processor -- start 2024-05-08T21:53:58.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.482+0000 7fe92140d700 1 -- start start 2024-05-08T21:53:58.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.483+0000 7fe92140d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe91c0c6fb0 0x7fe91c0c7430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:58.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.483+0000 7fe92140d700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe91c0c6510 0x7fe91c06f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:58.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.483+0000 7fe92140d700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe91c06b380 con 0x7fe91c154070 2024-05-08T21:53:58.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.483+0000 7fe92140d700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe91c0c3c60 con 0x7fe91c0c6510 2024-05-08T21:53:58.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.483+0000 7fe92140d700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe91c0c6950 con 0x7fe91c0c6fb0 2024-05-08T21:53:58.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.483+0000 7fe91b7fe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe91c0c6510 0x7fe91c06f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:58.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.483+0000 7fe91b7fe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe91c0c6510 0x7fe91c06f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53190/0 (socket says 172.21.15.73:53190) 2024-05-08T21:53:58.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.483+0000 7fe91b7fe700 1 -- 172.21.15.73:0/1761737630 learned_addr learned my addr 172.21.15.73:0/1761737630 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:53:58.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.483+0000 7fe91a7fc700 1 --2- 172.21.15.73:0/1761737630 >> v2:172.21.15.115:3300/0 conn(0x7fe91c0c6fb0 0x7fe91c0c7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:58.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.483+0000 7fe91b7fe700 1 -- 172.21.15.73:0/1761737630 >> v2:172.21.15.115:3300/0 conn(0x7fe91c0c6fb0 msgr2=0x7fe91c0c7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:53:58.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.483+0000 7fe91b7fe700 1 --2- 172.21.15.73:0/1761737630 >> v2:172.21.15.115:3300/0 conn(0x7fe91c0c6fb0 0x7fe91c0c7430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:58.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.483+0000 7fe91b7fe700 1 -- 172.21.15.73:0/1761737630 >> v1:172.21.15.115:6789/0 conn(0x7fe91c154070 legacy=0x7fe91c159b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:58.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.483+0000 7fe91b7fe700 1 -- 172.21.15.73:0/1761737630 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe91c15a280 con 0x7fe91c0c6510 2024-05-08T21:53:58.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.483+0000 7fe91b7fe700 1 --2- 172.21.15.73:0/1761737630 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe91c0c6510 0x7fe91c06f350 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fe91c0cd2d0 tx=0x7fe91400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e23f8fadecf2c98 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:58.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.483+0000 7fe919ffb700 1 -- 172.21.15.73:0/1761737630 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91400e070 con 0x7fe91c0c6510 2024-05-08T21:53:58.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.483+0000 7fe919ffb700 1 -- 172.21.15.73:0/1761737630 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe91400b9c0 con 0x7fe91c0c6510 2024-05-08T21:53:58.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.483+0000 7fe919ffb700 1 -- 172.21.15.73:0/1761737630 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91400bd70 con 0x7fe91c0c6510 2024-05-08T21:53:58.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.484+0000 7fe92140d700 1 -- 172.21.15.73:0/1761737630 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe91c0c6510 msgr2=0x7fe91c06f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:58.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.484+0000 7fe92140d700 1 --2- 172.21.15.73:0/1761737630 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe91c0c6510 0x7fe91c06f350 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fe91c0cd2d0 tx=0x7fe91400b330 comp rx=0 tx=0).stop 2024-05-08T21:53:58.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.484+0000 7fe92140d700 1 -- 172.21.15.73:0/1761737630 shutdown_connections 2024-05-08T21:53:58.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.484+0000 7fe92140d700 1 --2- 172.21.15.73:0/1761737630 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe91c0c6510 0x7fe91c06f350 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:58.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.484+0000 7fe92140d700 1 --2- 172.21.15.73:0/1761737630 >> v2:172.21.15.115:3300/0 conn(0x7fe91c0c6fb0 0x7fe91c0c7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:58.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.484+0000 7fe92140d700 1 -- 172.21.15.73:0/1761737630 >> 172.21.15.73:0/1761737630 conn(0x7fe91c0cc420 msgr2=0x7fe91c0cc800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:53:58.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.484+0000 7fe92140d700 1 -- 172.21.15.73:0/1761737630 shutdown_connections 2024-05-08T21:53:58.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.484+0000 7fe92140d700 1 -- 172.21.15.73:0/1761737630 wait complete. 2024-05-08T21:53:58.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.486+0000 7fe92140d700 1 Processor -- start 2024-05-08T21:53:58.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.486+0000 7fe92140d700 1 -- start start 2024-05-08T21:53:58.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.486+0000 7fe92140d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe91c0c6510 0x7fe91c14f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:58.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.486+0000 7fe92140d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe91c0c6fb0 0x7fe91c151060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:58.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.486+0000 7fe92140d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe91c154070 0x7fe91c146240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:58.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.487+0000 7fe92140d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe91c14fe50 con 0x7fe91c0c6510 2024-05-08T21:53:58.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.487+0000 7fe92140d700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe91c1f35a0 con 0x7fe91c0c6fb0 2024-05-08T21:53:58.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.487+0000 7fe92140d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe91c1f32c0 con 0x7fe91c154070 2024-05-08T21:53:58.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.487+0000 7fe91affd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe91c0c6510 0x7fe91c14f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:58.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.487+0000 7fe91affd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe91c0c6510 0x7fe91c14f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53206/0 (socket says 172.21.15.73:53206) 2024-05-08T21:53:58.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.487+0000 7fe91affd700 1 -- 172.21.15.73:0/536928852 learned_addr learned my addr 172.21.15.73:0/536928852 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:53:58.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.487+0000 7fe91a7fc700 1 --2- 172.21.15.73:0/536928852 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe91c0c6fb0 0x7fe91c151060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:58.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.487+0000 7fe91b7fe700 1 --2- 172.21.15.73:0/536928852 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe91c154070 0x7fe91c146240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:58.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.487+0000 7fe91affd700 1 -- 172.21.15.73:0/536928852 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe91c154070 msgr2=0x7fe91c146240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:58.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.487+0000 7fe91affd700 1 --2- 172.21.15.73:0/536928852 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe91c154070 0x7fe91c146240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:58.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.487+0000 7fe91affd700 1 -- 172.21.15.73:0/536928852 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe91c0c6fb0 msgr2=0x7fe91c151060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:58.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.487+0000 7fe91affd700 1 --2- 172.21.15.73:0/536928852 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe91c0c6fb0 0x7fe91c151060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:58.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.487+0000 7fe91affd700 1 -- 172.21.15.73:0/536928852 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe914009b30 con 0x7fe91c0c6510 2024-05-08T21:53:58.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.487+0000 7fe91a7fc700 1 --2- 172.21.15.73:0/536928852 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe91c0c6fb0 0x7fe91c151060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:53:58.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.487+0000 7fe91affd700 1 --2- 172.21.15.73:0/536928852 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe91c0c6510 0x7fe91c14f070 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe90c00c450 tx=0x7fe90c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:58.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.487+0000 7fe9037fe700 1 -- 172.21.15.73:0/536928852 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90c0052d0 con 0x7fe91c0c6510 2024-05-08T21:53:58.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.487+0000 7fe9037fe700 1 -- 172.21.15.73:0/536928852 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe90c005430 con 0x7fe91c0c6510 2024-05-08T21:53:58.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.487+0000 7fe92140d700 1 -- 172.21.15.73:0/536928852 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe91c1efe40 con 0x7fe91c0c6510 2024-05-08T21:53:58.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.487+0000 7fe9037fe700 1 -- 172.21.15.73:0/536928852 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90c0038c0 con 0x7fe91c0c6510 2024-05-08T21:53:58.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.487+0000 7fe92140d700 1 -- 172.21.15.73:0/536928852 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe91c1f0400 con 0x7fe91c0c6510 2024-05-08T21:53:58.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.488+0000 7fe92140d700 1 -- 172.21.15.73:0/536928852 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe91c06ec80 con 0x7fe91c0c6510 2024-05-08T21:53:58.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.489+0000 7fe9037fe700 1 -- 172.21.15.73:0/536928852 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe90c003a20 con 0x7fe91c0c6510 2024-05-08T21:53:58.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.489+0000 7fe9037fe700 1 --2- 172.21.15.73:0/536928852 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fe90806ac90 0x7fe90806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:58.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.489+0000 7fe9037fe700 1 -- 172.21.15.73:0/536928852 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5969+0+0 (secure 0 0 0) 0x7fe90c088910 con 0x7fe91c0c6510 2024-05-08T21:53:58.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.489+0000 7fe91a7fc700 1 --2- 172.21.15.73:0/536928852 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fe90806ac90 0x7fe90806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:58.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.489+0000 7fe91a7fc700 1 --2- 172.21.15.73:0/536928852 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fe90806ac90 0x7fe90806d150 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe91c0c9300 tx=0x7fe910008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:58.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.493+0000 7fe9037fe700 1 -- 172.21.15.73:0/536928852 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fe90c053950 con 0x7fe91c0c6510 2024-05-08T21:53:58.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.691+0000 7fe92140d700 1 -- 172.21.15.73:0/536928852 --> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fe91c06b5d0 con 0x7fe90806ac90 2024-05-08T21:53:58.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.691+0000 7fe9037fe700 1 -- 172.21.15.73:0/536928852 <== mgr.4104 v2:172.21.15.73:6832/46949 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe910009e60 con 0x7fe90806ac90 2024-05-08T21:53:58.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.693+0000 7fe92140d700 1 -- 172.21.15.73:0/536928852 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fe90806ac90 msgr2=0x7fe90806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:58.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.693+0000 7fe92140d700 1 --2- 172.21.15.73:0/536928852 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fe90806ac90 0x7fe90806d150 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe91c0c9300 tx=0x7fe910008040 comp rx=0 tx=0).stop 2024-05-08T21:53:58.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.693+0000 7fe92140d700 1 -- 172.21.15.73:0/536928852 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe91c0c6510 msgr2=0x7fe91c14f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:58.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.693+0000 7fe92140d700 1 --2- 172.21.15.73:0/536928852 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe91c0c6510 0x7fe91c14f070 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe90c00c450 tx=0x7fe90c00c810 comp rx=0 tx=0).stop 2024-05-08T21:53:58.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.693+0000 7fe92140d700 1 -- 172.21.15.73:0/536928852 shutdown_connections 2024-05-08T21:53:58.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.693+0000 7fe92140d700 1 --2- 172.21.15.73:0/536928852 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fe90806ac90 0x7fe90806d150 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:58.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.693+0000 7fe92140d700 1 --2- 172.21.15.73:0/536928852 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe91c154070 0x7fe91c146240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:58.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.693+0000 7fe92140d700 1 --2- 172.21.15.73:0/536928852 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe91c0c6510 0x7fe91c14f070 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:58.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.693+0000 7fe92140d700 1 --2- 172.21.15.73:0/536928852 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe91c0c6fb0 0x7fe91c151060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:58.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.693+0000 7fe92140d700 1 -- 172.21.15.73:0/536928852 >> 172.21.15.73:0/536928852 conn(0x7fe91c0cc420 msgr2=0x7fe91c0cc800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:53:58.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.694+0000 7fe92140d700 1 -- 172.21.15.73:0/536928852 shutdown_connections 2024-05-08T21:53:58.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.694+0000 7fe92140d700 1 -- 172.21.15.73:0/536928852 wait complete. 2024-05-08T21:53:58.696 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 7 to deep-scrub 2024-05-08T21:53:58.707 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T21:53:58.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.827+0000 7fc9d27be700 1 Processor -- start 2024-05-08T21:53:58.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.828+0000 7fc9d27be700 1 -- start start 2024-05-08T21:53:58.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.828+0000 7fc9d27be700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc9cc072980 0x7fc9cc06f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:58.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.828+0000 7fc9d27be700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc9cc072260 0x7fc9cc159d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:58.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.829+0000 7fc9d27be700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9cc15dfc0 con 0x7fc9cc072d60 2024-05-08T21:53:58.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.829+0000 7fc9d27be700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9cc070120 con 0x7fc9cc072980 2024-05-08T21:53:58.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.829+0000 7fc9d27be700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9cc06feb0 con 0x7fc9cc072260 2024-05-08T21:53:58.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.829+0000 7fc9cbfff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc9cc072980 0x7fc9cc06f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:58.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.829+0000 7fc9cbfff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc9cc072980 0x7fc9cc06f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53220/0 (socket says 172.21.15.73:53220) 2024-05-08T21:53:58.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.829+0000 7fc9cbfff700 1 -- 172.21.15.73:0/1810498613 learned_addr learned my addr 172.21.15.73:0/1810498613 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:53:58.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.829+0000 7fc9cb7fe700 1 --2- 172.21.15.73:0/1810498613 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc9cc072260 0x7fc9cc159d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:58.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.829+0000 7fc9cbfff700 1 -- 172.21.15.73:0/1810498613 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc9cc072260 msgr2=0x7fc9cc159d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:53:58.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.829+0000 7fc9cbfff700 1 --2- 172.21.15.73:0/1810498613 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc9cc072260 0x7fc9cc159d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:58.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.829+0000 7fc9cbfff700 1 -- 172.21.15.73:0/1810498613 >> v1:172.21.15.115:6789/0 conn(0x7fc9cc072d60 legacy=0x7fc9cc153860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:58.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.829+0000 7fc9cbfff700 1 -- 172.21.15.73:0/1810498613 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9cc15d3b0 con 0x7fc9cc072980 2024-05-08T21:53:58.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.829+0000 7fc9cbfff700 1 --2- 172.21.15.73:0/1810498613 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9cc072980 0x7fc9cc06f970 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc0098f0 tx=0x7fc9bc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4d5ccfeedb72984 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:58.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.829+0000 7fc9caffd700 1 -- 172.21.15.73:0/1810498613 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc00b8a0 con 0x7fc9cc072980 2024-05-08T21:53:58.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.829+0000 7fc9caffd700 1 -- 172.21.15.73:0/1810498613 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9bc00ba00 con 0x7fc9cc072980 2024-05-08T21:53:58.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.829+0000 7fc9caffd700 1 -- 172.21.15.73:0/1810498613 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc00bd90 con 0x7fc9cc072980 2024-05-08T21:53:58.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.830+0000 7fc9d27be700 1 -- 172.21.15.73:0/1810498613 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9cc072980 msgr2=0x7fc9cc06f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:58.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.830+0000 7fc9d27be700 1 --2- 172.21.15.73:0/1810498613 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9cc072980 0x7fc9cc06f970 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc0098f0 tx=0x7fc9bc009c00 comp rx=0 tx=0).stop 2024-05-08T21:53:58.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.830+0000 7fc9d27be700 1 -- 172.21.15.73:0/1810498613 shutdown_connections 2024-05-08T21:53:58.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.830+0000 7fc9d27be700 1 --2- 172.21.15.73:0/1810498613 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9cc072980 0x7fc9cc06f970 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:58.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.830+0000 7fc9d27be700 1 --2- 172.21.15.73:0/1810498613 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc9cc072260 0x7fc9cc159d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:58.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.830+0000 7fc9d27be700 1 -- 172.21.15.73:0/1810498613 >> 172.21.15.73:0/1810498613 conn(0x7fc9cc066cf0 msgr2=0x7fc9cc06bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:53:58.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.830+0000 7fc9d27be700 1 -- 172.21.15.73:0/1810498613 shutdown_connections 2024-05-08T21:53:58.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.830+0000 7fc9d27be700 1 -- 172.21.15.73:0/1810498613 wait complete. 2024-05-08T21:53:58.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.831+0000 7fc9d27be700 1 Processor -- start 2024-05-08T21:53:58.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.831+0000 7fc9d27be700 1 -- start start 2024-05-08T21:53:58.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.832+0000 7fc9d27be700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc9cc072260 0x7fc9cc15cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:58.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.832+0000 7fc9d27be700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9cc072980 0x7fc9cc0c5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:58.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.832+0000 7fc9d27be700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc9cc072d60 0x7fc9cc1efdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:58.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.832+0000 7fc9d27be700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9cc15b4d0 con 0x7fc9cc072980 2024-05-08T21:53:58.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.832+0000 7fc9d27be700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9cc1e5560 con 0x7fc9cc072d60 2024-05-08T21:53:58.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.832+0000 7fc9d27be700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9cc1e5840 con 0x7fc9cc072260 2024-05-08T21:53:58.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.832+0000 7fc9cb7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9cc072980 0x7fc9cc0c5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:58.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.832+0000 7fc9cb7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9cc072980 0x7fc9cc0c5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53226/0 (socket says 172.21.15.73:53226) 2024-05-08T21:53:58.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.832+0000 7fc9cb7fe700 1 -- 172.21.15.73:0/544328161 learned_addr learned my addr 172.21.15.73:0/544328161 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:53:58.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.832+0000 7fc9cbfff700 1 --2- 172.21.15.73:0/544328161 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc9cc072260 0x7fc9cc15cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:58.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.832+0000 7fc9d0d5b700 1 --2- 172.21.15.73:0/544328161 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc9cc072d60 0x7fc9cc1efdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:58.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.832+0000 7fc9cb7fe700 1 -- 172.21.15.73:0/544328161 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc9cc072260 msgr2=0x7fc9cc15cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:58.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.832+0000 7fc9cb7fe700 1 --2- 172.21.15.73:0/544328161 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc9cc072260 0x7fc9cc15cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:58.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.832+0000 7fc9cb7fe700 1 -- 172.21.15.73:0/544328161 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc9cc072d60 msgr2=0x7fc9cc1efdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:58.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.832+0000 7fc9cb7fe700 1 --2- 172.21.15.73:0/544328161 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc9cc072d60 0x7fc9cc1efdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:58.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.832+0000 7fc9cb7fe700 1 -- 172.21.15.73:0/544328161 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9bc009550 con 0x7fc9cc072980 2024-05-08T21:53:58.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.832+0000 7fc9d0d5b700 1 --2- 172.21.15.73:0/544328161 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc9cc072d60 0x7fc9cc1efdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:53:58.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.833+0000 7fc9cb7fe700 1 --2- 172.21.15.73:0/544328161 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9cc072980 0x7fc9cc0c5e30 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc9c000e810 tx=0x7fc9c000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:58.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.833+0000 7fc9c8ff9700 1 -- 172.21.15.73:0/544328161 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c0013610 con 0x7fc9cc072980 2024-05-08T21:53:58.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.833+0000 7fc9c8ff9700 1 -- 172.21.15.73:0/544328161 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9c0013770 con 0x7fc9cc072980 2024-05-08T21:53:58.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.833+0000 7fc9d27be700 1 -- 172.21.15.73:0/544328161 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9cc15ae80 con 0x7fc9cc072980 2024-05-08T21:53:58.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.833+0000 7fc9c8ff9700 1 -- 172.21.15.73:0/544328161 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c0013b20 con 0x7fc9cc072980 2024-05-08T21:53:58.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.833+0000 7fc9d27be700 1 -- 172.21.15.73:0/544328161 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9cc0c6370 con 0x7fc9cc072980 2024-05-08T21:53:58.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.834+0000 7fc9d27be700 1 -- 172.21.15.73:0/544328161 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9cc06ed80 con 0x7fc9cc072980 2024-05-08T21:53:58.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.834+0000 7fc9c8ff9700 1 -- 172.21.15.73:0/544328161 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc9c0013c80 con 0x7fc9cc072980 2024-05-08T21:53:58.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.835+0000 7fc9c8ff9700 1 --2- 172.21.15.73:0/544328161 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fc9b806ac90 0x7fc9b806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:53:58.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.835+0000 7fc9cbfff700 1 --2- 172.21.15.73:0/544328161 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fc9b806ac90 0x7fc9b806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:53:58.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.835+0000 7fc9c8ff9700 1 -- 172.21.15.73:0/544328161 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5969+0+0 (secure 0 0 0) 0x7fc9c00891e0 con 0x7fc9cc072980 2024-05-08T21:53:58.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.835+0000 7fc9cbfff700 1 --2- 172.21.15.73:0/544328161 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fc9b806ac90 0x7fc9b806d150 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc009c40 tx=0x7fc9bc008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:53:58.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:58.839+0000 7fc9c8ff9700 1 -- 172.21.15.73:0/544328161 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fc9c0054230 con 0x7fc9cc072980 2024-05-08T21:53:59.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:59.031+0000 7fc9d27be700 1 -- 172.21.15.73:0/544328161 --> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc9cc15dc50 con 0x7fc9b806ac90 2024-05-08T21:53:59.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:59.039+0000 7fc9c8ff9700 1 -- 172.21.15.73:0/544328161 <== mgr.4104 v2:172.21.15.73:6832/46949 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289034 (secure 0 0 0) 0x7fc9bc00bb70 con 0x7fc9b806ac90 2024-05-08T21:53:59.044 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:53:59.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:59.042+0000 7fc9d27be700 1 -- 172.21.15.73:0/544328161 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fc9b806ac90 msgr2=0x7fc9b806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:59.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:59.042+0000 7fc9d27be700 1 --2- 172.21.15.73:0/544328161 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fc9b806ac90 0x7fc9b806d150 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc009c40 tx=0x7fc9bc008030 comp rx=0 tx=0).stop 2024-05-08T21:53:59.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:59.042+0000 7fc9d27be700 1 -- 172.21.15.73:0/544328161 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9cc072980 msgr2=0x7fc9cc0c5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:53:59.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:59.042+0000 7fc9d27be700 1 --2- 172.21.15.73:0/544328161 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9cc072980 0x7fc9cc0c5e30 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc9c000e810 tx=0x7fc9c000ebd0 comp rx=0 tx=0).stop 2024-05-08T21:53:59.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:59.042+0000 7fc9d27be700 1 -- 172.21.15.73:0/544328161 shutdown_connections 2024-05-08T21:53:59.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:59.042+0000 7fc9d27be700 1 --2- 172.21.15.73:0/544328161 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fc9b806ac90 0x7fc9b806d150 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:59.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:59.042+0000 7fc9d27be700 1 --2- 172.21.15.73:0/544328161 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc9cc072d60 0x7fc9cc1efdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:59.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:59.042+0000 7fc9d27be700 1 --2- 172.21.15.73:0/544328161 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc9cc072260 0x7fc9cc15cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:59.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:59.042+0000 7fc9d27be700 1 --2- 172.21.15.73:0/544328161 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9cc072980 0x7fc9cc0c5e30 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:53:59.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:59.042+0000 7fc9d27be700 1 -- 172.21.15.73:0/544328161 >> 172.21.15.73:0/544328161 conn(0x7fc9cc066cf0 msgr2=0x7fc9cc148d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:53:59.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:59.043+0000 7fc9d27be700 1 -- 172.21.15.73:0/544328161 shutdown_connections 2024-05-08T21:53:59.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:53:59.043+0000 7fc9d27be700 1 -- 172.21.15.73:0/544328161 wait complete. 2024-05-08T21:53:59.047 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-05-08T21:53:59.056 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":148,"stamp":"2024-05-08T21:53:58.018379+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":977165,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":200,"num_read_kb":192,"num_write":9631,"num_write_kb":25168797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11621,"ondisk_log_size":11621,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":260984,"kb_used_data":3896,"kb_used_omap":12,"kb_used_meta":257011,"kb_avail":754713736,"statfs":{"total":773094113280,"available":772826865664,"internally_reserved":0,"allocated":3989504,"data_stored":2687994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":263179834},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10737404256,"num_objects":-2560,"num_object_clones":0,"num_object_copies":-5120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2560,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":2575,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002582"},"pg_stats":[{"pgid":"3.3f","version":"24'167","reported_seq":181,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.825286+0000","last_change":"2024-05-08T21:49:43.775912+0000","last_active":"2024-05-08T21:53:51.825286+0000","last_peered":"2024-05-08T21:53:51.825286+0000","last_clean":"2024-05-08T21:53:51.825286+0000","last_became_active":"2024-05-08T21:49:43.775657+0000","last_became_peered":"2024-05-08T21:49:43.775657+0000","last_unstale":"2024-05-08T21:53:51.825286+0000","last_undegraded":"2024-05-08T21:53:51.825286+0000","last_fullsized":"2024-05-08T21:53:51.825286+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:10:07.209965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"24'152","reported_seq":168,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:55.644417+0000","last_change":"2024-05-08T21:49:43.766984+0000","last_active":"2024-05-08T21:53:55.644417+0000","last_peered":"2024-05-08T21:53:55.644417+0000","last_clean":"2024-05-08T21:53:55.644417+0000","last_became_active":"2024-05-08T21:49:43.765995+0000","last_became_peered":"2024-05-08T21:49:43.765995+0000","last_unstale":"2024-05-08T21:53:55.644417+0000","last_undegraded":"2024-05-08T21:53:55.644417+0000","last_fullsized":"2024-05-08T21:53:55.644417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"24'178","reported_seq":192,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.813270+0000","last_change":"2024-05-08T21:49:43.766107+0000","last_active":"2024-05-08T21:53:51.813270+0000","last_peered":"2024-05-08T21:53:51.813270+0000","last_clean":"2024-05-08T21:53:51.813270+0000","last_became_active":"2024-05-08T21:49:43.765874+0000","last_became_peered":"2024-05-08T21:49:43.765874+0000","last_unstale":"2024-05-08T21:53:51.813270+0000","last_undegraded":"2024-05-08T21:53:51.813270+0000","last_fullsized":"2024-05-08T21:53:51.813270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:06:50.769169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"24'193","reported_seq":208,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.825503+0000","last_change":"2024-05-08T21:49:43.766355+0000","last_active":"2024-05-08T21:53:51.825503+0000","last_peered":"2024-05-08T21:53:51.825503+0000","last_clean":"2024-05-08T21:53:51.825503+0000","last_became_active":"2024-05-08T21:49:43.765507+0000","last_became_peered":"2024-05-08T21:49:43.765507+0000","last_unstale":"2024-05-08T21:53:51.825503+0000","last_undegraded":"2024-05-08T21:53:51.825503+0000","last_fullsized":"2024-05-08T21:53:51.825503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:09:09.676078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"24'174","reported_seq":187,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.820321+0000","last_change":"2024-05-08T21:50:33.104253+0000","last_active":"2024-05-08T21:53:51.820321+0000","last_peered":"2024-05-08T21:53:51.820321+0000","last_clean":"2024-05-08T21:53:51.820321+0000","last_became_active":"2024-05-08T21:50:33.103943+0000","last_became_peered":"2024-05-08T21:50:33.103943+0000","last_unstale":"2024-05-08T21:53:51.820321+0000","last_undegraded":"2024-05-08T21:53:51.820321+0000","last_fullsized":"2024-05-08T21:53:51.820321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"24'162","reported_seq":176,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.821871+0000","last_change":"2024-05-08T21:49:43.771390+0000","last_active":"2024-05-08T21:53:51.821871+0000","last_peered":"2024-05-08T21:53:51.821871+0000","last_clean":"2024-05-08T21:53:51.821871+0000","last_became_active":"2024-05-08T21:49:43.770893+0000","last_became_peered":"2024-05-08T21:49:43.770893+0000","last_unstale":"2024-05-08T21:53:51.821871+0000","last_undegraded":"2024-05-08T21:53:51.821871+0000","last_fullsized":"2024-05-08T21:53:51.821871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:28.979468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"24'188","reported_seq":202,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.820775+0000","last_change":"2024-05-08T21:49:43.769981+0000","last_active":"2024-05-08T21:53:51.820775+0000","last_peered":"2024-05-08T21:53:51.820775+0000","last_clean":"2024-05-08T21:53:51.820775+0000","last_became_active":"2024-05-08T21:49:43.769667+0000","last_became_peered":"2024-05-08T21:49:43.769667+0000","last_unstale":"2024-05-08T21:53:51.820775+0000","last_undegraded":"2024-05-08T21:53:51.820775+0000","last_fullsized":"2024-05-08T21:53:51.820775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:12:00.381761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"24'204","reported_seq":218,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.824368+0000","last_change":"2024-05-08T21:49:43.771078+0000","last_active":"2024-05-08T21:53:51.824368+0000","last_peered":"2024-05-08T21:53:51.824368+0000","last_clean":"2024-05-08T21:53:51.824368+0000","last_became_active":"2024-05-08T21:49:43.770912+0000","last_became_peered":"2024-05-08T21:49:43.770912+0000","last_unstale":"2024-05-08T21:53:51.824368+0000","last_undegraded":"2024-05-08T21:53:51.824368+0000","last_fullsized":"2024-05-08T21:53:51.824368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:12:00.381761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":483328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"24'178","reported_seq":200,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.825606+0000","last_change":"2024-05-08T21:50:33.106461+0000","last_active":"2024-05-08T21:53:51.825606+0000","last_peered":"2024-05-08T21:53:51.825606+0000","last_clean":"2024-05-08T21:53:51.825606+0000","last_became_active":"2024-05-08T21:50:33.106142+0000","last_became_peered":"2024-05-08T21:50:33.106142+0000","last_unstale":"2024-05-08T21:53:51.825606+0000","last_undegraded":"2024-05-08T21:53:51.825606+0000","last_fullsized":"2024-05-08T21:53:51.825606+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:18:29.982214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"24'190","reported_seq":204,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.819198+0000","last_change":"2024-05-08T21:49:43.772784+0000","last_active":"2024-05-08T21:53:51.819198+0000","last_peered":"2024-05-08T21:53:51.819198+0000","last_clean":"2024-05-08T21:53:51.819198+0000","last_became_active":"2024-05-08T21:49:43.772505+0000","last_became_peered":"2024-05-08T21:49:43.772505+0000","last_unstale":"2024-05-08T21:53:51.819198+0000","last_undegraded":"2024-05-08T21:53:51.819198+0000","last_fullsized":"2024-05-08T21:53:51.819198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:19:28.925404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"24'214","reported_seq":228,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.814924+0000","last_change":"2024-05-08T21:49:43.771781+0000","last_active":"2024-05-08T21:53:51.814924+0000","last_peered":"2024-05-08T21:53:51.814924+0000","last_clean":"2024-05-08T21:53:51.814924+0000","last_became_active":"2024-05-08T21:49:43.771457+0000","last_became_peered":"2024-05-08T21:49:43.771457+0000","last_unstale":"2024-05-08T21:53:51.814924+0000","last_undegraded":"2024-05-08T21:53:51.814924+0000","last_fullsized":"2024-05-08T21:53:51.814924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:43.798909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"24'166","reported_seq":180,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.814689+0000","last_change":"2024-05-08T21:49:43.764249+0000","last_active":"2024-05-08T21:53:51.814689+0000","last_peered":"2024-05-08T21:53:51.814689+0000","last_clean":"2024-05-08T21:53:51.814689+0000","last_became_active":"2024-05-08T21:49:43.763986+0000","last_became_peered":"2024-05-08T21:49:43.763986+0000","last_unstale":"2024-05-08T21:53:51.814689+0000","last_undegraded":"2024-05-08T21:53:51.814689+0000","last_fullsized":"2024-05-08T21:53:51.814689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:33:13.833915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"24'177","reported_seq":191,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.818372+0000","last_change":"2024-05-08T21:49:43.761127+0000","last_active":"2024-05-08T21:53:51.818372+0000","last_peered":"2024-05-08T21:53:51.818372+0000","last_clean":"2024-05-08T21:53:51.818372+0000","last_became_active":"2024-05-08T21:49:43.760874+0000","last_became_peered":"2024-05-08T21:49:43.760874+0000","last_unstale":"2024-05-08T21:53:51.818372+0000","last_undegraded":"2024-05-08T21:53:51.818372+0000","last_fullsized":"2024-05-08T21:53:51.818372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:17:34.570817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"24'172","reported_seq":186,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.820562+0000","last_change":"2024-05-08T21:49:43.765829+0000","last_active":"2024-05-08T21:53:51.820562+0000","last_peered":"2024-05-08T21:53:51.820562+0000","last_clean":"2024-05-08T21:53:51.820562+0000","last_became_active":"2024-05-08T21:49:43.765566+0000","last_became_peered":"2024-05-08T21:49:43.765566+0000","last_unstale":"2024-05-08T21:53:51.820562+0000","last_undegraded":"2024-05-08T21:53:51.820562+0000","last_fullsized":"2024-05-08T21:53:51.820562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:39.954320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"24'177","reported_seq":192,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.816008+0000","last_change":"2024-05-08T21:49:43.765080+0000","last_active":"2024-05-08T21:53:51.816008+0000","last_peered":"2024-05-08T21:53:51.816008+0000","last_clean":"2024-05-08T21:53:51.816008+0000","last_became_active":"2024-05-08T21:49:43.764810+0000","last_became_peered":"2024-05-08T21:49:43.764810+0000","last_unstale":"2024-05-08T21:53:51.816008+0000","last_undegraded":"2024-05-08T21:53:51.816008+0000","last_fullsized":"2024-05-08T21:53:51.816008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"24'162","reported_seq":176,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.816323+0000","last_change":"2024-05-08T21:49:43.766717+0000","last_active":"2024-05-08T21:53:51.816323+0000","last_peered":"2024-05-08T21:53:51.816323+0000","last_clean":"2024-05-08T21:53:51.816323+0000","last_became_active":"2024-05-08T21:49:43.766427+0000","last_became_peered":"2024-05-08T21:49:43.766427+0000","last_unstale":"2024-05-08T21:53:51.816323+0000","last_undegraded":"2024-05-08T21:53:51.816323+0000","last_fullsized":"2024-05-08T21:53:51.816323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:49:22.833820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"24'176","reported_seq":190,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.827269+0000","last_change":"2024-05-08T21:49:43.776929+0000","last_active":"2024-05-08T21:53:51.827269+0000","last_peered":"2024-05-08T21:53:51.827269+0000","last_clean":"2024-05-08T21:53:51.827269+0000","last_became_active":"2024-05-08T21:49:43.776509+0000","last_became_peered":"2024-05-08T21:49:43.776509+0000","last_unstale":"2024-05-08T21:53:51.827269+0000","last_undegraded":"2024-05-08T21:53:51.827269+0000","last_fullsized":"2024-05-08T21:53:51.827269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:26.199459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"24'179","reported_seq":193,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.819878+0000","last_change":"2024-05-08T21:49:43.762646+0000","last_active":"2024-05-08T21:53:51.819878+0000","last_peered":"2024-05-08T21:53:51.819878+0000","last_clean":"2024-05-08T21:53:51.819878+0000","last_became_active":"2024-05-08T21:49:43.762237+0000","last_became_peered":"2024-05-08T21:49:43.762237+0000","last_unstale":"2024-05-08T21:53:51.819878+0000","last_undegraded":"2024-05-08T21:53:51.819878+0000","last_fullsized":"2024-05-08T21:53:51.819878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:46:08.821947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"24'205","reported_seq":219,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.821454+0000","last_change":"2024-05-08T21:49:43.774729+0000","last_active":"2024-05-08T21:53:51.821454+0000","last_peered":"2024-05-08T21:53:51.821454+0000","last_clean":"2024-05-08T21:53:51.821454+0000","last_became_active":"2024-05-08T21:49:43.774450+0000","last_became_peered":"2024-05-08T21:49:43.774450+0000","last_unstale":"2024-05-08T21:53:51.821454+0000","last_undegraded":"2024-05-08T21:53:51.821454+0000","last_fullsized":"2024-05-08T21:53:51.821454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:25.661350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"24'5","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:26.306189+0000","last_change":"2024-05-08T21:49:43.219461+0000","last_active":"2024-05-08T21:52:26.306189+0000","last_peered":"2024-05-08T21:52:26.306189+0000","last_clean":"2024-05-08T21:52:26.306189+0000","last_became_active":"2024-05-08T21:49:43.219161+0000","last_became_peered":"2024-05-08T21:49:43.219161+0000","last_unstale":"2024-05-08T21:52:26.306189+0000","last_undegraded":"2024-05-08T21:52:26.306189+0000","last_fullsized":"2024-05-08T21:52:26.306189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:02:45.778415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"24'181","reported_seq":196,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.824073+0000","last_change":"2024-05-08T21:49:43.764252+0000","last_active":"2024-05-08T21:53:51.824073+0000","last_peered":"2024-05-08T21:53:51.824073+0000","last_clean":"2024-05-08T21:53:51.824073+0000","last_became_active":"2024-05-08T21:49:43.764045+0000","last_became_peered":"2024-05-08T21:49:43.764045+0000","last_unstale":"2024-05-08T21:53:51.824073+0000","last_undegraded":"2024-05-08T21:53:51.824073+0000","last_fullsized":"2024-05-08T21:53:51.824073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:43.798909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:11.012823+0000","last_change":"2024-05-08T21:49:43.221599+0000","last_active":"2024-05-08T21:52:11.012823+0000","last_peered":"2024-05-08T21:52:11.012823+0000","last_clean":"2024-05-08T21:52:11.012823+0000","last_became_active":"2024-05-08T21:49:43.221309+0000","last_became_peered":"2024-05-08T21:49:43.221309+0000","last_unstale":"2024-05-08T21:52:11.012823+0000","last_undegraded":"2024-05-08T21:52:11.012823+0000","last_fullsized":"2024-05-08T21:52:11.012823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:17.379362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"24'160","reported_seq":174,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.817213+0000","last_change":"2024-05-08T21:49:43.771523+0000","last_active":"2024-05-08T21:53:51.817213+0000","last_peered":"2024-05-08T21:53:51.817213+0000","last_clean":"2024-05-08T21:53:51.817213+0000","last_became_active":"2024-05-08T21:49:43.771295+0000","last_became_peered":"2024-05-08T21:49:43.771295+0000","last_unstale":"2024-05-08T21:53:51.817213+0000","last_undegraded":"2024-05-08T21:53:51.817213+0000","last_fullsized":"2024-05-08T21:53:51.817213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:53:14.774835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"24'3","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:26.315599+0000","last_change":"2024-05-08T21:49:43.226637+0000","last_active":"2024-05-08T21:52:26.315599+0000","last_peered":"2024-05-08T21:52:26.315599+0000","last_clean":"2024-05-08T21:52:26.315599+0000","last_became_active":"2024-05-08T21:49:43.226284+0000","last_became_peered":"2024-05-08T21:49:43.226284+0000","last_unstale":"2024-05-08T21:52:26.315599+0000","last_undegraded":"2024-05-08T21:52:26.315599+0000","last_fullsized":"2024-05-08T21:52:26.315599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:01.844011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"24'162","reported_seq":176,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.817169+0000","last_change":"2024-05-08T21:49:43.766694+0000","last_active":"2024-05-08T21:53:51.817169+0000","last_peered":"2024-05-08T21:53:51.817169+0000","last_clean":"2024-05-08T21:53:51.817169+0000","last_became_active":"2024-05-08T21:49:43.766079+0000","last_became_peered":"2024-05-08T21:49:43.766079+0000","last_unstale":"2024-05-08T21:53:51.817169+0000","last_undegraded":"2024-05-08T21:53:51.817169+0000","last_fullsized":"2024-05-08T21:53:51.817169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:01:16.682080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:26.310680+0000","last_change":"2024-05-08T21:49:43.230152+0000","last_active":"2024-05-08T21:52:26.310680+0000","last_peered":"2024-05-08T21:52:26.310680+0000","last_clean":"2024-05-08T21:52:26.310680+0000","last_became_active":"2024-05-08T21:49:43.229891+0000","last_became_peered":"2024-05-08T21:49:43.229891+0000","last_unstale":"2024-05-08T21:52:26.310680+0000","last_undegraded":"2024-05-08T21:52:26.310680+0000","last_fullsized":"2024-05-08T21:52:26.310680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:33:12.827218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"24'205","reported_seq":217,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.820197+0000","last_change":"2024-05-08T21:50:33.113046+0000","last_active":"2024-05-08T21:53:51.820197+0000","last_peered":"2024-05-08T21:53:51.820197+0000","last_clean":"2024-05-08T21:53:51.820197+0000","last_became_active":"2024-05-08T21:50:33.112776+0000","last_became_peered":"2024-05-08T21:50:33.112776+0000","last_unstale":"2024-05-08T21:53:51.820197+0000","last_undegraded":"2024-05-08T21:53:51.820197+0000","last_fullsized":"2024-05-08T21:53:51.820197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:27:54.132637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":458752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"24'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:11.012352+0000","last_change":"2024-05-08T21:49:43.220418+0000","last_active":"2024-05-08T21:52:11.012352+0000","last_peered":"2024-05-08T21:52:11.012352+0000","last_clean":"2024-05-08T21:52:11.012352+0000","last_became_active":"2024-05-08T21:49:43.220090+0000","last_became_peered":"2024-05-08T21:49:43.220090+0000","last_unstale":"2024-05-08T21:52:11.012352+0000","last_undegraded":"2024-05-08T21:52:11.012352+0000","last_fullsized":"2024-05-08T21:52:11.012352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:33:28.074468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"24'149","reported_seq":161,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.821276+0000","last_change":"2024-05-08T21:50:33.103551+0000","last_active":"2024-05-08T21:53:51.821276+0000","last_peered":"2024-05-08T21:53:51.821276+0000","last_clean":"2024-05-08T21:53:51.821276+0000","last_became_active":"2024-05-08T21:50:33.103147+0000","last_became_peered":"2024-05-08T21:50:33.103147+0000","last_unstale":"2024-05-08T21:53:51.821276+0000","last_undegraded":"2024-05-08T21:53:51.821276+0000","last_fullsized":"2024-05-08T21:53:51.821276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:50.167387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"24'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:11.012089+0000","last_change":"2024-05-08T21:49:43.220518+0000","last_active":"2024-05-08T21:52:11.012089+0000","last_peered":"2024-05-08T21:52:11.012089+0000","last_clean":"2024-05-08T21:52:11.012089+0000","last_became_active":"2024-05-08T21:49:43.218473+0000","last_became_peered":"2024-05-08T21:49:43.218473+0000","last_unstale":"2024-05-08T21:52:11.012089+0000","last_undegraded":"2024-05-08T21:52:11.012089+0000","last_fullsized":"2024-05-08T21:52:11.012089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:10.497167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"24'162","reported_seq":176,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.816263+0000","last_change":"2024-05-08T21:49:43.770935+0000","last_active":"2024-05-08T21:53:51.816263+0000","last_peered":"2024-05-08T21:53:51.816263+0000","last_clean":"2024-05-08T21:53:51.816263+0000","last_became_active":"2024-05-08T21:49:43.770677+0000","last_became_peered":"2024-05-08T21:49:43.770677+0000","last_unstale":"2024-05-08T21:53:51.816263+0000","last_undegraded":"2024-05-08T21:53:51.816263+0000","last_fullsized":"2024-05-08T21:53:51.816263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:04:14.416894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:06.001782+0000","last_change":"2024-05-08T21:49:43.221027+0000","last_active":"2024-05-08T21:52:06.001782+0000","last_peered":"2024-05-08T21:52:06.001782+0000","last_clean":"2024-05-08T21:52:06.001782+0000","last_became_active":"2024-05-08T21:49:43.220780+0000","last_became_peered":"2024-05-08T21:49:43.220780+0000","last_unstale":"2024-05-08T21:52:06.001782+0000","last_undegraded":"2024-05-08T21:52:06.001782+0000","last_fullsized":"2024-05-08T21:52:06.001782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:20:34.123736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"24'190","reported_seq":202,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.811986+0000","last_change":"2024-05-08T21:50:33.305422+0000","last_active":"2024-05-08T21:53:51.811986+0000","last_peered":"2024-05-08T21:53:51.811986+0000","last_clean":"2024-05-08T21:53:51.811986+0000","last_became_active":"2024-05-08T21:50:33.305037+0000","last_became_peered":"2024-05-08T21:50:33.305037+0000","last_unstale":"2024-05-08T21:53:51.811986+0000","last_undegraded":"2024-05-08T21:53:51.811986+0000","last_fullsized":"2024-05-08T21:53:51.811986+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:20:06.560937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:06.619556+0000","last_change":"2024-05-08T21:49:43.225299+0000","last_active":"2024-05-08T21:52:06.619556+0000","last_peered":"2024-05-08T21:52:06.619556+0000","last_clean":"2024-05-08T21:52:06.619556+0000","last_became_active":"2024-05-08T21:49:43.225057+0000","last_became_peered":"2024-05-08T21:49:43.225057+0000","last_unstale":"2024-05-08T21:52:06.619556+0000","last_undegraded":"2024-05-08T21:52:06.619556+0000","last_fullsized":"2024-05-08T21:52:06.619556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:38:43.069159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"24'187","reported_seq":202,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.824335+0000","last_change":"2024-05-08T21:49:43.757361+0000","last_active":"2024-05-08T21:53:51.824335+0000","last_peered":"2024-05-08T21:53:51.824335+0000","last_clean":"2024-05-08T21:53:51.824335+0000","last_became_active":"2024-05-08T21:49:43.757092+0000","last_became_peered":"2024-05-08T21:49:43.757092+0000","last_unstale":"2024-05-08T21:53:51.824335+0000","last_undegraded":"2024-05-08T21:53:51.824335+0000","last_fullsized":"2024-05-08T21:53:51.824335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"24'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:08.039542+0000","last_change":"2024-05-08T21:49:43.229405+0000","last_active":"2024-05-08T21:52:08.039542+0000","last_peered":"2024-05-08T21:52:08.039542+0000","last_clean":"2024-05-08T21:52:08.039542+0000","last_became_active":"2024-05-08T21:49:43.229105+0000","last_became_peered":"2024-05-08T21:49:43.229105+0000","last_unstale":"2024-05-08T21:52:08.039542+0000","last_undegraded":"2024-05-08T21:52:08.039542+0000","last_fullsized":"2024-05-08T21:52:08.039542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:18:58.164159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"24'251","reported_seq":265,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.827067+0000","last_change":"2024-05-08T21:49:43.773243+0000","last_active":"2024-05-08T21:53:51.827067+0000","last_peered":"2024-05-08T21:53:51.827067+0000","last_clean":"2024-05-08T21:53:51.827067+0000","last_became_active":"2024-05-08T21:49:43.772944+0000","last_became_peered":"2024-05-08T21:49:43.772944+0000","last_unstale":"2024-05-08T21:53:51.827067+0000","last_undegraded":"2024-05-08T21:53:51.827067+0000","last_fullsized":"2024-05-08T21:53:51.827067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":251,"log_dups_size":0,"ondisk_log_size":251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:21:41.238890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":598016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:06.620035+0000","last_change":"2024-05-08T21:49:43.224999+0000","last_active":"2024-05-08T21:52:06.620035+0000","last_peered":"2024-05-08T21:52:06.620035+0000","last_clean":"2024-05-08T21:52:06.620035+0000","last_became_active":"2024-05-08T21:49:43.223476+0000","last_became_peered":"2024-05-08T21:49:43.223476+0000","last_unstale":"2024-05-08T21:52:06.620035+0000","last_undegraded":"2024-05-08T21:52:06.620035+0000","last_fullsized":"2024-05-08T21:52:06.620035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:09:12.983430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"24'160","reported_seq":174,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.815458+0000","last_change":"2024-05-08T21:49:43.771526+0000","last_active":"2024-05-08T21:53:51.815458+0000","last_peered":"2024-05-08T21:53:51.815458+0000","last_clean":"2024-05-08T21:53:51.815458+0000","last_became_active":"2024-05-08T21:49:43.771279+0000","last_became_peered":"2024-05-08T21:49:43.771279+0000","last_unstale":"2024-05-08T21:53:51.815458+0000","last_undegraded":"2024-05-08T21:53:51.815458+0000","last_fullsized":"2024-05-08T21:53:51.815458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:41:45.602022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"24'8","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:52.366860+0000","last_change":"2024-05-08T21:49:43.224378+0000","last_active":"2024-05-08T21:53:52.366860+0000","last_peered":"2024-05-08T21:53:52.366860+0000","last_clean":"2024-05-08T21:53:52.366860+0000","last_became_active":"2024-05-08T21:49:43.224164+0000","last_became_peered":"2024-05-08T21:49:43.224164+0000","last_unstale":"2024-05-08T21:53:52.366860+0000","last_undegraded":"2024-05-08T21:53:52.366860+0000","last_fullsized":"2024-05-08T21:53:52.366860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"24'168","reported_seq":182,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.822883+0000","last_change":"2024-05-08T21:49:43.772948+0000","last_active":"2024-05-08T21:53:51.822883+0000","last_peered":"2024-05-08T21:53:51.822883+0000","last_clean":"2024-05-08T21:53:51.822883+0000","last_became_active":"2024-05-08T21:49:43.772685+0000","last_became_peered":"2024-05-08T21:49:43.772685+0000","last_unstale":"2024-05-08T21:53:51.822883+0000","last_undegraded":"2024-05-08T21:53:51.822883+0000","last_fullsized":"2024-05-08T21:53:51.822883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:02.850708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"24'182","reported_seq":203,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.783270+0000","last_change":"2024-05-08T21:49:43.222308+0000","last_active":"2024-05-08T21:53:51.783270+0000","last_peered":"2024-05-08T21:53:51.783270+0000","last_clean":"2024-05-08T21:53:51.783270+0000","last_became_active":"2024-05-08T21:49:43.221844+0000","last_became_peered":"2024-05-08T21:49:43.221844+0000","last_unstale":"2024-05-08T21:53:51.783270+0000","last_undegraded":"2024-05-08T21:53:51.783270+0000","last_fullsized":"2024-05-08T21:53:51.783270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:17.379362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":385494,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":180,"num_write_kb":527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"24'176","reported_seq":190,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.822133+0000","last_change":"2024-05-08T21:49:43.773923+0000","last_active":"2024-05-08T21:53:51.822133+0000","last_peered":"2024-05-08T21:53:51.822133+0000","last_clean":"2024-05-08T21:53:51.822133+0000","last_became_active":"2024-05-08T21:49:43.772037+0000","last_became_peered":"2024-05-08T21:49:43.772037+0000","last_unstale":"2024-05-08T21:53:51.822133+0000","last_undegraded":"2024-05-08T21:53:51.822133+0000","last_fullsized":"2024-05-08T21:53:51.822133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:52:32.629407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:11.006373+0000","last_change":"2024-05-08T21:49:43.219473+0000","last_active":"2024-05-08T21:52:11.006373+0000","last_peered":"2024-05-08T21:52:11.006373+0000","last_clean":"2024-05-08T21:52:11.006373+0000","last_became_active":"2024-05-08T21:49:43.219186+0000","last_became_peered":"2024-05-08T21:49:43.219186+0000","last_unstale":"2024-05-08T21:52:11.006373+0000","last_undegraded":"2024-05-08T21:52:11.006373+0000","last_fullsized":"2024-05-08T21:52:11.006373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:20:34.123736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"24'177","reported_seq":191,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.822894+0000","last_change":"2024-05-08T21:49:43.775135+0000","last_active":"2024-05-08T21:53:51.822894+0000","last_peered":"2024-05-08T21:53:51.822894+0000","last_clean":"2024-05-08T21:53:51.822894+0000","last_became_active":"2024-05-08T21:49:43.774919+0000","last_became_peered":"2024-05-08T21:49:43.774919+0000","last_unstale":"2024-05-08T21:53:51.822894+0000","last_undegraded":"2024-05-08T21:53:51.822894+0000","last_fullsized":"2024-05-08T21:53:51.822894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:01:00.614249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T21:52:06.031614+0000","last_change":"2024-05-08T21:49:43.227386+0000","last_active":"2024-05-08T21:52:06.031614+0000","last_peered":"2024-05-08T21:52:06.031614+0000","last_clean":"2024-05-08T21:52:06.031614+0000","last_became_active":"2024-05-08T21:49:43.227065+0000","last_became_peered":"2024-05-08T21:49:43.227065+0000","last_unstale":"2024-05-08T21:52:06.031614+0000","last_undegraded":"2024-05-08T21:52:06.031614+0000","last_fullsized":"2024-05-08T21:52:06.031614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:43:48.019170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"24'201","reported_seq":215,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.822702+0000","last_change":"2024-05-08T21:49:43.770509+0000","last_active":"2024-05-08T21:53:51.822702+0000","last_peered":"2024-05-08T21:53:51.822702+0000","last_clean":"2024-05-08T21:53:51.822702+0000","last_became_active":"2024-05-08T21:49:43.770180+0000","last_became_peered":"2024-05-08T21:49:43.770180+0000","last_unstale":"2024-05-08T21:53:51.822702+0000","last_undegraded":"2024-05-08T21:53:51.822702+0000","last_fullsized":"2024-05-08T21:53:51.822702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:00:38.941899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T21:52:03.038898+0000","last_change":"2024-05-08T21:49:43.220942+0000","last_active":"2024-05-08T21:52:03.038898+0000","last_peered":"2024-05-08T21:52:03.038898+0000","last_clean":"2024-05-08T21:52:03.038898+0000","last_became_active":"2024-05-08T21:49:43.220641+0000","last_became_peered":"2024-05-08T21:49:43.220641+0000","last_unstale":"2024-05-08T21:52:03.038898+0000","last_undegraded":"2024-05-08T21:52:03.038898+0000","last_fullsized":"2024-05-08T21:52:03.038898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:52.323917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"24'197","reported_seq":211,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.812015+0000","last_change":"2024-05-08T21:49:43.766269+0000","last_active":"2024-05-08T21:53:51.812015+0000","last_peered":"2024-05-08T21:53:51.812015+0000","last_clean":"2024-05-08T21:53:51.812015+0000","last_became_active":"2024-05-08T21:49:43.765945+0000","last_became_peered":"2024-05-08T21:49:43.765945+0000","last_unstale":"2024-05-08T21:53:51.812015+0000","last_undegraded":"2024-05-08T21:53:51.812015+0000","last_fullsized":"2024-05-08T21:53:51.812015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:17:34.570817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"24'9","reported_seq":32,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:26.314575+0000","last_change":"2024-05-08T21:49:43.208328+0000","last_active":"2024-05-08T21:52:26.314575+0000","last_peered":"2024-05-08T21:52:26.314575+0000","last_clean":"2024-05-08T21:52:26.314575+0000","last_became_active":"2024-05-08T21:49:43.208013+0000","last_became_peered":"2024-05-08T21:49:43.208013+0000","last_unstale":"2024-05-08T21:52:26.314575+0000","last_undegraded":"2024-05-08T21:52:26.314575+0000","last_fullsized":"2024-05-08T21:52:26.314575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:10.497167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"24'215","reported_seq":229,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.820898+0000","last_change":"2024-05-08T21:49:43.774210+0000","last_active":"2024-05-08T21:53:51.820898+0000","last_peered":"2024-05-08T21:53:51.820898+0000","last_clean":"2024-05-08T21:53:51.820898+0000","last_became_active":"2024-05-08T21:49:43.773933+0000","last_became_peered":"2024-05-08T21:49:43.773933+0000","last_unstale":"2024-05-08T21:53:51.820898+0000","last_undegraded":"2024-05-08T21:53:51.820898+0000","last_fullsized":"2024-05-08T21:53:51.820898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:10:25.398535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:07.434727+0000","last_change":"2024-05-08T21:49:43.217456+0000","last_active":"2024-05-08T21:52:07.434727+0000","last_peered":"2024-05-08T21:52:07.434727+0000","last_clean":"2024-05-08T21:52:07.434727+0000","last_became_active":"2024-05-08T21:49:43.216822+0000","last_became_peered":"2024-05-08T21:49:43.216822+0000","last_unstale":"2024-05-08T21:52:07.434727+0000","last_undegraded":"2024-05-08T21:52:07.434727+0000","last_fullsized":"2024-05-08T21:52:07.434727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:41:35.881003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"24'175","reported_seq":189,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.821964+0000","last_change":"2024-05-08T21:49:43.770066+0000","last_active":"2024-05-08T21:53:51.821964+0000","last_peered":"2024-05-08T21:53:51.821964+0000","last_clean":"2024-05-08T21:53:51.821964+0000","last_became_active":"2024-05-08T21:49:43.769762+0000","last_became_peered":"2024-05-08T21:49:43.769762+0000","last_unstale":"2024-05-08T21:53:51.821964+0000","last_undegraded":"2024-05-08T21:53:51.821964+0000","last_fullsized":"2024-05-08T21:53:51.821964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:40:20.301747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:55.644371+0000","last_change":"2024-05-08T21:49:43.215293+0000","last_active":"2024-05-08T21:53:55.644371+0000","last_peered":"2024-05-08T21:53:55.644371+0000","last_clean":"2024-05-08T21:53:55.644371+0000","last_became_active":"2024-05-08T21:49:43.215048+0000","last_became_peered":"2024-05-08T21:49:43.215048+0000","last_unstale":"2024-05-08T21:53:55.644371+0000","last_undegraded":"2024-05-08T21:53:55.644371+0000","last_fullsized":"2024-05-08T21:53:55.644371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"24'160","reported_seq":175,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.824979+0000","last_change":"2024-05-08T21:49:43.770326+0000","last_active":"2024-05-08T21:53:51.824979+0000","last_peered":"2024-05-08T21:53:51.824979+0000","last_clean":"2024-05-08T21:53:51.824979+0000","last_became_active":"2024-05-08T21:49:43.770029+0000","last_became_peered":"2024-05-08T21:49:43.770029+0000","last_unstale":"2024-05-08T21:53:51.824979+0000","last_undegraded":"2024-05-08T21:53:51.824979+0000","last_fullsized":"2024-05-08T21:53:51.824979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:33:33.642847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:06.619850+0000","last_change":"2024-05-08T21:49:43.227710+0000","last_active":"2024-05-08T21:52:06.619850+0000","last_peered":"2024-05-08T21:52:06.619850+0000","last_clean":"2024-05-08T21:52:06.619850+0000","last_became_active":"2024-05-08T21:49:43.227430+0000","last_became_peered":"2024-05-08T21:49:43.227430+0000","last_unstale":"2024-05-08T21:52:06.619850+0000","last_undegraded":"2024-05-08T21:52:06.619850+0000","last_fullsized":"2024-05-08T21:52:06.619850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:05:58.875400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"24'177","reported_seq":191,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.803005+0000","last_change":"2024-05-08T21:49:43.768588+0000","last_active":"2024-05-08T21:53:51.803005+0000","last_peered":"2024-05-08T21:53:51.803005+0000","last_clean":"2024-05-08T21:53:51.803005+0000","last_became_active":"2024-05-08T21:49:43.768307+0000","last_became_peered":"2024-05-08T21:49:43.768307+0000","last_unstale":"2024-05-08T21:53:51.803005+0000","last_undegraded":"2024-05-08T21:53:51.803005+0000","last_fullsized":"2024-05-08T21:53:51.803005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:04.968184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"24'165","reported_seq":181,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.821340+0000","last_change":"2024-05-08T21:49:43.758618+0000","last_active":"2024-05-08T21:53:51.821340+0000","last_peered":"2024-05-08T21:53:51.821340+0000","last_clean":"2024-05-08T21:53:51.821340+0000","last_became_active":"2024-05-08T21:49:43.758367+0000","last_became_peered":"2024-05-08T21:49:43.758367+0000","last_unstale":"2024-05-08T21:53:51.821340+0000","last_undegraded":"2024-05-08T21:53:51.821340+0000","last_fullsized":"2024-05-08T21:53:51.821340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"24'6","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:52.361342+0000","last_change":"2024-05-08T21:49:43.217410+0000","last_active":"2024-05-08T21:53:52.361342+0000","last_peered":"2024-05-08T21:53:52.361342+0000","last_clean":"2024-05-08T21:53:52.361342+0000","last_became_active":"2024-05-08T21:49:43.217133+0000","last_became_peered":"2024-05-08T21:49:43.217133+0000","last_unstale":"2024-05-08T21:53:52.361342+0000","last_undegraded":"2024-05-08T21:53:52.361342+0000","last_fullsized":"2024-05-08T21:53:52.361342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:17.379362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"24'183","reported_seq":197,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.823960+0000","last_change":"2024-05-08T21:49:43.771651+0000","last_active":"2024-05-08T21:53:51.823960+0000","last_peered":"2024-05-08T21:53:51.823960+0000","last_clean":"2024-05-08T21:53:51.823960+0000","last_became_active":"2024-05-08T21:49:43.771451+0000","last_became_peered":"2024-05-08T21:49:43.771451+0000","last_unstale":"2024-05-08T21:53:51.823960+0000","last_undegraded":"2024-05-08T21:53:51.823960+0000","last_fullsized":"2024-05-08T21:53:51.823960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:00:38.941899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:06.619660+0000","last_change":"2024-05-08T21:49:43.224929+0000","last_active":"2024-05-08T21:52:06.619660+0000","last_peered":"2024-05-08T21:52:06.619660+0000","last_clean":"2024-05-08T21:52:06.619660+0000","last_became_active":"2024-05-08T21:49:43.223469+0000","last_became_peered":"2024-05-08T21:49:43.223469+0000","last_unstale":"2024-05-08T21:52:06.619660+0000","last_undegraded":"2024-05-08T21:52:06.619660+0000","last_fullsized":"2024-05-08T21:52:06.619660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:27.504127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":169,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:06.294108+0000","last_change":"2024-05-08T21:49:38.626519+0000","last_active":"2024-05-08T21:52:06.294108+0000","last_peered":"2024-05-08T21:52:06.294108+0000","last_clean":"2024-05-08T21:52:06.294108+0000","last_became_active":"2024-05-08T21:49:38.626159+0000","last_became_peered":"2024-05-08T21:49:38.626159+0000","last_unstale":"2024-05-08T21:52:06.294108+0000","last_undegraded":"2024-05-08T21:52:06.294108+0000","last_fullsized":"2024-05-08T21:52:06.294108+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:36.031649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:36.031649+0000","last_clean_scrub_stamp":"2024-05-08T21:49:36.031649+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:12:04.846500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"24'165","reported_seq":179,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.805210+0000","last_change":"2024-05-08T21:49:43.770966+0000","last_active":"2024-05-08T21:53:51.805210+0000","last_peered":"2024-05-08T21:53:51.805210+0000","last_clean":"2024-05-08T21:53:51.805210+0000","last_became_active":"2024-05-08T21:49:43.770711+0000","last_became_peered":"2024-05-08T21:49:43.770711+0000","last_unstale":"2024-05-08T21:53:51.805210+0000","last_undegraded":"2024-05-08T21:53:51.805210+0000","last_fullsized":"2024-05-08T21:53:51.805210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:17:34.570817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:06.294247+0000","last_change":"2024-05-08T21:49:43.221086+0000","last_active":"2024-05-08T21:52:06.294247+0000","last_peered":"2024-05-08T21:52:06.294247+0000","last_clean":"2024-05-08T21:52:06.294247+0000","last_became_active":"2024-05-08T21:49:43.220539+0000","last_became_peered":"2024-05-08T21:49:43.220539+0000","last_unstale":"2024-05-08T21:52:06.294247+0000","last_undegraded":"2024-05-08T21:52:06.294247+0000","last_fullsized":"2024-05-08T21:52:06.294247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:52.323917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:06.294538+0000","last_change":"2024-05-08T21:49:43.222410+0000","last_active":"2024-05-08T21:52:06.294538+0000","last_peered":"2024-05-08T21:52:06.294538+0000","last_clean":"2024-05-08T21:52:06.294538+0000","last_became_active":"2024-05-08T21:49:43.222131+0000","last_became_peered":"2024-05-08T21:49:43.222131+0000","last_unstale":"2024-05-08T21:52:06.294538+0000","last_undegraded":"2024-05-08T21:52:06.294538+0000","last_fullsized":"2024-05-08T21:52:06.294538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:18:58.164159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"24'162","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:55.644338+0000","last_change":"2024-05-08T21:49:43.758424+0000","last_active":"2024-05-08T21:53:55.644338+0000","last_peered":"2024-05-08T21:53:55.644338+0000","last_clean":"2024-05-08T21:53:55.644338+0000","last_became_active":"2024-05-08T21:49:43.758140+0000","last_became_peered":"2024-05-08T21:49:43.758140+0000","last_unstale":"2024-05-08T21:53:55.644338+0000","last_undegraded":"2024-05-08T21:53:55.644338+0000","last_fullsized":"2024-05-08T21:53:55.644338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"24'14","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.308301+0000","last_change":"2024-05-08T21:49:43.218241+0000","last_active":"2024-05-08T21:53:51.308301+0000","last_peered":"2024-05-08T21:53:51.308301+0000","last_clean":"2024-05-08T21:53:51.308301+0000","last_became_active":"2024-05-08T21:49:43.217780+0000","last_became_peered":"2024-05-08T21:49:43.217780+0000","last_unstale":"2024-05-08T21:53:51.308301+0000","last_undegraded":"2024-05-08T21:53:51.308301+0000","last_fullsized":"2024-05-08T21:53:51.308301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":28,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"24'166","reported_seq":180,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.824517+0000","last_change":"2024-05-08T21:49:43.770491+0000","last_active":"2024-05-08T21:53:51.824517+0000","last_peered":"2024-05-08T21:53:51.824517+0000","last_clean":"2024-05-08T21:53:51.824517+0000","last_became_active":"2024-05-08T21:49:43.770221+0000","last_became_peered":"2024-05-08T21:49:43.770221+0000","last_unstale":"2024-05-08T21:53:51.824517+0000","last_undegraded":"2024-05-08T21:53:51.824517+0000","last_fullsized":"2024-05-08T21:53:51.824517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:25.661350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"24'3","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:26.317591+0000","last_change":"2024-05-08T21:49:43.221345+0000","last_active":"2024-05-08T21:52:26.317591+0000","last_peered":"2024-05-08T21:52:26.317591+0000","last_clean":"2024-05-08T21:52:26.317591+0000","last_became_active":"2024-05-08T21:49:43.220953+0000","last_became_peered":"2024-05-08T21:49:43.220953+0000","last_unstale":"2024-05-08T21:52:26.317591+0000","last_undegraded":"2024-05-08T21:52:26.317591+0000","last_fullsized":"2024-05-08T21:52:26.317591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:33:28.074468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"24'183","reported_seq":197,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.806180+0000","last_change":"2024-05-08T21:49:43.765001+0000","last_active":"2024-05-08T21:53:51.806180+0000","last_peered":"2024-05-08T21:53:51.806180+0000","last_clean":"2024-05-08T21:53:51.806180+0000","last_became_active":"2024-05-08T21:49:43.764740+0000","last_became_peered":"2024-05-08T21:49:43.764740+0000","last_unstale":"2024-05-08T21:53:51.806180+0000","last_undegraded":"2024-05-08T21:53:51.806180+0000","last_fullsized":"2024-05-08T21:53:51.806180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:18:58.836430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T21:51:53.035540+0000","last_change":"2024-05-08T21:49:43.221251+0000","last_active":"2024-05-08T21:51:53.035540+0000","last_peered":"2024-05-08T21:51:53.035540+0000","last_clean":"2024-05-08T21:51:53.035540+0000","last_became_active":"2024-05-08T21:49:43.220839+0000","last_became_peered":"2024-05-08T21:49:43.220839+0000","last_unstale":"2024-05-08T21:51:53.035540+0000","last_undegraded":"2024-05-08T21:51:53.035540+0000","last_fullsized":"2024-05-08T21:51:53.035540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:10.497167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"24'162","reported_seq":176,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.805404+0000","last_change":"2024-05-08T21:49:43.762511+0000","last_active":"2024-05-08T21:53:51.805404+0000","last_peered":"2024-05-08T21:53:51.805404+0000","last_clean":"2024-05-08T21:53:51.805404+0000","last_became_active":"2024-05-08T21:49:43.762170+0000","last_became_peered":"2024-05-08T21:49:43.762170+0000","last_unstale":"2024-05-08T21:53:51.805404+0000","last_undegraded":"2024-05-08T21:53:51.805404+0000","last_fullsized":"2024-05-08T21:53:51.805404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:11.503864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:06.000807+0000","last_change":"2024-05-08T21:49:43.215361+0000","last_active":"2024-05-08T21:52:06.000807+0000","last_peered":"2024-05-08T21:52:06.000807+0000","last_clean":"2024-05-08T21:52:06.000807+0000","last_became_active":"2024-05-08T21:49:43.215162+0000","last_became_peered":"2024-05-08T21:49:43.215162+0000","last_unstale":"2024-05-08T21:52:06.000807+0000","last_undegraded":"2024-05-08T21:52:06.000807+0000","last_fullsized":"2024-05-08T21:52:06.000807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"24'173","reported_seq":187,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.813714+0000","last_change":"2024-05-08T21:49:43.757512+0000","last_active":"2024-05-08T21:53:51.813714+0000","last_peered":"2024-05-08T21:53:51.813714+0000","last_clean":"2024-05-08T21:53:51.813714+0000","last_became_active":"2024-05-08T21:49:43.757233+0000","last_became_peered":"2024-05-08T21:49:43.757233+0000","last_unstale":"2024-05-08T21:53:51.813714+0000","last_undegraded":"2024-05-08T21:53:51.813714+0000","last_fullsized":"2024-05-08T21:53:51.813714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:53:14.774835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:06.000921+0000","last_change":"2024-05-08T21:49:43.217935+0000","last_active":"2024-05-08T21:52:06.000921+0000","last_peered":"2024-05-08T21:52:06.000921+0000","last_clean":"2024-05-08T21:52:06.000921+0000","last_became_active":"2024-05-08T21:49:43.217595+0000","last_became_peered":"2024-05-08T21:49:43.217595+0000","last_unstale":"2024-05-08T21:52:06.000921+0000","last_undegraded":"2024-05-08T21:52:06.000921+0000","last_fullsized":"2024-05-08T21:52:06.000921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"24'164","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.824588+0000","last_change":"2024-05-08T21:49:43.766816+0000","last_active":"2024-05-08T21:53:51.824588+0000","last_peered":"2024-05-08T21:53:51.824588+0000","last_clean":"2024-05-08T21:53:51.824588+0000","last_became_active":"2024-05-08T21:49:43.766596+0000","last_became_peered":"2024-05-08T21:49:43.766596+0000","last_unstale":"2024-05-08T21:53:51.824588+0000","last_undegraded":"2024-05-08T21:53:51.824588+0000","last_fullsized":"2024-05-08T21:53:51.824588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:01:00.614249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"24'4","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:11.011988+0000","last_change":"2024-05-08T21:49:43.224243+0000","last_active":"2024-05-08T21:52:11.011988+0000","last_peered":"2024-05-08T21:52:11.011988+0000","last_clean":"2024-05-08T21:52:11.011988+0000","last_became_active":"2024-05-08T21:49:43.223974+0000","last_became_peered":"2024-05-08T21:49:43.223974+0000","last_unstale":"2024-05-08T21:52:11.011988+0000","last_undegraded":"2024-05-08T21:52:11.011988+0000","last_fullsized":"2024-05-08T21:52:11.011988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:03.961487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"24'154","reported_seq":168,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.807669+0000","last_change":"2024-05-08T21:49:43.764377+0000","last_active":"2024-05-08T21:53:51.807669+0000","last_peered":"2024-05-08T21:53:51.807669+0000","last_clean":"2024-05-08T21:53:51.807669+0000","last_became_active":"2024-05-08T21:49:43.764075+0000","last_became_peered":"2024-05-08T21:49:43.764075+0000","last_unstale":"2024-05-08T21:53:51.807669+0000","last_undegraded":"2024-05-08T21:53:51.807669+0000","last_fullsized":"2024-05-08T21:53:51.807669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:41:45.602022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T21:51:58.034698+0000","last_change":"2024-05-08T21:49:43.229414+0000","last_active":"2024-05-08T21:51:58.034698+0000","last_peered":"2024-05-08T21:51:58.034698+0000","last_clean":"2024-05-08T21:51:58.034698+0000","last_became_active":"2024-05-08T21:49:43.229121+0000","last_became_peered":"2024-05-08T21:49:43.229121+0000","last_unstale":"2024-05-08T21:51:58.034698+0000","last_undegraded":"2024-05-08T21:51:58.034698+0000","last_fullsized":"2024-05-08T21:51:58.034698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:33:28.074468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"24'175","reported_seq":189,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.824315+0000","last_change":"2024-05-08T21:49:43.774111+0000","last_active":"2024-05-08T21:53:51.824315+0000","last_peered":"2024-05-08T21:53:51.824315+0000","last_clean":"2024-05-08T21:53:51.824315+0000","last_became_active":"2024-05-08T21:49:43.772528+0000","last_became_peered":"2024-05-08T21:49:43.772528+0000","last_unstale":"2024-05-08T21:53:51.824315+0000","last_undegraded":"2024-05-08T21:53:51.824315+0000","last_fullsized":"2024-05-08T21:53:51.824315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:28.983476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:11.006832+0000","last_change":"2024-05-08T21:49:43.208581+0000","last_active":"2024-05-08T21:52:11.006832+0000","last_peered":"2024-05-08T21:52:11.006832+0000","last_clean":"2024-05-08T21:52:11.006832+0000","last_became_active":"2024-05-08T21:49:43.208326+0000","last_became_peered":"2024-05-08T21:49:43.208326+0000","last_unstale":"2024-05-08T21:52:11.006832+0000","last_undegraded":"2024-05-08T21:52:11.006832+0000","last_fullsized":"2024-05-08T21:52:11.006832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"24'165","reported_seq":179,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.824709+0000","last_change":"2024-05-08T21:49:43.766519+0000","last_active":"2024-05-08T21:53:51.824709+0000","last_peered":"2024-05-08T21:53:51.824709+0000","last_clean":"2024-05-08T21:53:51.824709+0000","last_became_active":"2024-05-08T21:49:43.765789+0000","last_became_peered":"2024-05-08T21:49:43.765789+0000","last_unstale":"2024-05-08T21:53:51.824709+0000","last_undegraded":"2024-05-08T21:53:51.824709+0000","last_fullsized":"2024-05-08T21:53:51.824709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:23.674986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:26.311376+0000","last_change":"2024-05-08T21:49:43.218079+0000","last_active":"2024-05-08T21:52:26.311376+0000","last_peered":"2024-05-08T21:52:26.311376+0000","last_clean":"2024-05-08T21:52:26.311376+0000","last_became_active":"2024-05-08T21:49:43.217814+0000","last_became_peered":"2024-05-08T21:49:43.217814+0000","last_unstale":"2024-05-08T21:52:26.311376+0000","last_undegraded":"2024-05-08T21:52:26.311376+0000","last_fullsized":"2024-05-08T21:52:26.311376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:18:58.164159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"24'162","reported_seq":176,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.825665+0000","last_change":"2024-05-08T21:49:43.775713+0000","last_active":"2024-05-08T21:53:51.825665+0000","last_peered":"2024-05-08T21:53:51.825665+0000","last_clean":"2024-05-08T21:53:51.825665+0000","last_became_active":"2024-05-08T21:49:43.775361+0000","last_became_peered":"2024-05-08T21:49:43.775361+0000","last_unstale":"2024-05-08T21:53:51.825665+0000","last_undegraded":"2024-05-08T21:53:51.825665+0000","last_fullsized":"2024-05-08T21:53:51.825665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:48:24.482146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"24'180","reported_seq":195,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.814089+0000","last_change":"2024-05-08T21:49:43.767129+0000","last_active":"2024-05-08T21:53:51.814089+0000","last_peered":"2024-05-08T21:53:51.814089+0000","last_clean":"2024-05-08T21:53:51.814089+0000","last_became_active":"2024-05-08T21:49:43.766789+0000","last_became_peered":"2024-05-08T21:49:43.766789+0000","last_unstale":"2024-05-08T21:53:51.814089+0000","last_undegraded":"2024-05-08T21:53:51.814089+0000","last_fullsized":"2024-05-08T21:53:51.814089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:39.954320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"24'158","reported_seq":180,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.822323+0000","last_change":"2024-05-08T21:50:33.103563+0000","last_active":"2024-05-08T21:53:51.822323+0000","last_peered":"2024-05-08T21:53:51.822323+0000","last_clean":"2024-05-08T21:53:51.822323+0000","last_became_active":"2024-05-08T21:50:33.103289+0000","last_became_peered":"2024-05-08T21:50:33.103289+0000","last_unstale":"2024-05-08T21:53:51.822323+0000","last_undegraded":"2024-05-08T21:53:51.822323+0000","last_fullsized":"2024-05-08T21:53:51.822323+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:01:29.931035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"24'153","reported_seq":168,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.825437+0000","last_change":"2024-05-08T21:49:43.768929+0000","last_active":"2024-05-08T21:53:51.825437+0000","last_peered":"2024-05-08T21:53:51.825437+0000","last_clean":"2024-05-08T21:53:51.825437+0000","last_became_active":"2024-05-08T21:49:43.767606+0000","last_became_peered":"2024-05-08T21:49:43.767606+0000","last_unstale":"2024-05-08T21:53:51.825437+0000","last_undegraded":"2024-05-08T21:53:51.825437+0000","last_fullsized":"2024-05-08T21:53:51.825437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:13:06.426154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"24'134","reported_seq":148,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.815821+0000","last_change":"2024-05-08T21:49:43.774673+0000","last_active":"2024-05-08T21:53:51.815821+0000","last_peered":"2024-05-08T21:53:51.815821+0000","last_clean":"2024-05-08T21:53:51.815821+0000","last_became_active":"2024-05-08T21:49:43.774406+0000","last_became_peered":"2024-05-08T21:49:43.774406+0000","last_unstale":"2024-05-08T21:53:51.815821+0000","last_undegraded":"2024-05-08T21:53:51.815821+0000","last_fullsized":"2024-05-08T21:53:51.815821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:43.798909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"24'152","reported_seq":166,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.810899+0000","last_change":"2024-05-08T21:49:43.764222+0000","last_active":"2024-05-08T21:53:51.810899+0000","last_peered":"2024-05-08T21:53:51.810899+0000","last_clean":"2024-05-08T21:53:51.810899+0000","last_became_active":"2024-05-08T21:49:43.763937+0000","last_became_peered":"2024-05-08T21:49:43.763937+0000","last_unstale":"2024-05-08T21:53:51.810899+0000","last_undegraded":"2024-05-08T21:53:51.810899+0000","last_fullsized":"2024-05-08T21:53:51.810899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:04:14.416894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"24'166","reported_seq":181,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.805291+0000","last_change":"2024-05-08T21:49:43.757318+0000","last_active":"2024-05-08T21:53:51.805291+0000","last_peered":"2024-05-08T21:53:51.805291+0000","last_clean":"2024-05-08T21:53:51.805291+0000","last_became_active":"2024-05-08T21:49:43.757083+0000","last_became_peered":"2024-05-08T21:49:43.757083+0000","last_unstale":"2024-05-08T21:53:51.805291+0000","last_undegraded":"2024-05-08T21:53:51.805291+0000","last_fullsized":"2024-05-08T21:53:51.805291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"24'217","reported_seq":231,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.825684+0000","last_change":"2024-05-08T21:49:43.773491+0000","last_active":"2024-05-08T21:53:51.825684+0000","last_peered":"2024-05-08T21:53:51.825684+0000","last_clean":"2024-05-08T21:53:51.825684+0000","last_became_active":"2024-05-08T21:49:43.773203+0000","last_became_peered":"2024-05-08T21:49:43.773203+0000","last_unstale":"2024-05-08T21:53:51.825684+0000","last_undegraded":"2024-05-08T21:53:51.825684+0000","last_fullsized":"2024-05-08T21:53:51.825684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:53:14.774835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"24'160","reported_seq":174,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.808300+0000","last_change":"2024-05-08T21:49:43.761926+0000","last_active":"2024-05-08T21:53:51.808300+0000","last_peered":"2024-05-08T21:53:51.808300+0000","last_clean":"2024-05-08T21:53:51.808300+0000","last_became_active":"2024-05-08T21:49:43.761645+0000","last_became_peered":"2024-05-08T21:49:43.761645+0000","last_unstale":"2024-05-08T21:53:51.808300+0000","last_undegraded":"2024-05-08T21:53:51.808300+0000","last_fullsized":"2024-05-08T21:53:51.808300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:10:07.209965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"24'207","reported_seq":221,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.825046+0000","last_change":"2024-05-08T21:49:43.768942+0000","last_active":"2024-05-08T21:53:51.825046+0000","last_peered":"2024-05-08T21:53:51.825046+0000","last_clean":"2024-05-08T21:53:51.825046+0000","last_became_active":"2024-05-08T21:49:43.768673+0000","last_became_peered":"2024-05-08T21:49:43.768673+0000","last_unstale":"2024-05-08T21:53:51.825046+0000","last_undegraded":"2024-05-08T21:53:51.825046+0000","last_fullsized":"2024-05-08T21:53:51.825046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:15:41.869107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":475136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"24'150","reported_seq":164,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.809760+0000","last_change":"2024-05-08T21:49:43.766452+0000","last_active":"2024-05-08T21:53:51.809760+0000","last_peered":"2024-05-08T21:53:51.809760+0000","last_clean":"2024-05-08T21:53:51.809760+0000","last_became_active":"2024-05-08T21:49:43.765723+0000","last_became_peered":"2024-05-08T21:49:43.765723+0000","last_unstale":"2024-05-08T21:53:51.809760+0000","last_undegraded":"2024-05-08T21:53:51.809760+0000","last_fullsized":"2024-05-08T21:53:51.809760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:19:28.925404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"24'199","reported_seq":213,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.827487+0000","last_change":"2024-05-08T21:49:43.775098+0000","last_active":"2024-05-08T21:53:51.827487+0000","last_peered":"2024-05-08T21:53:51.827487+0000","last_clean":"2024-05-08T21:53:51.827487+0000","last_became_active":"2024-05-08T21:49:43.774808+0000","last_became_peered":"2024-05-08T21:49:43.774808+0000","last_unstale":"2024-05-08T21:53:51.827487+0000","last_undegraded":"2024-05-08T21:53:51.827487+0000","last_fullsized":"2024-05-08T21:53:51.827487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:51:15.152611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"24'154","reported_seq":168,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.823898+0000","last_change":"2024-05-08T21:49:43.775129+0000","last_active":"2024-05-08T21:53:51.823898+0000","last_peered":"2024-05-08T21:53:51.823898+0000","last_clean":"2024-05-08T21:53:51.823898+0000","last_became_active":"2024-05-08T21:49:43.774881+0000","last_became_peered":"2024-05-08T21:49:43.774881+0000","last_unstale":"2024-05-08T21:53:51.823898+0000","last_undegraded":"2024-05-08T21:53:51.823898+0000","last_fullsized":"2024-05-08T21:53:51.823898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:19:28.925404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"24'179","reported_seq":193,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.817175+0000","last_change":"2024-05-08T21:49:43.764163+0000","last_active":"2024-05-08T21:53:51.817175+0000","last_peered":"2024-05-08T21:53:51.817175+0000","last_clean":"2024-05-08T21:53:51.817175+0000","last_became_active":"2024-05-08T21:49:43.763907+0000","last_became_peered":"2024-05-08T21:49:43.763907+0000","last_unstale":"2024-05-08T21:53:51.817175+0000","last_undegraded":"2024-05-08T21:53:51.817175+0000","last_fullsized":"2024-05-08T21:53:51.817175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:01:00.614249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":417792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9216,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11255,"ondisk_log_size":11255,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":386797,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":84,"num_read_kb":92,"num_write":256,"num_write_kb":557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":835584,"data_stored":773594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509496,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31936,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339904,"statfs":{"total":96636764160,"available":96604061696,"internally_reserved":0,"allocated":843776,"data_stored":682658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.61299999999999999,"15min":0.60599999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":3.5680000000000001,"5min":3.5680000000000001,"15min":3.5680000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.64800000000000002,"15min":0.61799999999999999},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":3.6469999999999998,"5min":3.6469999999999998,"15min":3.6469999999999998},"last":0.59599999999999997}]},{"osd":1,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.60299999999999998,"15min":0.56499999999999995},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":3.2669999999999999,"5min":3.2669999999999999,"15min":3.2669999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":1.0980000000000001,"5min":0.65900000000000003,"15min":0.59399999999999997},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":5.5330000000000004,"5min":5.5330000000000004,"15min":5.5330000000000004},"last":0.44800000000000001}]},{"osd":2,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.61299999999999999,"15min":0.57699999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":5.0730000000000004,"5min":5.0730000000000004,"15min":5.0730000000000004},"last":0.62},{"interface":"front","average":{"1min":0.745,"5min":0.60299999999999998,"15min":0.57199999999999995},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":4.0250000000000004,"5min":4.0250000000000004,"15min":4.0250000000000004},"last":0.432}]},{"osd":3,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":1.603,"5min":0.78000000000000003,"15min":0.64800000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":20.791,"5min":20.791,"15min":20.791},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.60199999999999998,"15min":0.60399999999999998},"min":{"1min":0.40899999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.47999999999999998}]},{"osd":4,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.52400000000000002,"15min":0.50600000000000001},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":4.0979999999999999,"5min":4.0979999999999999,"15min":4.0979999999999999},"last":0.504},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.52500000000000002,"15min":0.52700000000000002},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.51600000000000001}]},{"osd":5,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.52400000000000002,"15min":0.53200000000000003},"min":{"1min":0.32600000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.81899999999999995,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.626,"15min":0.59599999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":7.0890000000000004,"5min":7.0890000000000004,"15min":7.0890000000000004},"last":0.64500000000000002}]},{"osd":6,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.61299999999999999,"15min":0.60899999999999999},"min":{"1min":0.40100000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":2.2440000000000002,"5min":2.2440000000000002,"15min":2.2440000000000002},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.57999999999999996,"15min":0.59599999999999997},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.56799999999999995}]}]},{"osd":6,"up_from":15,"seq":64424509496,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31736,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340104,"statfs":{"total":96636764160,"available":96604266496,"internally_reserved":0,"allocated":638976,"data_stored":477202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.91800000000000004,"15min":0.66300000000000003},"min":{"1min":0.39200000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":5.2839999999999998,"5min":23.625,"15min":23.625},"last":0.54500000000000004},{"interface":"front","average":{"1min":2.2090000000000001,"5min":2.2730000000000001,"15min":1.131},"min":{"1min":0.32600000000000001,"5min":0.308,"15min":0.308},"max":{"1min":23.975999999999999,"5min":73.831999999999994,"15min":73.831999999999994},"last":0.58799999999999997}]},{"osd":1,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":1.897,"5min":0.86599999999999999,"15min":0.74399999999999999},"min":{"1min":0.33400000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":11.552,"5min":11.552,"15min":11.552},"last":0.48299999999999998},{"interface":"front","average":{"1min":1.8180000000000001,"5min":1.012,"15min":0.73199999999999998},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":11.619999999999999,"5min":11.619999999999999,"15min":11.619999999999999},"last":0.64200000000000002}]},{"osd":2,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":2.3220000000000001,"5min":1.552,"15min":0.88400000000000001},"min":{"1min":0.36599999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":23.77,"5min":36.951000000000001,"15min":36.951000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":1.986,"5min":0.86899999999999999,"15min":0.69499999999999995},"min":{"1min":0.35899999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":20.956,"5min":20.956,"15min":20.956},"last":0.65700000000000003}]},{"osd":3,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":1.55,"5min":0.79400000000000004,"15min":0.68200000000000005},"min":{"1min":0.41199999999999998,"5min":0.38,"15min":0.38},"max":{"1min":7.9690000000000003,"5min":7.9690000000000003,"15min":7.9690000000000003},"last":0.504},{"interface":"front","average":{"1min":1.54,"5min":0.78500000000000003,"15min":0.66900000000000004},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":8.0709999999999997,"5min":8.0709999999999997,"15min":8.0709999999999997},"last":0.628}]},{"osd":4,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.53500000000000003,"15min":0.505},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":5.1840000000000002,"5min":5.1840000000000002,"15min":5.1840000000000002},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.749,"5min":0.55500000000000005,"15min":0.53100000000000003},"min":{"1min":0.34899999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":2.976,"5min":2.976,"15min":2.976},"last":0.71499999999999997}]},{"osd":5,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.53200000000000003,"15min":0.498},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":3.0369999999999999,"5min":3.0369999999999999,"15min":3.0369999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.60199999999999998,"15min":0.56999999999999995},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":5.1219999999999999,"5min":5.1219999999999999,"15min":5.1219999999999999},"last":0.69199999999999995}]},{"osd":7,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.61899999999999999,"15min":0.56999999999999995},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":4.0389999999999997,"5min":4.0389999999999997,"15min":4.0389999999999997},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.60099999999999998,"15min":0.56799999999999995},"min":{"1min":0.40100000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":2.883,"5min":2.883,"15min":2.883},"last":0.57699999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574903,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35452,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94336388,"statfs":{"total":96636764160,"available":96600461312,"internally_reserved":0,"allocated":249856,"data_stored":91798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:53:49 2024","interfaces":[{"interface":"back","average":{"1min":1.409,"5min":0.71799999999999997,"15min":0.628},"min":{"1min":0.35699999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":5.7889999999999997,"5min":5.7889999999999997,"15min":5.7889999999999997},"last":0.71999999999999997},{"interface":"front","average":{"1min":3.2599999999999998,"5min":1.109,"15min":0.77400000000000002},"min":{"1min":0.36699999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":24.751000000000001,"5min":24.751000000000001,"15min":24.751000000000001},"last":0.74399999999999999}]},{"osd":1,"last update":"Wed May 8 21:53:44 2024","interfaces":[{"interface":"back","average":{"1min":4.1360000000000001,"5min":1.294,"15min":0.84299999999999997},"min":{"1min":0.41699999999999998,"5min":0.313,"15min":0.313},"max":{"1min":53.069000000000003,"5min":53.069000000000003,"15min":53.069000000000003},"last":0.70699999999999996},{"interface":"front","average":{"1min":6.2969999999999997,"5min":1.681,"15min":0.88500000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":80.463999999999999,"5min":80.463999999999999,"15min":80.463999999999999},"last":0.72899999999999998}]},{"osd":2,"last update":"Wed May 8 21:53:49 2024","interfaces":[{"interface":"back","average":{"1min":3.8079999999999998,"5min":1.248,"15min":0.84199999999999997},"min":{"1min":0.40400000000000003,"5min":0.375,"15min":0.375},"max":{"1min":24.332000000000001,"5min":24.332000000000001,"15min":24.332000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":4.0270000000000001,"5min":1.28,"15min":0.81299999999999994},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":24.349,"5min":24.349,"15min":24.349},"last":0.75700000000000001}]},{"osd":3,"last update":"Wed May 8 21:53:49 2024","interfaces":[{"interface":"back","average":{"1min":3.9689999999999999,"5min":1.2450000000000001,"15min":0.77400000000000002},"min":{"1min":0.46400000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":33.368000000000002,"5min":33.368000000000002,"15min":33.368000000000002},"last":0.67700000000000005},{"interface":"front","average":{"1min":1.921,"5min":0.85399999999999998,"15min":0.69899999999999995},"min":{"1min":0.42599999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":8.125,"5min":8.125,"15min":8.125},"last":0.69299999999999995}]},{"osd":4,"last update":"Wed May 8 21:53:49 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.51900000000000002,"15min":0.53100000000000003},"min":{"1min":0.32800000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":2.3140000000000001,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.624,"15min":0.61399999999999999},"min":{"1min":0.34300000000000003,"5min":0.307,"15min":0.307},"max":{"1min":5.0149999999999997,"5min":5.0149999999999997,"15min":5.0149999999999997},"last":0.61199999999999999}]},{"osd":6,"last update":"Wed May 8 21:53:49 2024","interfaces":[{"interface":"back","average":{"1min":1.587,"5min":0.73599999999999999,"15min":0.59899999999999998},"min":{"1min":0.34000000000000002,"5min":0.315,"15min":0.315},"max":{"1min":8.7430000000000003,"5min":8.7430000000000003,"15min":8.7430000000000003},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.59199999999999997,"15min":0.59799999999999998},"min":{"1min":0.37,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":2.5649999999999999,"5min":2.5649999999999999,"15min":2.5649999999999999},"last":0.58999999999999997}]},{"osd":7,"last update":"Wed May 8 21:53:49 2024","interfaces":[{"interface":"back","average":{"1min":1.516,"5min":0.76900000000000002,"15min":0.66400000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":9.5380000000000003,"5min":9.5380000000000003,"15min":9.5380000000000003},"last":0.77800000000000002},{"interface":"front","average":{"1min":1.385,"5min":0.73199999999999998,"15min":0.61699999999999999},"min":{"1min":0.42499999999999999,"5min":0.375,"15min":0.375},"max":{"1min":8.7959999999999994,"5min":8.7959999999999994,"15min":8.7959999999999994},"last":0.64400000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574902,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31360,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340480,"statfs":{"total":96636764160,"available":96604651520,"internally_reserved":0,"allocated":253952,"data_stored":91868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":9.1020000000000003,"5min":2.2200000000000002,"15min":1.1719999999999999},"min":{"1min":0.26100000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":119.55200000000001,"5min":119.55200000000001,"15min":119.55200000000001},"last":0.29799999999999999},{"interface":"front","average":{"1min":2.9020000000000001,"5min":1.028,"15min":0.83999999999999997},"min":{"1min":0.24099999999999999,"5min":0.192,"15min":0.192},"max":{"1min":23.457999999999998,"5min":23.457999999999998,"15min":23.457999999999998},"last":0.36499999999999999}]},{"osd":2,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":3.9689999999999999,"5min":1.125,"15min":0.68300000000000005},"min":{"1min":0.255,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":33.259,"5min":33.259,"15min":33.259},"last":0.31},{"interface":"front","average":{"1min":4.3860000000000001,"5min":1.343,"15min":0.97299999999999998},"min":{"1min":0.249,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":43.167000000000002,"5min":43.167000000000002,"15min":43.167000000000002},"last":0.26500000000000001}]},{"osd":3,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":4.6210000000000004,"5min":1.26,"15min":0.71399999999999997},"min":{"1min":0.254,"5min":0.247,"15min":0.247},"max":{"1min":43.131,"5min":43.131,"15min":43.131},"last":0.33500000000000002},{"interface":"front","average":{"1min":7.319,"5min":1.7949999999999999,"15min":0.88100000000000001},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":52.923999999999999,"5min":52.923999999999999,"15min":52.923999999999999},"last":0.34100000000000003}]},{"osd":4,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":2.7330000000000001,"5min":1.0549999999999999,"15min":0.78700000000000003},"min":{"1min":0.41599999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":16.914000000000001,"5min":16.914000000000001,"15min":16.914000000000001},"last":0.44800000000000001},{"interface":"front","average":{"1min":4.056,"5min":1.2929999999999999,"15min":0.83299999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":43.078000000000003,"5min":43.078000000000003,"15min":43.078000000000003},"last":0.504}]},{"osd":5,"last update":"Wed May 8 21:53:38 2024","interfaces":[{"interface":"back","average":{"1min":3.8370000000000002,"5min":1.28,"15min":0.86199999999999999},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":33.198,"5min":33.198,"15min":33.198},"last":0.53000000000000003},{"interface":"front","average":{"1min":1.6990000000000001,"5min":1.002,"15min":1.0169999999999999},"min":{"1min":0.48899999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":7.6139999999999999,"5min":9.2400000000000002,"15min":9.2400000000000002},"last":0.45500000000000002}]},{"osd":6,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":1.665,"5min":0.98199999999999998,"15min":0.98799999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":7.5449999999999999,"5min":9.202,"15min":9.202},"last":0.433},{"interface":"front","average":{"1min":3.5529999999999999,"5min":1.2450000000000001,"15min":0.86899999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":33.283000000000001,"5min":33.283000000000001,"15min":33.283000000000001},"last":0.55000000000000004}]},{"osd":7,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":1.6319999999999999,"5min":0.98499999999999999,"15min":1.0049999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":7.6669999999999998,"5min":9.2249999999999996,"15min":9.2249999999999996},"last":0.53900000000000003},{"interface":"front","average":{"1min":3.2189999999999999,"5min":1.1799999999999999,"15min":0.85599999999999998},"min":{"1min":0.44400000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":16.981000000000002,"5min":16.981000000000002,"15min":16.981000000000002},"last":0.46600000000000003}]}]},{"osd":0,"up_from":15,"seq":64424509494,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31944,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339896,"statfs":{"total":96636764160,"available":96604053504,"internally_reserved":0,"allocated":851968,"data_stored":682714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":1.6599999999999999,"5min":0.63500000000000001,"15min":0.46899999999999997},"min":{"1min":0.26100000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":27.239999999999998,"5min":27.239999999999998,"15min":27.239999999999998},"last":0.27400000000000002},{"interface":"front","average":{"1min":2.0640000000000001,"5min":0.73299999999999998,"15min":0.52500000000000002},"min":{"1min":0.26100000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":27.643000000000001,"5min":27.643000000000001,"15min":27.643000000000001},"last":0.34599999999999997}]},{"osd":2,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":1.583,"5min":0.63,"15min":0.48499999999999999},"min":{"1min":0.24299999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":25.739000000000001,"5min":25.739000000000001,"15min":25.739000000000001},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.47399999999999998,"15min":0.43099999999999999},"min":{"1min":0.28000000000000003,"5min":0.253,"15min":0.253},"max":{"1min":4.9989999999999997,"5min":4.9989999999999997,"15min":4.9989999999999997},"last":0.29299999999999998}]},{"osd":3,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":1.952,"5min":0.71599999999999997,"15min":0.52200000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":13.685,"5min":13.685,"15min":13.685},"last":0.255},{"interface":"front","average":{"1min":1.8500000000000001,"5min":0.71799999999999997,"15min":0.54300000000000004},"min":{"1min":0.27400000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":28.379999999999999,"5min":28.379999999999999,"15min":28.379999999999999},"last":0.33000000000000002}]},{"osd":4,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":0.69599999999999995,"15min":0.626},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":5.6790000000000003,"5min":5.6790000000000003,"15min":5.6790000000000003},"last":0.61299999999999999},{"interface":"front","average":{"1min":1.8600000000000001,"5min":0.82499999999999996,"15min":0.64900000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":13.794,"5min":13.794,"15min":13.794},"last":0.51700000000000002}]},{"osd":5,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":1.877,"5min":0.84599999999999997,"15min":0.67200000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":13.827,"5min":13.827,"15min":13.827},"last":0.63},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.66300000000000003,"15min":0.64900000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":4.9240000000000004,"5min":4.9240000000000004,"15min":4.9240000000000004},"last":0.67000000000000004}]},{"osd":6,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":0.70999999999999996,"15min":0.65400000000000003},"min":{"1min":0.379,"5min":0.376,"15min":0.376},"max":{"1min":8.3379999999999992,"5min":8.3379999999999992,"15min":8.3379999999999992},"last":0.63600000000000001},{"interface":"front","average":{"1min":1.1359999999999999,"5min":0.70199999999999996,"15min":0.63400000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":5.6500000000000004,"5min":5.6500000000000004,"15min":5.6500000000000004},"last":0.50600000000000001}]},{"osd":7,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":0.76500000000000001,"15min":0.68000000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":9.1950000000000003,"5min":9.1950000000000003,"15min":9.1950000000000003},"last":0.64900000000000002},{"interface":"front","average":{"1min":1.8799999999999999,"5min":0.86799999999999999,"15min":0.70799999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":13.756,"5min":13.756,"15min":13.756},"last":0.55700000000000005}]}]},{"osd":2,"up_from":15,"seq":64424509496,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31356,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340484,"statfs":{"total":96636764160,"available":96604655616,"internally_reserved":0,"allocated":249856,"data_stored":92213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:53:45 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.42199999999999999,"15min":0.34999999999999998},"min":{"1min":0.255,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":3.73,"5min":3.73,"15min":3.73},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.44,"15min":0.38200000000000001},"min":{"1min":0.27400000000000002,"5min":0.254,"15min":0.254},"max":{"1min":3.1600000000000001,"5min":3.1600000000000001,"15min":3.1600000000000001},"last":0.36499999999999999}]},{"osd":1,"last update":"Wed May 8 21:53:45 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.39600000000000002,"15min":0.36199999999999999},"min":{"1min":0.23999999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":3.1930000000000001,"5min":3.1930000000000001,"15min":3.1930000000000001},"last":0.436},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.40100000000000002,"15min":0.375},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":2.1299999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":0.315}]},{"osd":3,"last update":"Wed May 8 21:53:45 2024","interfaces":[{"interface":"back","average":{"1min":4.0759999999999996,"5min":1.1160000000000001,"15min":0.60699999999999998},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":60.899000000000001,"5min":60.899000000000001,"15min":60.899000000000001},"last":0.34999999999999998},{"interface":"front","average":{"1min":1.1140000000000001,"5min":0.53900000000000003,"15min":0.437},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":9.7469999999999999,"5min":9.7469999999999999,"15min":9.7469999999999999},"last":0.33100000000000002}]},{"osd":4,"last update":"Wed May 8 21:53:45 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":0.69099999999999995,"15min":0.63600000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":7.8499999999999996,"5min":7.8499999999999996,"15min":7.8499999999999996},"last":0.54300000000000004},{"interface":"front","average":{"1min":1.123,"5min":0.72399999999999998,"15min":0.66000000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":8.1189999999999998,"5min":8.1189999999999998,"15min":8.1189999999999998},"last":0.56399999999999995}]},{"osd":5,"last update":"Wed May 8 21:53:45 2024","interfaces":[{"interface":"back","average":{"1min":1.462,"5min":0.77100000000000002,"15min":0.65100000000000002},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":11.326000000000001,"5min":11.326000000000001,"15min":11.326000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":1.1259999999999999,"5min":0.69199999999999995,"15min":0.628},"min":{"1min":0.375,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":7.8860000000000001,"5min":7.8860000000000001,"15min":7.8860000000000001},"last":0.48599999999999999}]},{"osd":6,"last update":"Wed May 8 21:53:45 2024","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":0.69799999999999995,"15min":0.63800000000000001},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":8.1709999999999994,"5min":8.1709999999999994,"15min":8.1709999999999994},"last":0.44900000000000001},{"interface":"front","average":{"1min":1.421,"5min":0.76700000000000002,"15min":0.66000000000000003},"min":{"1min":0.40300000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":10.41,"5min":10.41,"15min":10.41},"last":0.55400000000000005}]},{"osd":7,"last update":"Wed May 8 21:53:45 2024","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.67000000000000004,"15min":0.62},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":5.2699999999999996,"5min":5.2699999999999996,"15min":5.2699999999999996},"last":0.45800000000000002},{"interface":"front","average":{"1min":1.1679999999999999,"5min":0.72799999999999998,"15min":0.65200000000000002},"min":{"1min":0.42899999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":7.5810000000000004,"5min":7.5810000000000004,"15min":7.5810000000000004},"last":0.53400000000000003}]}]},{"osd":3,"up_from":15,"seq":64424509494,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35836,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94336004,"statfs":{"total":96636764160,"available":96600068096,"internally_reserved":0,"allocated":643072,"data_stored":477707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36043208},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:53:42 2024","interfaces":[{"interface":"back","average":{"1min":2.0739999999999998,"5min":0.69299999999999995,"15min":0.47899999999999998},"min":{"1min":0.21299999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":39.470999999999997,"5min":39.470999999999997,"15min":39.470999999999997},"last":0.23799999999999999},{"interface":"front","average":{"1min":1.9750000000000001,"5min":0.68400000000000005,"15min":0.48099999999999998},"min":{"1min":0.25700000000000001,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":32.802,"5min":32.802,"15min":32.802},"last":0.31900000000000001}]},{"osd":1,"last update":"Wed May 8 21:53:42 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.38500000000000001,"15min":0.38700000000000001},"min":{"1min":0.252,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.34599999999999997},{"interface":"front","average":{"1min":2.48,"5min":0.82799999999999996,"15min":0.56399999999999995},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":43.493000000000002,"5min":43.493000000000002,"15min":43.493000000000002},"last":0.29799999999999999}]},{"osd":2,"last update":"Wed May 8 21:53:42 2024","interfaces":[{"interface":"back","average":{"1min":2.4969999999999999,"5min":0.85099999999999998,"15min":0.59299999999999997},"min":{"1min":0.318,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":43.445999999999998,"5min":43.445999999999998,"15min":43.445999999999998},"last":0.33800000000000002},{"interface":"front","average":{"1min":2.3530000000000002,"5min":0.83799999999999997,"15min":0.59599999999999997},"min":{"1min":0.34499999999999997,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":39.569000000000003,"5min":39.569000000000003,"15min":39.569000000000003},"last":0.35899999999999999}]},{"osd":4,"last update":"Wed May 8 21:53:42 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.629,"15min":0.61499999999999999},"min":{"1min":0.41199999999999998,"5min":0.377,"15min":0.377},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":0.54100000000000004},{"interface":"front","average":{"1min":1.821,"5min":0.85699999999999998,"15min":0.70399999999999996},"min":{"1min":0.375,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":19.024999999999999,"5min":19.024999999999999,"15min":19.024999999999999},"last":0.60899999999999999}]},{"osd":5,"last update":"Wed May 8 21:53:42 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.63200000000000001,"15min":0.627},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.833,"5min":1.833,"15min":1.833},"last":0.75},{"interface":"front","average":{"1min":2.0470000000000002,"5min":0.91900000000000004,"15min":0.72099999999999997},"min":{"1min":0.46700000000000003,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":27.678999999999998,"5min":27.678999999999998,"15min":27.678999999999998},"last":0.71799999999999997}]},{"osd":6,"last update":"Wed May 8 21:53:42 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.65400000000000003,"15min":0.64400000000000002},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.915,"5min":1.915,"15min":1.915},"last":0.73299999999999998},{"interface":"front","average":{"1min":2.2530000000000001,"5min":0.96299999999999997,"15min":0.77100000000000002},"min":{"1min":0.46500000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":32.655000000000001,"5min":32.655000000000001,"15min":32.655000000000001},"last":0.56100000000000005}]},{"osd":7,"last update":"Wed May 8 21:53:42 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.68700000000000006,"15min":0.66700000000000004},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":3.4089999999999998,"5min":3.4089999999999998,"15min":3.4089999999999998},"last":0.70799999999999996},{"interface":"front","average":{"1min":1.653,"5min":0.88800000000000001,"15min":0.72299999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":18.939,"5min":18.939,"15min":18.939},"last":0.57899999999999996}]}]},{"osd":4,"up_from":15,"seq":64424509495,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31364,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340476,"statfs":{"total":96636764160,"available":96604647424,"internally_reserved":0,"allocated":258048,"data_stored":91834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:53:44 2024","interfaces":[{"interface":"back","average":{"1min":2.1030000000000002,"5min":0.82299999999999995,"15min":0.59999999999999998},"min":{"1min":0.29399999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":21.042999999999999,"5min":21.042999999999999,"15min":21.042999999999999},"last":0.30199999999999999},{"interface":"front","average":{"1min":2.1970000000000001,"5min":0.874,"15min":0.65200000000000002},"min":{"1min":0.46200000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":21.478999999999999,"5min":21.478999999999999,"15min":21.478999999999999},"last":0.53400000000000003}]},{"osd":1,"last update":"Wed May 8 21:53:44 2024","interfaces":[{"interface":"back","average":{"1min":1.986,"5min":0.83699999999999997,"15min":0.63100000000000001},"min":{"1min":0.372,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":14.555999999999999,"5min":14.555999999999999,"15min":14.555999999999999},"last":0.33500000000000002},{"interface":"front","average":{"1min":1.1100000000000001,"5min":0.63700000000000001,"15min":0.55500000000000005},"min":{"1min":0.40799999999999997,"5min":0.314,"15min":0.314},"max":{"1min":7.7140000000000004,"5min":7.7140000000000004,"15min":7.7140000000000004},"last":0.38900000000000001}]},{"osd":2,"last update":"Wed May 8 21:53:44 2024","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":0.69399999999999995,"15min":0.58199999999999996},"min":{"1min":0.41899999999999998,"5min":0.377,"15min":0.377},"max":{"1min":11.724,"5min":11.724,"15min":11.724},"last":0.378},{"interface":"front","average":{"1min":1.089,"5min":0.65700000000000003,"15min":0.58899999999999997},"min":{"1min":0.44600000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":4.6740000000000004,"5min":4.6740000000000004,"15min":4.6740000000000004},"last":0.44400000000000001}]},{"osd":3,"last update":"Wed May 8 21:53:44 2024","interfaces":[{"interface":"back","average":{"1min":2.4849999999999999,"5min":0.93700000000000006,"15min":0.68300000000000005},"min":{"1min":0.39400000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":30.84,"5min":30.84,"15min":30.84},"last":0.46100000000000002},{"interface":"front","average":{"1min":2.0739999999999998,"5min":0.89000000000000001,"15min":0.69099999999999995},"min":{"1min":0.41499999999999998,"5min":0.37,"15min":0.37},"max":{"1min":21.754000000000001,"5min":21.754000000000001,"15min":21.754000000000001},"last":0.47899999999999998}]},{"osd":5,"last update":"Wed May 8 21:53:44 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.52200000000000002,"15min":0.51200000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":4.4660000000000002,"5min":4.4660000000000002,"15min":4.4660000000000002},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.56899999999999995,"15min":0.56599999999999995},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":5.2190000000000003,"5min":5.2190000000000003,"15min":5.2190000000000003},"last":0.55700000000000005}]},{"osd":6,"last update":"Wed May 8 21:53:44 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.61299999999999999,"15min":0.59499999999999997},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":4.9720000000000004,"5min":4.9720000000000004,"15min":4.9720000000000004},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.60599999999999998,"15min":0.60699999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":4.4100000000000001,"5min":4.4100000000000001,"15min":4.4100000000000001},"last":0.497}]},{"osd":7,"last update":"Wed May 8 21:53:44 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.60399999999999998,"15min":0.61399999999999999},"min":{"1min":0.34699999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":4.444,"5min":4.444,"15min":4.444},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.877,"5min":0.67900000000000005,"15min":0.66100000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":5.0430000000000001,"5min":5.0430000000000001,"15min":5.0430000000000001},"last":0.52000000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":397312,"data_stored":385999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":385494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T21:53:59.064 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.064 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.064 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.064 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.064 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.064 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.064 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.064 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.065 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.065 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.065 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.065 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.065 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.065 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.066 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.066 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.066 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.066 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.066 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.066 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-05-08T21:49:42.193474+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=42, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.067 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.067 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-05-08T21:49:42.193474+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=42, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.067 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.067 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-05-08T21:49:42.193474+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=42, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.067 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.067 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-05-08T21:49:42.193474+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=42, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.067 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.067 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-05-08T21:49:42.193474+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=42, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.067 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.068 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-05-08T21:49:42.193474+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=42, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.068 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.068 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-05-08T21:49:42.193474+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=42, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.068 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.068 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-05-08T21:49:42.193474+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=42, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.068 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.068 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-05-08T21:49:42.193474+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=42, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.068 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.069 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-05-08T21:49:42.193474+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=42, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.069 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.069 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-05-08T21:49:42.193474+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=42, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.069 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.069 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-05-08T21:49:42.193474+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=42, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.069 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.069 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-05-08T21:49:42.193474+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=42, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.069 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.070 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-05-08T21:49:42.193474+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=42, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.070 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.070 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-05-08T21:49:42.193474+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=42, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.070 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.070 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-05-08T21:49:42.193474+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=42, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.070 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.070 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-05-08T21:49:42.193474+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=42, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.070 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.070 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-05-08T21:49:42.193474+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=42, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.070 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.071 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-05-08T21:49:42.193474+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=42, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.071 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.071 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.071 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-05-08T21:49:42.193474+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=42, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.071 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.071 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-05-08T21:49:42.193474+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=42, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.071 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-08T21:49:36.031649+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.071 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.071 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-08T21:49:42.193474+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=42, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.072 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-05-08T21:49:42.193474+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=42, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.072 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.072 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-05-08T21:49:42.193474+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=42, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.072 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.072 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-05-08T21:49:42.193474+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=42, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.072 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.072 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-05-08T21:49:42.193474+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=42, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.072 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.072 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-05-08T21:49:42.193474+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=42, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.072 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.073 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-05-08T21:49:42.193474+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=42, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.073 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.073 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-05-08T21:49:42.193474+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=42, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.073 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.073 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-05-08T21:49:42.193474+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=42, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.073 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.073 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-05-08T21:49:42.193474+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=42, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.073 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.073 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-05-08T21:49:42.193474+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=42, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.073 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.074 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.074 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.074 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.074 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.074 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.074 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.074 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.074 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.074 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.075 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.075 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.075 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.075 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:53:59.075 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-08T21:54:19.076 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T21:54:19.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.216+0000 7fe065c33700 1 Processor -- start 2024-05-08T21:54:19.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.216+0000 7fe065c33700 1 -- start start 2024-05-08T21:54:19.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.217+0000 7fe065c33700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe0600c55c0 0x7fe06015ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:54:19.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.217+0000 7fe065c33700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0600c2810 0x7fe0600c5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:54:19.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.217+0000 7fe065c33700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe06015b000 con 0x7fe060151ae0 2024-05-08T21:54:19.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.217+0000 7fe065c33700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe06015b5c0 con 0x7fe0600c55c0 2024-05-08T21:54:19.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.217+0000 7fe065c33700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe06015bf90 con 0x7fe0600c2810 2024-05-08T21:54:19.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.217+0000 7fe05effd700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe0600c55c0 0x7fe06015ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:54:19.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.217+0000 7fe05effd700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe0600c55c0 0x7fe06015ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34150/0 (socket says 172.21.15.73:34150) 2024-05-08T21:54:19.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.217+0000 7fe05f7fe700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fe060151ae0 0x7fe060157a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:36582/0 (socket says 172.21.15.73:36582) 2024-05-08T21:54:19.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.217+0000 7fe05effd700 1 -- 172.21.15.73:0/935386993 learned_addr learned my addr 172.21.15.73:0/935386993 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:54:19.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.217+0000 7fe05ffff700 1 --2- 172.21.15.73:0/935386993 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0600c2810 0x7fe0600c5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:54:19.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.217+0000 7fe05effd700 1 -- 172.21.15.73:0/935386993 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0600c2810 msgr2=0x7fe0600c5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:54:19.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.217+0000 7fe05effd700 1 --2- 172.21.15.73:0/935386993 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0600c2810 0x7fe0600c5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:54:19.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.217+0000 7fe05effd700 1 -- 172.21.15.73:0/935386993 >> v1:172.21.15.73:6789/0 conn(0x7fe060151ae0 legacy=0x7fe060157a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:54:19.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.217+0000 7fe05effd700 1 -- 172.21.15.73:0/935386993 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe060151ec0 con 0x7fe0600c55c0 2024-05-08T21:54:19.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.217+0000 7fe05ffff700 1 --2- 172.21.15.73:0/935386993 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0600c2810 0x7fe0600c5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:54:19.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.217+0000 7fe05effd700 1 --2- 172.21.15.73:0/935386993 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0600c55c0 0x7fe06015ba50 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe0500098f0 tx=0x7fe050009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d84cc45dcec3459 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:54:19.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.218+0000 7fe05e7fc700 1 -- 172.21.15.73:0/935386993 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe05000b8a0 con 0x7fe0600c55c0 2024-05-08T21:54:19.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.218+0000 7fe05e7fc700 1 -- 172.21.15.73:0/935386993 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe05000ba00 con 0x7fe0600c55c0 2024-05-08T21:54:19.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.218+0000 7fe05e7fc700 1 -- 172.21.15.73:0/935386993 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe05000bd90 con 0x7fe0600c55c0 2024-05-08T21:54:19.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.218+0000 7fe065c33700 1 -- 172.21.15.73:0/935386993 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0600c55c0 msgr2=0x7fe06015ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:54:19.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.218+0000 7fe065c33700 1 --2- 172.21.15.73:0/935386993 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0600c55c0 0x7fe06015ba50 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe0500098f0 tx=0x7fe050009c00 comp rx=0 tx=0).stop 2024-05-08T21:54:19.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.218+0000 7fe065c33700 1 -- 172.21.15.73:0/935386993 shutdown_connections 2024-05-08T21:54:19.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.218+0000 7fe065c33700 1 --2- 172.21.15.73:0/935386993 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0600c2810 0x7fe0600c5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:54:19.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.218+0000 7fe065c33700 1 --2- 172.21.15.73:0/935386993 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0600c55c0 0x7fe06015ba50 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:54:19.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.218+0000 7fe065c33700 1 -- 172.21.15.73:0/935386993 >> 172.21.15.73:0/935386993 conn(0x7fe06006ce80 msgr2=0x7fe06006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:54:19.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.218+0000 7fe065c33700 1 -- 172.21.15.73:0/935386993 shutdown_connections 2024-05-08T21:54:19.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.218+0000 7fe065c33700 1 -- 172.21.15.73:0/935386993 wait complete. 2024-05-08T21:54:19.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.219+0000 7fe065c33700 1 Processor -- start 2024-05-08T21:54:19.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.220+0000 7fe065c33700 1 -- start start 2024-05-08T21:54:19.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.220+0000 7fe065c33700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0600c2810 0x7fe0600cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:54:19.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.220+0000 7fe065c33700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0600c55c0 0x7fe06014a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:54:19.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.220+0000 7fe065c33700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe060151ae0 0x7fe060153160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:54:19.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.220+0000 7fe065c33700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0600cc1b0 con 0x7fe0600c55c0 2024-05-08T21:54:19.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.220+0000 7fe065c33700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0600c25a0 con 0x7fe060151ae0 2024-05-08T21:54:19.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.220+0000 7fe065c33700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0601ed8d0 con 0x7fe0600c2810 2024-05-08T21:54:19.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.221+0000 7fe05effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0600c55c0 0x7fe06014a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:54:19.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.221+0000 7fe05effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0600c55c0 0x7fe06014a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34158/0 (socket says 172.21.15.73:34158) 2024-05-08T21:54:19.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.221+0000 7fe05effd700 1 -- 172.21.15.73:0/1431845611 learned_addr learned my addr 172.21.15.73:0/1431845611 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:54:19.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.221+0000 7fe05f7fe700 1 --2- 172.21.15.73:0/1431845611 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0600c2810 0x7fe0600cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:54:19.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.221+0000 7fe05ffff700 1 --2- 172.21.15.73:0/1431845611 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe060151ae0 0x7fe060153160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:54:19.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.221+0000 7fe05effd700 1 -- 172.21.15.73:0/1431845611 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0600c2810 msgr2=0x7fe0600cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:54:19.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.221+0000 7fe05effd700 1 --2- 172.21.15.73:0/1431845611 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0600c2810 0x7fe0600cbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:54:19.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.221+0000 7fe05effd700 1 -- 172.21.15.73:0/1431845611 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe060151ae0 msgr2=0x7fe060153160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:54:19.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.221+0000 7fe05effd700 1 --2- 172.21.15.73:0/1431845611 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe060151ae0 0x7fe060153160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:54:19.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.221+0000 7fe05effd700 1 -- 172.21.15.73:0/1431845611 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe050009550 con 0x7fe0600c55c0 2024-05-08T21:54:19.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.221+0000 7fe05f7fe700 1 --2- 172.21.15.73:0/1431845611 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0600c2810 0x7fe0600cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:54:19.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.221+0000 7fe05effd700 1 --2- 172.21.15.73:0/1431845611 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0600c55c0 0x7fe06014a960 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe050009c40 tx=0x7fe050004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:54:19.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.221+0000 7fe047fff700 1 -- 172.21.15.73:0/1431845611 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe050004530 con 0x7fe0600c55c0 2024-05-08T21:54:19.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.221+0000 7fe047fff700 1 -- 172.21.15.73:0/1431845611 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe05001f070 con 0x7fe0600c55c0 2024-05-08T21:54:19.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.221+0000 7fe047fff700 1 -- 172.21.15.73:0/1431845611 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0500038a0 con 0x7fe0600c55c0 2024-05-08T21:54:19.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.221+0000 7fe065c33700 1 -- 172.21.15.73:0/1431845611 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0601523a0 con 0x7fe0600c55c0 2024-05-08T21:54:19.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.221+0000 7fe065c33700 1 -- 172.21.15.73:0/1431845611 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe060152960 con 0x7fe0600c55c0 2024-05-08T21:54:19.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.222+0000 7fe065c33700 1 -- 172.21.15.73:0/1431845611 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe060067a20 con 0x7fe0600c55c0 2024-05-08T21:54:19.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.223+0000 7fe047fff700 1 -- 172.21.15.73:0/1431845611 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe050021030 con 0x7fe0600c55c0 2024-05-08T21:54:19.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.223+0000 7fe047fff700 1 --2- 172.21.15.73:0/1431845611 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fe04c06ac90 0x7fe04c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:54:19.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.223+0000 7fe047fff700 1 -- 172.21.15.73:0/1431845611 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5969+0+0 (secure 0 0 0) 0x7fe05008a850 con 0x7fe0600c55c0 2024-05-08T21:54:19.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.223+0000 7fe05f7fe700 1 --2- 172.21.15.73:0/1431845611 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fe04c06ac90 0x7fe04c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:54:19.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.223+0000 7fe05f7fe700 1 --2- 172.21.15.73:0/1431845611 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fe04c06ac90 0x7fe04c06d150 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe054000f60 tx=0x7fe054007dd0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:54:19.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.228+0000 7fe047fff700 1 -- 172.21.15.73:0/1431845611 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fe0500559b0 con 0x7fe0600c55c0 2024-05-08T21:54:19.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.420+0000 7fe065c33700 1 -- 172.21.15.73:0/1431845611 --> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe060158810 con 0x7fe04c06ac90 2024-05-08T21:54:19.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.428+0000 7fe047fff700 1 -- 172.21.15.73:0/1431845611 <== mgr.4104 v2:172.21.15.73:6832/46949 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288922 (secure 0 0 0) 0x7fe054005cd0 con 0x7fe04c06ac90 2024-05-08T21:54:19.432 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:54:19.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.431+0000 7fe065c33700 1 -- 172.21.15.73:0/1431845611 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fe04c06ac90 msgr2=0x7fe04c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:54:19.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.431+0000 7fe065c33700 1 --2- 172.21.15.73:0/1431845611 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fe04c06ac90 0x7fe04c06d150 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe054000f60 tx=0x7fe054007dd0 comp rx=0 tx=0).stop 2024-05-08T21:54:19.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.431+0000 7fe065c33700 1 -- 172.21.15.73:0/1431845611 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0600c55c0 msgr2=0x7fe06014a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:54:19.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.431+0000 7fe065c33700 1 --2- 172.21.15.73:0/1431845611 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0600c55c0 0x7fe06014a960 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe050009c40 tx=0x7fe050004750 comp rx=0 tx=0).stop 2024-05-08T21:54:19.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.431+0000 7fe065c33700 1 -- 172.21.15.73:0/1431845611 shutdown_connections 2024-05-08T21:54:19.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.431+0000 7fe065c33700 1 --2- 172.21.15.73:0/1431845611 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fe04c06ac90 0x7fe04c06d150 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:54:19.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.431+0000 7fe065c33700 1 --2- 172.21.15.73:0/1431845611 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe060151ae0 0x7fe060153160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:54:19.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.431+0000 7fe065c33700 1 --2- 172.21.15.73:0/1431845611 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0600c2810 0x7fe0600cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:54:19.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.431+0000 7fe065c33700 1 --2- 172.21.15.73:0/1431845611 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0600c55c0 0x7fe06014a960 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:54:19.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.431+0000 7fe065c33700 1 -- 172.21.15.73:0/1431845611 >> 172.21.15.73:0/1431845611 conn(0x7fe06006ce80 msgr2=0x7fe060150050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:54:19.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.431+0000 7fe065c33700 1 -- 172.21.15.73:0/1431845611 shutdown_connections 2024-05-08T21:54:19.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:19.431+0000 7fe065c33700 1 -- 172.21.15.73:0/1431845611 wait complete. 2024-05-08T21:54:19.436 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-05-08T21:54:19.444 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":158,"stamp":"2024-05-08T21:54:18.023512+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":979501,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":200,"num_read_kb":192,"num_write":9635,"num_write_kb":25168801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11643,"ondisk_log_size":11643,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":260992,"kb_used_data":3904,"kb_used_omap":12,"kb_used_meta":257011,"kb_avail":754713728,"statfs":{"total":773094113280,"available":772826857472,"internally_reserved":0,"allocated":3997696,"data_stored":2692666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":263179834},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002967"},"pg_stats":[{"pgid":"3.3f","version":"24'167","reported_seq":183,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:58.693445+0000","last_change":"2024-05-08T21:49:43.775912+0000","last_active":"2024-05-08T21:53:58.693445+0000","last_peered":"2024-05-08T21:53:58.693445+0000","last_clean":"2024-05-08T21:53:58.693445+0000","last_became_active":"2024-05-08T21:49:43.775657+0000","last_became_peered":"2024-05-08T21:49:43.775657+0000","last_unstale":"2024-05-08T21:53:58.693445+0000","last_undegraded":"2024-05-08T21:53:58.693445+0000","last_fullsized":"2024-05-08T21:53:58.693445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"24'152","reported_seq":168,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:55.644417+0000","last_change":"2024-05-08T21:49:43.766984+0000","last_active":"2024-05-08T21:53:55.644417+0000","last_peered":"2024-05-08T21:53:55.644417+0000","last_clean":"2024-05-08T21:53:55.644417+0000","last_became_active":"2024-05-08T21:49:43.765995+0000","last_became_peered":"2024-05-08T21:49:43.765995+0000","last_unstale":"2024-05-08T21:53:55.644417+0000","last_undegraded":"2024-05-08T21:53:55.644417+0000","last_fullsized":"2024-05-08T21:53:55.644417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"24'178","reported_seq":205,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:07.675725+0000","last_change":"2024-05-08T21:54:07.675848+0000","last_active":"2024-05-08T21:54:07.675725+0000","last_peered":"2024-05-08T21:54:07.675725+0000","last_clean":"2024-05-08T21:54:07.675725+0000","last_became_active":"2024-05-08T21:49:43.765874+0000","last_became_peered":"2024-05-08T21:49:43.765874+0000","last_unstale":"2024-05-08T21:54:07.675725+0000","last_undegraded":"2024-05-08T21:54:07.675725+0000","last_fullsized":"2024-05-08T21:54:07.675725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'178","last_scrub_stamp":"2024-05-08T21:54:07.675698+0000","last_deep_scrub":"24'178","last_deep_scrub_stamp":"2024-05-08T21:54:07.675698+0000","last_clean_scrub_stamp":"2024-05-08T21:54:07.675698+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:56:49.033245+0000","scrub_duration":0.002959854,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"24'193","reported_seq":209,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.825592+0000","last_change":"2024-05-08T21:49:43.766355+0000","last_active":"2024-05-08T21:53:51.825592+0000","last_peered":"2024-05-08T21:53:51.825592+0000","last_clean":"2024-05-08T21:53:51.825592+0000","last_became_active":"2024-05-08T21:49:43.765507+0000","last_became_peered":"2024-05-08T21:49:43.765507+0000","last_unstale":"2024-05-08T21:53:51.825592+0000","last_undegraded":"2024-05-08T21:53:51.825592+0000","last_fullsized":"2024-05-08T21:53:51.825592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"24'174","reported_seq":187,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.820321+0000","last_change":"2024-05-08T21:50:33.104253+0000","last_active":"2024-05-08T21:53:51.820321+0000","last_peered":"2024-05-08T21:53:51.820321+0000","last_clean":"2024-05-08T21:53:51.820321+0000","last_became_active":"2024-05-08T21:50:33.103943+0000","last_became_peered":"2024-05-08T21:50:33.103943+0000","last_unstale":"2024-05-08T21:53:51.820321+0000","last_undegraded":"2024-05-08T21:53:51.820321+0000","last_fullsized":"2024-05-08T21:53:51.820321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"24'162","reported_seq":177,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.822081+0000","last_change":"2024-05-08T21:49:43.771390+0000","last_active":"2024-05-08T21:53:51.822081+0000","last_peered":"2024-05-08T21:53:51.822081+0000","last_clean":"2024-05-08T21:53:51.822081+0000","last_became_active":"2024-05-08T21:49:43.770893+0000","last_became_peered":"2024-05-08T21:49:43.770893+0000","last_unstale":"2024-05-08T21:53:51.822081+0000","last_undegraded":"2024-05-08T21:53:51.822081+0000","last_fullsized":"2024-05-08T21:53:51.822081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"24'188","reported_seq":203,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.820955+0000","last_change":"2024-05-08T21:49:43.769981+0000","last_active":"2024-05-08T21:53:51.820955+0000","last_peered":"2024-05-08T21:53:51.820955+0000","last_clean":"2024-05-08T21:53:51.820955+0000","last_became_active":"2024-05-08T21:49:43.769667+0000","last_became_peered":"2024-05-08T21:49:43.769667+0000","last_unstale":"2024-05-08T21:53:51.820955+0000","last_undegraded":"2024-05-08T21:53:51.820955+0000","last_fullsized":"2024-05-08T21:53:51.820955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"24'204","reported_seq":219,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.824460+0000","last_change":"2024-05-08T21:49:43.771078+0000","last_active":"2024-05-08T21:53:51.824460+0000","last_peered":"2024-05-08T21:53:51.824460+0000","last_clean":"2024-05-08T21:53:51.824460+0000","last_became_active":"2024-05-08T21:49:43.770912+0000","last_became_peered":"2024-05-08T21:49:43.770912+0000","last_unstale":"2024-05-08T21:53:51.824460+0000","last_undegraded":"2024-05-08T21:53:51.824460+0000","last_fullsized":"2024-05-08T21:53:51.824460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":483328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"24'178","reported_seq":201,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.825723+0000","last_change":"2024-05-08T21:50:33.106461+0000","last_active":"2024-05-08T21:53:51.825723+0000","last_peered":"2024-05-08T21:53:51.825723+0000","last_clean":"2024-05-08T21:53:51.825723+0000","last_became_active":"2024-05-08T21:50:33.106142+0000","last_became_peered":"2024-05-08T21:50:33.106142+0000","last_unstale":"2024-05-08T21:53:51.825723+0000","last_undegraded":"2024-05-08T21:53:51.825723+0000","last_fullsized":"2024-05-08T21:53:51.825723+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"24'190","reported_seq":205,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.821000+0000","last_change":"2024-05-08T21:49:43.772784+0000","last_active":"2024-05-08T21:53:51.821000+0000","last_peered":"2024-05-08T21:53:51.821000+0000","last_clean":"2024-05-08T21:53:51.821000+0000","last_became_active":"2024-05-08T21:49:43.772505+0000","last_became_peered":"2024-05-08T21:49:43.772505+0000","last_unstale":"2024-05-08T21:53:51.821000+0000","last_undegraded":"2024-05-08T21:53:51.821000+0000","last_fullsized":"2024-05-08T21:53:51.821000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"24'214","reported_seq":240,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:10.739193+0000","last_change":"2024-05-08T21:54:10.739319+0000","last_active":"2024-05-08T21:54:10.739193+0000","last_peered":"2024-05-08T21:54:10.739193+0000","last_clean":"2024-05-08T21:54:10.739193+0000","last_became_active":"2024-05-08T21:49:43.771457+0000","last_became_peered":"2024-05-08T21:49:43.771457+0000","last_unstale":"2024-05-08T21:54:10.739193+0000","last_undegraded":"2024-05-08T21:54:10.739193+0000","last_fullsized":"2024-05-08T21:54:10.739193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'214","last_scrub_stamp":"2024-05-08T21:54:10.739166+0000","last_deep_scrub":"24'214","last_deep_scrub_stamp":"2024-05-08T21:54:10.739166+0000","last_clean_scrub_stamp":"2024-05-08T21:54:10.739166+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:05:25.395957+0000","scrub_duration":0.0033296089999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"24'166","reported_seq":192,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:05.271627+0000","last_change":"2024-05-08T21:54:05.271747+0000","last_active":"2024-05-08T21:54:05.271627+0000","last_peered":"2024-05-08T21:54:05.271627+0000","last_clean":"2024-05-08T21:54:05.271627+0000","last_became_active":"2024-05-08T21:49:43.763986+0000","last_became_peered":"2024-05-08T21:49:43.763986+0000","last_unstale":"2024-05-08T21:54:05.271627+0000","last_undegraded":"2024-05-08T21:54:05.271627+0000","last_fullsized":"2024-05-08T21:54:05.271627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'166","last_scrub_stamp":"2024-05-08T21:54:05.271586+0000","last_deep_scrub":"24'166","last_deep_scrub_stamp":"2024-05-08T21:54:05.271586+0000","last_clean_scrub_stamp":"2024-05-08T21:54:05.271586+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:38:55.915259+0000","scrub_duration":0.0044053850000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"24'177","reported_seq":203,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:12.014978+0000","last_change":"2024-05-08T21:54:12.015093+0000","last_active":"2024-05-08T21:54:12.014978+0000","last_peered":"2024-05-08T21:54:12.014978+0000","last_clean":"2024-05-08T21:54:12.014978+0000","last_became_active":"2024-05-08T21:49:43.760874+0000","last_became_peered":"2024-05-08T21:49:43.760874+0000","last_unstale":"2024-05-08T21:54:12.014978+0000","last_undegraded":"2024-05-08T21:54:12.014978+0000","last_fullsized":"2024-05-08T21:54:12.014978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'177","last_scrub_stamp":"2024-05-08T21:54:12.014952+0000","last_deep_scrub":"24'177","last_deep_scrub_stamp":"2024-05-08T21:54:12.014952+0000","last_clean_scrub_stamp":"2024-05-08T21:54:12.014952+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:31:09.163282+0000","scrub_duration":0.0037380849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"24'172","reported_seq":187,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.820644+0000","last_change":"2024-05-08T21:49:43.765829+0000","last_active":"2024-05-08T21:53:51.820644+0000","last_peered":"2024-05-08T21:53:51.820644+0000","last_clean":"2024-05-08T21:53:51.820644+0000","last_became_active":"2024-05-08T21:49:43.765566+0000","last_became_peered":"2024-05-08T21:49:43.765566+0000","last_unstale":"2024-05-08T21:53:51.820644+0000","last_undegraded":"2024-05-08T21:53:51.820644+0000","last_fullsized":"2024-05-08T21:53:51.820644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"24'177","reported_seq":192,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.816008+0000","last_change":"2024-05-08T21:49:43.765080+0000","last_active":"2024-05-08T21:53:51.816008+0000","last_peered":"2024-05-08T21:53:51.816008+0000","last_clean":"2024-05-08T21:53:51.816008+0000","last_became_active":"2024-05-08T21:49:43.764810+0000","last_became_peered":"2024-05-08T21:49:43.764810+0000","last_unstale":"2024-05-08T21:53:51.816008+0000","last_undegraded":"2024-05-08T21:53:51.816008+0000","last_fullsized":"2024-05-08T21:53:51.816008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"24'162","reported_seq":177,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.820869+0000","last_change":"2024-05-08T21:49:43.766717+0000","last_active":"2024-05-08T21:53:51.820869+0000","last_peered":"2024-05-08T21:53:51.820869+0000","last_clean":"2024-05-08T21:53:51.820869+0000","last_became_active":"2024-05-08T21:49:43.766427+0000","last_became_peered":"2024-05-08T21:49:43.766427+0000","last_unstale":"2024-05-08T21:53:51.820869+0000","last_undegraded":"2024-05-08T21:53:51.820869+0000","last_fullsized":"2024-05-08T21:53:51.820869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"24'176","reported_seq":191,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.827345+0000","last_change":"2024-05-08T21:49:43.776929+0000","last_active":"2024-05-08T21:53:51.827345+0000","last_peered":"2024-05-08T21:53:51.827345+0000","last_clean":"2024-05-08T21:53:51.827345+0000","last_became_active":"2024-05-08T21:49:43.776509+0000","last_became_peered":"2024-05-08T21:49:43.776509+0000","last_unstale":"2024-05-08T21:53:51.827345+0000","last_undegraded":"2024-05-08T21:53:51.827345+0000","last_fullsized":"2024-05-08T21:53:51.827345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"24'179","reported_seq":205,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:10.056947+0000","last_change":"2024-05-08T21:54:10.057071+0000","last_active":"2024-05-08T21:54:10.056947+0000","last_peered":"2024-05-08T21:54:10.056947+0000","last_clean":"2024-05-08T21:54:10.056947+0000","last_became_active":"2024-05-08T21:49:43.762237+0000","last_became_peered":"2024-05-08T21:49:43.762237+0000","last_unstale":"2024-05-08T21:54:10.056947+0000","last_undegraded":"2024-05-08T21:54:10.056947+0000","last_fullsized":"2024-05-08T21:54:10.056947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'179","last_scrub_stamp":"2024-05-08T21:54:10.056922+0000","last_deep_scrub":"24'179","last_deep_scrub_stamp":"2024-05-08T21:54:10.056922+0000","last_clean_scrub_stamp":"2024-05-08T21:54:10.056922+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:12:15.674986+0000","scrub_duration":0.003987684,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"24'205","reported_seq":220,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.822273+0000","last_change":"2024-05-08T21:49:43.774729+0000","last_active":"2024-05-08T21:53:51.822273+0000","last_peered":"2024-05-08T21:53:51.822273+0000","last_clean":"2024-05-08T21:53:51.822273+0000","last_became_active":"2024-05-08T21:49:43.774450+0000","last_became_peered":"2024-05-08T21:49:43.774450+0000","last_unstale":"2024-05-08T21:53:51.822273+0000","last_undegraded":"2024-05-08T21:53:51.822273+0000","last_fullsized":"2024-05-08T21:53:51.822273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"24'7","reported_seq":37,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:58.756471+0000","last_change":"2024-05-08T21:53:58.756585+0000","last_active":"2024-05-08T21:53:58.756471+0000","last_peered":"2024-05-08T21:53:58.756471+0000","last_clean":"2024-05-08T21:53:58.756471+0000","last_became_active":"2024-05-08T21:49:43.219161+0000","last_became_peered":"2024-05-08T21:49:43.219161+0000","last_unstale":"2024-05-08T21:53:58.756471+0000","last_undegraded":"2024-05-08T21:53:58.756471+0000","last_fullsized":"2024-05-08T21:53:58.756471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'7","last_scrub_stamp":"2024-05-08T21:53:58.756448+0000","last_deep_scrub":"24'7","last_deep_scrub_stamp":"2024-05-08T21:53:58.756448+0000","last_clean_scrub_stamp":"2024-05-08T21:53:58.756448+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:46:56.777485+0000","scrub_duration":0.0058782679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"24'181","reported_seq":197,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.824164+0000","last_change":"2024-05-08T21:49:43.764252+0000","last_active":"2024-05-08T21:53:51.824164+0000","last_peered":"2024-05-08T21:53:51.824164+0000","last_clean":"2024-05-08T21:53:51.824164+0000","last_became_active":"2024-05-08T21:49:43.764045+0000","last_became_peered":"2024-05-08T21:49:43.764045+0000","last_unstale":"2024-05-08T21:53:51.824164+0000","last_undegraded":"2024-05-08T21:53:51.824164+0000","last_fullsized":"2024-05-08T21:53:51.824164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'2","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:03.976354+0000","last_change":"2024-05-08T21:54:03.976461+0000","last_active":"2024-05-08T21:54:03.976354+0000","last_peered":"2024-05-08T21:54:03.976354+0000","last_clean":"2024-05-08T21:54:03.976354+0000","last_became_active":"2024-05-08T21:49:43.221309+0000","last_became_peered":"2024-05-08T21:49:43.221309+0000","last_unstale":"2024-05-08T21:54:03.976354+0000","last_undegraded":"2024-05-08T21:54:03.976354+0000","last_fullsized":"2024-05-08T21:54:03.976354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'2","last_scrub_stamp":"2024-05-08T21:54:03.976327+0000","last_deep_scrub":"24'2","last_deep_scrub_stamp":"2024-05-08T21:54:03.976327+0000","last_clean_scrub_stamp":"2024-05-08T21:54:03.976327+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:57:35.011981+0000","scrub_duration":0.0018723979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"24'160","reported_seq":176,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:55.137388+0000","last_change":"2024-05-08T21:49:43.771523+0000","last_active":"2024-05-08T21:53:55.137388+0000","last_peered":"2024-05-08T21:53:55.137388+0000","last_clean":"2024-05-08T21:53:55.137388+0000","last_became_active":"2024-05-08T21:49:43.771295+0000","last_became_peered":"2024-05-08T21:49:43.771295+0000","last_unstale":"2024-05-08T21:53:55.137388+0000","last_undegraded":"2024-05-08T21:53:55.137388+0000","last_fullsized":"2024-05-08T21:53:55.137388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"24'3","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:52:52.887409+0000","last_change":"2024-05-08T21:49:43.226637+0000","last_active":"2024-05-08T21:52:52.887409+0000","last_peered":"2024-05-08T21:52:52.887409+0000","last_clean":"2024-05-08T21:52:52.887409+0000","last_became_active":"2024-05-08T21:49:43.226284+0000","last_became_peered":"2024-05-08T21:49:43.226284+0000","last_unstale":"2024-05-08T21:52:52.887409+0000","last_undegraded":"2024-05-08T21:52:52.887409+0000","last_fullsized":"2024-05-08T21:52:52.887409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"24'162","reported_seq":177,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.818955+0000","last_change":"2024-05-08T21:49:43.766694+0000","last_active":"2024-05-08T21:53:51.818955+0000","last_peered":"2024-05-08T21:53:51.818955+0000","last_clean":"2024-05-08T21:53:51.818955+0000","last_became_active":"2024-05-08T21:49:43.766079+0000","last_became_peered":"2024-05-08T21:49:43.766079+0000","last_unstale":"2024-05-08T21:53:51.818955+0000","last_undegraded":"2024-05-08T21:53:51.818955+0000","last_fullsized":"2024-05-08T21:53:51.818955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"24'3","reported_seq":32,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:08.965266+0000","last_change":"2024-05-08T21:54:08.965385+0000","last_active":"2024-05-08T21:54:08.965266+0000","last_peered":"2024-05-08T21:54:08.965266+0000","last_clean":"2024-05-08T21:54:08.965266+0000","last_became_active":"2024-05-08T21:49:43.229891+0000","last_became_peered":"2024-05-08T21:49:43.229891+0000","last_unstale":"2024-05-08T21:54:08.965266+0000","last_undegraded":"2024-05-08T21:54:08.965266+0000","last_fullsized":"2024-05-08T21:54:08.965266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'3","last_scrub_stamp":"2024-05-08T21:54:08.965240+0000","last_deep_scrub":"24'3","last_deep_scrub_stamp":"2024-05-08T21:54:08.965240+0000","last_clean_scrub_stamp":"2024-05-08T21:54:08.965240+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:25:07.591586+0000","scrub_duration":0.0027495779999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"24'205","reported_seq":218,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.820283+0000","last_change":"2024-05-08T21:50:33.113046+0000","last_active":"2024-05-08T21:53:51.820283+0000","last_peered":"2024-05-08T21:53:51.820283+0000","last_clean":"2024-05-08T21:53:51.820283+0000","last_became_active":"2024-05-08T21:50:33.112776+0000","last_became_peered":"2024-05-08T21:50:33.112776+0000","last_unstale":"2024-05-08T21:53:51.820283+0000","last_undegraded":"2024-05-08T21:53:51.820283+0000","last_fullsized":"2024-05-08T21:53:51.820283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":458752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"24'2","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:01.895028+0000","last_change":"2024-05-08T21:54:01.895201+0000","last_active":"2024-05-08T21:54:01.895028+0000","last_peered":"2024-05-08T21:54:01.895028+0000","last_clean":"2024-05-08T21:54:01.895028+0000","last_became_active":"2024-05-08T21:49:43.220090+0000","last_became_peered":"2024-05-08T21:49:43.220090+0000","last_unstale":"2024-05-08T21:54:01.895028+0000","last_undegraded":"2024-05-08T21:54:01.895028+0000","last_fullsized":"2024-05-08T21:54:01.895028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'2","last_scrub_stamp":"2024-05-08T21:54:01.894999+0000","last_deep_scrub":"24'2","last_deep_scrub_stamp":"2024-05-08T21:54:01.894999+0000","last_clean_scrub_stamp":"2024-05-08T21:54:01.894999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:38:52.538673+0000","scrub_duration":0.002723521,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"24'149","reported_seq":173,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:13.089760+0000","last_change":"2024-05-08T21:54:13.089891+0000","last_active":"2024-05-08T21:54:13.089760+0000","last_peered":"2024-05-08T21:54:13.089760+0000","last_clean":"2024-05-08T21:54:13.089760+0000","last_became_active":"2024-05-08T21:50:33.103147+0000","last_became_peered":"2024-05-08T21:50:33.103147+0000","last_unstale":"2024-05-08T21:54:13.089760+0000","last_undegraded":"2024-05-08T21:54:13.089760+0000","last_fullsized":"2024-05-08T21:54:13.089760+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'149","last_scrub_stamp":"2024-05-08T21:54:13.089730+0000","last_deep_scrub":"24'149","last_deep_scrub_stamp":"2024-05-08T21:54:13.089730+0000","last_clean_scrub_stamp":"2024-05-08T21:54:13.089730+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:31:10.238060+0000","scrub_duration":0.0044294210000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"24'2","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:59.634205+0000","last_change":"2024-05-08T21:53:59.634326+0000","last_active":"2024-05-08T21:53:59.634205+0000","last_peered":"2024-05-08T21:53:59.634205+0000","last_clean":"2024-05-08T21:53:59.634205+0000","last_became_active":"2024-05-08T21:49:43.218473+0000","last_became_peered":"2024-05-08T21:49:43.218473+0000","last_unstale":"2024-05-08T21:53:59.634205+0000","last_undegraded":"2024-05-08T21:53:59.634205+0000","last_fullsized":"2024-05-08T21:53:59.634205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'2","last_scrub_stamp":"2024-05-08T21:53:59.634180+0000","last_deep_scrub":"24'2","last_deep_scrub_stamp":"2024-05-08T21:53:59.634180+0000","last_clean_scrub_stamp":"2024-05-08T21:53:59.634180+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:38:50.277853+0000","scrub_duration":0.0013227530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"24'162","reported_seq":188,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:13.651717+0000","last_change":"2024-05-08T21:54:13.651830+0000","last_active":"2024-05-08T21:54:13.651717+0000","last_peered":"2024-05-08T21:54:13.651717+0000","last_clean":"2024-05-08T21:54:13.651717+0000","last_became_active":"2024-05-08T21:49:43.770677+0000","last_became_peered":"2024-05-08T21:49:43.770677+0000","last_unstale":"2024-05-08T21:54:13.651717+0000","last_undegraded":"2024-05-08T21:54:13.651717+0000","last_fullsized":"2024-05-08T21:54:13.651717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'162","last_scrub_stamp":"2024-05-08T21:54:13.651690+0000","last_deep_scrub":"24'162","last_deep_scrub_stamp":"2024-05-08T21:54:13.651690+0000","last_clean_scrub_stamp":"2024-05-08T21:54:13.651690+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:12:19.269754+0000","scrub_duration":0.003372454,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:04.933338+0000","last_change":"2024-05-08T21:54:04.933446+0000","last_active":"2024-05-08T21:54:04.933338+0000","last_peered":"2024-05-08T21:54:04.933338+0000","last_clean":"2024-05-08T21:54:04.933338+0000","last_became_active":"2024-05-08T21:49:43.220780+0000","last_became_peered":"2024-05-08T21:49:43.220780+0000","last_unstale":"2024-05-08T21:54:04.933338+0000","last_undegraded":"2024-05-08T21:54:04.933338+0000","last_fullsized":"2024-05-08T21:54:04.933338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:54:04.933315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:54:04.933315+0000","last_clean_scrub_stamp":"2024-05-08T21:54:04.933315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:12:19.285123+0000","scrub_duration":0.0022305060000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"24'190","reported_seq":214,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:15.093196+0000","last_change":"2024-05-08T21:54:15.093348+0000","last_active":"2024-05-08T21:54:15.093196+0000","last_peered":"2024-05-08T21:54:15.093196+0000","last_clean":"2024-05-08T21:54:15.093196+0000","last_became_active":"2024-05-08T21:50:33.305037+0000","last_became_peered":"2024-05-08T21:50:33.305037+0000","last_unstale":"2024-05-08T21:54:15.093196+0000","last_undegraded":"2024-05-08T21:54:15.093196+0000","last_fullsized":"2024-05-08T21:54:15.093196+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'190","last_scrub_stamp":"2024-05-08T21:54:15.093167+0000","last_deep_scrub":"24'190","last_deep_scrub_stamp":"2024-05-08T21:54:15.093167+0000","last_clean_scrub_stamp":"2024-05-08T21:54:15.093167+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:25:13.719513+0000","scrub_duration":0.0041475000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:59.638873+0000","last_change":"2024-05-08T21:53:59.638981+0000","last_active":"2024-05-08T21:53:59.638873+0000","last_peered":"2024-05-08T21:53:59.638873+0000","last_clean":"2024-05-08T21:53:59.638873+0000","last_became_active":"2024-05-08T21:49:43.225057+0000","last_became_peered":"2024-05-08T21:49:43.225057+0000","last_unstale":"2024-05-08T21:53:59.638873+0000","last_undegraded":"2024-05-08T21:53:59.638873+0000","last_fullsized":"2024-05-08T21:53:59.638873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:53:59.638851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:53:59.638851+0000","last_clean_scrub_stamp":"2024-05-08T21:53:59.638851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:30:47.457087+0000","scrub_duration":0.001332172,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"24'187","reported_seq":202,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.824335+0000","last_change":"2024-05-08T21:49:43.757361+0000","last_active":"2024-05-08T21:53:51.824335+0000","last_peered":"2024-05-08T21:53:51.824335+0000","last_clean":"2024-05-08T21:53:51.824335+0000","last_became_active":"2024-05-08T21:49:43.757092+0000","last_became_peered":"2024-05-08T21:49:43.757092+0000","last_unstale":"2024-05-08T21:53:51.824335+0000","last_undegraded":"2024-05-08T21:53:51.824335+0000","last_fullsized":"2024-05-08T21:53:51.824335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"24'1","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:05.715612+0000","last_change":"2024-05-08T21:54:05.715714+0000","last_active":"2024-05-08T21:54:05.715612+0000","last_peered":"2024-05-08T21:54:05.715612+0000","last_clean":"2024-05-08T21:54:05.715612+0000","last_became_active":"2024-05-08T21:49:43.229105+0000","last_became_peered":"2024-05-08T21:49:43.229105+0000","last_unstale":"2024-05-08T21:54:05.715612+0000","last_undegraded":"2024-05-08T21:54:05.715612+0000","last_fullsized":"2024-05-08T21:54:05.715612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'1","last_scrub_stamp":"2024-05-08T21:54:05.715584+0000","last_deep_scrub":"24'1","last_deep_scrub_stamp":"2024-05-08T21:54:05.715584+0000","last_clean_scrub_stamp":"2024-05-08T21:54:05.715584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:50:49.933050+0000","scrub_duration":0.0026438849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"24'251","reported_seq":266,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.827132+0000","last_change":"2024-05-08T21:49:43.773243+0000","last_active":"2024-05-08T21:53:51.827132+0000","last_peered":"2024-05-08T21:53:51.827132+0000","last_clean":"2024-05-08T21:53:51.827132+0000","last_became_active":"2024-05-08T21:49:43.772944+0000","last_became_peered":"2024-05-08T21:49:43.772944+0000","last_unstale":"2024-05-08T21:53:51.827132+0000","last_undegraded":"2024-05-08T21:53:51.827132+0000","last_fullsized":"2024-05-08T21:53:51.827132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":251,"log_dups_size":0,"ondisk_log_size":251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":598016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:05.661074+0000","last_change":"2024-05-08T21:54:05.661193+0000","last_active":"2024-05-08T21:54:05.661074+0000","last_peered":"2024-05-08T21:54:05.661074+0000","last_clean":"2024-05-08T21:54:05.661074+0000","last_became_active":"2024-05-08T21:49:43.223476+0000","last_became_peered":"2024-05-08T21:49:43.223476+0000","last_unstale":"2024-05-08T21:54:05.661074+0000","last_undegraded":"2024-05-08T21:54:05.661074+0000","last_fullsized":"2024-05-08T21:54:05.661074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:54:05.661051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:54:05.661051+0000","last_clean_scrub_stamp":"2024-05-08T21:54:05.661051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:48:28.865727+0000","scrub_duration":0.0014156990000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"24'160","reported_seq":175,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.815528+0000","last_change":"2024-05-08T21:49:43.771526+0000","last_active":"2024-05-08T21:53:51.815528+0000","last_peered":"2024-05-08T21:53:51.815528+0000","last_clean":"2024-05-08T21:53:51.815528+0000","last_became_active":"2024-05-08T21:49:43.771279+0000","last_became_peered":"2024-05-08T21:49:43.771279+0000","last_unstale":"2024-05-08T21:53:51.815528+0000","last_undegraded":"2024-05-08T21:53:51.815528+0000","last_fullsized":"2024-05-08T21:53:51.815528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"24'9","reported_seq":39,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:13.130160+0000","last_change":"2024-05-08T21:54:13.130280+0000","last_active":"2024-05-08T21:54:13.130160+0000","last_peered":"2024-05-08T21:54:13.130160+0000","last_clean":"2024-05-08T21:54:13.130160+0000","last_became_active":"2024-05-08T21:49:43.224164+0000","last_became_peered":"2024-05-08T21:49:43.224164+0000","last_unstale":"2024-05-08T21:54:13.130160+0000","last_undegraded":"2024-05-08T21:54:13.130160+0000","last_fullsized":"2024-05-08T21:54:13.130160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'9","last_scrub_stamp":"2024-05-08T21:54:13.130137+0000","last_deep_scrub":"24'9","last_deep_scrub_stamp":"2024-05-08T21:54:13.130137+0000","last_clean_scrub_stamp":"2024-05-08T21:54:13.130137+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:30:47.087710+0000","scrub_duration":0.0046032640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"24'168","reported_seq":194,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:01.292107+0000","last_change":"2024-05-08T21:54:01.292214+0000","last_active":"2024-05-08T21:54:01.292107+0000","last_peered":"2024-05-08T21:54:01.292107+0000","last_clean":"2024-05-08T21:54:01.292107+0000","last_became_active":"2024-05-08T21:49:43.772685+0000","last_became_peered":"2024-05-08T21:49:43.772685+0000","last_unstale":"2024-05-08T21:54:01.292107+0000","last_undegraded":"2024-05-08T21:54:01.292107+0000","last_fullsized":"2024-05-08T21:54:01.292107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'168","last_scrub_stamp":"2024-05-08T21:54:01.292080+0000","last_deep_scrub":"24'168","last_deep_scrub_stamp":"2024-05-08T21:54:01.292080+0000","last_clean_scrub_stamp":"2024-05-08T21:54:01.292080+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:34.130535+0000","scrub_duration":0.003607589,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"24'186","reported_seq":219,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:01.692528+0000","last_change":"2024-05-08T21:54:01.692635+0000","last_active":"2024-05-08T21:54:01.692528+0000","last_peered":"2024-05-08T21:54:01.692528+0000","last_clean":"2024-05-08T21:54:01.692528+0000","last_became_active":"2024-05-08T21:49:43.221844+0000","last_became_peered":"2024-05-08T21:49:43.221844+0000","last_unstale":"2024-05-08T21:54:01.692528+0000","last_undegraded":"2024-05-08T21:54:01.692528+0000","last_fullsized":"2024-05-08T21:54:01.692528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'186","last_scrub_stamp":"2024-05-08T21:54:01.692501+0000","last_deep_scrub":"24'186","last_deep_scrub_stamp":"2024-05-08T21:54:01.692501+0000","last_clean_scrub_stamp":"2024-05-08T21:54:01.692501+0000","objects_scrubbed":4,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:57:32.728155+0000","scrub_duration":0.0057571819999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":387830,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":182,"num_write_kb":531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"24'176","reported_seq":191,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.822356+0000","last_change":"2024-05-08T21:49:43.773923+0000","last_active":"2024-05-08T21:53:51.822356+0000","last_peered":"2024-05-08T21:53:51.822356+0000","last_clean":"2024-05-08T21:53:51.822356+0000","last_became_active":"2024-05-08T21:49:43.772037+0000","last_became_peered":"2024-05-08T21:49:43.772037+0000","last_unstale":"2024-05-08T21:53:51.822356+0000","last_undegraded":"2024-05-08T21:53:51.822356+0000","last_fullsized":"2024-05-08T21:53:51.822356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"24'4","reported_seq":33,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:57.730763+0000","last_change":"2024-05-08T21:53:57.730838+0000","last_active":"2024-05-08T21:53:57.730763+0000","last_peered":"2024-05-08T21:53:57.730763+0000","last_clean":"2024-05-08T21:53:57.730763+0000","last_became_active":"2024-05-08T21:49:43.219186+0000","last_became_peered":"2024-05-08T21:49:43.219186+0000","last_unstale":"2024-05-08T21:53:57.730763+0000","last_undegraded":"2024-05-08T21:53:57.730763+0000","last_fullsized":"2024-05-08T21:53:57.730763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'4","last_scrub_stamp":"2024-05-08T21:53:57.730742+0000","last_deep_scrub":"24'4","last_deep_scrub_stamp":"2024-05-08T21:53:57.730742+0000","last_clean_scrub_stamp":"2024-05-08T21:53:57.730742+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:27:07.750268+0000","scrub_duration":0.0042791699999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"24'177","reported_seq":203,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:11.656400+0000","last_change":"2024-05-08T21:54:11.656510+0000","last_active":"2024-05-08T21:54:11.656400+0000","last_peered":"2024-05-08T21:54:11.656400+0000","last_clean":"2024-05-08T21:54:11.656400+0000","last_became_active":"2024-05-08T21:49:43.774919+0000","last_became_peered":"2024-05-08T21:49:43.774919+0000","last_unstale":"2024-05-08T21:54:11.656400+0000","last_undegraded":"2024-05-08T21:54:11.656400+0000","last_fullsized":"2024-05-08T21:54:11.656400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'177","last_scrub_stamp":"2024-05-08T21:54:11.656373+0000","last_deep_scrub":"24'177","last_deep_scrub_stamp":"2024-05-08T21:54:11.656373+0000","last_clean_scrub_stamp":"2024-05-08T21:54:11.656373+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:50:55.873838+0000","scrub_duration":0.0044413589999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:11.649284+0000","last_change":"2024-05-08T21:54:11.649426+0000","last_active":"2024-05-08T21:54:11.649284+0000","last_peered":"2024-05-08T21:54:11.649284+0000","last_clean":"2024-05-08T21:54:11.649284+0000","last_became_active":"2024-05-08T21:49:43.227065+0000","last_became_peered":"2024-05-08T21:49:43.227065+0000","last_unstale":"2024-05-08T21:54:11.649284+0000","last_undegraded":"2024-05-08T21:54:11.649284+0000","last_fullsized":"2024-05-08T21:54:11.649284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:54:11.649258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:54:11.649258+0000","last_clean_scrub_stamp":"2024-05-08T21:54:11.649258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:47:08.160695+0000","scrub_duration":0.0024401050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"24'201","reported_seq":216,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.822766+0000","last_change":"2024-05-08T21:49:43.770509+0000","last_active":"2024-05-08T21:53:51.822766+0000","last_peered":"2024-05-08T21:53:51.822766+0000","last_clean":"2024-05-08T21:53:51.822766+0000","last_became_active":"2024-05-08T21:49:43.770180+0000","last_became_peered":"2024-05-08T21:49:43.770180+0000","last_unstale":"2024-05-08T21:53:51.822766+0000","last_undegraded":"2024-05-08T21:53:51.822766+0000","last_fullsized":"2024-05-08T21:53:51.822766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:04.727932+0000","last_change":"2024-05-08T21:54:04.728088+0000","last_active":"2024-05-08T21:54:04.727932+0000","last_peered":"2024-05-08T21:54:04.727932+0000","last_clean":"2024-05-08T21:54:04.727932+0000","last_became_active":"2024-05-08T21:49:43.220641+0000","last_became_peered":"2024-05-08T21:49:43.220641+0000","last_unstale":"2024-05-08T21:54:04.727932+0000","last_undegraded":"2024-05-08T21:54:04.727932+0000","last_fullsized":"2024-05-08T21:54:04.727932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:54:04.727909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:54:04.727909+0000","last_clean_scrub_stamp":"2024-05-08T21:54:04.727909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:20:25.262158+0000","scrub_duration":0.0016556240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"24'197","reported_seq":223,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:07.764633+0000","last_change":"2024-05-08T21:54:07.764776+0000","last_active":"2024-05-08T21:54:07.764633+0000","last_peered":"2024-05-08T21:54:07.764633+0000","last_clean":"2024-05-08T21:54:07.764633+0000","last_became_active":"2024-05-08T21:49:43.765945+0000","last_became_peered":"2024-05-08T21:49:43.765945+0000","last_unstale":"2024-05-08T21:54:07.764633+0000","last_undegraded":"2024-05-08T21:54:07.764633+0000","last_fullsized":"2024-05-08T21:54:07.764633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'197","last_scrub_stamp":"2024-05-08T21:54:07.764589+0000","last_deep_scrub":"24'197","last_deep_scrub_stamp":"2024-05-08T21:54:07.764589+0000","last_clean_scrub_stamp":"2024-05-08T21:54:07.764589+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:12:13.382654+0000","scrub_duration":0.0048995460000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"24'13","reported_seq":48,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:01.062357+0000","last_change":"2024-05-08T21:54:01.062501+0000","last_active":"2024-05-08T21:54:01.062357+0000","last_peered":"2024-05-08T21:54:01.062357+0000","last_clean":"2024-05-08T21:54:01.062357+0000","last_became_active":"2024-05-08T21:49:43.208013+0000","last_became_peered":"2024-05-08T21:49:43.208013+0000","last_unstale":"2024-05-08T21:54:01.062357+0000","last_undegraded":"2024-05-08T21:54:01.062357+0000","last_fullsized":"2024-05-08T21:54:01.062357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'13","last_scrub_stamp":"2024-05-08T21:54:01.062323+0000","last_deep_scrub":"24'13","last_deep_scrub_stamp":"2024-05-08T21:54:01.062323+0000","last_clean_scrub_stamp":"2024-05-08T21:54:01.062323+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:38:51.705996+0000","scrub_duration":0.0050219519999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"24'215","reported_seq":230,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.821035+0000","last_change":"2024-05-08T21:49:43.774210+0000","last_active":"2024-05-08T21:53:51.821035+0000","last_peered":"2024-05-08T21:53:51.821035+0000","last_clean":"2024-05-08T21:53:51.821035+0000","last_became_active":"2024-05-08T21:49:43.773933+0000","last_became_peered":"2024-05-08T21:49:43.773933+0000","last_unstale":"2024-05-08T21:53:51.821035+0000","last_undegraded":"2024-05-08T21:53:51.821035+0000","last_fullsized":"2024-05-08T21:53:51.821035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"24'2","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:58.265770+0000","last_change":"2024-05-08T21:53:58.265770+0000","last_active":"2024-05-08T21:53:58.265770+0000","last_peered":"2024-05-08T21:53:58.265770+0000","last_clean":"2024-05-08T21:53:58.265770+0000","last_became_active":"2024-05-08T21:49:43.216822+0000","last_became_peered":"2024-05-08T21:49:43.216822+0000","last_unstale":"2024-05-08T21:53:58.265770+0000","last_undegraded":"2024-05-08T21:53:58.265770+0000","last_fullsized":"2024-05-08T21:53:58.265770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'2","last_scrub_stamp":"2024-05-08T21:53:58.265597+0000","last_deep_scrub":"24'2","last_deep_scrub_stamp":"2024-05-08T21:53:58.265597+0000","last_clean_scrub_stamp":"2024-05-08T21:53:58.265597+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:23:36.103671+0000","scrub_duration":0.0039105140000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"24'175","reported_seq":190,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.822044+0000","last_change":"2024-05-08T21:49:43.770066+0000","last_active":"2024-05-08T21:53:51.822044+0000","last_peered":"2024-05-08T21:53:51.822044+0000","last_clean":"2024-05-08T21:53:51.822044+0000","last_became_active":"2024-05-08T21:49:43.769762+0000","last_became_peered":"2024-05-08T21:49:43.769762+0000","last_unstale":"2024-05-08T21:53:51.822044+0000","last_undegraded":"2024-05-08T21:53:51.822044+0000","last_fullsized":"2024-05-08T21:53:51.822044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:00.091497+0000","last_change":"2024-05-08T21:54:00.091607+0000","last_active":"2024-05-08T21:54:00.091497+0000","last_peered":"2024-05-08T21:54:00.091497+0000","last_clean":"2024-05-08T21:54:00.091497+0000","last_became_active":"2024-05-08T21:49:43.215048+0000","last_became_peered":"2024-05-08T21:49:43.215048+0000","last_unstale":"2024-05-08T21:54:00.091497+0000","last_undegraded":"2024-05-08T21:54:00.091497+0000","last_fullsized":"2024-05-08T21:54:00.091497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:54:00.091474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:54:00.091474+0000","last_clean_scrub_stamp":"2024-05-08T21:54:00.091474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:41:28.795723+0000","scrub_duration":0.0018240509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"24'160","reported_seq":176,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:57.668342+0000","last_change":"2024-05-08T21:49:43.770326+0000","last_active":"2024-05-08T21:53:57.668342+0000","last_peered":"2024-05-08T21:53:57.668342+0000","last_clean":"2024-05-08T21:53:57.668342+0000","last_became_active":"2024-05-08T21:49:43.770029+0000","last_became_peered":"2024-05-08T21:49:43.770029+0000","last_unstale":"2024-05-08T21:53:57.668342+0000","last_undegraded":"2024-05-08T21:53:57.668342+0000","last_fullsized":"2024-05-08T21:53:57.668342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:02.644657+0000","last_change":"2024-05-08T21:54:02.644782+0000","last_active":"2024-05-08T21:54:02.644657+0000","last_peered":"2024-05-08T21:54:02.644657+0000","last_clean":"2024-05-08T21:54:02.644657+0000","last_became_active":"2024-05-08T21:49:43.227430+0000","last_became_peered":"2024-05-08T21:49:43.227430+0000","last_unstale":"2024-05-08T21:54:02.644657+0000","last_undegraded":"2024-05-08T21:54:02.644657+0000","last_fullsized":"2024-05-08T21:54:02.644657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:54:02.644631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:54:02.644631+0000","last_clean_scrub_stamp":"2024-05-08T21:54:02.644631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:07:34.685146+0000","scrub_duration":0.002515307,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"24'177","reported_seq":204,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:00.273626+0000","last_change":"2024-05-08T21:54:00.273626+0000","last_active":"2024-05-08T21:54:00.273626+0000","last_peered":"2024-05-08T21:54:00.273626+0000","last_clean":"2024-05-08T21:54:00.273626+0000","last_became_active":"2024-05-08T21:49:43.768307+0000","last_became_peered":"2024-05-08T21:49:43.768307+0000","last_unstale":"2024-05-08T21:54:00.273626+0000","last_undegraded":"2024-05-08T21:54:00.273626+0000","last_fullsized":"2024-05-08T21:54:00.273626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'177","last_scrub_stamp":"2024-05-08T21:54:00.273494+0000","last_deep_scrub":"24'177","last_deep_scrub_stamp":"2024-05-08T21:54:00.273494+0000","last_clean_scrub_stamp":"2024-05-08T21:54:00.273494+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:56:54.948792+0000","scrub_duration":0.0038275840000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"24'165","reported_seq":192,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:15.148970+0000","last_change":"2024-05-08T21:54:15.149075+0000","last_active":"2024-05-08T21:54:15.148970+0000","last_peered":"2024-05-08T21:54:15.148970+0000","last_clean":"2024-05-08T21:54:15.148970+0000","last_became_active":"2024-05-08T21:49:43.758367+0000","last_became_peered":"2024-05-08T21:49:43.758367+0000","last_unstale":"2024-05-08T21:54:15.148970+0000","last_undegraded":"2024-05-08T21:54:15.148970+0000","last_fullsized":"2024-05-08T21:54:15.148970+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'165","last_scrub_stamp":"2024-05-08T21:54:15.148943+0000","last_deep_scrub":"24'165","last_deep_scrub_stamp":"2024-05-08T21:54:15.148943+0000","last_clean_scrub_stamp":"2024-05-08T21:54:15.148943+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:47:11.660380+0000","scrub_duration":0.003182023,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"24'6","reported_seq":39,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:07.006691+0000","last_change":"2024-05-08T21:54:07.006803+0000","last_active":"2024-05-08T21:54:07.006691+0000","last_peered":"2024-05-08T21:54:07.006691+0000","last_clean":"2024-05-08T21:54:07.006691+0000","last_became_active":"2024-05-08T21:49:43.217133+0000","last_became_peered":"2024-05-08T21:49:43.217133+0000","last_unstale":"2024-05-08T21:54:07.006691+0000","last_undegraded":"2024-05-08T21:54:07.006691+0000","last_fullsized":"2024-05-08T21:54:07.006691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'6","last_scrub_stamp":"2024-05-08T21:54:07.006665+0000","last_deep_scrub":"24'6","last_deep_scrub_stamp":"2024-05-08T21:54:07.006665+0000","last_clean_scrub_stamp":"2024-05-08T21:54:07.006665+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:20:27.540915+0000","scrub_duration":0.0024388360000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"24'183","reported_seq":210,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:09.963678+0000","last_change":"2024-05-08T21:54:09.963785+0000","last_active":"2024-05-08T21:54:09.963678+0000","last_peered":"2024-05-08T21:54:09.963678+0000","last_clean":"2024-05-08T21:54:09.963678+0000","last_became_active":"2024-05-08T21:49:43.771451+0000","last_became_peered":"2024-05-08T21:49:43.771451+0000","last_unstale":"2024-05-08T21:54:09.963678+0000","last_undegraded":"2024-05-08T21:54:09.963678+0000","last_fullsized":"2024-05-08T21:54:09.963678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'183","last_scrub_stamp":"2024-05-08T21:54:09.963651+0000","last_deep_scrub":"24'183","last_deep_scrub_stamp":"2024-05-08T21:54:09.963651+0000","last_clean_scrub_stamp":"2024-05-08T21:54:09.963651+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:12:15.581715+0000","scrub_duration":0.0044283860000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:09.629236+0000","last_change":"2024-05-08T21:54:09.629368+0000","last_active":"2024-05-08T21:54:09.629236+0000","last_peered":"2024-05-08T21:54:09.629236+0000","last_clean":"2024-05-08T21:54:09.629236+0000","last_became_active":"2024-05-08T21:49:43.223469+0000","last_became_peered":"2024-05-08T21:49:43.223469+0000","last_unstale":"2024-05-08T21:54:09.629236+0000","last_undegraded":"2024-05-08T21:54:09.629236+0000","last_fullsized":"2024-05-08T21:54:09.629236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:54:09.629211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:54:09.629211+0000","last_clean_scrub_stamp":"2024-05-08T21:54:09.629211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:30:43.586785+0000","scrub_duration":0.0033484270000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"24'119","reported_seq":183,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:01.855797+0000","last_change":"2024-05-08T21:54:01.855909+0000","last_active":"2024-05-08T21:54:01.855797+0000","last_peered":"2024-05-08T21:54:01.855797+0000","last_clean":"2024-05-08T21:54:01.855797+0000","last_became_active":"2024-05-08T21:49:38.626159+0000","last_became_peered":"2024-05-08T21:49:38.626159+0000","last_unstale":"2024-05-08T21:54:01.855797+0000","last_undegraded":"2024-05-08T21:54:01.855797+0000","last_fullsized":"2024-05-08T21:54:01.855797+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'119","last_scrub_stamp":"2024-05-08T21:54:01.855772+0000","last_deep_scrub":"24'119","last_deep_scrub_stamp":"2024-05-08T21:54:01.855772+0000","last_clean_scrub_stamp":"2024-05-08T21:54:01.855772+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:50:46.073238+0000","scrub_duration":0.0063122120000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"24'165","reported_seq":192,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:04.734425+0000","last_change":"2024-05-08T21:54:04.734578+0000","last_active":"2024-05-08T21:54:04.734425+0000","last_peered":"2024-05-08T21:54:04.734425+0000","last_clean":"2024-05-08T21:54:04.734425+0000","last_became_active":"2024-05-08T21:49:43.770711+0000","last_became_peered":"2024-05-08T21:49:43.770711+0000","last_unstale":"2024-05-08T21:54:04.734425+0000","last_undegraded":"2024-05-08T21:54:04.734425+0000","last_fullsized":"2024-05-08T21:54:04.734425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'165","last_scrub_stamp":"2024-05-08T21:54:04.734399+0000","last_deep_scrub":"24'165","last_deep_scrub_stamp":"2024-05-08T21:54:04.734399+0000","last_clean_scrub_stamp":"2024-05-08T21:54:04.734399+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:38:55.378073+0000","scrub_duration":0.0038027999999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:03.902183+0000","last_change":"2024-05-08T21:54:03.902325+0000","last_active":"2024-05-08T21:54:03.902183+0000","last_peered":"2024-05-08T21:54:03.902183+0000","last_clean":"2024-05-08T21:54:03.902183+0000","last_became_active":"2024-05-08T21:49:43.220539+0000","last_became_peered":"2024-05-08T21:49:43.220539+0000","last_unstale":"2024-05-08T21:54:03.902183+0000","last_undegraded":"2024-05-08T21:54:03.902183+0000","last_fullsized":"2024-05-08T21:54:03.902183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:54:03.902144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:54:03.902144+0000","last_clean_scrub_stamp":"2024-05-08T21:54:03.902144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:12:09.520208+0000","scrub_duration":0.0024220439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:11.021338+0000","last_change":"2024-05-08T21:54:11.021441+0000","last_active":"2024-05-08T21:54:11.021338+0000","last_peered":"2024-05-08T21:54:11.021338+0000","last_clean":"2024-05-08T21:54:11.021338+0000","last_became_active":"2024-05-08T21:49:43.222131+0000","last_became_peered":"2024-05-08T21:49:43.222131+0000","last_unstale":"2024-05-08T21:54:11.021338+0000","last_undegraded":"2024-05-08T21:54:11.021338+0000","last_fullsized":"2024-05-08T21:54:11.021338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:54:11.021310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:54:11.021310+0000","last_clean_scrub_stamp":"2024-05-08T21:54:11.021310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:18:39.449979+0000","scrub_duration":0.001879045,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"24'162","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:55.644338+0000","last_change":"2024-05-08T21:49:43.758424+0000","last_active":"2024-05-08T21:53:55.644338+0000","last_peered":"2024-05-08T21:53:55.644338+0000","last_clean":"2024-05-08T21:53:55.644338+0000","last_became_active":"2024-05-08T21:49:43.758140+0000","last_became_peered":"2024-05-08T21:49:43.758140+0000","last_unstale":"2024-05-08T21:53:55.644338+0000","last_undegraded":"2024-05-08T21:53:55.644338+0000","last_fullsized":"2024-05-08T21:53:55.644338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"24'15","reported_seq":44,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:01.062923+0000","last_change":"2024-05-08T21:54:01.062923+0000","last_active":"2024-05-08T21:54:01.062923+0000","last_peered":"2024-05-08T21:54:01.062923+0000","last_clean":"2024-05-08T21:54:01.062923+0000","last_became_active":"2024-05-08T21:49:43.217780+0000","last_became_peered":"2024-05-08T21:49:43.217780+0000","last_unstale":"2024-05-08T21:54:01.062923+0000","last_undegraded":"2024-05-08T21:54:01.062923+0000","last_fullsized":"2024-05-08T21:54:01.062923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'15","last_scrub_stamp":"2024-05-08T21:54:01.062736+0000","last_deep_scrub":"24'15","last_deep_scrub_stamp":"2024-05-08T21:54:01.062736+0000","last_clean_scrub_stamp":"2024-05-08T21:54:01.062736+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:04:59.971978+0000","scrub_duration":0.0028540369999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"24'166","reported_seq":193,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:07.967700+0000","last_change":"2024-05-08T21:54:07.967700+0000","last_active":"2024-05-08T21:54:07.967700+0000","last_peered":"2024-05-08T21:54:07.967700+0000","last_clean":"2024-05-08T21:54:07.967700+0000","last_became_active":"2024-05-08T21:49:43.770221+0000","last_became_peered":"2024-05-08T21:49:43.770221+0000","last_unstale":"2024-05-08T21:54:07.967700+0000","last_undegraded":"2024-05-08T21:54:07.967700+0000","last_fullsized":"2024-05-08T21:54:07.967700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'166","last_scrub_stamp":"2024-05-08T21:54:07.967533+0000","last_deep_scrub":"24'166","last_deep_scrub_stamp":"2024-05-08T21:54:07.967533+0000","last_clean_scrub_stamp":"2024-05-08T21:54:07.967533+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:50:52.184999+0000","scrub_duration":0.003871729,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"24'4","reported_seq":34,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:02.681489+0000","last_change":"2024-05-08T21:54:02.681622+0000","last_active":"2024-05-08T21:54:02.681489+0000","last_peered":"2024-05-08T21:54:02.681489+0000","last_clean":"2024-05-08T21:54:02.681489+0000","last_became_active":"2024-05-08T21:49:43.220953+0000","last_became_peered":"2024-05-08T21:49:43.220953+0000","last_unstale":"2024-05-08T21:54:02.681489+0000","last_undegraded":"2024-05-08T21:54:02.681489+0000","last_fullsized":"2024-05-08T21:54:02.681489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'4","last_scrub_stamp":"2024-05-08T21:54:02.681463+0000","last_deep_scrub":"24'4","last_deep_scrub_stamp":"2024-05-08T21:54:02.681463+0000","last_clean_scrub_stamp":"2024-05-08T21:54:02.681463+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:12:17.033271+0000","scrub_duration":0.0033577419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"24'183","reported_seq":210,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:10.638099+0000","last_change":"2024-05-08T21:54:10.638229+0000","last_active":"2024-05-08T21:54:10.638099+0000","last_peered":"2024-05-08T21:54:10.638099+0000","last_clean":"2024-05-08T21:54:10.638099+0000","last_became_active":"2024-05-08T21:49:43.764740+0000","last_became_peered":"2024-05-08T21:49:43.764740+0000","last_unstale":"2024-05-08T21:54:10.638099+0000","last_undegraded":"2024-05-08T21:54:10.638099+0000","last_fullsized":"2024-05-08T21:54:10.638099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'183","last_scrub_stamp":"2024-05-08T21:54:10.638071+0000","last_deep_scrub":"24'183","last_deep_scrub_stamp":"2024-05-08T21:54:10.638071+0000","last_clean_scrub_stamp":"2024-05-08T21:54:10.638071+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:20:31.172321+0000","scrub_duration":0.0038965330000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:58.693338+0000","last_change":"2024-05-08T21:49:43.221251+0000","last_active":"2024-05-08T21:53:58.693338+0000","last_peered":"2024-05-08T21:53:58.693338+0000","last_clean":"2024-05-08T21:53:58.693338+0000","last_became_active":"2024-05-08T21:49:43.220839+0000","last_became_peered":"2024-05-08T21:49:43.220839+0000","last_unstale":"2024-05-08T21:53:58.693338+0000","last_undegraded":"2024-05-08T21:53:58.693338+0000","last_fullsized":"2024-05-08T21:53:58.693338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:42.193474+0000","last_clean_scrub_stamp":"2024-05-08T21:49:42.193474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"24'162","reported_seq":189,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:59.310338+0000","last_change":"2024-05-08T21:53:59.310338+0000","last_active":"2024-05-08T21:53:59.310338+0000","last_peered":"2024-05-08T21:53:59.310338+0000","last_clean":"2024-05-08T21:53:59.310338+0000","last_became_active":"2024-05-08T21:49:43.762170+0000","last_became_peered":"2024-05-08T21:49:43.762170+0000","last_unstale":"2024-05-08T21:53:59.310338+0000","last_undegraded":"2024-05-08T21:53:59.310338+0000","last_fullsized":"2024-05-08T21:53:59.310338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'162","last_scrub_stamp":"2024-05-08T21:53:59.310186+0000","last_deep_scrub":"24'162","last_deep_scrub_stamp":"2024-05-08T21:53:59.310186+0000","last_clean_scrub_stamp":"2024-05-08T21:53:59.310186+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:27:09.329712+0000","scrub_duration":0.0038376149999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:03.071044+0000","last_change":"2024-05-08T21:54:03.071044+0000","last_active":"2024-05-08T21:54:03.071044+0000","last_peered":"2024-05-08T21:54:03.071044+0000","last_clean":"2024-05-08T21:54:03.071044+0000","last_became_active":"2024-05-08T21:49:43.215162+0000","last_became_peered":"2024-05-08T21:49:43.215162+0000","last_unstale":"2024-05-08T21:54:03.071044+0000","last_undegraded":"2024-05-08T21:54:03.071044+0000","last_fullsized":"2024-05-08T21:54:03.071044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:54:03.070884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:54:03.070884+0000","last_clean_scrub_stamp":"2024-05-08T21:54:03.070884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:30:50.889120+0000","scrub_duration":0.00223391,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"24'173","reported_seq":189,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:56.657456+0000","last_change":"2024-05-08T21:49:43.757512+0000","last_active":"2024-05-08T21:53:56.657456+0000","last_peered":"2024-05-08T21:53:56.657456+0000","last_clean":"2024-05-08T21:53:56.657456+0000","last_became_active":"2024-05-08T21:49:43.757233+0000","last_became_peered":"2024-05-08T21:49:43.757233+0000","last_unstale":"2024-05-08T21:53:56.657456+0000","last_undegraded":"2024-05-08T21:53:56.657456+0000","last_fullsized":"2024-05-08T21:53:56.657456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:09.028045+0000","last_change":"2024-05-08T21:54:09.028045+0000","last_active":"2024-05-08T21:54:09.028045+0000","last_peered":"2024-05-08T21:54:09.028045+0000","last_clean":"2024-05-08T21:54:09.028045+0000","last_became_active":"2024-05-08T21:49:43.217595+0000","last_became_peered":"2024-05-08T21:49:43.217595+0000","last_unstale":"2024-05-08T21:54:09.028045+0000","last_undegraded":"2024-05-08T21:54:09.028045+0000","last_fullsized":"2024-05-08T21:54:09.028045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:54:09.027906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:54:09.027906+0000","last_clean_scrub_stamp":"2024-05-08T21:54:09.027906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:48:32.232583+0000","scrub_duration":0.001924608,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"24'164","reported_seq":190,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:06.967840+0000","last_change":"2024-05-08T21:54:06.967960+0000","last_active":"2024-05-08T21:54:06.967840+0000","last_peered":"2024-05-08T21:54:06.967840+0000","last_clean":"2024-05-08T21:54:06.967840+0000","last_became_active":"2024-05-08T21:49:43.766596+0000","last_became_peered":"2024-05-08T21:49:43.766596+0000","last_unstale":"2024-05-08T21:54:06.967840+0000","last_undegraded":"2024-05-08T21:54:06.967840+0000","last_fullsized":"2024-05-08T21:54:06.967840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'164","last_scrub_stamp":"2024-05-08T21:54:06.967815+0000","last_deep_scrub":"24'164","last_deep_scrub_stamp":"2024-05-08T21:54:06.967815+0000","last_clean_scrub_stamp":"2024-05-08T21:54:06.967815+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:20:27.502064+0000","scrub_duration":0.003136518,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"24'5","reported_seq":34,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:06.909587+0000","last_change":"2024-05-08T21:54:06.909587+0000","last_active":"2024-05-08T21:54:06.909587+0000","last_peered":"2024-05-08T21:54:06.909587+0000","last_clean":"2024-05-08T21:54:06.909587+0000","last_became_active":"2024-05-08T21:49:43.223974+0000","last_became_peered":"2024-05-08T21:49:43.223974+0000","last_unstale":"2024-05-08T21:54:06.909587+0000","last_undegraded":"2024-05-08T21:54:06.909587+0000","last_fullsized":"2024-05-08T21:54:06.909587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'5","last_scrub_stamp":"2024-05-08T21:54:06.909436+0000","last_deep_scrub":"24'5","last_deep_scrub_stamp":"2024-05-08T21:54:06.909436+0000","last_clean_scrub_stamp":"2024-05-08T21:54:06.909436+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:31:04.057767+0000","scrub_duration":0.0031627399999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"24'154","reported_seq":170,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:58.183312+0000","last_change":"2024-05-08T21:49:43.764377+0000","last_active":"2024-05-08T21:53:58.183312+0000","last_peered":"2024-05-08T21:53:58.183312+0000","last_clean":"2024-05-08T21:53:58.183312+0000","last_became_active":"2024-05-08T21:49:43.764075+0000","last_became_peered":"2024-05-08T21:49:43.764075+0000","last_unstale":"2024-05-08T21:53:58.183312+0000","last_undegraded":"2024-05-08T21:53:58.183312+0000","last_fullsized":"2024-05-08T21:53:58.183312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:04.062533+0000","last_change":"2024-05-08T21:54:04.062533+0000","last_active":"2024-05-08T21:54:04.062533+0000","last_peered":"2024-05-08T21:54:04.062533+0000","last_clean":"2024-05-08T21:54:04.062533+0000","last_became_active":"2024-05-08T21:49:43.229121+0000","last_became_peered":"2024-05-08T21:49:43.229121+0000","last_unstale":"2024-05-08T21:54:04.062533+0000","last_undegraded":"2024-05-08T21:54:04.062533+0000","last_fullsized":"2024-05-08T21:54:04.062533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:54:04.062359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:54:04.062359+0000","last_clean_scrub_stamp":"2024-05-08T21:54:04.062359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:56:45.419906+0000","scrub_duration":0.0019280689999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"24'175","reported_seq":201,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:00.802666+0000","last_change":"2024-05-08T21:54:00.802783+0000","last_active":"2024-05-08T21:54:00.802666+0000","last_peered":"2024-05-08T21:54:00.802666+0000","last_clean":"2024-05-08T21:54:00.802666+0000","last_became_active":"2024-05-08T21:49:43.772528+0000","last_became_peered":"2024-05-08T21:49:43.772528+0000","last_unstale":"2024-05-08T21:54:00.802666+0000","last_undegraded":"2024-05-08T21:54:00.802666+0000","last_fullsized":"2024-05-08T21:54:00.802666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'175","last_scrub_stamp":"2024-05-08T21:54:00.802639+0000","last_deep_scrub":"24'175","last_deep_scrub_stamp":"2024-05-08T21:54:00.802639+0000","last_clean_scrub_stamp":"2024-05-08T21:54:00.802639+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:20:21.336889+0000","scrub_duration":0.0035440060000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"24'2","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:05.107638+0000","last_change":"2024-05-08T21:54:05.107638+0000","last_active":"2024-05-08T21:54:05.107638+0000","last_peered":"2024-05-08T21:54:05.107638+0000","last_clean":"2024-05-08T21:54:05.107638+0000","last_became_active":"2024-05-08T21:49:43.208326+0000","last_became_peered":"2024-05-08T21:49:43.208326+0000","last_unstale":"2024-05-08T21:54:05.107638+0000","last_undegraded":"2024-05-08T21:54:05.107638+0000","last_fullsized":"2024-05-08T21:54:05.107638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'2","last_scrub_stamp":"2024-05-08T21:54:05.107507+0000","last_deep_scrub":"24'2","last_deep_scrub_stamp":"2024-05-08T21:54:05.107507+0000","last_clean_scrub_stamp":"2024-05-08T21:54:05.107507+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:07:37.148022+0000","scrub_duration":0.0042913359999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"24'165","reported_seq":181,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:57.673652+0000","last_change":"2024-05-08T21:49:43.766519+0000","last_active":"2024-05-08T21:53:57.673652+0000","last_peered":"2024-05-08T21:53:57.673652+0000","last_clean":"2024-05-08T21:53:57.673652+0000","last_became_active":"2024-05-08T21:49:43.765789+0000","last_became_peered":"2024-05-08T21:49:43.765789+0000","last_unstale":"2024-05-08T21:53:57.673652+0000","last_undegraded":"2024-05-08T21:53:57.673652+0000","last_fullsized":"2024-05-08T21:53:57.673652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"24'3","reported_seq":33,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:57.022707+0000","last_change":"2024-05-08T21:53:57.022707+0000","last_active":"2024-05-08T21:53:57.022707+0000","last_peered":"2024-05-08T21:53:57.022707+0000","last_clean":"2024-05-08T21:53:57.022707+0000","last_became_active":"2024-05-08T21:49:43.217814+0000","last_became_peered":"2024-05-08T21:49:43.217814+0000","last_unstale":"2024-05-08T21:53:57.022707+0000","last_undegraded":"2024-05-08T21:53:57.022707+0000","last_fullsized":"2024-05-08T21:53:57.022707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'3","last_scrub_stamp":"2024-05-08T21:53:57.022599+0000","last_deep_scrub":"24'3","last_deep_scrub_stamp":"2024-05-08T21:53:57.022599+0000","last_clean_scrub_stamp":"2024-05-08T21:53:57.022599+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:29.861054+0000","scrub_duration":0.0025112469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"24'162","reported_seq":177,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.826209+0000","last_change":"2024-05-08T21:49:43.775713+0000","last_active":"2024-05-08T21:53:51.826209+0000","last_peered":"2024-05-08T21:53:51.826209+0000","last_clean":"2024-05-08T21:53:51.826209+0000","last_became_active":"2024-05-08T21:49:43.775361+0000","last_became_peered":"2024-05-08T21:49:43.775361+0000","last_unstale":"2024-05-08T21:53:51.826209+0000","last_undegraded":"2024-05-08T21:53:51.826209+0000","last_fullsized":"2024-05-08T21:53:51.826209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"24'180","reported_seq":196,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:55.695591+0000","last_change":"2024-05-08T21:49:43.767129+0000","last_active":"2024-05-08T21:53:55.695591+0000","last_peered":"2024-05-08T21:53:55.695591+0000","last_clean":"2024-05-08T21:53:55.695591+0000","last_became_active":"2024-05-08T21:49:43.766789+0000","last_became_peered":"2024-05-08T21:49:43.766789+0000","last_unstale":"2024-05-08T21:53:55.695591+0000","last_undegraded":"2024-05-08T21:53:55.695591+0000","last_fullsized":"2024-05-08T21:53:55.695591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"24'158","reported_seq":193,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:08.057981+0000","last_change":"2024-05-08T21:54:08.058100+0000","last_active":"2024-05-08T21:54:08.057981+0000","last_peered":"2024-05-08T21:54:08.057981+0000","last_clean":"2024-05-08T21:54:08.057981+0000","last_became_active":"2024-05-08T21:50:33.103289+0000","last_became_peered":"2024-05-08T21:50:33.103289+0000","last_unstale":"2024-05-08T21:54:08.057981+0000","last_undegraded":"2024-05-08T21:54:08.057981+0000","last_fullsized":"2024-05-08T21:54:08.057981+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'158","last_scrub_stamp":"2024-05-08T21:54:08.057953+0000","last_deep_scrub":"24'158","last_deep_scrub_stamp":"2024-05-08T21:54:08.057953+0000","last_clean_scrub_stamp":"2024-05-08T21:54:08.057953+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:50:52.275418+0000","scrub_duration":0.0042494200000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"24'153","reported_seq":169,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:57.668203+0000","last_change":"2024-05-08T21:49:43.768929+0000","last_active":"2024-05-08T21:53:57.668203+0000","last_peered":"2024-05-08T21:53:57.668203+0000","last_clean":"2024-05-08T21:53:57.668203+0000","last_became_active":"2024-05-08T21:49:43.767606+0000","last_became_peered":"2024-05-08T21:49:43.767606+0000","last_unstale":"2024-05-08T21:53:57.668203+0000","last_undegraded":"2024-05-08T21:53:57.668203+0000","last_fullsized":"2024-05-08T21:53:57.668203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"24'134","reported_seq":150,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:55.137362+0000","last_change":"2024-05-08T21:49:43.774673+0000","last_active":"2024-05-08T21:53:55.137362+0000","last_peered":"2024-05-08T21:53:55.137362+0000","last_clean":"2024-05-08T21:53:55.137362+0000","last_became_active":"2024-05-08T21:49:43.774406+0000","last_became_peered":"2024-05-08T21:49:43.774406+0000","last_unstale":"2024-05-08T21:53:55.137362+0000","last_undegraded":"2024-05-08T21:53:55.137362+0000","last_fullsized":"2024-05-08T21:53:55.137362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"24'152","reported_seq":168,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:56.657505+0000","last_change":"2024-05-08T21:49:43.764222+0000","last_active":"2024-05-08T21:53:56.657505+0000","last_peered":"2024-05-08T21:53:56.657505+0000","last_clean":"2024-05-08T21:53:56.657505+0000","last_became_active":"2024-05-08T21:49:43.763937+0000","last_became_peered":"2024-05-08T21:49:43.763937+0000","last_unstale":"2024-05-08T21:53:56.657505+0000","last_undegraded":"2024-05-08T21:53:56.657505+0000","last_fullsized":"2024-05-08T21:53:56.657505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"24'166","reported_seq":182,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:55.644431+0000","last_change":"2024-05-08T21:49:43.757318+0000","last_active":"2024-05-08T21:53:55.644431+0000","last_peered":"2024-05-08T21:53:55.644431+0000","last_clean":"2024-05-08T21:53:55.644431+0000","last_became_active":"2024-05-08T21:49:43.757083+0000","last_became_peered":"2024-05-08T21:49:43.757083+0000","last_unstale":"2024-05-08T21:53:55.644431+0000","last_undegraded":"2024-05-08T21:53:55.644431+0000","last_fullsized":"2024-05-08T21:53:55.644431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"24'217","reported_seq":233,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:58.183359+0000","last_change":"2024-05-08T21:49:43.773491+0000","last_active":"2024-05-08T21:53:58.183359+0000","last_peered":"2024-05-08T21:53:58.183359+0000","last_clean":"2024-05-08T21:53:58.183359+0000","last_became_active":"2024-05-08T21:49:43.773203+0000","last_became_peered":"2024-05-08T21:49:43.773203+0000","last_unstale":"2024-05-08T21:53:58.183359+0000","last_undegraded":"2024-05-08T21:53:58.183359+0000","last_fullsized":"2024-05-08T21:53:58.183359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"24'160","reported_seq":176,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:56.657486+0000","last_change":"2024-05-08T21:49:43.761926+0000","last_active":"2024-05-08T21:53:56.657486+0000","last_peered":"2024-05-08T21:53:56.657486+0000","last_clean":"2024-05-08T21:53:56.657486+0000","last_became_active":"2024-05-08T21:49:43.761645+0000","last_became_peered":"2024-05-08T21:49:43.761645+0000","last_unstale":"2024-05-08T21:53:56.657486+0000","last_undegraded":"2024-05-08T21:53:56.657486+0000","last_fullsized":"2024-05-08T21:53:56.657486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"24'207","reported_seq":223,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:57.673772+0000","last_change":"2024-05-08T21:49:43.768942+0000","last_active":"2024-05-08T21:53:57.673772+0000","last_peered":"2024-05-08T21:53:57.673772+0000","last_clean":"2024-05-08T21:53:57.673772+0000","last_became_active":"2024-05-08T21:49:43.768673+0000","last_became_peered":"2024-05-08T21:49:43.768673+0000","last_unstale":"2024-05-08T21:53:57.673772+0000","last_undegraded":"2024-05-08T21:53:57.673772+0000","last_fullsized":"2024-05-08T21:53:57.673772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":475136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"24'150","reported_seq":165,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.809819+0000","last_change":"2024-05-08T21:49:43.766452+0000","last_active":"2024-05-08T21:53:51.809819+0000","last_peered":"2024-05-08T21:53:51.809819+0000","last_clean":"2024-05-08T21:53:51.809819+0000","last_became_active":"2024-05-08T21:49:43.765723+0000","last_became_peered":"2024-05-08T21:49:43.765723+0000","last_unstale":"2024-05-08T21:53:51.809819+0000","last_undegraded":"2024-05-08T21:53:51.809819+0000","last_fullsized":"2024-05-08T21:53:51.809819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"24'199","reported_seq":215,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:57.673780+0000","last_change":"2024-05-08T21:49:43.775098+0000","last_active":"2024-05-08T21:53:57.673780+0000","last_peered":"2024-05-08T21:53:57.673780+0000","last_clean":"2024-05-08T21:53:57.673780+0000","last_became_active":"2024-05-08T21:49:43.774808+0000","last_became_peered":"2024-05-08T21:49:43.774808+0000","last_unstale":"2024-05-08T21:53:57.673780+0000","last_undegraded":"2024-05-08T21:53:57.673780+0000","last_fullsized":"2024-05-08T21:53:57.673780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"24'154","reported_seq":169,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.824834+0000","last_change":"2024-05-08T21:49:43.775129+0000","last_active":"2024-05-08T21:53:51.824834+0000","last_peered":"2024-05-08T21:53:51.824834+0000","last_clean":"2024-05-08T21:53:51.824834+0000","last_became_active":"2024-05-08T21:49:43.774881+0000","last_became_peered":"2024-05-08T21:49:43.774881+0000","last_unstale":"2024-05-08T21:53:51.824834+0000","last_undegraded":"2024-05-08T21:53:51.824834+0000","last_fullsized":"2024-05-08T21:53:51.824834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"24'179","reported_seq":205,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:14.680331+0000","last_change":"2024-05-08T21:54:14.680464+0000","last_active":"2024-05-08T21:54:14.680331+0000","last_peered":"2024-05-08T21:54:14.680331+0000","last_clean":"2024-05-08T21:54:14.680331+0000","last_became_active":"2024-05-08T21:49:43.763907+0000","last_became_peered":"2024-05-08T21:49:43.763907+0000","last_unstale":"2024-05-08T21:54:14.680331+0000","last_undegraded":"2024-05-08T21:54:14.680331+0000","last_fullsized":"2024-05-08T21:54:14.680331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'179","last_scrub_stamp":"2024-05-08T21:54:14.680299+0000","last_deep_scrub":"24'179","last_deep_scrub_stamp":"2024-05-08T21:54:14.680299+0000","last_clean_scrub_stamp":"2024-05-08T21:54:14.680299+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:52:59.637596+0000","scrub_duration":0.0048495500000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":417792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9216,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11255,"ondisk_log_size":11255,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":389133,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":84,"num_read_kb":92,"num_write":260,"num_write_kb":561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":843776,"data_stored":778266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":269,"ondisk_log_size":269,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509500,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31936,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339904,"statfs":{"total":96636764160,"available":96604061696,"internally_reserved":0,"allocated":843776,"data_stored":682658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.61299999999999999,"15min":0.60599999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":3.5680000000000001,"5min":3.5680000000000001,"15min":3.5680000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.64800000000000002,"15min":0.61799999999999999},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":3.6469999999999998,"5min":3.6469999999999998,"15min":3.6469999999999998},"last":0.55400000000000005}]},{"osd":1,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.60299999999999998,"15min":0.56499999999999995},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":3.2669999999999999,"5min":3.2669999999999999,"15min":3.2669999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":1.0980000000000001,"5min":0.65900000000000003,"15min":0.59399999999999997},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":5.5330000000000004,"5min":5.5330000000000004,"15min":5.5330000000000004},"last":0.65600000000000003}]},{"osd":2,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.61299999999999999,"15min":0.57699999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":5.0730000000000004,"5min":5.0730000000000004,"15min":5.0730000000000004},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.60299999999999998,"15min":0.57199999999999995},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":4.0250000000000004,"5min":4.0250000000000004,"15min":4.0250000000000004},"last":0.59799999999999998}]},{"osd":3,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":1.603,"5min":0.78000000000000003,"15min":0.64800000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":20.791,"5min":20.791,"15min":20.791},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.60199999999999998,"15min":0.60399999999999998},"min":{"1min":0.40899999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.64600000000000002}]},{"osd":4,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.52400000000000002,"15min":0.50600000000000001},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":4.0979999999999999,"5min":4.0979999999999999,"15min":4.0979999999999999},"last":0.62},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.52500000000000002,"15min":0.52700000000000002},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.66900000000000004}]},{"osd":5,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.52400000000000002,"15min":0.53200000000000003},"min":{"1min":0.32600000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.81899999999999995,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.626,"15min":0.59599999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":7.0890000000000004,"5min":7.0890000000000004,"15min":7.0890000000000004},"last":0.68300000000000005}]},{"osd":6,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.61299999999999999,"15min":0.60899999999999999},"min":{"1min":0.40100000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":2.2440000000000002,"5min":2.2440000000000002,"15min":2.2440000000000002},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.57999999999999996,"15min":0.59599999999999997},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.57999999999999996}]}]},{"osd":6,"up_from":15,"seq":64424509500,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31740,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340100,"statfs":{"total":96636764160,"available":96604262400,"internally_reserved":0,"allocated":643072,"data_stored":479538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.91800000000000004,"15min":0.66300000000000003},"min":{"1min":0.39200000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":5.2839999999999998,"5min":23.625,"15min":23.625},"last":0.45900000000000002},{"interface":"front","average":{"1min":2.2090000000000001,"5min":2.2730000000000001,"15min":1.131},"min":{"1min":0.32600000000000001,"5min":0.308,"15min":0.308},"max":{"1min":23.975999999999999,"5min":73.831999999999994,"15min":73.831999999999994},"last":0.48699999999999999}]},{"osd":1,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":1.897,"5min":0.86599999999999999,"15min":0.74399999999999999},"min":{"1min":0.33400000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":11.552,"5min":11.552,"15min":11.552},"last":0.54400000000000004},{"interface":"front","average":{"1min":1.8180000000000001,"5min":1.012,"15min":0.73199999999999998},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":11.619999999999999,"5min":11.619999999999999,"15min":11.619999999999999},"last":0.628}]},{"osd":2,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":2.3220000000000001,"5min":1.552,"15min":0.88400000000000001},"min":{"1min":0.36599999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":23.77,"5min":36.951000000000001,"15min":36.951000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":1.986,"5min":0.86899999999999999,"15min":0.69499999999999995},"min":{"1min":0.35899999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":20.956,"5min":20.956,"15min":20.956},"last":0.59699999999999998}]},{"osd":3,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":1.55,"5min":0.79400000000000004,"15min":0.68200000000000005},"min":{"1min":0.41199999999999998,"5min":0.38,"15min":0.38},"max":{"1min":7.9690000000000003,"5min":7.9690000000000003,"15min":7.9690000000000003},"last":0.58399999999999996},{"interface":"front","average":{"1min":1.54,"5min":0.78500000000000003,"15min":0.66900000000000004},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":8.0709999999999997,"5min":8.0709999999999997,"15min":8.0709999999999997},"last":0.65400000000000003}]},{"osd":4,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.53500000000000003,"15min":0.505},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":5.1840000000000002,"5min":5.1840000000000002,"15min":5.1840000000000002},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.749,"5min":0.55500000000000005,"15min":0.53100000000000003},"min":{"1min":0.34899999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":2.976,"5min":2.976,"15min":2.976},"last":0.67500000000000004}]},{"osd":5,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.53200000000000003,"15min":0.498},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":3.0369999999999999,"5min":3.0369999999999999,"15min":3.0369999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.60199999999999998,"15min":0.56999999999999995},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":5.1219999999999999,"5min":5.1219999999999999,"15min":5.1219999999999999},"last":0.74299999999999999}]},{"osd":7,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.61899999999999999,"15min":0.56999999999999995},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":4.0389999999999997,"5min":4.0389999999999997,"15min":4.0389999999999997},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.60099999999999998,"15min":0.56799999999999995},"min":{"1min":0.40100000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":2.883,"5min":2.883,"15min":2.883},"last":0.75700000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574907,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35452,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94336388,"statfs":{"total":96636764160,"available":96600461312,"internally_reserved":0,"allocated":249856,"data_stored":91798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:53:49 2024","interfaces":[{"interface":"back","average":{"1min":1.409,"5min":0.71799999999999997,"15min":0.628},"min":{"1min":0.35699999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":5.7889999999999997,"5min":5.7889999999999997,"15min":5.7889999999999997},"last":0.52500000000000002},{"interface":"front","average":{"1min":3.2599999999999998,"5min":1.109,"15min":0.77400000000000002},"min":{"1min":0.36699999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":24.751000000000001,"5min":24.751000000000001,"15min":24.751000000000001},"last":0.47399999999999998}]},{"osd":1,"last update":"Wed May 8 21:53:44 2024","interfaces":[{"interface":"back","average":{"1min":4.1360000000000001,"5min":1.294,"15min":0.84299999999999997},"min":{"1min":0.41699999999999998,"5min":0.313,"15min":0.313},"max":{"1min":53.069000000000003,"5min":53.069000000000003,"15min":53.069000000000003},"last":0.57699999999999996},{"interface":"front","average":{"1min":6.2969999999999997,"5min":1.681,"15min":0.88500000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":80.463999999999999,"5min":80.463999999999999,"15min":80.463999999999999},"last":0.59199999999999997}]},{"osd":2,"last update":"Wed May 8 21:53:49 2024","interfaces":[{"interface":"back","average":{"1min":3.8079999999999998,"5min":1.248,"15min":0.84199999999999997},"min":{"1min":0.40400000000000003,"5min":0.375,"15min":0.375},"max":{"1min":24.332000000000001,"5min":24.332000000000001,"15min":24.332000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":4.0270000000000001,"5min":1.28,"15min":0.81299999999999994},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":24.349,"5min":24.349,"15min":24.349},"last":0.62}]},{"osd":3,"last update":"Wed May 8 21:53:49 2024","interfaces":[{"interface":"back","average":{"1min":3.9689999999999999,"5min":1.2450000000000001,"15min":0.77400000000000002},"min":{"1min":0.46400000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":33.368000000000002,"5min":33.368000000000002,"15min":33.368000000000002},"last":0.502},{"interface":"front","average":{"1min":1.921,"5min":0.85399999999999998,"15min":0.69899999999999995},"min":{"1min":0.42599999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":8.125,"5min":8.125,"15min":8.125},"last":0.54900000000000004}]},{"osd":4,"last update":"Wed May 8 21:53:49 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.51900000000000002,"15min":0.53100000000000003},"min":{"1min":0.32800000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":2.3140000000000001,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.624,"15min":0.61399999999999999},"min":{"1min":0.34300000000000003,"5min":0.307,"15min":0.307},"max":{"1min":5.0149999999999997,"5min":5.0149999999999997,"15min":5.0149999999999997},"last":0.42399999999999999}]},{"osd":6,"last update":"Wed May 8 21:53:49 2024","interfaces":[{"interface":"back","average":{"1min":1.587,"5min":0.73599999999999999,"15min":0.59899999999999998},"min":{"1min":0.34000000000000002,"5min":0.315,"15min":0.315},"max":{"1min":8.7430000000000003,"5min":8.7430000000000003,"15min":8.7430000000000003},"last":0.439},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.59199999999999997,"15min":0.59799999999999998},"min":{"1min":0.37,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":2.5649999999999999,"5min":2.5649999999999999,"15min":2.5649999999999999},"last":0.48899999999999999}]},{"osd":7,"last update":"Wed May 8 21:53:49 2024","interfaces":[{"interface":"back","average":{"1min":1.516,"5min":0.76900000000000002,"15min":0.66400000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":9.5380000000000003,"5min":9.5380000000000003,"15min":9.5380000000000003},"last":0.53400000000000003},{"interface":"front","average":{"1min":1.385,"5min":0.73199999999999998,"15min":0.61699999999999999},"min":{"1min":0.42499999999999999,"5min":0.375,"15min":0.375},"max":{"1min":8.7959999999999994,"5min":8.7959999999999994,"15min":8.7959999999999994},"last":0.55900000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574906,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31360,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340480,"statfs":{"total":96636764160,"available":96604651520,"internally_reserved":0,"allocated":253952,"data_stored":91868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":9.1020000000000003,"5min":2.2200000000000002,"15min":1.1719999999999999},"min":{"1min":0.26100000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":119.55200000000001,"5min":119.55200000000001,"15min":119.55200000000001},"last":0.34200000000000003},{"interface":"front","average":{"1min":2.9020000000000001,"5min":1.028,"15min":0.83999999999999997},"min":{"1min":0.24099999999999999,"5min":0.192,"15min":0.192},"max":{"1min":23.457999999999998,"5min":23.457999999999998,"15min":23.457999999999998},"last":0.32400000000000001}]},{"osd":2,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":3.9689999999999999,"5min":1.125,"15min":0.68300000000000005},"min":{"1min":0.255,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":33.259,"5min":33.259,"15min":33.259},"last":0.36399999999999999},{"interface":"front","average":{"1min":4.3860000000000001,"5min":1.343,"15min":0.97299999999999998},"min":{"1min":0.249,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":43.167000000000002,"5min":43.167000000000002,"15min":43.167000000000002},"last":0.38600000000000001}]},{"osd":3,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":4.6210000000000004,"5min":1.26,"15min":0.71399999999999997},"min":{"1min":0.254,"5min":0.247,"15min":0.247},"max":{"1min":43.131,"5min":43.131,"15min":43.131},"last":0.41099999999999998},{"interface":"front","average":{"1min":7.319,"5min":1.7949999999999999,"15min":0.88100000000000001},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":52.923999999999999,"5min":52.923999999999999,"15min":52.923999999999999},"last":0.38}]},{"osd":4,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":2.7330000000000001,"5min":1.0549999999999999,"15min":0.78700000000000003},"min":{"1min":0.41599999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":16.914000000000001,"5min":16.914000000000001,"15min":16.914000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":4.056,"5min":1.2929999999999999,"15min":0.83299999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":43.078000000000003,"5min":43.078000000000003,"15min":43.078000000000003},"last":0.63}]},{"osd":5,"last update":"Wed May 8 21:53:38 2024","interfaces":[{"interface":"back","average":{"1min":3.8370000000000002,"5min":1.28,"15min":0.86199999999999999},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":33.198,"5min":33.198,"15min":33.198},"last":0.67000000000000004},{"interface":"front","average":{"1min":1.6990000000000001,"5min":1.002,"15min":1.0169999999999999},"min":{"1min":0.48899999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":7.6139999999999999,"5min":9.2400000000000002,"15min":9.2400000000000002},"last":0.58899999999999997}]},{"osd":6,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":1.665,"5min":0.98199999999999998,"15min":0.98799999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":7.5449999999999999,"5min":9.202,"15min":9.202},"last":0.55500000000000005},{"interface":"front","average":{"1min":3.5529999999999999,"5min":1.2450000000000001,"15min":0.86899999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":33.283000000000001,"5min":33.283000000000001,"15min":33.283000000000001},"last":0.64600000000000002}]},{"osd":7,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":1.6319999999999999,"5min":0.98499999999999999,"15min":1.0049999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":7.6669999999999998,"5min":9.2249999999999996,"15min":9.2249999999999996},"last":0.53500000000000003},{"interface":"front","average":{"1min":3.2189999999999999,"5min":1.1799999999999999,"15min":0.85599999999999998},"min":{"1min":0.44400000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":16.981000000000002,"5min":16.981000000000002,"15min":16.981000000000002},"last":0.61799999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509498,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31944,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339896,"statfs":{"total":96636764160,"available":96604053504,"internally_reserved":0,"allocated":851968,"data_stored":682714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":1.6599999999999999,"5min":0.63500000000000001,"15min":0.46899999999999997},"min":{"1min":0.26100000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":27.239999999999998,"5min":27.239999999999998,"15min":27.239999999999998},"last":0.437},{"interface":"front","average":{"1min":2.0640000000000001,"5min":0.73299999999999998,"15min":0.52500000000000002},"min":{"1min":0.26100000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":27.643000000000001,"5min":27.643000000000001,"15min":27.643000000000001},"last":0.41699999999999998}]},{"osd":2,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":1.583,"5min":0.63,"15min":0.48499999999999999},"min":{"1min":0.24299999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":25.739000000000001,"5min":25.739000000000001,"15min":25.739000000000001},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.47399999999999998,"15min":0.43099999999999999},"min":{"1min":0.28000000000000003,"5min":0.253,"15min":0.253},"max":{"1min":4.9989999999999997,"5min":4.9989999999999997,"15min":4.9989999999999997},"last":0.45600000000000002}]},{"osd":3,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":1.952,"5min":0.71599999999999997,"15min":0.52200000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":13.685,"5min":13.685,"15min":13.685},"last":0.33100000000000002},{"interface":"front","average":{"1min":1.8500000000000001,"5min":0.71799999999999997,"15min":0.54300000000000004},"min":{"1min":0.27400000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":28.379999999999999,"5min":28.379999999999999,"15min":28.379999999999999},"last":0.47599999999999998}]},{"osd":4,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":0.69599999999999995,"15min":0.626},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":5.6790000000000003,"5min":5.6790000000000003,"15min":5.6790000000000003},"last":0.72899999999999998},{"interface":"front","average":{"1min":1.8600000000000001,"5min":0.82499999999999996,"15min":0.64900000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":13.794,"5min":13.794,"15min":13.794},"last":0.61599999999999999}]},{"osd":5,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":1.877,"5min":0.84599999999999997,"15min":0.67200000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":13.827,"5min":13.827,"15min":13.827},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.66300000000000003,"15min":0.64900000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":4.9240000000000004,"5min":4.9240000000000004,"15min":4.9240000000000004},"last":0.69199999999999995}]},{"osd":6,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":0.70999999999999996,"15min":0.65400000000000003},"min":{"1min":0.379,"5min":0.376,"15min":0.376},"max":{"1min":8.3379999999999992,"5min":8.3379999999999992,"15min":8.3379999999999992},"last":0.71799999999999997},{"interface":"front","average":{"1min":1.1359999999999999,"5min":0.70199999999999996,"15min":0.63400000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":5.6500000000000004,"5min":5.6500000000000004,"15min":5.6500000000000004},"last":0.63600000000000001}]},{"osd":7,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":0.76500000000000001,"15min":0.68000000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":9.1950000000000003,"5min":9.1950000000000003,"15min":9.1950000000000003},"last":0.67300000000000004},{"interface":"front","average":{"1min":1.8799999999999999,"5min":0.86799999999999999,"15min":0.70799999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":13.756,"5min":13.756,"15min":13.756},"last":0.70699999999999996}]}]},{"osd":2,"up_from":15,"seq":64424509500,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31356,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340484,"statfs":{"total":96636764160,"available":96604655616,"internally_reserved":0,"allocated":249856,"data_stored":92213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:53:45 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.42199999999999999,"15min":0.34999999999999998},"min":{"1min":0.255,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":3.73,"5min":3.73,"15min":3.73},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.44,"15min":0.38200000000000001},"min":{"1min":0.27400000000000002,"5min":0.254,"15min":0.254},"max":{"1min":3.1600000000000001,"5min":3.1600000000000001,"15min":3.1600000000000001},"last":0.41899999999999998}]},{"osd":1,"last update":"Wed May 8 21:53:45 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.39600000000000002,"15min":0.36199999999999999},"min":{"1min":0.23999999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":3.1930000000000001,"5min":3.1930000000000001,"15min":3.1930000000000001},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.40100000000000002,"15min":0.375},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":2.1299999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":0.36899999999999999}]},{"osd":3,"last update":"Wed May 8 21:53:45 2024","interfaces":[{"interface":"back","average":{"1min":4.0759999999999996,"5min":1.1160000000000001,"15min":0.60699999999999998},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":60.899000000000001,"5min":60.899000000000001,"15min":60.899000000000001},"last":0.38100000000000001},{"interface":"front","average":{"1min":1.1140000000000001,"5min":0.53900000000000003,"15min":0.437},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":9.7469999999999999,"5min":9.7469999999999999,"15min":9.7469999999999999},"last":0.44600000000000001}]},{"osd":4,"last update":"Wed May 8 21:53:45 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":0.69099999999999995,"15min":0.63600000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":7.8499999999999996,"5min":7.8499999999999996,"15min":7.8499999999999996},"last":0.64300000000000002},{"interface":"front","average":{"1min":1.123,"5min":0.72399999999999998,"15min":0.66000000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":8.1189999999999998,"5min":8.1189999999999998,"15min":8.1189999999999998},"last":0.58699999999999997}]},{"osd":5,"last update":"Wed May 8 21:53:45 2024","interfaces":[{"interface":"back","average":{"1min":1.462,"5min":0.77100000000000002,"15min":0.65100000000000002},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":11.326000000000001,"5min":11.326000000000001,"15min":11.326000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":1.1259999999999999,"5min":0.69199999999999995,"15min":0.628},"min":{"1min":0.375,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":7.8860000000000001,"5min":7.8860000000000001,"15min":7.8860000000000001},"last":0.60299999999999998}]},{"osd":6,"last update":"Wed May 8 21:53:45 2024","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":0.69799999999999995,"15min":0.63800000000000001},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":8.1709999999999994,"5min":8.1709999999999994,"15min":8.1709999999999994},"last":0.61199999999999999},{"interface":"front","average":{"1min":1.421,"5min":0.76700000000000002,"15min":0.66000000000000003},"min":{"1min":0.40300000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":10.41,"5min":10.41,"15min":10.41},"last":0.51200000000000001}]},{"osd":7,"last update":"Wed May 8 21:53:45 2024","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.67000000000000004,"15min":0.62},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":5.2699999999999996,"5min":5.2699999999999996,"15min":5.2699999999999996},"last":0.57699999999999996},{"interface":"front","average":{"1min":1.1679999999999999,"5min":0.72799999999999998,"15min":0.65200000000000002},"min":{"1min":0.42899999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":7.5810000000000004,"5min":7.5810000000000004,"15min":7.5810000000000004},"last":0.65200000000000002}]}]},{"osd":3,"up_from":15,"seq":64424509498,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35840,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94336000,"statfs":{"total":96636764160,"available":96600064000,"internally_reserved":0,"allocated":647168,"data_stored":480043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36043208},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:53:42 2024","interfaces":[{"interface":"back","average":{"1min":2.0739999999999998,"5min":0.69299999999999995,"15min":0.47899999999999998},"min":{"1min":0.21299999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":39.470999999999997,"5min":39.470999999999997,"15min":39.470999999999997},"last":0.441},{"interface":"front","average":{"1min":1.9750000000000001,"5min":0.68400000000000005,"15min":0.48099999999999998},"min":{"1min":0.25700000000000001,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":32.802,"5min":32.802,"15min":32.802},"last":0.33700000000000002}]},{"osd":1,"last update":"Wed May 8 21:53:42 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.38500000000000001,"15min":0.38700000000000001},"min":{"1min":0.252,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.38700000000000001},{"interface":"front","average":{"1min":2.48,"5min":0.82799999999999996,"15min":0.56399999999999995},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":43.493000000000002,"5min":43.493000000000002,"15min":43.493000000000002},"last":0.36099999999999999}]},{"osd":2,"last update":"Wed May 8 21:53:42 2024","interfaces":[{"interface":"back","average":{"1min":2.4969999999999999,"5min":0.85099999999999998,"15min":0.59299999999999997},"min":{"1min":0.318,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":43.445999999999998,"5min":43.445999999999998,"15min":43.445999999999998},"last":0.40799999999999997},{"interface":"front","average":{"1min":2.3530000000000002,"5min":0.83799999999999997,"15min":0.59599999999999997},"min":{"1min":0.34499999999999997,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":39.569000000000003,"5min":39.569000000000003,"15min":39.569000000000003},"last":0.46899999999999997}]},{"osd":4,"last update":"Wed May 8 21:53:42 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.629,"15min":0.61499999999999999},"min":{"1min":0.41199999999999998,"5min":0.377,"15min":0.377},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":0.66100000000000003},{"interface":"front","average":{"1min":1.821,"5min":0.85699999999999998,"15min":0.70399999999999996},"min":{"1min":0.375,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":19.024999999999999,"5min":19.024999999999999,"15min":19.024999999999999},"last":0.57399999999999995}]},{"osd":5,"last update":"Wed May 8 21:53:42 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.63200000000000001,"15min":0.627},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.833,"5min":1.833,"15min":1.833},"last":0.624},{"interface":"front","average":{"1min":2.0470000000000002,"5min":0.91900000000000004,"15min":0.72099999999999997},"min":{"1min":0.46700000000000003,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":27.678999999999998,"5min":27.678999999999998,"15min":27.678999999999998},"last":0.58599999999999997}]},{"osd":6,"last update":"Wed May 8 21:53:42 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.65400000000000003,"15min":0.64400000000000002},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.915,"5min":1.915,"15min":1.915},"last":0.69699999999999995},{"interface":"front","average":{"1min":2.2530000000000001,"5min":0.96299999999999997,"15min":0.77100000000000002},"min":{"1min":0.46500000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":32.655000000000001,"5min":32.655000000000001,"15min":32.655000000000001},"last":0.55500000000000005}]},{"osd":7,"last update":"Wed May 8 21:53:42 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.68700000000000006,"15min":0.66700000000000004},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":3.4089999999999998,"5min":3.4089999999999998,"15min":3.4089999999999998},"last":0.71899999999999997},{"interface":"front","average":{"1min":1.653,"5min":0.88800000000000001,"15min":0.72299999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":18.939,"5min":18.939,"15min":18.939},"last":0.61099999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509499,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31364,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340476,"statfs":{"total":96636764160,"available":96604647424,"internally_reserved":0,"allocated":258048,"data_stored":91834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:53:44 2024","interfaces":[{"interface":"back","average":{"1min":2.1030000000000002,"5min":0.82299999999999995,"15min":0.59999999999999998},"min":{"1min":0.29399999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":21.042999999999999,"5min":21.042999999999999,"15min":21.042999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":2.1970000000000001,"5min":0.874,"15min":0.65200000000000002},"min":{"1min":0.46200000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":21.478999999999999,"5min":21.478999999999999,"15min":21.478999999999999},"last":0.66400000000000003}]},{"osd":1,"last update":"Wed May 8 21:53:44 2024","interfaces":[{"interface":"back","average":{"1min":1.986,"5min":0.83699999999999997,"15min":0.63100000000000001},"min":{"1min":0.372,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":14.555999999999999,"5min":14.555999999999999,"15min":14.555999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":1.1100000000000001,"5min":0.63700000000000001,"15min":0.55500000000000005},"min":{"1min":0.40799999999999997,"5min":0.314,"15min":0.314},"max":{"1min":7.7140000000000004,"5min":7.7140000000000004,"15min":7.7140000000000004},"last":0.67600000000000005}]},{"osd":2,"last update":"Wed May 8 21:53:44 2024","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":0.69399999999999995,"15min":0.58199999999999996},"min":{"1min":0.41899999999999998,"5min":0.377,"15min":0.377},"max":{"1min":11.724,"5min":11.724,"15min":11.724},"last":0.69499999999999995},{"interface":"front","average":{"1min":1.089,"5min":0.65700000000000003,"15min":0.58899999999999997},"min":{"1min":0.44600000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":4.6740000000000004,"5min":4.6740000000000004,"15min":4.6740000000000004},"last":0.751}]},{"osd":3,"last update":"Wed May 8 21:53:44 2024","interfaces":[{"interface":"back","average":{"1min":2.4849999999999999,"5min":0.93700000000000006,"15min":0.68300000000000005},"min":{"1min":0.39400000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":30.84,"5min":30.84,"15min":30.84},"last":0.73299999999999998},{"interface":"front","average":{"1min":2.0739999999999998,"5min":0.89000000000000001,"15min":0.69099999999999995},"min":{"1min":0.41499999999999998,"5min":0.37,"15min":0.37},"max":{"1min":21.754000000000001,"5min":21.754000000000001,"15min":21.754000000000001},"last":0.72399999999999998}]},{"osd":5,"last update":"Wed May 8 21:53:44 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.52200000000000002,"15min":0.51200000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":4.4660000000000002,"5min":4.4660000000000002,"15min":4.4660000000000002},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.56899999999999995,"15min":0.56599999999999995},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":5.2190000000000003,"5min":5.2190000000000003,"15min":5.2190000000000003},"last":0.50800000000000001}]},{"osd":6,"last update":"Wed May 8 21:53:44 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.61299999999999999,"15min":0.59499999999999997},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":4.9720000000000004,"5min":4.9720000000000004,"15min":4.9720000000000004},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.60599999999999998,"15min":0.60699999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":4.4100000000000001,"5min":4.4100000000000001,"15min":4.4100000000000001},"last":0.54000000000000004}]},{"osd":7,"last update":"Wed May 8 21:53:44 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.60399999999999998,"15min":0.61399999999999999},"min":{"1min":0.34699999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":4.444,"5min":4.444,"15min":4.444},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.877,"5min":0.67900000000000005,"15min":0.66100000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":5.0430000000000001,"5min":5.0430000000000001,"15min":5.0430000000000001},"last":0.625}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":388335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":397312,"data_stored":387830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T21:54:19.450 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:54:19.451 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:54:19.451 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:54:19.451 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:54:19.451 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:54:19.451 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:54:19.451 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:54:19.452 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:54:19.452 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:54:19.452 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:54:19.452 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:54:19.452 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:54:19.452 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:54:19.452 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:54:19.452 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:54:19.453 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:54:19.453 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-05-08T21:49:42.193474+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=42, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:54:19.453 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:54:19.453 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:54:19.453 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:54:19.453 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:54:19.453 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:54:19.453 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:54:19.454 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:54:19.454 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:54:19.454 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:54:19.454 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:54:19.454 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:54:19.455 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-05-08T21:49:42.193474+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=42, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:54:19.455 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:54:19.455 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:54:19.455 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:54:19.455 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:54:19.455 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:54:19.455 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:54:19.455 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:54:19.455 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:54:19.456 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:54:19.456 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:54:19.456 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:54:19.456 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:54:19.456 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:54:19.456 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:54:19.456 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:54:19.456 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-08T21:54:20.662 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:54:20.665 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:54:39.458 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T21:54:39.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.600+0000 7f0b202e6700 1 Processor -- start 2024-05-08T21:54:39.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.600+0000 7f0b202e6700 1 -- start start 2024-05-08T21:54:39.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.601+0000 7f0b202e6700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0b18153d20 0x7f0b1815d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:54:39.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.601+0000 7f0b202e6700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0b180c6510 0x7f0b181644f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:54:39.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.601+0000 7f0b202e6700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b180c77e0 con 0x7f0b1806f700 2024-05-08T21:54:39.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.601+0000 7f0b202e6700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b180c7da0 con 0x7f0b180c6510 2024-05-08T21:54:39.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.601+0000 7f0b202e6700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1806fc50 con 0x7f0b18153d20 2024-05-08T21:54:39.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.601+0000 7f0b1e883700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0b180c6510 0x7f0b181644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:54:39.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.601+0000 7f0b1e883700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0b180c6510 0x7f0b181644f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54224/0 (socket says 172.21.15.73:54224) 2024-05-08T21:54:39.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.601+0000 7f0b1e883700 1 -- 172.21.15.73:0/419046489 learned_addr learned my addr 172.21.15.73:0/419046489 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:54:39.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.601+0000 7f0b1e082700 1 --2- 172.21.15.73:0/419046489 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0b18153d20 0x7f0b1815d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:54:39.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.601+0000 7f0b1e883700 1 -- 172.21.15.73:0/419046489 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0b18153d20 msgr2=0x7f0b1815d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:54:39.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.601+0000 7f0b1e883700 1 --2- 172.21.15.73:0/419046489 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0b18153d20 0x7f0b1815d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:54:39.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.601+0000 7f0b1e883700 1 -- 172.21.15.73:0/419046489 >> v1:172.21.15.115:6789/0 conn(0x7f0b1806f700 legacy=0x7f0b180c8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:54:39.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.601+0000 7f0b1e883700 1 -- 172.21.15.73:0/419046489 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b1806ff30 con 0x7f0b180c6510 2024-05-08T21:54:39.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.601+0000 7f0b1e082700 1 --2- 172.21.15.73:0/419046489 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0b18153d20 0x7f0b1815d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:54:39.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.602+0000 7f0b1e883700 1 --2- 172.21.15.73:0/419046489 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b180c6510 0x7f0b181644f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f0b10009e50 tx=0x7f0b1000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=604afdfb35a68692 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:54:39.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.602+0000 7f0b1d080700 1 -- 172.21.15.73:0/419046489 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1000e070 con 0x7f0b180c6510 2024-05-08T21:54:39.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.602+0000 7f0b1d080700 1 -- 172.21.15.73:0/419046489 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b1000b9c0 con 0x7f0b180c6510 2024-05-08T21:54:39.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.602+0000 7f0b1d080700 1 -- 172.21.15.73:0/419046489 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1000bd70 con 0x7f0b180c6510 2024-05-08T21:54:39.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.602+0000 7f0b202e6700 1 -- 172.21.15.73:0/419046489 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b180c6510 msgr2=0x7f0b181644f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:54:39.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.602+0000 7f0b202e6700 1 --2- 172.21.15.73:0/419046489 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b180c6510 0x7f0b181644f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f0b10009e50 tx=0x7f0b1000b330 comp rx=0 tx=0).stop 2024-05-08T21:54:39.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.602+0000 7f0b202e6700 1 -- 172.21.15.73:0/419046489 shutdown_connections 2024-05-08T21:54:39.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.602+0000 7f0b202e6700 1 --2- 172.21.15.73:0/419046489 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b180c6510 0x7f0b181644f0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:54:39.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.602+0000 7f0b202e6700 1 --2- 172.21.15.73:0/419046489 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0b18153d20 0x7f0b1815d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:54:39.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.602+0000 7f0b202e6700 1 -- 172.21.15.73:0/419046489 >> 172.21.15.73:0/419046489 conn(0x7f0b180cc420 msgr2=0x7f0b180cc800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:54:39.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.603+0000 7f0b202e6700 1 -- 172.21.15.73:0/419046489 shutdown_connections 2024-05-08T21:54:39.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.603+0000 7f0b202e6700 1 -- 172.21.15.73:0/419046489 wait complete. 2024-05-08T21:54:39.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.604+0000 7f0b202e6700 1 Processor -- start 2024-05-08T21:54:39.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.604+0000 7f0b202e6700 1 -- start start 2024-05-08T21:54:39.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.604+0000 7f0b202e6700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b1806f700 0x7f0b1815ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:54:39.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.604+0000 7f0b202e6700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b180c6510 0x7f0b18146c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:54:39.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.604+0000 7f0b202e6700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0b18153d20 0x7f0b181efc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:54:39.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.604+0000 7f0b202e6700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1815caf0 con 0x7f0b1806f700 2024-05-08T21:54:39.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.605+0000 7f0b202e6700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1815bf90 con 0x7f0b180c6510 2024-05-08T21:54:39.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.605+0000 7f0b202e6700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1815c250 con 0x7f0b18153d20 2024-05-08T21:54:39.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.605+0000 7f0b1e082700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b1806f700 0x7f0b1815ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:54:39.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.605+0000 7f0b1e082700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b1806f700 0x7f0b1815ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54226/0 (socket says 172.21.15.73:54226) 2024-05-08T21:54:39.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.605+0000 7f0b1e082700 1 -- 172.21.15.73:0/3869573366 learned_addr learned my addr 172.21.15.73:0/3869573366 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:54:39.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.605+0000 7f0b1e883700 1 --2- 172.21.15.73:0/3869573366 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0b18153d20 0x7f0b181efc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:54:39.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.605+0000 7f0b1d881700 1 --2- 172.21.15.73:0/3869573366 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b180c6510 0x7f0b18146c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:54:39.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.605+0000 7f0b1e082700 1 -- 172.21.15.73:0/3869573366 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0b18153d20 msgr2=0x7f0b181efc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:54:39.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.605+0000 7f0b1e082700 1 --2- 172.21.15.73:0/3869573366 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0b18153d20 0x7f0b181efc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:54:39.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.605+0000 7f0b1e082700 1 -- 172.21.15.73:0/3869573366 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b180c6510 msgr2=0x7f0b18146c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:54:39.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.605+0000 7f0b1e082700 1 --2- 172.21.15.73:0/3869573366 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b180c6510 0x7f0b18146c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:54:39.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.605+0000 7f0b1e082700 1 -- 172.21.15.73:0/3869573366 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b10009b30 con 0x7f0b1806f700 2024-05-08T21:54:39.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.605+0000 7f0b1e082700 1 --2- 172.21.15.73:0/3869573366 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b1806f700 0x7f0b1815ccf0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f0b0800c7f0 tx=0x7f0b0800cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:54:39.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.605+0000 7f0b0effd700 1 -- 172.21.15.73:0/3869573366 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b08011800 con 0x7f0b1806f700 2024-05-08T21:54:39.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.605+0000 7f0b0effd700 1 -- 172.21.15.73:0/3869573366 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b08011960 con 0x7f0b1806f700 2024-05-08T21:54:39.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.605+0000 7f0b202e6700 1 -- 172.21.15.73:0/3869573366 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b1815c530 con 0x7f0b1806f700 2024-05-08T21:54:39.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.605+0000 7f0b0effd700 1 -- 172.21.15.73:0/3869573366 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b08011cf0 con 0x7f0b1806f700 2024-05-08T21:54:39.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.605+0000 7f0b202e6700 1 -- 172.21.15.73:0/3869573366 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b181ef6e0 con 0x7f0b1806f700 2024-05-08T21:54:39.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.606+0000 7f0b202e6700 1 -- 172.21.15.73:0/3869573366 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b181ef540 con 0x7f0b1806f700 2024-05-08T21:54:39.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.607+0000 7f0b0effd700 1 -- 172.21.15.73:0/3869573366 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0b08018360 con 0x7f0b1806f700 2024-05-08T21:54:39.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.607+0000 7f0b0effd700 1 --2- 172.21.15.73:0/3869573366 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f0afc06acc0 0x7f0afc06d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:54:39.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.607+0000 7f0b0effd700 1 -- 172.21.15.73:0/3869573366 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5969+0+0 (secure 0 0 0) 0x7f0b080891d0 con 0x7f0b1806f700 2024-05-08T21:54:39.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.607+0000 7f0b1d881700 1 --2- 172.21.15.73:0/3869573366 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f0afc06acc0 0x7f0afc06d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:54:39.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.608+0000 7f0b1d881700 1 --2- 172.21.15.73:0/3869573366 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f0afc06acc0 0x7f0afc06d180 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0b18072d30 tx=0x7f0b14009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:54:39.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.612+0000 7f0b0effd700 1 -- 172.21.15.73:0/3869573366 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f0b181ef540 con 0x7f0b1806f700 2024-05-08T21:54:39.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.806+0000 7f0b202e6700 1 -- 172.21.15.73:0/3869573366 --> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0b1815d6a0 con 0x7f0afc06acc0 2024-05-08T21:54:39.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.814+0000 7f0b0effd700 1 -- 172.21.15.73:0/3869573366 <== mgr.4104 v2:172.21.15.73:6832/46949 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+290866 (secure 0 0 0) 0x7f0b14001580 con 0x7f0afc06acc0 2024-05-08T21:54:39.819 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:54:39.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.817+0000 7f0b202e6700 1 -- 172.21.15.73:0/3869573366 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f0afc06acc0 msgr2=0x7f0afc06d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:54:39.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.817+0000 7f0b202e6700 1 --2- 172.21.15.73:0/3869573366 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f0afc06acc0 0x7f0afc06d180 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0b18072d30 tx=0x7f0b14009040 comp rx=0 tx=0).stop 2024-05-08T21:54:39.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.817+0000 7f0b202e6700 1 -- 172.21.15.73:0/3869573366 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b1806f700 msgr2=0x7f0b1815ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:54:39.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.817+0000 7f0b202e6700 1 --2- 172.21.15.73:0/3869573366 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b1806f700 0x7f0b1815ccf0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f0b0800c7f0 tx=0x7f0b0800cb00 comp rx=0 tx=0).stop 2024-05-08T21:54:39.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.817+0000 7f0b202e6700 1 -- 172.21.15.73:0/3869573366 shutdown_connections 2024-05-08T21:54:39.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.817+0000 7f0b202e6700 1 --2- 172.21.15.73:0/3869573366 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f0afc06acc0 0x7f0afc06d180 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:54:39.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.817+0000 7f0b202e6700 1 --2- 172.21.15.73:0/3869573366 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0b18153d20 0x7f0b181efc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:54:39.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.817+0000 7f0b202e6700 1 --2- 172.21.15.73:0/3869573366 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b1806f700 0x7f0b1815ccf0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:54:39.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.817+0000 7f0b202e6700 1 --2- 172.21.15.73:0/3869573366 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b180c6510 0x7f0b18146c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:54:39.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.817+0000 7f0b202e6700 1 -- 172.21.15.73:0/3869573366 >> 172.21.15.73:0/3869573366 conn(0x7f0b180cc420 msgr2=0x7f0b181491c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:54:39.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.817+0000 7f0b202e6700 1 -- 172.21.15.73:0/3869573366 shutdown_connections 2024-05-08T21:54:39.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:39.817+0000 7f0b202e6700 1 -- 172.21.15.73:0/3869573366 wait complete. 2024-05-08T21:54:39.823 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-05-08T21:54:39.831 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":168,"stamp":"2024-05-08T21:54:38.029115+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":979501,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":200,"num_read_kb":192,"num_write":9635,"num_write_kb":25168801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11644,"ondisk_log_size":11644,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":260992,"kb_used_data":3904,"kb_used_omap":12,"kb_used_meta":257011,"kb_avail":754713728,"statfs":{"total":773094113280,"available":772826857472,"internally_reserved":0,"allocated":3997696,"data_stored":2692666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":263179834},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003261"},"pg_stats":[{"pgid":"3.3f","version":"24'167","reported_seq":183,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:58.693445+0000","last_change":"2024-05-08T21:49:43.775912+0000","last_active":"2024-05-08T21:53:58.693445+0000","last_peered":"2024-05-08T21:53:58.693445+0000","last_clean":"2024-05-08T21:53:58.693445+0000","last_became_active":"2024-05-08T21:49:43.775657+0000","last_became_peered":"2024-05-08T21:49:43.775657+0000","last_unstale":"2024-05-08T21:53:58.693445+0000","last_undegraded":"2024-05-08T21:53:58.693445+0000","last_fullsized":"2024-05-08T21:53:58.693445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"24'152","reported_seq":168,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:55.644417+0000","last_change":"2024-05-08T21:49:43.766984+0000","last_active":"2024-05-08T21:53:55.644417+0000","last_peered":"2024-05-08T21:53:55.644417+0000","last_clean":"2024-05-08T21:53:55.644417+0000","last_became_active":"2024-05-08T21:49:43.765995+0000","last_became_peered":"2024-05-08T21:49:43.765995+0000","last_unstale":"2024-05-08T21:53:55.644417+0000","last_undegraded":"2024-05-08T21:53:55.644417+0000","last_fullsized":"2024-05-08T21:53:55.644417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"24'178","reported_seq":205,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:07.675725+0000","last_change":"2024-05-08T21:54:07.675848+0000","last_active":"2024-05-08T21:54:07.675725+0000","last_peered":"2024-05-08T21:54:07.675725+0000","last_clean":"2024-05-08T21:54:07.675725+0000","last_became_active":"2024-05-08T21:49:43.765874+0000","last_became_peered":"2024-05-08T21:49:43.765874+0000","last_unstale":"2024-05-08T21:54:07.675725+0000","last_undegraded":"2024-05-08T21:54:07.675725+0000","last_fullsized":"2024-05-08T21:54:07.675725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'178","last_scrub_stamp":"2024-05-08T21:54:07.675698+0000","last_deep_scrub":"24'178","last_deep_scrub_stamp":"2024-05-08T21:54:07.675698+0000","last_clean_scrub_stamp":"2024-05-08T21:54:07.675698+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:56:49.033245+0000","scrub_duration":0.002959854,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"24'193","reported_seq":220,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:35.493818+0000","last_change":"2024-05-08T21:54:35.493951+0000","last_active":"2024-05-08T21:54:35.493818+0000","last_peered":"2024-05-08T21:54:35.493818+0000","last_clean":"2024-05-08T21:54:35.493818+0000","last_became_active":"2024-05-08T21:49:43.765507+0000","last_became_peered":"2024-05-08T21:49:43.765507+0000","last_unstale":"2024-05-08T21:54:35.493818+0000","last_undegraded":"2024-05-08T21:54:35.493818+0000","last_fullsized":"2024-05-08T21:54:35.493818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'193","last_scrub_stamp":"2024-05-08T21:54:35.493789+0000","last_deep_scrub":"24'193","last_deep_scrub_stamp":"2024-05-08T21:54:35.493789+0000","last_clean_scrub_stamp":"2024-05-08T21:54:35.493789+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:15:19.292276+0000","scrub_duration":0.0041280070000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"24'174","reported_seq":187,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.820321+0000","last_change":"2024-05-08T21:50:33.104253+0000","last_active":"2024-05-08T21:53:51.820321+0000","last_peered":"2024-05-08T21:53:51.820321+0000","last_clean":"2024-05-08T21:53:51.820321+0000","last_became_active":"2024-05-08T21:50:33.103943+0000","last_became_peered":"2024-05-08T21:50:33.103943+0000","last_unstale":"2024-05-08T21:53:51.820321+0000","last_undegraded":"2024-05-08T21:53:51.820321+0000","last_fullsized":"2024-05-08T21:53:51.820321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"24'162","reported_seq":177,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.822081+0000","last_change":"2024-05-08T21:49:43.771390+0000","last_active":"2024-05-08T21:53:51.822081+0000","last_peered":"2024-05-08T21:53:51.822081+0000","last_clean":"2024-05-08T21:53:51.822081+0000","last_became_active":"2024-05-08T21:49:43.770893+0000","last_became_peered":"2024-05-08T21:49:43.770893+0000","last_unstale":"2024-05-08T21:53:51.822081+0000","last_undegraded":"2024-05-08T21:53:51.822081+0000","last_fullsized":"2024-05-08T21:53:51.822081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"24'188","reported_seq":203,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.820955+0000","last_change":"2024-05-08T21:49:43.769981+0000","last_active":"2024-05-08T21:53:51.820955+0000","last_peered":"2024-05-08T21:53:51.820955+0000","last_clean":"2024-05-08T21:53:51.820955+0000","last_became_active":"2024-05-08T21:49:43.769667+0000","last_became_peered":"2024-05-08T21:49:43.769667+0000","last_unstale":"2024-05-08T21:53:51.820955+0000","last_undegraded":"2024-05-08T21:53:51.820955+0000","last_fullsized":"2024-05-08T21:53:51.820955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"24'204","reported_seq":219,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.824460+0000","last_change":"2024-05-08T21:49:43.771078+0000","last_active":"2024-05-08T21:53:51.824460+0000","last_peered":"2024-05-08T21:53:51.824460+0000","last_clean":"2024-05-08T21:53:51.824460+0000","last_became_active":"2024-05-08T21:49:43.770912+0000","last_became_peered":"2024-05-08T21:49:43.770912+0000","last_unstale":"2024-05-08T21:53:51.824460+0000","last_undegraded":"2024-05-08T21:53:51.824460+0000","last_fullsized":"2024-05-08T21:53:51.824460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":483328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"24'178","reported_seq":212,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:34.221391+0000","last_change":"2024-05-08T21:54:34.221515+0000","last_active":"2024-05-08T21:54:34.221391+0000","last_peered":"2024-05-08T21:54:34.221391+0000","last_clean":"2024-05-08T21:54:34.221391+0000","last_became_active":"2024-05-08T21:50:33.106142+0000","last_became_peered":"2024-05-08T21:50:33.106142+0000","last_unstale":"2024-05-08T21:54:34.221391+0000","last_undegraded":"2024-05-08T21:54:34.221391+0000","last_fullsized":"2024-05-08T21:54:34.221391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'178","last_scrub_stamp":"2024-05-08T21:54:34.221364+0000","last_deep_scrub":"24'178","last_deep_scrub_stamp":"2024-05-08T21:54:34.221364+0000","last_clean_scrub_stamp":"2024-05-08T21:54:34.221364+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:19:40.524754+0000","scrub_duration":0.0030355920000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"24'190","reported_seq":216,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:30.620703+0000","last_change":"2024-05-08T21:54:30.620814+0000","last_active":"2024-05-08T21:54:30.620703+0000","last_peered":"2024-05-08T21:54:30.620703+0000","last_clean":"2024-05-08T21:54:30.620703+0000","last_became_active":"2024-05-08T21:49:43.772505+0000","last_became_peered":"2024-05-08T21:49:43.772505+0000","last_unstale":"2024-05-08T21:54:30.620703+0000","last_undegraded":"2024-05-08T21:54:30.620703+0000","last_fullsized":"2024-05-08T21:54:30.620703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'190","last_scrub_stamp":"2024-05-08T21:54:30.620675+0000","last_deep_scrub":"24'190","last_deep_scrub_stamp":"2024-05-08T21:54:30.620675+0000","last_clean_scrub_stamp":"2024-05-08T21:54:30.620675+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:44:25.504008+0000","scrub_duration":0.0035011619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"24'214","reported_seq":240,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:10.739193+0000","last_change":"2024-05-08T21:54:10.739319+0000","last_active":"2024-05-08T21:54:10.739193+0000","last_peered":"2024-05-08T21:54:10.739193+0000","last_clean":"2024-05-08T21:54:10.739193+0000","last_became_active":"2024-05-08T21:49:43.771457+0000","last_became_peered":"2024-05-08T21:49:43.771457+0000","last_unstale":"2024-05-08T21:54:10.739193+0000","last_undegraded":"2024-05-08T21:54:10.739193+0000","last_fullsized":"2024-05-08T21:54:10.739193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'214","last_scrub_stamp":"2024-05-08T21:54:10.739166+0000","last_deep_scrub":"24'214","last_deep_scrub_stamp":"2024-05-08T21:54:10.739166+0000","last_clean_scrub_stamp":"2024-05-08T21:54:10.739166+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:05:25.395957+0000","scrub_duration":0.0033296089999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"24'166","reported_seq":193,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:05.271747+0000","last_change":"2024-05-08T21:54:05.271747+0000","last_active":"2024-05-08T21:54:05.271747+0000","last_peered":"2024-05-08T21:54:05.271747+0000","last_clean":"2024-05-08T21:54:05.271747+0000","last_became_active":"2024-05-08T21:49:43.763986+0000","last_became_peered":"2024-05-08T21:49:43.763986+0000","last_unstale":"2024-05-08T21:54:05.271747+0000","last_undegraded":"2024-05-08T21:54:05.271747+0000","last_fullsized":"2024-05-08T21:54:05.271747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'166","last_scrub_stamp":"2024-05-08T21:54:05.271586+0000","last_deep_scrub":"24'166","last_deep_scrub_stamp":"2024-05-08T21:54:05.271586+0000","last_clean_scrub_stamp":"2024-05-08T21:54:05.271586+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:38:55.915259+0000","scrub_duration":0.0044053850000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"24'177","reported_seq":203,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:12.014978+0000","last_change":"2024-05-08T21:54:12.015093+0000","last_active":"2024-05-08T21:54:12.014978+0000","last_peered":"2024-05-08T21:54:12.014978+0000","last_clean":"2024-05-08T21:54:12.014978+0000","last_became_active":"2024-05-08T21:49:43.760874+0000","last_became_peered":"2024-05-08T21:49:43.760874+0000","last_unstale":"2024-05-08T21:54:12.014978+0000","last_undegraded":"2024-05-08T21:54:12.014978+0000","last_fullsized":"2024-05-08T21:54:12.014978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'177","last_scrub_stamp":"2024-05-08T21:54:12.014952+0000","last_deep_scrub":"24'177","last_deep_scrub_stamp":"2024-05-08T21:54:12.014952+0000","last_clean_scrub_stamp":"2024-05-08T21:54:12.014952+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:31:09.163282+0000","scrub_duration":0.0037380849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"24'172","reported_seq":199,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:16.692972+0000","last_change":"2024-05-08T21:54:16.692972+0000","last_active":"2024-05-08T21:54:16.692972+0000","last_peered":"2024-05-08T21:54:16.692972+0000","last_clean":"2024-05-08T21:54:16.692972+0000","last_became_active":"2024-05-08T21:49:43.765566+0000","last_became_peered":"2024-05-08T21:49:43.765566+0000","last_unstale":"2024-05-08T21:54:16.692972+0000","last_undegraded":"2024-05-08T21:54:16.692972+0000","last_fullsized":"2024-05-08T21:54:16.692972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'172","last_scrub_stamp":"2024-05-08T21:54:16.692825+0000","last_deep_scrub":"24'172","last_deep_scrub_stamp":"2024-05-08T21:54:16.692825+0000","last_clean_scrub_stamp":"2024-05-08T21:54:16.692825+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:31:13.841155+0000","scrub_duration":0.0040346499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"24'177","reported_seq":193,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:55.644370+0000","last_change":"2024-05-08T21:49:43.765080+0000","last_active":"2024-05-08T21:53:55.644370+0000","last_peered":"2024-05-08T21:53:55.644370+0000","last_clean":"2024-05-08T21:53:55.644370+0000","last_became_active":"2024-05-08T21:49:43.764810+0000","last_became_peered":"2024-05-08T21:49:43.764810+0000","last_unstale":"2024-05-08T21:53:55.644370+0000","last_undegraded":"2024-05-08T21:53:55.644370+0000","last_fullsized":"2024-05-08T21:53:55.644370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"24'162","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:57.673830+0000","last_change":"2024-05-08T21:49:43.766717+0000","last_active":"2024-05-08T21:53:57.673830+0000","last_peered":"2024-05-08T21:53:57.673830+0000","last_clean":"2024-05-08T21:53:57.673830+0000","last_became_active":"2024-05-08T21:49:43.766427+0000","last_became_peered":"2024-05-08T21:49:43.766427+0000","last_unstale":"2024-05-08T21:53:57.673830+0000","last_undegraded":"2024-05-08T21:53:57.673830+0000","last_fullsized":"2024-05-08T21:53:57.673830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"24'176","reported_seq":203,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:19.568252+0000","last_change":"2024-05-08T21:54:19.568252+0000","last_active":"2024-05-08T21:54:19.568252+0000","last_peered":"2024-05-08T21:54:19.568252+0000","last_clean":"2024-05-08T21:54:19.568252+0000","last_became_active":"2024-05-08T21:49:43.776509+0000","last_became_peered":"2024-05-08T21:49:43.776509+0000","last_unstale":"2024-05-08T21:54:19.568252+0000","last_undegraded":"2024-05-08T21:54:19.568252+0000","last_fullsized":"2024-05-08T21:54:19.568252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'176","last_scrub_stamp":"2024-05-08T21:54:19.568081+0000","last_deep_scrub":"24'176","last_deep_scrub_stamp":"2024-05-08T21:54:19.568081+0000","last_clean_scrub_stamp":"2024-05-08T21:54:19.568081+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:59:23.480500+0000","scrub_duration":0.0027818550000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"24'179","reported_seq":206,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:10.057071+0000","last_change":"2024-05-08T21:54:10.057071+0000","last_active":"2024-05-08T21:54:10.057071+0000","last_peered":"2024-05-08T21:54:10.057071+0000","last_clean":"2024-05-08T21:54:10.057071+0000","last_became_active":"2024-05-08T21:49:43.762237+0000","last_became_peered":"2024-05-08T21:49:43.762237+0000","last_unstale":"2024-05-08T21:54:10.057071+0000","last_undegraded":"2024-05-08T21:54:10.057071+0000","last_fullsized":"2024-05-08T21:54:10.057071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'179","last_scrub_stamp":"2024-05-08T21:54:10.056922+0000","last_deep_scrub":"24'179","last_deep_scrub_stamp":"2024-05-08T21:54:10.056922+0000","last_clean_scrub_stamp":"2024-05-08T21:54:10.056922+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:12:15.674986+0000","scrub_duration":0.003987684,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"24'205","reported_seq":232,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:32.143883+0000","last_change":"2024-05-08T21:54:32.144005+0000","last_active":"2024-05-08T21:54:32.143883+0000","last_peered":"2024-05-08T21:54:32.143883+0000","last_clean":"2024-05-08T21:54:32.143883+0000","last_became_active":"2024-05-08T21:49:43.774450+0000","last_became_peered":"2024-05-08T21:49:43.774450+0000","last_unstale":"2024-05-08T21:54:32.143883+0000","last_undegraded":"2024-05-08T21:54:32.143883+0000","last_fullsized":"2024-05-08T21:54:32.143883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'205","last_scrub_stamp":"2024-05-08T21:54:32.143843+0000","last_deep_scrub":"24'205","last_deep_scrub_stamp":"2024-05-08T21:54:32.143843+0000","last_clean_scrub_stamp":"2024-05-08T21:54:32.143843+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:37:36.108788+0000","scrub_duration":0.0039636029999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"24'7","reported_seq":37,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:58.756471+0000","last_change":"2024-05-08T21:53:58.756585+0000","last_active":"2024-05-08T21:53:58.756471+0000","last_peered":"2024-05-08T21:53:58.756471+0000","last_clean":"2024-05-08T21:53:58.756471+0000","last_became_active":"2024-05-08T21:49:43.219161+0000","last_became_peered":"2024-05-08T21:49:43.219161+0000","last_unstale":"2024-05-08T21:53:58.756471+0000","last_undegraded":"2024-05-08T21:53:58.756471+0000","last_fullsized":"2024-05-08T21:53:58.756471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'7","last_scrub_stamp":"2024-05-08T21:53:58.756448+0000","last_deep_scrub":"24'7","last_deep_scrub_stamp":"2024-05-08T21:53:58.756448+0000","last_clean_scrub_stamp":"2024-05-08T21:53:58.756448+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:46:56.777485+0000","scrub_duration":0.0058782679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"24'181","reported_seq":208,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:30.112991+0000","last_change":"2024-05-08T21:54:30.113170+0000","last_active":"2024-05-08T21:54:30.112991+0000","last_peered":"2024-05-08T21:54:30.112991+0000","last_clean":"2024-05-08T21:54:30.112991+0000","last_became_active":"2024-05-08T21:49:43.764045+0000","last_became_peered":"2024-05-08T21:49:43.764045+0000","last_unstale":"2024-05-08T21:54:30.112991+0000","last_undegraded":"2024-05-08T21:54:30.112991+0000","last_fullsized":"2024-05-08T21:54:30.112991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'181","last_scrub_stamp":"2024-05-08T21:54:30.112949+0000","last_deep_scrub":"24'181","last_deep_scrub_stamp":"2024-05-08T21:54:30.112949+0000","last_clean_scrub_stamp":"2024-05-08T21:54:30.112949+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:22:04.449694+0000","scrub_duration":0.0047377349999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'2","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:03.976354+0000","last_change":"2024-05-08T21:54:03.976461+0000","last_active":"2024-05-08T21:54:03.976354+0000","last_peered":"2024-05-08T21:54:03.976354+0000","last_clean":"2024-05-08T21:54:03.976354+0000","last_became_active":"2024-05-08T21:49:43.221309+0000","last_became_peered":"2024-05-08T21:49:43.221309+0000","last_unstale":"2024-05-08T21:54:03.976354+0000","last_undegraded":"2024-05-08T21:54:03.976354+0000","last_fullsized":"2024-05-08T21:54:03.976354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'2","last_scrub_stamp":"2024-05-08T21:54:03.976327+0000","last_deep_scrub":"24'2","last_deep_scrub_stamp":"2024-05-08T21:54:03.976327+0000","last_clean_scrub_stamp":"2024-05-08T21:54:03.976327+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:57:35.011981+0000","scrub_duration":0.0018723979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"24'160","reported_seq":187,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:29.584442+0000","last_change":"2024-05-08T21:54:29.584614+0000","last_active":"2024-05-08T21:54:29.584442+0000","last_peered":"2024-05-08T21:54:29.584442+0000","last_clean":"2024-05-08T21:54:29.584442+0000","last_became_active":"2024-05-08T21:49:43.771295+0000","last_became_peered":"2024-05-08T21:49:43.771295+0000","last_unstale":"2024-05-08T21:54:29.584442+0000","last_undegraded":"2024-05-08T21:54:29.584442+0000","last_fullsized":"2024-05-08T21:54:29.584442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'160","last_scrub_stamp":"2024-05-08T21:54:29.584397+0000","last_deep_scrub":"24'160","last_deep_scrub_stamp":"2024-05-08T21:54:29.584397+0000","last_clean_scrub_stamp":"2024-05-08T21:54:29.584397+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:22:03.921142+0000","scrub_duration":0.0027834410000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"24'4","reported_seq":33,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:15.023827+0000","last_change":"2024-05-08T21:54:15.023966+0000","last_active":"2024-05-08T21:54:15.023827+0000","last_peered":"2024-05-08T21:54:15.023827+0000","last_clean":"2024-05-08T21:54:15.023827+0000","last_became_active":"2024-05-08T21:49:43.226284+0000","last_became_peered":"2024-05-08T21:49:43.226284+0000","last_unstale":"2024-05-08T21:54:15.023827+0000","last_undegraded":"2024-05-08T21:54:15.023827+0000","last_fullsized":"2024-05-08T21:54:15.023827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'4","last_scrub_stamp":"2024-05-08T21:54:15.023799+0000","last_deep_scrub":"24'4","last_deep_scrub_stamp":"2024-05-08T21:54:15.023799+0000","last_clean_scrub_stamp":"2024-05-08T21:54:15.023799+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:31.876453+0000","scrub_duration":0.0029006930000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"24'162","reported_seq":177,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:51.818955+0000","last_change":"2024-05-08T21:49:43.766694+0000","last_active":"2024-05-08T21:53:51.818955+0000","last_peered":"2024-05-08T21:53:51.818955+0000","last_clean":"2024-05-08T21:53:51.818955+0000","last_became_active":"2024-05-08T21:49:43.766079+0000","last_became_peered":"2024-05-08T21:49:43.766079+0000","last_unstale":"2024-05-08T21:53:51.818955+0000","last_undegraded":"2024-05-08T21:53:51.818955+0000","last_fullsized":"2024-05-08T21:53:51.818955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"24'3","reported_seq":32,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:08.965266+0000","last_change":"2024-05-08T21:54:08.965385+0000","last_active":"2024-05-08T21:54:08.965266+0000","last_peered":"2024-05-08T21:54:08.965266+0000","last_clean":"2024-05-08T21:54:08.965266+0000","last_became_active":"2024-05-08T21:49:43.229891+0000","last_became_peered":"2024-05-08T21:49:43.229891+0000","last_unstale":"2024-05-08T21:54:08.965266+0000","last_undegraded":"2024-05-08T21:54:08.965266+0000","last_fullsized":"2024-05-08T21:54:08.965266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'3","last_scrub_stamp":"2024-05-08T21:54:08.965240+0000","last_deep_scrub":"24'3","last_deep_scrub_stamp":"2024-05-08T21:54:08.965240+0000","last_clean_scrub_stamp":"2024-05-08T21:54:08.965240+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:25:07.591586+0000","scrub_duration":0.0027495779999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"24'205","reported_seq":229,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:17.083467+0000","last_change":"2024-05-08T21:54:17.083611+0000","last_active":"2024-05-08T21:54:17.083467+0000","last_peered":"2024-05-08T21:54:17.083467+0000","last_clean":"2024-05-08T21:54:17.083467+0000","last_became_active":"2024-05-08T21:50:33.112776+0000","last_became_peered":"2024-05-08T21:50:33.112776+0000","last_unstale":"2024-05-08T21:54:17.083467+0000","last_undegraded":"2024-05-08T21:54:17.083467+0000","last_fullsized":"2024-05-08T21:54:17.083467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'205","last_scrub_stamp":"2024-05-08T21:54:17.083439+0000","last_deep_scrub":"24'205","last_deep_scrub_stamp":"2024-05-08T21:54:17.083439+0000","last_clean_scrub_stamp":"2024-05-08T21:54:17.083439+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:18:45.512107+0000","scrub_duration":0.0041864329999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":458752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"24'2","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:01.895028+0000","last_change":"2024-05-08T21:54:01.895201+0000","last_active":"2024-05-08T21:54:01.895028+0000","last_peered":"2024-05-08T21:54:01.895028+0000","last_clean":"2024-05-08T21:54:01.895028+0000","last_became_active":"2024-05-08T21:49:43.220090+0000","last_became_peered":"2024-05-08T21:49:43.220090+0000","last_unstale":"2024-05-08T21:54:01.895028+0000","last_undegraded":"2024-05-08T21:54:01.895028+0000","last_fullsized":"2024-05-08T21:54:01.895028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'2","last_scrub_stamp":"2024-05-08T21:54:01.894999+0000","last_deep_scrub":"24'2","last_deep_scrub_stamp":"2024-05-08T21:54:01.894999+0000","last_clean_scrub_stamp":"2024-05-08T21:54:01.894999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:38:52.538673+0000","scrub_duration":0.002723521,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"24'149","reported_seq":173,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:13.089760+0000","last_change":"2024-05-08T21:54:13.089891+0000","last_active":"2024-05-08T21:54:13.089760+0000","last_peered":"2024-05-08T21:54:13.089760+0000","last_clean":"2024-05-08T21:54:13.089760+0000","last_became_active":"2024-05-08T21:50:33.103147+0000","last_became_peered":"2024-05-08T21:50:33.103147+0000","last_unstale":"2024-05-08T21:54:13.089760+0000","last_undegraded":"2024-05-08T21:54:13.089760+0000","last_fullsized":"2024-05-08T21:54:13.089760+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'149","last_scrub_stamp":"2024-05-08T21:54:13.089730+0000","last_deep_scrub":"24'149","last_deep_scrub_stamp":"2024-05-08T21:54:13.089730+0000","last_clean_scrub_stamp":"2024-05-08T21:54:13.089730+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:31:10.238060+0000","scrub_duration":0.0044294210000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"24'2","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:59.634205+0000","last_change":"2024-05-08T21:53:59.634326+0000","last_active":"2024-05-08T21:53:59.634205+0000","last_peered":"2024-05-08T21:53:59.634205+0000","last_clean":"2024-05-08T21:53:59.634205+0000","last_became_active":"2024-05-08T21:49:43.218473+0000","last_became_peered":"2024-05-08T21:49:43.218473+0000","last_unstale":"2024-05-08T21:53:59.634205+0000","last_undegraded":"2024-05-08T21:53:59.634205+0000","last_fullsized":"2024-05-08T21:53:59.634205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'2","last_scrub_stamp":"2024-05-08T21:53:59.634180+0000","last_deep_scrub":"24'2","last_deep_scrub_stamp":"2024-05-08T21:53:59.634180+0000","last_clean_scrub_stamp":"2024-05-08T21:53:59.634180+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:38:50.277853+0000","scrub_duration":0.0013227530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"24'162","reported_seq":188,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:13.651717+0000","last_change":"2024-05-08T21:54:13.651830+0000","last_active":"2024-05-08T21:54:13.651717+0000","last_peered":"2024-05-08T21:54:13.651717+0000","last_clean":"2024-05-08T21:54:13.651717+0000","last_became_active":"2024-05-08T21:49:43.770677+0000","last_became_peered":"2024-05-08T21:49:43.770677+0000","last_unstale":"2024-05-08T21:54:13.651717+0000","last_undegraded":"2024-05-08T21:54:13.651717+0000","last_fullsized":"2024-05-08T21:54:13.651717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'162","last_scrub_stamp":"2024-05-08T21:54:13.651690+0000","last_deep_scrub":"24'162","last_deep_scrub_stamp":"2024-05-08T21:54:13.651690+0000","last_clean_scrub_stamp":"2024-05-08T21:54:13.651690+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:12:19.269754+0000","scrub_duration":0.003372454,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:04.933446+0000","last_change":"2024-05-08T21:54:04.933446+0000","last_active":"2024-05-08T21:54:04.933446+0000","last_peered":"2024-05-08T21:54:04.933446+0000","last_clean":"2024-05-08T21:54:04.933446+0000","last_became_active":"2024-05-08T21:49:43.220780+0000","last_became_peered":"2024-05-08T21:49:43.220780+0000","last_unstale":"2024-05-08T21:54:04.933446+0000","last_undegraded":"2024-05-08T21:54:04.933446+0000","last_fullsized":"2024-05-08T21:54:04.933446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:54:04.933315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:54:04.933315+0000","last_clean_scrub_stamp":"2024-05-08T21:54:04.933315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:12:19.285123+0000","scrub_duration":0.0022305060000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"24'190","reported_seq":214,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:15.093196+0000","last_change":"2024-05-08T21:54:15.093348+0000","last_active":"2024-05-08T21:54:15.093196+0000","last_peered":"2024-05-08T21:54:15.093196+0000","last_clean":"2024-05-08T21:54:15.093196+0000","last_became_active":"2024-05-08T21:50:33.305037+0000","last_became_peered":"2024-05-08T21:50:33.305037+0000","last_unstale":"2024-05-08T21:54:15.093196+0000","last_undegraded":"2024-05-08T21:54:15.093196+0000","last_fullsized":"2024-05-08T21:54:15.093196+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'190","last_scrub_stamp":"2024-05-08T21:54:15.093167+0000","last_deep_scrub":"24'190","last_deep_scrub_stamp":"2024-05-08T21:54:15.093167+0000","last_clean_scrub_stamp":"2024-05-08T21:54:15.093167+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:25:13.719513+0000","scrub_duration":0.0041475000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:59.638981+0000","last_change":"2024-05-08T21:53:59.638981+0000","last_active":"2024-05-08T21:53:59.638981+0000","last_peered":"2024-05-08T21:53:59.638981+0000","last_clean":"2024-05-08T21:53:59.638981+0000","last_became_active":"2024-05-08T21:49:43.225057+0000","last_became_peered":"2024-05-08T21:49:43.225057+0000","last_unstale":"2024-05-08T21:53:59.638981+0000","last_undegraded":"2024-05-08T21:53:59.638981+0000","last_fullsized":"2024-05-08T21:53:59.638981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:53:59.638851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:53:59.638851+0000","last_clean_scrub_stamp":"2024-05-08T21:53:59.638851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:30:47.457087+0000","scrub_duration":0.001332172,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"24'187","reported_seq":213,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:23.144184+0000","last_change":"2024-05-08T21:54:23.144319+0000","last_active":"2024-05-08T21:54:23.144184+0000","last_peered":"2024-05-08T21:54:23.144184+0000","last_clean":"2024-05-08T21:54:23.144184+0000","last_became_active":"2024-05-08T21:49:43.757092+0000","last_became_peered":"2024-05-08T21:49:43.757092+0000","last_unstale":"2024-05-08T21:54:23.144184+0000","last_undegraded":"2024-05-08T21:54:23.144184+0000","last_fullsized":"2024-05-08T21:54:23.144184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'187","last_scrub_stamp":"2024-05-08T21:54:23.144159+0000","last_deep_scrub":"24'187","last_deep_scrub_stamp":"2024-05-08T21:54:23.144159+0000","last_clean_scrub_stamp":"2024-05-08T21:54:23.144159+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:59:27.056579+0000","scrub_duration":0.0036987840000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"24'1","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:05.715714+0000","last_change":"2024-05-08T21:54:05.715714+0000","last_active":"2024-05-08T21:54:05.715714+0000","last_peered":"2024-05-08T21:54:05.715714+0000","last_clean":"2024-05-08T21:54:05.715714+0000","last_became_active":"2024-05-08T21:49:43.229105+0000","last_became_peered":"2024-05-08T21:49:43.229105+0000","last_unstale":"2024-05-08T21:54:05.715714+0000","last_undegraded":"2024-05-08T21:54:05.715714+0000","last_fullsized":"2024-05-08T21:54:05.715714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'1","last_scrub_stamp":"2024-05-08T21:54:05.715584+0000","last_deep_scrub":"24'1","last_deep_scrub_stamp":"2024-05-08T21:54:05.715584+0000","last_clean_scrub_stamp":"2024-05-08T21:54:05.715584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:50:49.933050+0000","scrub_duration":0.0026438849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"24'251","reported_seq":278,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:20.587959+0000","last_change":"2024-05-08T21:54:20.587959+0000","last_active":"2024-05-08T21:54:20.587959+0000","last_peered":"2024-05-08T21:54:20.587959+0000","last_clean":"2024-05-08T21:54:20.587959+0000","last_became_active":"2024-05-08T21:49:43.772944+0000","last_became_peered":"2024-05-08T21:49:43.772944+0000","last_unstale":"2024-05-08T21:54:20.587959+0000","last_undegraded":"2024-05-08T21:54:20.587959+0000","last_fullsized":"2024-05-08T21:54:20.587959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'251","last_scrub_stamp":"2024-05-08T21:54:20.587827+0000","last_deep_scrub":"24'251","last_deep_scrub_stamp":"2024-05-08T21:54:20.587827+0000","last_clean_scrub_stamp":"2024-05-08T21:54:20.587827+0000","objects_scrubbed":0,"log_size":251,"log_dups_size":0,"ondisk_log_size":251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:18.094741+0000","scrub_duration":0.0041642789999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":598016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:05.661193+0000","last_change":"2024-05-08T21:54:05.661193+0000","last_active":"2024-05-08T21:54:05.661193+0000","last_peered":"2024-05-08T21:54:05.661193+0000","last_clean":"2024-05-08T21:54:05.661193+0000","last_became_active":"2024-05-08T21:49:43.223476+0000","last_became_peered":"2024-05-08T21:49:43.223476+0000","last_unstale":"2024-05-08T21:54:05.661193+0000","last_undegraded":"2024-05-08T21:54:05.661193+0000","last_fullsized":"2024-05-08T21:54:05.661193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:54:05.661051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:54:05.661051+0000","last_clean_scrub_stamp":"2024-05-08T21:54:05.661051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:48:28.865727+0000","scrub_duration":0.0014156990000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"24'160","reported_seq":186,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:20.709965+0000","last_change":"2024-05-08T21:54:20.710080+0000","last_active":"2024-05-08T21:54:20.709965+0000","last_peered":"2024-05-08T21:54:20.709965+0000","last_clean":"2024-05-08T21:54:20.709965+0000","last_became_active":"2024-05-08T21:49:43.771279+0000","last_became_peered":"2024-05-08T21:49:43.771279+0000","last_unstale":"2024-05-08T21:54:20.709965+0000","last_undegraded":"2024-05-08T21:54:20.709965+0000","last_fullsized":"2024-05-08T21:54:20.709965+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'160","last_scrub_stamp":"2024-05-08T21:54:20.709939+0000","last_deep_scrub":"24'160","last_deep_scrub_stamp":"2024-05-08T21:54:20.709939+0000","last_clean_scrub_stamp":"2024-05-08T21:54:20.709939+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:18:49.138608+0000","scrub_duration":0.0032270900000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"24'9","reported_seq":40,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:13.130280+0000","last_change":"2024-05-08T21:54:13.130280+0000","last_active":"2024-05-08T21:54:13.130280+0000","last_peered":"2024-05-08T21:54:13.130280+0000","last_clean":"2024-05-08T21:54:13.130280+0000","last_became_active":"2024-05-08T21:49:43.224164+0000","last_became_peered":"2024-05-08T21:49:43.224164+0000","last_unstale":"2024-05-08T21:54:13.130280+0000","last_undegraded":"2024-05-08T21:54:13.130280+0000","last_fullsized":"2024-05-08T21:54:13.130280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'9","last_scrub_stamp":"2024-05-08T21:54:13.130137+0000","last_deep_scrub":"24'9","last_deep_scrub_stamp":"2024-05-08T21:54:13.130137+0000","last_clean_scrub_stamp":"2024-05-08T21:54:13.130137+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:30:47.087710+0000","scrub_duration":0.0046032640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"24'168","reported_seq":195,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:01.292214+0000","last_change":"2024-05-08T21:54:01.292214+0000","last_active":"2024-05-08T21:54:01.292214+0000","last_peered":"2024-05-08T21:54:01.292214+0000","last_clean":"2024-05-08T21:54:01.292214+0000","last_became_active":"2024-05-08T21:49:43.772685+0000","last_became_peered":"2024-05-08T21:49:43.772685+0000","last_unstale":"2024-05-08T21:54:01.292214+0000","last_undegraded":"2024-05-08T21:54:01.292214+0000","last_fullsized":"2024-05-08T21:54:01.292214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'168","last_scrub_stamp":"2024-05-08T21:54:01.292080+0000","last_deep_scrub":"24'168","last_deep_scrub_stamp":"2024-05-08T21:54:01.292080+0000","last_clean_scrub_stamp":"2024-05-08T21:54:01.292080+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:34.130535+0000","scrub_duration":0.003607589,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"24'186","reported_seq":220,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:01.692635+0000","last_change":"2024-05-08T21:54:01.692635+0000","last_active":"2024-05-08T21:54:01.692635+0000","last_peered":"2024-05-08T21:54:01.692635+0000","last_clean":"2024-05-08T21:54:01.692635+0000","last_became_active":"2024-05-08T21:49:43.221844+0000","last_became_peered":"2024-05-08T21:49:43.221844+0000","last_unstale":"2024-05-08T21:54:01.692635+0000","last_undegraded":"2024-05-08T21:54:01.692635+0000","last_fullsized":"2024-05-08T21:54:01.692635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'186","last_scrub_stamp":"2024-05-08T21:54:01.692501+0000","last_deep_scrub":"24'186","last_deep_scrub_stamp":"2024-05-08T21:54:01.692501+0000","last_clean_scrub_stamp":"2024-05-08T21:54:01.692501+0000","objects_scrubbed":4,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:57:32.728155+0000","scrub_duration":0.0057571819999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":387830,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":182,"num_write_kb":531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"24'176","reported_seq":203,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:30.094819+0000","last_change":"2024-05-08T21:54:30.094819+0000","last_active":"2024-05-08T21:54:30.094819+0000","last_peered":"2024-05-08T21:54:30.094819+0000","last_clean":"2024-05-08T21:54:30.094819+0000","last_became_active":"2024-05-08T21:49:43.772037+0000","last_became_peered":"2024-05-08T21:49:43.772037+0000","last_unstale":"2024-05-08T21:54:30.094819+0000","last_undegraded":"2024-05-08T21:54:30.094819+0000","last_fullsized":"2024-05-08T21:54:30.094819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'176","last_scrub_stamp":"2024-05-08T21:54:30.094694+0000","last_deep_scrub":"24'176","last_deep_scrub_stamp":"2024-05-08T21:54:30.094694+0000","last_clean_scrub_stamp":"2024-05-08T21:54:30.094694+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:54:13.890552+0000","scrub_duration":0.0042606689999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"24'4","reported_seq":34,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:57.730838+0000","last_change":"2024-05-08T21:53:57.730838+0000","last_active":"2024-05-08T21:53:57.730838+0000","last_peered":"2024-05-08T21:53:57.730838+0000","last_clean":"2024-05-08T21:53:57.730838+0000","last_became_active":"2024-05-08T21:49:43.219186+0000","last_became_peered":"2024-05-08T21:49:43.219186+0000","last_unstale":"2024-05-08T21:53:57.730838+0000","last_undegraded":"2024-05-08T21:53:57.730838+0000","last_fullsized":"2024-05-08T21:53:57.730838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'4","last_scrub_stamp":"2024-05-08T21:53:57.730742+0000","last_deep_scrub":"24'4","last_deep_scrub_stamp":"2024-05-08T21:53:57.730742+0000","last_clean_scrub_stamp":"2024-05-08T21:53:57.730742+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:27:07.750268+0000","scrub_duration":0.0042791699999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"24'177","reported_seq":204,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:11.656510+0000","last_change":"2024-05-08T21:54:11.656510+0000","last_active":"2024-05-08T21:54:11.656510+0000","last_peered":"2024-05-08T21:54:11.656510+0000","last_clean":"2024-05-08T21:54:11.656510+0000","last_became_active":"2024-05-08T21:49:43.774919+0000","last_became_peered":"2024-05-08T21:49:43.774919+0000","last_unstale":"2024-05-08T21:54:11.656510+0000","last_undegraded":"2024-05-08T21:54:11.656510+0000","last_fullsized":"2024-05-08T21:54:11.656510+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'177","last_scrub_stamp":"2024-05-08T21:54:11.656373+0000","last_deep_scrub":"24'177","last_deep_scrub_stamp":"2024-05-08T21:54:11.656373+0000","last_clean_scrub_stamp":"2024-05-08T21:54:11.656373+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:50:55.873838+0000","scrub_duration":0.0044413589999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:11.649426+0000","last_change":"2024-05-08T21:54:11.649426+0000","last_active":"2024-05-08T21:54:11.649426+0000","last_peered":"2024-05-08T21:54:11.649426+0000","last_clean":"2024-05-08T21:54:11.649426+0000","last_became_active":"2024-05-08T21:49:43.227065+0000","last_became_peered":"2024-05-08T21:49:43.227065+0000","last_unstale":"2024-05-08T21:54:11.649426+0000","last_undegraded":"2024-05-08T21:54:11.649426+0000","last_fullsized":"2024-05-08T21:54:11.649426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:54:11.649258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:54:11.649258+0000","last_clean_scrub_stamp":"2024-05-08T21:54:11.649258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:47:08.160695+0000","scrub_duration":0.0024401050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"24'201","reported_seq":228,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:23.088221+0000","last_change":"2024-05-08T21:54:23.088221+0000","last_active":"2024-05-08T21:54:23.088221+0000","last_peered":"2024-05-08T21:54:23.088221+0000","last_clean":"2024-05-08T21:54:23.088221+0000","last_became_active":"2024-05-08T21:49:43.770180+0000","last_became_peered":"2024-05-08T21:49:43.770180+0000","last_unstale":"2024-05-08T21:54:23.088221+0000","last_undegraded":"2024-05-08T21:54:23.088221+0000","last_fullsized":"2024-05-08T21:54:23.088221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'201","last_scrub_stamp":"2024-05-08T21:54:23.088040+0000","last_deep_scrub":"24'201","last_deep_scrub_stamp":"2024-05-08T21:54:23.088040+0000","last_clean_scrub_stamp":"2024-05-08T21:54:23.088040+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:44:17.971373+0000","scrub_duration":0.003562609,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:04.728088+0000","last_change":"2024-05-08T21:54:04.728088+0000","last_active":"2024-05-08T21:54:04.728088+0000","last_peered":"2024-05-08T21:54:04.728088+0000","last_clean":"2024-05-08T21:54:04.728088+0000","last_became_active":"2024-05-08T21:49:43.220641+0000","last_became_peered":"2024-05-08T21:49:43.220641+0000","last_unstale":"2024-05-08T21:54:04.728088+0000","last_undegraded":"2024-05-08T21:54:04.728088+0000","last_fullsized":"2024-05-08T21:54:04.728088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:54:04.727909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:54:04.727909+0000","last_clean_scrub_stamp":"2024-05-08T21:54:04.727909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:20:25.262158+0000","scrub_duration":0.0016556240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"24'197","reported_seq":224,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:07.764776+0000","last_change":"2024-05-08T21:54:07.764776+0000","last_active":"2024-05-08T21:54:07.764776+0000","last_peered":"2024-05-08T21:54:07.764776+0000","last_clean":"2024-05-08T21:54:07.764776+0000","last_became_active":"2024-05-08T21:49:43.765945+0000","last_became_peered":"2024-05-08T21:49:43.765945+0000","last_unstale":"2024-05-08T21:54:07.764776+0000","last_undegraded":"2024-05-08T21:54:07.764776+0000","last_fullsized":"2024-05-08T21:54:07.764776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'197","last_scrub_stamp":"2024-05-08T21:54:07.764589+0000","last_deep_scrub":"24'197","last_deep_scrub_stamp":"2024-05-08T21:54:07.764589+0000","last_clean_scrub_stamp":"2024-05-08T21:54:07.764589+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:12:13.382654+0000","scrub_duration":0.0048995460000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"24'13","reported_seq":49,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:01.062501+0000","last_change":"2024-05-08T21:54:01.062501+0000","last_active":"2024-05-08T21:54:01.062501+0000","last_peered":"2024-05-08T21:54:01.062501+0000","last_clean":"2024-05-08T21:54:01.062501+0000","last_became_active":"2024-05-08T21:49:43.208013+0000","last_became_peered":"2024-05-08T21:49:43.208013+0000","last_unstale":"2024-05-08T21:54:01.062501+0000","last_undegraded":"2024-05-08T21:54:01.062501+0000","last_fullsized":"2024-05-08T21:54:01.062501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'13","last_scrub_stamp":"2024-05-08T21:54:01.062323+0000","last_deep_scrub":"24'13","last_deep_scrub_stamp":"2024-05-08T21:54:01.062323+0000","last_clean_scrub_stamp":"2024-05-08T21:54:01.062323+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:38:51.705996+0000","scrub_duration":0.0050219519999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"24'215","reported_seq":242,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:24.092278+0000","last_change":"2024-05-08T21:54:24.092278+0000","last_active":"2024-05-08T21:54:24.092278+0000","last_peered":"2024-05-08T21:54:24.092278+0000","last_clean":"2024-05-08T21:54:24.092278+0000","last_became_active":"2024-05-08T21:49:43.773933+0000","last_became_peered":"2024-05-08T21:49:43.773933+0000","last_unstale":"2024-05-08T21:54:24.092278+0000","last_undegraded":"2024-05-08T21:54:24.092278+0000","last_fullsized":"2024-05-08T21:54:24.092278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'215","last_scrub_stamp":"2024-05-08T21:54:24.092120+0000","last_deep_scrub":"24'215","last_deep_scrub_stamp":"2024-05-08T21:54:24.092120+0000","last_clean_scrub_stamp":"2024-05-08T21:54:24.092120+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:17.601798+0000","scrub_duration":0.0040403330000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"24'2","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:58.265770+0000","last_change":"2024-05-08T21:53:58.265770+0000","last_active":"2024-05-08T21:53:58.265770+0000","last_peered":"2024-05-08T21:53:58.265770+0000","last_clean":"2024-05-08T21:53:58.265770+0000","last_became_active":"2024-05-08T21:49:43.216822+0000","last_became_peered":"2024-05-08T21:49:43.216822+0000","last_unstale":"2024-05-08T21:53:58.265770+0000","last_undegraded":"2024-05-08T21:53:58.265770+0000","last_fullsized":"2024-05-08T21:53:58.265770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'2","last_scrub_stamp":"2024-05-08T21:53:58.265597+0000","last_deep_scrub":"24'2","last_deep_scrub_stamp":"2024-05-08T21:53:58.265597+0000","last_clean_scrub_stamp":"2024-05-08T21:53:58.265597+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:23:36.103671+0000","scrub_duration":0.0039105140000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"24'175","reported_seq":202,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:25.125878+0000","last_change":"2024-05-08T21:54:25.126026+0000","last_active":"2024-05-08T21:54:25.125878+0000","last_peered":"2024-05-08T21:54:25.125878+0000","last_clean":"2024-05-08T21:54:25.125878+0000","last_became_active":"2024-05-08T21:49:43.769762+0000","last_became_peered":"2024-05-08T21:49:43.769762+0000","last_unstale":"2024-05-08T21:54:25.125878+0000","last_undegraded":"2024-05-08T21:54:25.125878+0000","last_fullsized":"2024-05-08T21:54:25.125878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'175","last_scrub_stamp":"2024-05-08T21:54:25.125852+0000","last_deep_scrub":"24'175","last_deep_scrub_stamp":"2024-05-08T21:54:25.125852+0000","last_clean_scrub_stamp":"2024-05-08T21:54:25.125852+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:53:47.171840+0000","scrub_duration":0.0036851039999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:00.091497+0000","last_change":"2024-05-08T21:54:00.091607+0000","last_active":"2024-05-08T21:54:00.091497+0000","last_peered":"2024-05-08T21:54:00.091497+0000","last_clean":"2024-05-08T21:54:00.091497+0000","last_became_active":"2024-05-08T21:49:43.215048+0000","last_became_peered":"2024-05-08T21:49:43.215048+0000","last_unstale":"2024-05-08T21:54:00.091497+0000","last_undegraded":"2024-05-08T21:54:00.091497+0000","last_fullsized":"2024-05-08T21:54:00.091497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:54:00.091474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:54:00.091474+0000","last_clean_scrub_stamp":"2024-05-08T21:54:00.091474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:41:28.795723+0000","scrub_duration":0.0018240509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"24'160","reported_seq":187,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:33.557172+0000","last_change":"2024-05-08T21:54:33.557308+0000","last_active":"2024-05-08T21:54:33.557172+0000","last_peered":"2024-05-08T21:54:33.557172+0000","last_clean":"2024-05-08T21:54:33.557172+0000","last_became_active":"2024-05-08T21:49:43.770029+0000","last_became_peered":"2024-05-08T21:49:43.770029+0000","last_unstale":"2024-05-08T21:54:33.557172+0000","last_undegraded":"2024-05-08T21:54:33.557172+0000","last_fullsized":"2024-05-08T21:54:33.557172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'160","last_scrub_stamp":"2024-05-08T21:54:33.557130+0000","last_deep_scrub":"24'160","last_deep_scrub_stamp":"2024-05-08T21:54:33.557130+0000","last_clean_scrub_stamp":"2024-05-08T21:54:33.557130+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:09:53.625848+0000","scrub_duration":0.0040793909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:02.644657+0000","last_change":"2024-05-08T21:54:02.644782+0000","last_active":"2024-05-08T21:54:02.644657+0000","last_peered":"2024-05-08T21:54:02.644657+0000","last_clean":"2024-05-08T21:54:02.644657+0000","last_became_active":"2024-05-08T21:49:43.227430+0000","last_became_peered":"2024-05-08T21:49:43.227430+0000","last_unstale":"2024-05-08T21:54:02.644657+0000","last_undegraded":"2024-05-08T21:54:02.644657+0000","last_fullsized":"2024-05-08T21:54:02.644657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:54:02.644631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:54:02.644631+0000","last_clean_scrub_stamp":"2024-05-08T21:54:02.644631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:07:34.685146+0000","scrub_duration":0.002515307,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"24'177","reported_seq":204,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:00.273626+0000","last_change":"2024-05-08T21:54:00.273626+0000","last_active":"2024-05-08T21:54:00.273626+0000","last_peered":"2024-05-08T21:54:00.273626+0000","last_clean":"2024-05-08T21:54:00.273626+0000","last_became_active":"2024-05-08T21:49:43.768307+0000","last_became_peered":"2024-05-08T21:49:43.768307+0000","last_unstale":"2024-05-08T21:54:00.273626+0000","last_undegraded":"2024-05-08T21:54:00.273626+0000","last_fullsized":"2024-05-08T21:54:00.273626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'177","last_scrub_stamp":"2024-05-08T21:54:00.273494+0000","last_deep_scrub":"24'177","last_deep_scrub_stamp":"2024-05-08T21:54:00.273494+0000","last_clean_scrub_stamp":"2024-05-08T21:54:00.273494+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:56:54.948792+0000","scrub_duration":0.0038275840000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"24'165","reported_seq":192,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:15.148970+0000","last_change":"2024-05-08T21:54:15.149075+0000","last_active":"2024-05-08T21:54:15.148970+0000","last_peered":"2024-05-08T21:54:15.148970+0000","last_clean":"2024-05-08T21:54:15.148970+0000","last_became_active":"2024-05-08T21:49:43.758367+0000","last_became_peered":"2024-05-08T21:49:43.758367+0000","last_unstale":"2024-05-08T21:54:15.148970+0000","last_undegraded":"2024-05-08T21:54:15.148970+0000","last_fullsized":"2024-05-08T21:54:15.148970+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'165","last_scrub_stamp":"2024-05-08T21:54:15.148943+0000","last_deep_scrub":"24'165","last_deep_scrub_stamp":"2024-05-08T21:54:15.148943+0000","last_clean_scrub_stamp":"2024-05-08T21:54:15.148943+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:47:11.660380+0000","scrub_duration":0.003182023,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"24'6","reported_seq":39,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:07.006691+0000","last_change":"2024-05-08T21:54:07.006803+0000","last_active":"2024-05-08T21:54:07.006691+0000","last_peered":"2024-05-08T21:54:07.006691+0000","last_clean":"2024-05-08T21:54:07.006691+0000","last_became_active":"2024-05-08T21:49:43.217133+0000","last_became_peered":"2024-05-08T21:49:43.217133+0000","last_unstale":"2024-05-08T21:54:07.006691+0000","last_undegraded":"2024-05-08T21:54:07.006691+0000","last_fullsized":"2024-05-08T21:54:07.006691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'6","last_scrub_stamp":"2024-05-08T21:54:07.006665+0000","last_deep_scrub":"24'6","last_deep_scrub_stamp":"2024-05-08T21:54:07.006665+0000","last_clean_scrub_stamp":"2024-05-08T21:54:07.006665+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:20:27.540915+0000","scrub_duration":0.0024388360000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"24'183","reported_seq":210,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:09.963678+0000","last_change":"2024-05-08T21:54:09.963785+0000","last_active":"2024-05-08T21:54:09.963678+0000","last_peered":"2024-05-08T21:54:09.963678+0000","last_clean":"2024-05-08T21:54:09.963678+0000","last_became_active":"2024-05-08T21:49:43.771451+0000","last_became_peered":"2024-05-08T21:49:43.771451+0000","last_unstale":"2024-05-08T21:54:09.963678+0000","last_undegraded":"2024-05-08T21:54:09.963678+0000","last_fullsized":"2024-05-08T21:54:09.963678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'183","last_scrub_stamp":"2024-05-08T21:54:09.963651+0000","last_deep_scrub":"24'183","last_deep_scrub_stamp":"2024-05-08T21:54:09.963651+0000","last_clean_scrub_stamp":"2024-05-08T21:54:09.963651+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:12:15.581715+0000","scrub_duration":0.0044283860000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:09.629236+0000","last_change":"2024-05-08T21:54:09.629368+0000","last_active":"2024-05-08T21:54:09.629236+0000","last_peered":"2024-05-08T21:54:09.629236+0000","last_clean":"2024-05-08T21:54:09.629236+0000","last_became_active":"2024-05-08T21:49:43.223469+0000","last_became_peered":"2024-05-08T21:49:43.223469+0000","last_unstale":"2024-05-08T21:54:09.629236+0000","last_undegraded":"2024-05-08T21:54:09.629236+0000","last_fullsized":"2024-05-08T21:54:09.629236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:54:09.629211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:54:09.629211+0000","last_clean_scrub_stamp":"2024-05-08T21:54:09.629211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:30:43.586785+0000","scrub_duration":0.0033484270000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"24'119","reported_seq":183,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:01.855797+0000","last_change":"2024-05-08T21:54:01.855909+0000","last_active":"2024-05-08T21:54:01.855797+0000","last_peered":"2024-05-08T21:54:01.855797+0000","last_clean":"2024-05-08T21:54:01.855797+0000","last_became_active":"2024-05-08T21:49:38.626159+0000","last_became_peered":"2024-05-08T21:49:38.626159+0000","last_unstale":"2024-05-08T21:54:01.855797+0000","last_undegraded":"2024-05-08T21:54:01.855797+0000","last_fullsized":"2024-05-08T21:54:01.855797+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'119","last_scrub_stamp":"2024-05-08T21:54:01.855772+0000","last_deep_scrub":"24'119","last_deep_scrub_stamp":"2024-05-08T21:54:01.855772+0000","last_clean_scrub_stamp":"2024-05-08T21:54:01.855772+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:50:46.073238+0000","scrub_duration":0.0063122120000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"24'165","reported_seq":192,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:04.734425+0000","last_change":"2024-05-08T21:54:04.734578+0000","last_active":"2024-05-08T21:54:04.734425+0000","last_peered":"2024-05-08T21:54:04.734425+0000","last_clean":"2024-05-08T21:54:04.734425+0000","last_became_active":"2024-05-08T21:49:43.770711+0000","last_became_peered":"2024-05-08T21:49:43.770711+0000","last_unstale":"2024-05-08T21:54:04.734425+0000","last_undegraded":"2024-05-08T21:54:04.734425+0000","last_fullsized":"2024-05-08T21:54:04.734425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'165","last_scrub_stamp":"2024-05-08T21:54:04.734399+0000","last_deep_scrub":"24'165","last_deep_scrub_stamp":"2024-05-08T21:54:04.734399+0000","last_clean_scrub_stamp":"2024-05-08T21:54:04.734399+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:38:55.378073+0000","scrub_duration":0.0038027999999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:03.902183+0000","last_change":"2024-05-08T21:54:03.902325+0000","last_active":"2024-05-08T21:54:03.902183+0000","last_peered":"2024-05-08T21:54:03.902183+0000","last_clean":"2024-05-08T21:54:03.902183+0000","last_became_active":"2024-05-08T21:49:43.220539+0000","last_became_peered":"2024-05-08T21:49:43.220539+0000","last_unstale":"2024-05-08T21:54:03.902183+0000","last_undegraded":"2024-05-08T21:54:03.902183+0000","last_fullsized":"2024-05-08T21:54:03.902183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:54:03.902144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:54:03.902144+0000","last_clean_scrub_stamp":"2024-05-08T21:54:03.902144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:12:09.520208+0000","scrub_duration":0.0024220439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:11.021338+0000","last_change":"2024-05-08T21:54:11.021441+0000","last_active":"2024-05-08T21:54:11.021338+0000","last_peered":"2024-05-08T21:54:11.021338+0000","last_clean":"2024-05-08T21:54:11.021338+0000","last_became_active":"2024-05-08T21:49:43.222131+0000","last_became_peered":"2024-05-08T21:49:43.222131+0000","last_unstale":"2024-05-08T21:54:11.021338+0000","last_undegraded":"2024-05-08T21:54:11.021338+0000","last_fullsized":"2024-05-08T21:54:11.021338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:54:11.021310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:54:11.021310+0000","last_clean_scrub_stamp":"2024-05-08T21:54:11.021310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:18:39.449979+0000","scrub_duration":0.001879045,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"24'162","reported_seq":189,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:24.158761+0000","last_change":"2024-05-08T21:54:24.158892+0000","last_active":"2024-05-08T21:54:24.158761+0000","last_peered":"2024-05-08T21:54:24.158761+0000","last_clean":"2024-05-08T21:54:24.158761+0000","last_became_active":"2024-05-08T21:49:43.758140+0000","last_became_peered":"2024-05-08T21:49:43.758140+0000","last_unstale":"2024-05-08T21:54:24.158761+0000","last_undegraded":"2024-05-08T21:54:24.158761+0000","last_fullsized":"2024-05-08T21:54:24.158761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'162","last_scrub_stamp":"2024-05-08T21:54:24.158736+0000","last_deep_scrub":"24'162","last_deep_scrub_stamp":"2024-05-08T21:54:24.158736+0000","last_clean_scrub_stamp":"2024-05-08T21:54:24.158736+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:21.665649+0000","scrub_duration":0.0039939609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"24'15","reported_seq":44,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:01.062923+0000","last_change":"2024-05-08T21:54:01.062923+0000","last_active":"2024-05-08T21:54:01.062923+0000","last_peered":"2024-05-08T21:54:01.062923+0000","last_clean":"2024-05-08T21:54:01.062923+0000","last_became_active":"2024-05-08T21:49:43.217780+0000","last_became_peered":"2024-05-08T21:49:43.217780+0000","last_unstale":"2024-05-08T21:54:01.062923+0000","last_undegraded":"2024-05-08T21:54:01.062923+0000","last_fullsized":"2024-05-08T21:54:01.062923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'15","last_scrub_stamp":"2024-05-08T21:54:01.062736+0000","last_deep_scrub":"24'15","last_deep_scrub_stamp":"2024-05-08T21:54:01.062736+0000","last_clean_scrub_stamp":"2024-05-08T21:54:01.062736+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:04:59.971978+0000","scrub_duration":0.0028540369999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"24'166","reported_seq":193,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:07.967700+0000","last_change":"2024-05-08T21:54:07.967700+0000","last_active":"2024-05-08T21:54:07.967700+0000","last_peered":"2024-05-08T21:54:07.967700+0000","last_clean":"2024-05-08T21:54:07.967700+0000","last_became_active":"2024-05-08T21:49:43.770221+0000","last_became_peered":"2024-05-08T21:49:43.770221+0000","last_unstale":"2024-05-08T21:54:07.967700+0000","last_undegraded":"2024-05-08T21:54:07.967700+0000","last_fullsized":"2024-05-08T21:54:07.967700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'166","last_scrub_stamp":"2024-05-08T21:54:07.967533+0000","last_deep_scrub":"24'166","last_deep_scrub_stamp":"2024-05-08T21:54:07.967533+0000","last_clean_scrub_stamp":"2024-05-08T21:54:07.967533+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:50:52.184999+0000","scrub_duration":0.003871729,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"24'4","reported_seq":34,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:02.681489+0000","last_change":"2024-05-08T21:54:02.681622+0000","last_active":"2024-05-08T21:54:02.681489+0000","last_peered":"2024-05-08T21:54:02.681489+0000","last_clean":"2024-05-08T21:54:02.681489+0000","last_became_active":"2024-05-08T21:49:43.220953+0000","last_became_peered":"2024-05-08T21:49:43.220953+0000","last_unstale":"2024-05-08T21:54:02.681489+0000","last_undegraded":"2024-05-08T21:54:02.681489+0000","last_fullsized":"2024-05-08T21:54:02.681489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'4","last_scrub_stamp":"2024-05-08T21:54:02.681463+0000","last_deep_scrub":"24'4","last_deep_scrub_stamp":"2024-05-08T21:54:02.681463+0000","last_clean_scrub_stamp":"2024-05-08T21:54:02.681463+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:12:17.033271+0000","scrub_duration":0.0033577419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"24'183","reported_seq":210,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:10.638099+0000","last_change":"2024-05-08T21:54:10.638229+0000","last_active":"2024-05-08T21:54:10.638099+0000","last_peered":"2024-05-08T21:54:10.638099+0000","last_clean":"2024-05-08T21:54:10.638099+0000","last_became_active":"2024-05-08T21:49:43.764740+0000","last_became_peered":"2024-05-08T21:49:43.764740+0000","last_unstale":"2024-05-08T21:54:10.638099+0000","last_undegraded":"2024-05-08T21:54:10.638099+0000","last_fullsized":"2024-05-08T21:54:10.638099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'183","last_scrub_stamp":"2024-05-08T21:54:10.638071+0000","last_deep_scrub":"24'183","last_deep_scrub_stamp":"2024-05-08T21:54:10.638071+0000","last_clean_scrub_stamp":"2024-05-08T21:54:10.638071+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:20:31.172321+0000","scrub_duration":0.0038965330000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:22.071628+0000","last_change":"2024-05-08T21:54:22.071761+0000","last_active":"2024-05-08T21:54:22.071628+0000","last_peered":"2024-05-08T21:54:22.071628+0000","last_clean":"2024-05-08T21:54:22.071628+0000","last_became_active":"2024-05-08T21:49:43.220839+0000","last_became_peered":"2024-05-08T21:49:43.220839+0000","last_unstale":"2024-05-08T21:54:22.071628+0000","last_undegraded":"2024-05-08T21:54:22.071628+0000","last_fullsized":"2024-05-08T21:54:22.071628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:54:22.071603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:54:22.071603+0000","last_clean_scrub_stamp":"2024-05-08T21:54:22.071603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:58:08.972263+0000","scrub_duration":0.0016106250000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"24'162","reported_seq":189,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:59.310338+0000","last_change":"2024-05-08T21:53:59.310338+0000","last_active":"2024-05-08T21:53:59.310338+0000","last_peered":"2024-05-08T21:53:59.310338+0000","last_clean":"2024-05-08T21:53:59.310338+0000","last_became_active":"2024-05-08T21:49:43.762170+0000","last_became_peered":"2024-05-08T21:49:43.762170+0000","last_unstale":"2024-05-08T21:53:59.310338+0000","last_undegraded":"2024-05-08T21:53:59.310338+0000","last_fullsized":"2024-05-08T21:53:59.310338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'162","last_scrub_stamp":"2024-05-08T21:53:59.310186+0000","last_deep_scrub":"24'162","last_deep_scrub_stamp":"2024-05-08T21:53:59.310186+0000","last_clean_scrub_stamp":"2024-05-08T21:53:59.310186+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:27:09.329712+0000","scrub_duration":0.0038376149999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:03.071044+0000","last_change":"2024-05-08T21:54:03.071044+0000","last_active":"2024-05-08T21:54:03.071044+0000","last_peered":"2024-05-08T21:54:03.071044+0000","last_clean":"2024-05-08T21:54:03.071044+0000","last_became_active":"2024-05-08T21:49:43.215162+0000","last_became_peered":"2024-05-08T21:49:43.215162+0000","last_unstale":"2024-05-08T21:54:03.071044+0000","last_undegraded":"2024-05-08T21:54:03.071044+0000","last_fullsized":"2024-05-08T21:54:03.071044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:54:03.070884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:54:03.070884+0000","last_clean_scrub_stamp":"2024-05-08T21:54:03.070884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:30:50.889120+0000","scrub_duration":0.00223391,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"24'173","reported_seq":200,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:33.174471+0000","last_change":"2024-05-08T21:54:33.174595+0000","last_active":"2024-05-08T21:54:33.174471+0000","last_peered":"2024-05-08T21:54:33.174471+0000","last_clean":"2024-05-08T21:54:33.174471+0000","last_became_active":"2024-05-08T21:49:43.757233+0000","last_became_peered":"2024-05-08T21:49:43.757233+0000","last_unstale":"2024-05-08T21:54:33.174471+0000","last_undegraded":"2024-05-08T21:54:33.174471+0000","last_fullsized":"2024-05-08T21:54:33.174471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'173","last_scrub_stamp":"2024-05-08T21:54:33.174445+0000","last_deep_scrub":"24'173","last_deep_scrub_stamp":"2024-05-08T21:54:33.174445+0000","last_clean_scrub_stamp":"2024-05-08T21:54:33.174445+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:44:28.057777+0000","scrub_duration":0.0041494039999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:09.028045+0000","last_change":"2024-05-08T21:54:09.028045+0000","last_active":"2024-05-08T21:54:09.028045+0000","last_peered":"2024-05-08T21:54:09.028045+0000","last_clean":"2024-05-08T21:54:09.028045+0000","last_became_active":"2024-05-08T21:49:43.217595+0000","last_became_peered":"2024-05-08T21:49:43.217595+0000","last_unstale":"2024-05-08T21:54:09.028045+0000","last_undegraded":"2024-05-08T21:54:09.028045+0000","last_fullsized":"2024-05-08T21:54:09.028045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:54:09.027906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:54:09.027906+0000","last_clean_scrub_stamp":"2024-05-08T21:54:09.027906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:48:32.232583+0000","scrub_duration":0.001924608,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"24'164","reported_seq":191,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:06.967960+0000","last_change":"2024-05-08T21:54:06.967960+0000","last_active":"2024-05-08T21:54:06.967960+0000","last_peered":"2024-05-08T21:54:06.967960+0000","last_clean":"2024-05-08T21:54:06.967960+0000","last_became_active":"2024-05-08T21:49:43.766596+0000","last_became_peered":"2024-05-08T21:49:43.766596+0000","last_unstale":"2024-05-08T21:54:06.967960+0000","last_undegraded":"2024-05-08T21:54:06.967960+0000","last_fullsized":"2024-05-08T21:54:06.967960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'164","last_scrub_stamp":"2024-05-08T21:54:06.967815+0000","last_deep_scrub":"24'164","last_deep_scrub_stamp":"2024-05-08T21:54:06.967815+0000","last_clean_scrub_stamp":"2024-05-08T21:54:06.967815+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:20:27.502064+0000","scrub_duration":0.003136518,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"24'5","reported_seq":34,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:06.909587+0000","last_change":"2024-05-08T21:54:06.909587+0000","last_active":"2024-05-08T21:54:06.909587+0000","last_peered":"2024-05-08T21:54:06.909587+0000","last_clean":"2024-05-08T21:54:06.909587+0000","last_became_active":"2024-05-08T21:49:43.223974+0000","last_became_peered":"2024-05-08T21:49:43.223974+0000","last_unstale":"2024-05-08T21:54:06.909587+0000","last_undegraded":"2024-05-08T21:54:06.909587+0000","last_fullsized":"2024-05-08T21:54:06.909587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'5","last_scrub_stamp":"2024-05-08T21:54:06.909436+0000","last_deep_scrub":"24'5","last_deep_scrub_stamp":"2024-05-08T21:54:06.909436+0000","last_clean_scrub_stamp":"2024-05-08T21:54:06.909436+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:31:04.057767+0000","scrub_duration":0.0031627399999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"24'154","reported_seq":181,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:27.632207+0000","last_change":"2024-05-08T21:54:27.632376+0000","last_active":"2024-05-08T21:54:27.632207+0000","last_peered":"2024-05-08T21:54:27.632207+0000","last_clean":"2024-05-08T21:54:27.632207+0000","last_became_active":"2024-05-08T21:49:43.764075+0000","last_became_peered":"2024-05-08T21:49:43.764075+0000","last_unstale":"2024-05-08T21:54:27.632207+0000","last_undegraded":"2024-05-08T21:54:27.632207+0000","last_fullsized":"2024-05-08T21:54:27.632207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'154","last_scrub_stamp":"2024-05-08T21:54:27.632154+0000","last_deep_scrub":"24'154","last_deep_scrub_stamp":"2024-05-08T21:54:27.632154+0000","last_clean_scrub_stamp":"2024-05-08T21:54:27.632154+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:22:01.968898+0000","scrub_duration":0.004325995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:04.062533+0000","last_change":"2024-05-08T21:54:04.062533+0000","last_active":"2024-05-08T21:54:04.062533+0000","last_peered":"2024-05-08T21:54:04.062533+0000","last_clean":"2024-05-08T21:54:04.062533+0000","last_became_active":"2024-05-08T21:49:43.229121+0000","last_became_peered":"2024-05-08T21:49:43.229121+0000","last_unstale":"2024-05-08T21:54:04.062533+0000","last_undegraded":"2024-05-08T21:54:04.062533+0000","last_fullsized":"2024-05-08T21:54:04.062533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:54:04.062359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:54:04.062359+0000","last_clean_scrub_stamp":"2024-05-08T21:54:04.062359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:56:45.419906+0000","scrub_duration":0.0019280689999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"24'175","reported_seq":202,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:00.802783+0000","last_change":"2024-05-08T21:54:00.802783+0000","last_active":"2024-05-08T21:54:00.802783+0000","last_peered":"2024-05-08T21:54:00.802783+0000","last_clean":"2024-05-08T21:54:00.802783+0000","last_became_active":"2024-05-08T21:49:43.772528+0000","last_became_peered":"2024-05-08T21:49:43.772528+0000","last_unstale":"2024-05-08T21:54:00.802783+0000","last_undegraded":"2024-05-08T21:54:00.802783+0000","last_fullsized":"2024-05-08T21:54:00.802783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'175","last_scrub_stamp":"2024-05-08T21:54:00.802639+0000","last_deep_scrub":"24'175","last_deep_scrub_stamp":"2024-05-08T21:54:00.802639+0000","last_clean_scrub_stamp":"2024-05-08T21:54:00.802639+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:20:21.336889+0000","scrub_duration":0.0035440060000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"24'2","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:05.107638+0000","last_change":"2024-05-08T21:54:05.107638+0000","last_active":"2024-05-08T21:54:05.107638+0000","last_peered":"2024-05-08T21:54:05.107638+0000","last_clean":"2024-05-08T21:54:05.107638+0000","last_became_active":"2024-05-08T21:49:43.208326+0000","last_became_peered":"2024-05-08T21:49:43.208326+0000","last_unstale":"2024-05-08T21:54:05.107638+0000","last_undegraded":"2024-05-08T21:54:05.107638+0000","last_fullsized":"2024-05-08T21:54:05.107638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'2","last_scrub_stamp":"2024-05-08T21:54:05.107507+0000","last_deep_scrub":"24'2","last_deep_scrub_stamp":"2024-05-08T21:54:05.107507+0000","last_clean_scrub_stamp":"2024-05-08T21:54:05.107507+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:07:37.148022+0000","scrub_duration":0.0042913359999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"24'165","reported_seq":181,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:57.673652+0000","last_change":"2024-05-08T21:49:43.766519+0000","last_active":"2024-05-08T21:53:57.673652+0000","last_peered":"2024-05-08T21:53:57.673652+0000","last_clean":"2024-05-08T21:53:57.673652+0000","last_became_active":"2024-05-08T21:49:43.765789+0000","last_became_peered":"2024-05-08T21:49:43.765789+0000","last_unstale":"2024-05-08T21:53:57.673652+0000","last_undegraded":"2024-05-08T21:53:57.673652+0000","last_fullsized":"2024-05-08T21:53:57.673652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"24'3","reported_seq":33,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:57.022707+0000","last_change":"2024-05-08T21:53:57.022707+0000","last_active":"2024-05-08T21:53:57.022707+0000","last_peered":"2024-05-08T21:53:57.022707+0000","last_clean":"2024-05-08T21:53:57.022707+0000","last_became_active":"2024-05-08T21:49:43.217814+0000","last_became_peered":"2024-05-08T21:49:43.217814+0000","last_unstale":"2024-05-08T21:53:57.022707+0000","last_undegraded":"2024-05-08T21:53:57.022707+0000","last_fullsized":"2024-05-08T21:53:57.022707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'3","last_scrub_stamp":"2024-05-08T21:53:57.022599+0000","last_deep_scrub":"24'3","last_deep_scrub_stamp":"2024-05-08T21:53:57.022599+0000","last_clean_scrub_stamp":"2024-05-08T21:53:57.022599+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:29.861054+0000","scrub_duration":0.0025112469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"24'162","reported_seq":189,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:26.148850+0000","last_change":"2024-05-08T21:54:26.148984+0000","last_active":"2024-05-08T21:54:26.148850+0000","last_peered":"2024-05-08T21:54:26.148850+0000","last_clean":"2024-05-08T21:54:26.148850+0000","last_became_active":"2024-05-08T21:49:43.775361+0000","last_became_peered":"2024-05-08T21:49:43.775361+0000","last_unstale":"2024-05-08T21:54:26.148850+0000","last_undegraded":"2024-05-08T21:54:26.148850+0000","last_fullsized":"2024-05-08T21:54:26.148850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'162","last_scrub_stamp":"2024-05-08T21:54:26.148824+0000","last_deep_scrub":"24'162","last_deep_scrub_stamp":"2024-05-08T21:54:26.148824+0000","last_clean_scrub_stamp":"2024-05-08T21:54:26.148824+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:34:58.088689+0000","scrub_duration":0.0029224049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"24'180","reported_seq":207,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:29.600070+0000","last_change":"2024-05-08T21:54:29.600208+0000","last_active":"2024-05-08T21:54:29.600070+0000","last_peered":"2024-05-08T21:54:29.600070+0000","last_clean":"2024-05-08T21:54:29.600070+0000","last_became_active":"2024-05-08T21:49:43.766789+0000","last_became_peered":"2024-05-08T21:49:43.766789+0000","last_unstale":"2024-05-08T21:54:29.600070+0000","last_undegraded":"2024-05-08T21:54:29.600070+0000","last_fullsized":"2024-05-08T21:54:29.600070+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'180","last_scrub_stamp":"2024-05-08T21:54:29.600045+0000","last_deep_scrub":"24'180","last_deep_scrub_stamp":"2024-05-08T21:54:29.600045+0000","last_clean_scrub_stamp":"2024-05-08T21:54:29.600045+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:58:16.500705+0000","scrub_duration":0.0046833999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"24'158","reported_seq":193,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:08.057981+0000","last_change":"2024-05-08T21:54:08.058100+0000","last_active":"2024-05-08T21:54:08.057981+0000","last_peered":"2024-05-08T21:54:08.057981+0000","last_clean":"2024-05-08T21:54:08.057981+0000","last_became_active":"2024-05-08T21:50:33.103289+0000","last_became_peered":"2024-05-08T21:50:33.103289+0000","last_unstale":"2024-05-08T21:54:08.057981+0000","last_undegraded":"2024-05-08T21:54:08.057981+0000","last_fullsized":"2024-05-08T21:54:08.057981+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'158","last_scrub_stamp":"2024-05-08T21:54:08.057953+0000","last_deep_scrub":"24'158","last_deep_scrub_stamp":"2024-05-08T21:54:08.057953+0000","last_clean_scrub_stamp":"2024-05-08T21:54:08.057953+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:50:52.275418+0000","scrub_duration":0.0042494200000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"24'153","reported_seq":180,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:32.535405+0000","last_change":"2024-05-08T21:54:32.535515+0000","last_active":"2024-05-08T21:54:32.535405+0000","last_peered":"2024-05-08T21:54:32.535405+0000","last_clean":"2024-05-08T21:54:32.535405+0000","last_became_active":"2024-05-08T21:49:43.767606+0000","last_became_peered":"2024-05-08T21:49:43.767606+0000","last_unstale":"2024-05-08T21:54:32.535405+0000","last_undegraded":"2024-05-08T21:54:32.535405+0000","last_fullsized":"2024-05-08T21:54:32.535405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'153","last_scrub_stamp":"2024-05-08T21:54:32.535380+0000","last_deep_scrub":"24'153","last_deep_scrub_stamp":"2024-05-08T21:54:32.535380+0000","last_clean_scrub_stamp":"2024-05-08T21:54:32.535380+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:12:07.158253+0000","scrub_duration":0.0038935720000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"24'134","reported_seq":161,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:18.700216+0000","last_change":"2024-05-08T21:54:18.700332+0000","last_active":"2024-05-08T21:54:18.700216+0000","last_peered":"2024-05-08T21:54:18.700216+0000","last_clean":"2024-05-08T21:54:18.700216+0000","last_became_active":"2024-05-08T21:49:43.774406+0000","last_became_peered":"2024-05-08T21:49:43.774406+0000","last_unstale":"2024-05-08T21:54:18.700216+0000","last_undegraded":"2024-05-08T21:54:18.700216+0000","last_fullsized":"2024-05-08T21:54:18.700216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'134","last_scrub_stamp":"2024-05-08T21:54:18.700166+0000","last_deep_scrub":"24'134","last_deep_scrub_stamp":"2024-05-08T21:54:18.700166+0000","last_clean_scrub_stamp":"2024-05-08T21:54:18.700166+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:25:17.326512+0000","scrub_duration":0.003361345,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"24'152","reported_seq":179,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:16.958102+0000","last_change":"2024-05-08T21:54:16.958241+0000","last_active":"2024-05-08T21:54:16.958102+0000","last_peered":"2024-05-08T21:54:16.958102+0000","last_clean":"2024-05-08T21:54:16.958102+0000","last_became_active":"2024-05-08T21:49:43.763937+0000","last_became_peered":"2024-05-08T21:49:43.763937+0000","last_unstale":"2024-05-08T21:54:16.958102+0000","last_undegraded":"2024-05-08T21:54:16.958102+0000","last_fullsized":"2024-05-08T21:54:16.958102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'152","last_scrub_stamp":"2024-05-08T21:54:16.958074+0000","last_deep_scrub":"24'152","last_deep_scrub_stamp":"2024-05-08T21:54:16.958074+0000","last_clean_scrub_stamp":"2024-05-08T21:54:16.958074+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:53:01.915370+0000","scrub_duration":0.004254791,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"24'166","reported_seq":193,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:27.166321+0000","last_change":"2024-05-08T21:54:27.166465+0000","last_active":"2024-05-08T21:54:27.166321+0000","last_peered":"2024-05-08T21:54:27.166321+0000","last_clean":"2024-05-08T21:54:27.166321+0000","last_became_active":"2024-05-08T21:49:43.757083+0000","last_became_peered":"2024-05-08T21:49:43.757083+0000","last_unstale":"2024-05-08T21:54:27.166321+0000","last_undegraded":"2024-05-08T21:54:27.166321+0000","last_fullsized":"2024-05-08T21:54:27.166321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'166","last_scrub_stamp":"2024-05-08T21:54:27.166276+0000","last_deep_scrub":"24'166","last_deep_scrub_stamp":"2024-05-08T21:54:27.166276+0000","last_clean_scrub_stamp":"2024-05-08T21:54:27.166276+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:33:38.486597+0000","scrub_duration":0.0037007120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"24'217","reported_seq":244,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:31.612578+0000","last_change":"2024-05-08T21:54:31.612692+0000","last_active":"2024-05-08T21:54:31.612578+0000","last_peered":"2024-05-08T21:54:31.612578+0000","last_clean":"2024-05-08T21:54:31.612578+0000","last_became_active":"2024-05-08T21:49:43.773203+0000","last_became_peered":"2024-05-08T21:49:43.773203+0000","last_unstale":"2024-05-08T21:54:31.612578+0000","last_undegraded":"2024-05-08T21:54:31.612578+0000","last_fullsized":"2024-05-08T21:54:31.612578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'217","last_scrub_stamp":"2024-05-08T21:54:31.612549+0000","last_deep_scrub":"24'217","last_deep_scrub_stamp":"2024-05-08T21:54:31.612549+0000","last_clean_scrub_stamp":"2024-05-08T21:54:31.612549+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:25.122227+0000","scrub_duration":0.004118549,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"24'160","reported_seq":176,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:56.657486+0000","last_change":"2024-05-08T21:49:43.761926+0000","last_active":"2024-05-08T21:53:56.657486+0000","last_peered":"2024-05-08T21:53:56.657486+0000","last_clean":"2024-05-08T21:53:56.657486+0000","last_became_active":"2024-05-08T21:49:43.761645+0000","last_became_peered":"2024-05-08T21:49:43.761645+0000","last_unstale":"2024-05-08T21:53:56.657486+0000","last_undegraded":"2024-05-08T21:53:56.657486+0000","last_fullsized":"2024-05-08T21:53:56.657486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"24'207","reported_seq":234,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:23.555458+0000","last_change":"2024-05-08T21:54:23.555587+0000","last_active":"2024-05-08T21:54:23.555458+0000","last_peered":"2024-05-08T21:54:23.555458+0000","last_clean":"2024-05-08T21:54:23.555458+0000","last_became_active":"2024-05-08T21:49:43.768673+0000","last_became_peered":"2024-05-08T21:49:43.768673+0000","last_unstale":"2024-05-08T21:54:23.555458+0000","last_undegraded":"2024-05-08T21:54:23.555458+0000","last_fullsized":"2024-05-08T21:54:23.555458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'207","last_scrub_stamp":"2024-05-08T21:54:23.555432+0000","last_deep_scrub":"24'207","last_deep_scrub_stamp":"2024-05-08T21:54:23.555432+0000","last_clean_scrub_stamp":"2024-05-08T21:54:23.555432+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:33:34.875753+0000","scrub_duration":0.0045520810000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":475136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"24'150","reported_seq":177,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:32.133628+0000","last_change":"2024-05-08T21:54:32.133764+0000","last_active":"2024-05-08T21:54:32.133628+0000","last_peered":"2024-05-08T21:54:32.133628+0000","last_clean":"2024-05-08T21:54:32.133628+0000","last_became_active":"2024-05-08T21:49:43.765723+0000","last_became_peered":"2024-05-08T21:49:43.765723+0000","last_unstale":"2024-05-08T21:54:32.133628+0000","last_undegraded":"2024-05-08T21:54:32.133628+0000","last_fullsized":"2024-05-08T21:54:32.133628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'150","last_scrub_stamp":"2024-05-08T21:54:32.133601+0000","last_deep_scrub":"24'150","last_deep_scrub_stamp":"2024-05-08T21:54:32.133601+0000","last_clean_scrub_stamp":"2024-05-08T21:54:32.133601+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:58:19.034261+0000","scrub_duration":0.0045527120000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"24'199","reported_seq":215,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:57.673780+0000","last_change":"2024-05-08T21:49:43.775098+0000","last_active":"2024-05-08T21:53:57.673780+0000","last_peered":"2024-05-08T21:53:57.673780+0000","last_clean":"2024-05-08T21:53:57.673780+0000","last_became_active":"2024-05-08T21:49:43.774808+0000","last_became_peered":"2024-05-08T21:49:43.774808+0000","last_unstale":"2024-05-08T21:53:57.673780+0000","last_undegraded":"2024-05-08T21:53:57.673780+0000","last_fullsized":"2024-05-08T21:53:57.673780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:49:43.200171+0000","last_clean_scrub_stamp":"2024-05-08T21:49:43.200171+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"24'154","reported_seq":181,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:24.594237+0000","last_change":"2024-05-08T21:54:24.594347+0000","last_active":"2024-05-08T21:54:24.594237+0000","last_peered":"2024-05-08T21:54:24.594237+0000","last_clean":"2024-05-08T21:54:24.594237+0000","last_became_active":"2024-05-08T21:49:43.774881+0000","last_became_peered":"2024-05-08T21:49:43.774881+0000","last_unstale":"2024-05-08T21:54:24.594237+0000","last_undegraded":"2024-05-08T21:54:24.594237+0000","last_fullsized":"2024-05-08T21:54:24.594237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'154","last_scrub_stamp":"2024-05-08T21:54:24.594209+0000","last_deep_scrub":"24'154","last_deep_scrub_stamp":"2024-05-08T21:54:24.594209+0000","last_clean_scrub_stamp":"2024-05-08T21:54:24.594209+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:41.446863+0000","scrub_duration":0.0038226269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"24'179","reported_seq":206,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:14.680464+0000","last_change":"2024-05-08T21:54:14.680464+0000","last_active":"2024-05-08T21:54:14.680464+0000","last_peered":"2024-05-08T21:54:14.680464+0000","last_clean":"2024-05-08T21:54:14.680464+0000","last_became_active":"2024-05-08T21:49:43.763907+0000","last_became_peered":"2024-05-08T21:49:43.763907+0000","last_unstale":"2024-05-08T21:54:14.680464+0000","last_undegraded":"2024-05-08T21:54:14.680464+0000","last_fullsized":"2024-05-08T21:54:14.680464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'179","last_scrub_stamp":"2024-05-08T21:54:14.680299+0000","last_deep_scrub":"24'179","last_deep_scrub_stamp":"2024-05-08T21:54:14.680299+0000","last_clean_scrub_stamp":"2024-05-08T21:54:14.680299+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:52:59.637596+0000","scrub_duration":0.0048495500000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":417792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9216,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11255,"ondisk_log_size":11255,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":389133,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":84,"num_read_kb":92,"num_write":260,"num_write_kb":561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":843776,"data_stored":778266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":270,"ondisk_log_size":270,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509504,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31936,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339904,"statfs":{"total":96636764160,"available":96604061696,"internally_reserved":0,"allocated":843776,"data_stored":682658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.61299999999999999,"15min":0.60599999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":3.5680000000000001,"5min":3.5680000000000001,"15min":3.5680000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.64800000000000002,"15min":0.61799999999999999},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":3.6469999999999998,"5min":3.6469999999999998,"15min":3.6469999999999998},"last":0.58299999999999996}]},{"osd":1,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.60299999999999998,"15min":0.56499999999999995},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":3.2669999999999999,"5min":3.2669999999999999,"15min":3.2669999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":1.0980000000000001,"5min":0.65900000000000003,"15min":0.59399999999999997},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":5.5330000000000004,"5min":5.5330000000000004,"15min":5.5330000000000004},"last":0.67800000000000005}]},{"osd":2,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.61299999999999999,"15min":0.57699999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":5.0730000000000004,"5min":5.0730000000000004,"15min":5.0730000000000004},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.745,"5min":0.60299999999999998,"15min":0.57199999999999995},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":4.0250000000000004,"5min":4.0250000000000004,"15min":4.0250000000000004},"last":0.59899999999999998}]},{"osd":3,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":1.603,"5min":0.78000000000000003,"15min":0.64800000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":20.791,"5min":20.791,"15min":20.791},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.60199999999999998,"15min":0.60399999999999998},"min":{"1min":0.40899999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.64700000000000002}]},{"osd":4,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.52400000000000002,"15min":0.50600000000000001},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":4.0979999999999999,"5min":4.0979999999999999,"15min":4.0979999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.52500000000000002,"15min":0.52700000000000002},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.55300000000000005}]},{"osd":5,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.52400000000000002,"15min":0.53200000000000003},"min":{"1min":0.32600000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.81899999999999995,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.626,"15min":0.59599999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":7.0890000000000004,"5min":7.0890000000000004,"15min":7.0890000000000004},"last":0.63500000000000001}]},{"osd":6,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.61299999999999999,"15min":0.60899999999999999},"min":{"1min":0.40100000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":2.2440000000000002,"5min":2.2440000000000002,"15min":2.2440000000000002},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.57999999999999996,"15min":0.59599999999999997},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.70599999999999996}]}]},{"osd":6,"up_from":15,"seq":64424509504,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31740,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340100,"statfs":{"total":96636764160,"available":96604262400,"internally_reserved":0,"allocated":643072,"data_stored":479538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.91800000000000004,"15min":0.66300000000000003},"min":{"1min":0.39200000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":5.2839999999999998,"5min":23.625,"15min":23.625},"last":0.54900000000000004},{"interface":"front","average":{"1min":2.2090000000000001,"5min":2.2730000000000001,"15min":1.131},"min":{"1min":0.32600000000000001,"5min":0.308,"15min":0.308},"max":{"1min":23.975999999999999,"5min":73.831999999999994,"15min":73.831999999999994},"last":0.67200000000000004}]},{"osd":1,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":1.897,"5min":0.86599999999999999,"15min":0.74399999999999999},"min":{"1min":0.33400000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":11.552,"5min":11.552,"15min":11.552},"last":0.50900000000000001},{"interface":"front","average":{"1min":1.8180000000000001,"5min":1.012,"15min":0.73199999999999998},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":11.619999999999999,"5min":11.619999999999999,"15min":11.619999999999999},"last":0.58999999999999997}]},{"osd":2,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":2.3220000000000001,"5min":1.552,"15min":0.88400000000000001},"min":{"1min":0.36599999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":23.77,"5min":36.951000000000001,"15min":36.951000000000001},"last":0.624},{"interface":"front","average":{"1min":1.986,"5min":0.86899999999999999,"15min":0.69499999999999995},"min":{"1min":0.35899999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":20.956,"5min":20.956,"15min":20.956},"last":0.56899999999999995}]},{"osd":3,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":1.55,"5min":0.79400000000000004,"15min":0.68200000000000005},"min":{"1min":0.41199999999999998,"5min":0.38,"15min":0.38},"max":{"1min":7.9690000000000003,"5min":7.9690000000000003,"15min":7.9690000000000003},"last":0.64400000000000002},{"interface":"front","average":{"1min":1.54,"5min":0.78500000000000003,"15min":0.66900000000000004},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":8.0709999999999997,"5min":8.0709999999999997,"15min":8.0709999999999997},"last":0.65800000000000003}]},{"osd":4,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.53500000000000003,"15min":0.505},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":5.1840000000000002,"5min":5.1840000000000002,"15min":5.1840000000000002},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.749,"5min":0.55500000000000005,"15min":0.53100000000000003},"min":{"1min":0.34899999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":2.976,"5min":2.976,"15min":2.976},"last":0.40500000000000003}]},{"osd":5,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.53200000000000003,"15min":0.498},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":3.0369999999999999,"5min":3.0369999999999999,"15min":3.0369999999999999},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.60199999999999998,"15min":0.56999999999999995},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":5.1219999999999999,"5min":5.1219999999999999,"15min":5.1219999999999999},"last":0.38600000000000001}]},{"osd":7,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.61899999999999999,"15min":0.56999999999999995},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":4.0389999999999997,"5min":4.0389999999999997,"15min":4.0389999999999997},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.60099999999999998,"15min":0.56799999999999995},"min":{"1min":0.40100000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":2.883,"5min":2.883,"15min":2.883},"last":0.41799999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574911,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35452,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94336388,"statfs":{"total":96636764160,"available":96600461312,"internally_reserved":0,"allocated":249856,"data_stored":91798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:53:49 2024","interfaces":[{"interface":"back","average":{"1min":1.409,"5min":0.71799999999999997,"15min":0.628},"min":{"1min":0.35699999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":5.7889999999999997,"5min":5.7889999999999997,"15min":5.7889999999999997},"last":0.57799999999999996},{"interface":"front","average":{"1min":3.2599999999999998,"5min":1.109,"15min":0.77400000000000002},"min":{"1min":0.36699999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":24.751000000000001,"5min":24.751000000000001,"15min":24.751000000000001},"last":0.505}]},{"osd":1,"last update":"Wed May 8 21:53:44 2024","interfaces":[{"interface":"back","average":{"1min":4.1360000000000001,"5min":1.294,"15min":0.84299999999999997},"min":{"1min":0.41699999999999998,"5min":0.313,"15min":0.313},"max":{"1min":53.069000000000003,"5min":53.069000000000003,"15min":53.069000000000003},"last":0.53000000000000003},{"interface":"front","average":{"1min":6.2969999999999997,"5min":1.681,"15min":0.88500000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":80.463999999999999,"5min":80.463999999999999,"15min":80.463999999999999},"last":0.59399999999999997}]},{"osd":2,"last update":"Wed May 8 21:53:49 2024","interfaces":[{"interface":"back","average":{"1min":3.8079999999999998,"5min":1.248,"15min":0.84199999999999997},"min":{"1min":0.40400000000000003,"5min":0.375,"15min":0.375},"max":{"1min":24.332000000000001,"5min":24.332000000000001,"15min":24.332000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":4.0270000000000001,"5min":1.28,"15min":0.81299999999999994},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":24.349,"5min":24.349,"15min":24.349},"last":0.628}]},{"osd":3,"last update":"Wed May 8 21:53:49 2024","interfaces":[{"interface":"back","average":{"1min":3.9689999999999999,"5min":1.2450000000000001,"15min":0.77400000000000002},"min":{"1min":0.46400000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":33.368000000000002,"5min":33.368000000000002,"15min":33.368000000000002},"last":0.65000000000000002},{"interface":"front","average":{"1min":1.921,"5min":0.85399999999999998,"15min":0.69899999999999995},"min":{"1min":0.42599999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":8.125,"5min":8.125,"15min":8.125},"last":0.52000000000000002}]},{"osd":4,"last update":"Wed May 8 21:53:49 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.51900000000000002,"15min":0.53100000000000003},"min":{"1min":0.32800000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":2.3140000000000001,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.624,"15min":0.61399999999999999},"min":{"1min":0.34300000000000003,"5min":0.307,"15min":0.307},"max":{"1min":5.0149999999999997,"5min":5.0149999999999997,"15min":5.0149999999999997},"last":0.41499999999999998}]},{"osd":6,"last update":"Wed May 8 21:53:49 2024","interfaces":[{"interface":"back","average":{"1min":1.587,"5min":0.73599999999999999,"15min":0.59899999999999998},"min":{"1min":0.34000000000000002,"5min":0.315,"15min":0.315},"max":{"1min":8.7430000000000003,"5min":8.7430000000000003,"15min":8.7430000000000003},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.59199999999999997,"15min":0.59799999999999998},"min":{"1min":0.37,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":2.5649999999999999,"5min":2.5649999999999999,"15min":2.5649999999999999},"last":0.47899999999999998}]},{"osd":7,"last update":"Wed May 8 21:53:49 2024","interfaces":[{"interface":"back","average":{"1min":1.516,"5min":0.76900000000000002,"15min":0.66400000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":9.5380000000000003,"5min":9.5380000000000003,"15min":9.5380000000000003},"last":0.35399999999999998},{"interface":"front","average":{"1min":1.385,"5min":0.73199999999999998,"15min":0.61699999999999999},"min":{"1min":0.42499999999999999,"5min":0.375,"15min":0.375},"max":{"1min":8.7959999999999994,"5min":8.7959999999999994,"15min":8.7959999999999994},"last":0.39600000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574910,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31360,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340480,"statfs":{"total":96636764160,"available":96604651520,"internally_reserved":0,"allocated":253952,"data_stored":91868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":9.1020000000000003,"5min":2.2200000000000002,"15min":1.1719999999999999},"min":{"1min":0.26100000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":119.55200000000001,"5min":119.55200000000001,"15min":119.55200000000001},"last":0.35899999999999999},{"interface":"front","average":{"1min":2.9020000000000001,"5min":1.028,"15min":0.83999999999999997},"min":{"1min":0.24099999999999999,"5min":0.192,"15min":0.192},"max":{"1min":23.457999999999998,"5min":23.457999999999998,"15min":23.457999999999998},"last":0.441}]},{"osd":2,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":3.9689999999999999,"5min":1.125,"15min":0.68300000000000005},"min":{"1min":0.255,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":33.259,"5min":33.259,"15min":33.259},"last":0.42099999999999999},{"interface":"front","average":{"1min":4.3860000000000001,"5min":1.343,"15min":0.97299999999999998},"min":{"1min":0.249,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":43.167000000000002,"5min":43.167000000000002,"15min":43.167000000000002},"last":0.54100000000000004}]},{"osd":3,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":4.6210000000000004,"5min":1.26,"15min":0.71399999999999997},"min":{"1min":0.254,"5min":0.247,"15min":0.247},"max":{"1min":43.131,"5min":43.131,"15min":43.131},"last":0.46500000000000002},{"interface":"front","average":{"1min":7.319,"5min":1.7949999999999999,"15min":0.88100000000000001},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":52.923999999999999,"5min":52.923999999999999,"15min":52.923999999999999},"last":0.40699999999999997}]},{"osd":4,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":2.7330000000000001,"5min":1.0549999999999999,"15min":0.78700000000000003},"min":{"1min":0.41599999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":16.914000000000001,"5min":16.914000000000001,"15min":16.914000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":4.056,"5min":1.2929999999999999,"15min":0.83299999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":43.078000000000003,"5min":43.078000000000003,"15min":43.078000000000003},"last":0.61899999999999999}]},{"osd":5,"last update":"Wed May 8 21:53:38 2024","interfaces":[{"interface":"back","average":{"1min":3.8370000000000002,"5min":1.28,"15min":0.86199999999999999},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":33.198,"5min":33.198,"15min":33.198},"last":0.53300000000000003},{"interface":"front","average":{"1min":1.6990000000000001,"5min":1.002,"15min":1.0169999999999999},"min":{"1min":0.48899999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":7.6139999999999999,"5min":9.2400000000000002,"15min":9.2400000000000002},"last":0.64400000000000002}]},{"osd":6,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":1.665,"5min":0.98199999999999998,"15min":0.98799999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":7.5449999999999999,"5min":9.202,"15min":9.202},"last":0.60499999999999998},{"interface":"front","average":{"1min":3.5529999999999999,"5min":1.2450000000000001,"15min":0.86899999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":33.283000000000001,"5min":33.283000000000001,"15min":33.283000000000001},"last":0.59399999999999997}]},{"osd":7,"last update":"Wed May 8 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":1.6319999999999999,"5min":0.98499999999999999,"15min":1.0049999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":7.6669999999999998,"5min":9.2249999999999996,"15min":9.2249999999999996},"last":0.52000000000000002},{"interface":"front","average":{"1min":3.2189999999999999,"5min":1.1799999999999999,"15min":0.85599999999999998},"min":{"1min":0.44400000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":16.981000000000002,"5min":16.981000000000002,"15min":16.981000000000002},"last":0.63100000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509502,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31944,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339896,"statfs":{"total":96636764160,"available":96604053504,"internally_reserved":0,"allocated":851968,"data_stored":682714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":1.6599999999999999,"5min":0.63500000000000001,"15min":0.46899999999999997},"min":{"1min":0.26100000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":27.239999999999998,"5min":27.239999999999998,"15min":27.239999999999998},"last":0.49199999999999999},{"interface":"front","average":{"1min":2.0640000000000001,"5min":0.73299999999999998,"15min":0.52500000000000002},"min":{"1min":0.26100000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":27.643000000000001,"5min":27.643000000000001,"15min":27.643000000000001},"last":0.41399999999999998}]},{"osd":2,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":1.583,"5min":0.63,"15min":0.48499999999999999},"min":{"1min":0.24299999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":25.739000000000001,"5min":25.739000000000001,"15min":25.739000000000001},"last":0.377},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.47399999999999998,"15min":0.43099999999999999},"min":{"1min":0.28000000000000003,"5min":0.253,"15min":0.253},"max":{"1min":4.9989999999999997,"5min":4.9989999999999997,"15min":4.9989999999999997},"last":0.47199999999999998}]},{"osd":3,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":1.952,"5min":0.71599999999999997,"15min":0.52200000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":13.685,"5min":13.685,"15min":13.685},"last":0.432},{"interface":"front","average":{"1min":1.8500000000000001,"5min":0.71799999999999997,"15min":0.54300000000000004},"min":{"1min":0.27400000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":28.379999999999999,"5min":28.379999999999999,"15min":28.379999999999999},"last":0.44400000000000001}]},{"osd":4,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":0.69599999999999995,"15min":0.626},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":5.6790000000000003,"5min":5.6790000000000003,"15min":5.6790000000000003},"last":0.77200000000000002},{"interface":"front","average":{"1min":1.8600000000000001,"5min":0.82499999999999996,"15min":0.64900000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":13.794,"5min":13.794,"15min":13.794},"last":0.63600000000000001}]},{"osd":5,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":1.877,"5min":0.84599999999999997,"15min":0.67200000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":13.827,"5min":13.827,"15min":13.827},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.66300000000000003,"15min":0.64900000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":4.9240000000000004,"5min":4.9240000000000004,"15min":4.9240000000000004},"last":0.748}]},{"osd":6,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":0.70999999999999996,"15min":0.65400000000000003},"min":{"1min":0.379,"5min":0.376,"15min":0.376},"max":{"1min":8.3379999999999992,"5min":8.3379999999999992,"15min":8.3379999999999992},"last":0.70599999999999996},{"interface":"front","average":{"1min":1.1359999999999999,"5min":0.70199999999999996,"15min":0.63400000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":5.6500000000000004,"5min":5.6500000000000004,"15min":5.6500000000000004},"last":0.625}]},{"osd":7,"last update":"Wed May 8 21:53:46 2024","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":0.76500000000000001,"15min":0.68000000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":9.1950000000000003,"5min":9.1950000000000003,"15min":9.1950000000000003},"last":0.73199999999999998},{"interface":"front","average":{"1min":1.8799999999999999,"5min":0.86799999999999999,"15min":0.70799999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":13.756,"5min":13.756,"15min":13.756},"last":0.76000000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509504,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31356,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340484,"statfs":{"total":96636764160,"available":96604655616,"internally_reserved":0,"allocated":249856,"data_stored":92213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:53:45 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.42199999999999999,"15min":0.34999999999999998},"min":{"1min":0.255,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":3.73,"5min":3.73,"15min":3.73},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.44,"15min":0.38200000000000001},"min":{"1min":0.27400000000000002,"5min":0.254,"15min":0.254},"max":{"1min":3.1600000000000001,"5min":3.1600000000000001,"15min":3.1600000000000001},"last":0.47799999999999998}]},{"osd":1,"last update":"Wed May 8 21:53:45 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.39600000000000002,"15min":0.36199999999999999},"min":{"1min":0.23999999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":3.1930000000000001,"5min":3.1930000000000001,"15min":3.1930000000000001},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.40100000000000002,"15min":0.375},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":2.1299999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":0.434}]},{"osd":3,"last update":"Wed May 8 21:53:45 2024","interfaces":[{"interface":"back","average":{"1min":4.0759999999999996,"5min":1.1160000000000001,"15min":0.60699999999999998},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":60.899000000000001,"5min":60.899000000000001,"15min":60.899000000000001},"last":0.34599999999999997},{"interface":"front","average":{"1min":1.1140000000000001,"5min":0.53900000000000003,"15min":0.437},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":9.7469999999999999,"5min":9.7469999999999999,"15min":9.7469999999999999},"last":0.46000000000000002}]},{"osd":4,"last update":"Wed May 8 21:53:45 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":0.69099999999999995,"15min":0.63600000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":7.8499999999999996,"5min":7.8499999999999996,"15min":7.8499999999999996},"last":0.59599999999999997},{"interface":"front","average":{"1min":1.123,"5min":0.72399999999999998,"15min":0.66000000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":8.1189999999999998,"5min":8.1189999999999998,"15min":8.1189999999999998},"last":0.58399999999999996}]},{"osd":5,"last update":"Wed May 8 21:53:45 2024","interfaces":[{"interface":"back","average":{"1min":1.462,"5min":0.77100000000000002,"15min":0.65100000000000002},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":11.326000000000001,"5min":11.326000000000001,"15min":11.326000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":1.1259999999999999,"5min":0.69199999999999995,"15min":0.628},"min":{"1min":0.375,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":7.8860000000000001,"5min":7.8860000000000001,"15min":7.8860000000000001},"last":0.65200000000000002}]},{"osd":6,"last update":"Wed May 8 21:53:45 2024","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":0.69799999999999995,"15min":0.63800000000000001},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":8.1709999999999994,"5min":8.1709999999999994,"15min":8.1709999999999994},"last":0.52100000000000002},{"interface":"front","average":{"1min":1.421,"5min":0.76700000000000002,"15min":0.66000000000000003},"min":{"1min":0.40300000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":10.41,"5min":10.41,"15min":10.41},"last":0.63400000000000001}]},{"osd":7,"last update":"Wed May 8 21:53:45 2024","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.67000000000000004,"15min":0.62},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":5.2699999999999996,"5min":5.2699999999999996,"15min":5.2699999999999996},"last":0.68400000000000005},{"interface":"front","average":{"1min":1.1679999999999999,"5min":0.72799999999999998,"15min":0.65200000000000002},"min":{"1min":0.42899999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":7.5810000000000004,"5min":7.5810000000000004,"15min":7.5810000000000004},"last":0.66500000000000004}]}]},{"osd":3,"up_from":15,"seq":64424509502,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35840,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94336000,"statfs":{"total":96636764160,"available":96600064000,"internally_reserved":0,"allocated":647168,"data_stored":480043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36043208},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:53:42 2024","interfaces":[{"interface":"back","average":{"1min":2.0739999999999998,"5min":0.69299999999999995,"15min":0.47899999999999998},"min":{"1min":0.21299999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":39.470999999999997,"5min":39.470999999999997,"15min":39.470999999999997},"last":0.49199999999999999},{"interface":"front","average":{"1min":1.9750000000000001,"5min":0.68400000000000005,"15min":0.48099999999999998},"min":{"1min":0.25700000000000001,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":32.802,"5min":32.802,"15min":32.802},"last":0.5}]},{"osd":1,"last update":"Wed May 8 21:53:42 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.38500000000000001,"15min":0.38700000000000001},"min":{"1min":0.252,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.46300000000000002},{"interface":"front","average":{"1min":2.48,"5min":0.82799999999999996,"15min":0.56399999999999995},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":43.493000000000002,"5min":43.493000000000002,"15min":43.493000000000002},"last":0.626}]},{"osd":2,"last update":"Wed May 8 21:53:42 2024","interfaces":[{"interface":"back","average":{"1min":2.4969999999999999,"5min":0.85099999999999998,"15min":0.59299999999999997},"min":{"1min":0.318,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":43.445999999999998,"5min":43.445999999999998,"15min":43.445999999999998},"last":0.56299999999999994},{"interface":"front","average":{"1min":2.3530000000000002,"5min":0.83799999999999997,"15min":0.59599999999999997},"min":{"1min":0.34499999999999997,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":39.569000000000003,"5min":39.569000000000003,"15min":39.569000000000003},"last":0.70399999999999996}]},{"osd":4,"last update":"Wed May 8 21:53:42 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.629,"15min":0.61499999999999999},"min":{"1min":0.41199999999999998,"5min":0.377,"15min":0.377},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":0.54900000000000004},{"interface":"front","average":{"1min":1.821,"5min":0.85699999999999998,"15min":0.70399999999999996},"min":{"1min":0.375,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":19.024999999999999,"5min":19.024999999999999,"15min":19.024999999999999},"last":0.65600000000000003}]},{"osd":5,"last update":"Wed May 8 21:53:42 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.63200000000000001,"15min":0.627},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.833,"5min":1.833,"15min":1.833},"last":0.59499999999999997},{"interface":"front","average":{"1min":2.0470000000000002,"5min":0.91900000000000004,"15min":0.72099999999999997},"min":{"1min":0.46700000000000003,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":27.678999999999998,"5min":27.678999999999998,"15min":27.678999999999998},"last":0.66800000000000004}]},{"osd":6,"last update":"Wed May 8 21:53:42 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.65400000000000003,"15min":0.64400000000000002},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.915,"5min":1.915,"15min":1.915},"last":0.64600000000000002},{"interface":"front","average":{"1min":2.2530000000000001,"5min":0.96299999999999997,"15min":0.77100000000000002},"min":{"1min":0.46500000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":32.655000000000001,"5min":32.655000000000001,"15min":32.655000000000001},"last":0.72999999999999998}]},{"osd":7,"last update":"Wed May 8 21:53:42 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.68700000000000006,"15min":0.66700000000000004},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":3.4089999999999998,"5min":3.4089999999999998,"15min":3.4089999999999998},"last":0.68200000000000005},{"interface":"front","average":{"1min":1.653,"5min":0.88800000000000001,"15min":0.72299999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":18.939,"5min":18.939,"15min":18.939},"last":0.61299999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509503,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31364,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340476,"statfs":{"total":96636764160,"available":96604647424,"internally_reserved":0,"allocated":258048,"data_stored":91834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:53:44 2024","interfaces":[{"interface":"back","average":{"1min":2.1030000000000002,"5min":0.82299999999999995,"15min":0.59999999999999998},"min":{"1min":0.29399999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":21.042999999999999,"5min":21.042999999999999,"15min":21.042999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":2.1970000000000001,"5min":0.874,"15min":0.65200000000000002},"min":{"1min":0.46200000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":21.478999999999999,"5min":21.478999999999999,"15min":21.478999999999999},"last":0.59899999999999998}]},{"osd":1,"last update":"Wed May 8 21:53:44 2024","interfaces":[{"interface":"back","average":{"1min":1.986,"5min":0.83699999999999997,"15min":0.63100000000000001},"min":{"1min":0.372,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":14.555999999999999,"5min":14.555999999999999,"15min":14.555999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":1.1100000000000001,"5min":0.63700000000000001,"15min":0.55500000000000005},"min":{"1min":0.40799999999999997,"5min":0.314,"15min":0.314},"max":{"1min":7.7140000000000004,"5min":7.7140000000000004,"15min":7.7140000000000004},"last":0.53200000000000003}]},{"osd":2,"last update":"Wed May 8 21:53:44 2024","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":0.69399999999999995,"15min":0.58199999999999996},"min":{"1min":0.41899999999999998,"5min":0.377,"15min":0.377},"max":{"1min":11.724,"5min":11.724,"15min":11.724},"last":0.627},{"interface":"front","average":{"1min":1.089,"5min":0.65700000000000003,"15min":0.58899999999999997},"min":{"1min":0.44600000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":4.6740000000000004,"5min":4.6740000000000004,"15min":4.6740000000000004},"last":0.60999999999999999}]},{"osd":3,"last update":"Wed May 8 21:53:44 2024","interfaces":[{"interface":"back","average":{"1min":2.4849999999999999,"5min":0.93700000000000006,"15min":0.68300000000000005},"min":{"1min":0.39400000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":30.84,"5min":30.84,"15min":30.84},"last":0.498},{"interface":"front","average":{"1min":2.0739999999999998,"5min":0.89000000000000001,"15min":0.69099999999999995},"min":{"1min":0.41499999999999998,"5min":0.37,"15min":0.37},"max":{"1min":21.754000000000001,"5min":21.754000000000001,"15min":21.754000000000001},"last":0.70099999999999996}]},{"osd":5,"last update":"Wed May 8 21:53:44 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.52200000000000002,"15min":0.51200000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":4.4660000000000002,"5min":4.4660000000000002,"15min":4.4660000000000002},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.56899999999999995,"15min":0.56599999999999995},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":5.2190000000000003,"5min":5.2190000000000003,"15min":5.2190000000000003},"last":0.68600000000000005}]},{"osd":6,"last update":"Wed May 8 21:53:44 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.61299999999999999,"15min":0.59499999999999997},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":4.9720000000000004,"5min":4.9720000000000004,"15min":4.9720000000000004},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.60599999999999998,"15min":0.60699999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":4.4100000000000001,"5min":4.4100000000000001,"15min":4.4100000000000001},"last":0.71699999999999997}]},{"osd":7,"last update":"Wed May 8 21:53:44 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.60399999999999998,"15min":0.61399999999999999},"min":{"1min":0.34699999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":4.444,"5min":4.444,"15min":4.444},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.877,"5min":0.67900000000000005,"15min":0.66100000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":5.0430000000000001,"5min":5.0430000000000001,"15min":5.0430000000000001},"last":0.77300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":388335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":397312,"data_stored":387830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T21:54:39.836 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:54:39.837 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:54:39.837 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:54:39.837 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:54:39.837 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:54:39.837 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:54:39.837 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:54:39.838 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:54:39.838 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:54:39.839 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:54:39.839 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:54:39.839 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-05-08T21:49:43.200171+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=49, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=53, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:54:39.839 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-08T21:54:50.732 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:54:50.735 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:54:59.841 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T21:54:59.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.974+0000 7f2e4629f700 1 Processor -- start 2024-05-08T21:54:59.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.974+0000 7f2e4629f700 1 -- start start 2024-05-08T21:54:59.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.975+0000 7f2e4629f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2e40153ed0 0x7f2e4006c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:54:59.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.975+0000 7f2e4629f700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2e400cb630 0x7f2e400cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:54:59.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.975+0000 7f2e4629f700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e4015e1b0 con 0x7f2e400cafc0 2024-05-08T21:54:59.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.975+0000 7f2e4629f700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e400ca930 con 0x7f2e400cb630 2024-05-08T21:54:59.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.975+0000 7f2e4629f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4006bc00 con 0x7f2e40153ed0 2024-05-08T21:54:59.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.975+0000 7f2e4483c700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f2e400cafc0 0x7f2e40159c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:59748/0 (socket says 172.21.15.73:59748) 2024-05-08T21:54:59.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.975+0000 7f2e4483c700 1 -- 172.21.15.73:0/1612963152 learned_addr learned my addr 172.21.15.73:0/1612963152 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:54:59.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.975+0000 7f2e3effd700 1 -- 172.21.15.73:0/1612963152 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 13419119 0 0) 0x7f2e4015e1b0 con 0x7f2e400cafc0 2024-05-08T21:54:59.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.975+0000 7f2e3f7fe700 1 --2- 172.21.15.73:0/1612963152 >> v2:172.21.15.115:3300/0 conn(0x7f2e400cb630 0x7f2e400cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:54:59.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.975+0000 7f2e3ffff700 1 --2- 172.21.15.73:0/1612963152 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2e40153ed0 0x7f2e4006c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:54:59.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.975+0000 7f2e3effd700 1 -- 172.21.15.73:0/1612963152 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e2c0035b0 con 0x7f2e400cafc0 2024-05-08T21:54:59.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.976+0000 7f2e3effd700 1 -- 172.21.15.73:0/1612963152 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2872356243 0 0) 0x7f2e2c0035b0 con 0x7f2e400cafc0 2024-05-08T21:54:59.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.976+0000 7f2e3effd700 1 -- 172.21.15.73:0/1612963152 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2e40153ed0 msgr2=0x7f2e4006c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:54:59.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.976+0000 7f2e3effd700 1 --2- 172.21.15.73:0/1612963152 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2e40153ed0 0x7f2e4006c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:54:59.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.976+0000 7f2e3effd700 1 -- 172.21.15.73:0/1612963152 >> v2:172.21.15.115:3300/0 conn(0x7f2e400cb630 msgr2=0x7f2e400cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:54:59.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.976+0000 7f2e3effd700 1 --2- 172.21.15.73:0/1612963152 >> v2:172.21.15.115:3300/0 conn(0x7f2e400cb630 0x7f2e400cbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:54:59.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.976+0000 7f2e3effd700 1 -- 172.21.15.73:0/1612963152 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e400cbcc0 con 0x7f2e400cafc0 2024-05-08T21:54:59.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.976+0000 7f2e3effd700 1 -- 172.21.15.73:0/1612963152 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 953298616 0 0) 0x7f2e380019f0 con 0x7f2e400cafc0 2024-05-08T21:54:59.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.976+0000 7f2e3effd700 1 -- 172.21.15.73:0/1612963152 >> v1:172.21.15.73:6789/0 conn(0x7f2e400cafc0 legacy=0x7f2e40159c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:54:59.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.976+0000 7f2e3effd700 1 --2- 172.21.15.73:0/1612963152 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e2c003a00 0x7f2e2c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:54:59.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.976+0000 7f2e3effd700 1 --2- 172.21.15.73:0/1612963152 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2e40153ed0 0x7f2e2c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:54:59.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.976+0000 7f2e3effd700 1 --2- 172.21.15.73:0/1612963152 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2e2c004d90 0x7f2e2c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:54:59.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.976+0000 7f2e3effd700 1 -- 172.21.15.73:0/1612963152 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e400ca930 con 0x7f2e2c004d90 2024-05-08T21:54:59.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.976+0000 7f2e3effd700 1 -- 172.21.15.73:0/1612963152 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4006bc00 con 0x7f2e2c003a00 2024-05-08T21:54:59.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.976+0000 7f2e3effd700 1 -- 172.21.15.73:0/1612963152 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2c00ba10 con 0x7f2e40153ed0 2024-05-08T21:54:59.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.976+0000 7f2e4483c700 1 --2- 172.21.15.73:0/1612963152 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2e2c004d90 0x7f2e2c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:54:59.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.976+0000 7f2e3ffff700 1 --2- 172.21.15.73:0/1612963152 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e2c003a00 0x7f2e2c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:54:59.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.976+0000 7f2e3f7fe700 1 --2- 172.21.15.73:0/1612963152 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2e40153ed0 0x7f2e2c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:54:59.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.976+0000 7f2e4483c700 1 -- 172.21.15.73:0/1612963152 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2e40153ed0 msgr2=0x7f2e2c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:54:59.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.976+0000 7f2e4483c700 1 --2- 172.21.15.73:0/1612963152 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2e40153ed0 0x7f2e2c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:54:59.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.976+0000 7f2e4483c700 1 -- 172.21.15.73:0/1612963152 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e2c003a00 msgr2=0x7f2e2c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:54:59.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.976+0000 7f2e4483c700 1 --2- 172.21.15.73:0/1612963152 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e2c003a00 0x7f2e2c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:54:59.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.976+0000 7f2e4483c700 1 -- 172.21.15.73:0/1612963152 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e2c0035b0 con 0x7f2e2c004d90 2024-05-08T21:54:59.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.976+0000 7f2e4483c700 1 --2- 172.21.15.73:0/1612963152 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2e2c004d90 0x7f2e2c005210 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f2e3800a810 tx=0x7f2e2c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23336d2a7dbaf531 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:54:59.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.977+0000 7f2e3effd700 1 -- 172.21.15.73:0/1612963152 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e38012600 con 0x7f2e2c004d90 2024-05-08T21:54:59.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.977+0000 7f2e3effd700 1 -- 172.21.15.73:0/1612963152 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e38012760 con 0x7f2e2c004d90 2024-05-08T21:54:59.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.977+0000 7f2e3effd700 1 -- 172.21.15.73:0/1612963152 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e38012af0 con 0x7f2e2c004d90 2024-05-08T21:54:59.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.977+0000 7f2e4629f700 1 -- 172.21.15.73:0/1612963152 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2e2c004d90 msgr2=0x7f2e2c005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:54:59.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.977+0000 7f2e4629f700 1 --2- 172.21.15.73:0/1612963152 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2e2c004d90 0x7f2e2c005210 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f2e3800a810 tx=0x7f2e2c005880 comp rx=0 tx=0).stop 2024-05-08T21:54:59.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.977+0000 7f2e4483c700 1 -- 172.21.15.73:0/1612963152 reap_dead start 2024-05-08T21:54:59.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.977+0000 7f2e4629f700 1 -- 172.21.15.73:0/1612963152 shutdown_connections 2024-05-08T21:54:59.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.977+0000 7f2e4629f700 1 -- 172.21.15.73:0/1612963152 >> 172.21.15.73:0/1612963152 conn(0x7f2e400666c0 msgr2=0x7f2e40066ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:54:59.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.977+0000 7f2e4629f700 1 -- 172.21.15.73:0/1612963152 shutdown_connections 2024-05-08T21:54:59.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.977+0000 7f2e4629f700 1 -- 172.21.15.73:0/1612963152 wait complete. 2024-05-08T21:54:59.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.978+0000 7f2e4629f700 1 Processor -- start 2024-05-08T21:54:59.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.979+0000 7f2e4629f700 1 -- start start 2024-05-08T21:54:59.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.979+0000 7f2e4629f700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e4015d850 0x7f2e401441f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:54:59.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.979+0000 7f2e4629f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2e4015dc30 0x7f2e40144730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:54:59.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.979+0000 7f2e4629f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2e4015ae10 0x7f2e400c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:54:59.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.979+0000 7f2e4629f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4015b510 con 0x7f2e4015ae10 2024-05-08T21:54:59.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.979+0000 7f2e4629f700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4015ba00 con 0x7f2e4015d850 2024-05-08T21:54:59.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.979+0000 7f2e4629f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e401e5fc0 con 0x7f2e4015dc30 2024-05-08T21:54:59.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.979+0000 7f2e4483c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2e4015ae10 0x7f2e400c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:54:59.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.979+0000 7f2e4483c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2e4015ae10 0x7f2e400c8c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42038/0 (socket says 172.21.15.73:42038) 2024-05-08T21:54:59.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.979+0000 7f2e4483c700 1 -- 172.21.15.73:0/1908813146 learned_addr learned my addr 172.21.15.73:0/1908813146 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:54:59.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.980+0000 7f2e3ffff700 1 --2- 172.21.15.73:0/1908813146 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e4015d850 0x7f2e401441f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:54:59.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.980+0000 7f2e3f7fe700 1 --2- 172.21.15.73:0/1908813146 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2e4015dc30 0x7f2e40144730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:54:59.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.980+0000 7f2e4483c700 1 -- 172.21.15.73:0/1908813146 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2e4015dc30 msgr2=0x7f2e40144730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:54:59.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.980+0000 7f2e4483c700 1 --2- 172.21.15.73:0/1908813146 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2e4015dc30 0x7f2e40144730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:54:59.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.980+0000 7f2e4483c700 1 -- 172.21.15.73:0/1908813146 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e4015d850 msgr2=0x7f2e401441f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:54:59.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.980+0000 7f2e4483c700 1 --2- 172.21.15.73:0/1908813146 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e4015d850 0x7f2e401441f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:54:59.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.980+0000 7f2e4483c700 1 -- 172.21.15.73:0/1908813146 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e400c69b0 con 0x7f2e4015ae10 2024-05-08T21:54:59.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.980+0000 7f2e4483c700 1 --2- 172.21.15.73:0/1908813146 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2e4015ae10 0x7f2e400c8c10 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f2e38015040 tx=0x7f2e400b3470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:54:59.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.980+0000 7f2e3cff9700 1 -- 172.21.15.73:0/1908813146 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e380019c0 con 0x7f2e4015ae10 2024-05-08T21:54:59.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.980+0000 7f2e3cff9700 1 -- 172.21.15.73:0/1908813146 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e3800a280 con 0x7f2e4015ae10 2024-05-08T21:54:59.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.980+0000 7f2e4629f700 1 -- 172.21.15.73:0/1908813146 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e4015b720 con 0x7f2e4015ae10 2024-05-08T21:54:59.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.980+0000 7f2e3cff9700 1 -- 172.21.15.73:0/1908813146 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e38027650 con 0x7f2e4015ae10 2024-05-08T21:54:59.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.980+0000 7f2e4629f700 1 -- 172.21.15.73:0/1908813146 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e400c86f0 con 0x7f2e4015ae10 2024-05-08T21:54:59.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.981+0000 7f2e4629f700 1 -- 172.21.15.73:0/1908813146 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e40151990 con 0x7f2e4015ae10 2024-05-08T21:54:59.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.981+0000 7f2e3cff9700 1 -- 172.21.15.73:0/1908813146 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2e38019070 con 0x7f2e4015ae10 2024-05-08T21:54:59.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.982+0000 7f2e3cff9700 1 --2- 172.21.15.73:0/1908813146 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f2e2006ac90 0x7f2e2006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:54:59.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.982+0000 7f2e3cff9700 1 -- 172.21.15.73:0/1908813146 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5969+0+0 (secure 0 0 0) 0x7f2e3808a570 con 0x7f2e4015ae10 2024-05-08T21:54:59.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.982+0000 7f2e3ffff700 1 --2- 172.21.15.73:0/1908813146 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f2e2006ac90 0x7f2e2006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:54:59.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.982+0000 7f2e3ffff700 1 --2- 172.21.15.73:0/1908813146 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f2e2006ac90 0x7f2e2006d150 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2e28009b20 tx=0x7f2e28008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:54:59.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:54:59.986+0000 7f2e3cff9700 1 -- 172.21.15.73:0/1908813146 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f2e38055650 con 0x7f2e4015ae10 2024-05-08T21:55:00.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.180+0000 7f2e4629f700 1 -- 172.21.15.73:0/1908813146 --> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2e40152c80 con 0x7f2e2006ac90 2024-05-08T21:55:00.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.188+0000 7f2e3cff9700 1 -- 172.21.15.73:0/1908813146 <== mgr.4104 v2:172.21.15.73:6832/46949 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+292291 (secure 0 0 0) 0x7f2e40152c80 con 0x7f2e2006ac90 2024-05-08T21:55:00.192 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:55:00.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.192+0000 7f2e4629f700 1 -- 172.21.15.73:0/1908813146 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f2e2006ac90 msgr2=0x7f2e2006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:55:00.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.192+0000 7f2e4629f700 1 --2- 172.21.15.73:0/1908813146 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f2e2006ac90 0x7f2e2006d150 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2e28009b20 tx=0x7f2e28008040 comp rx=0 tx=0).stop 2024-05-08T21:55:00.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.192+0000 7f2e4629f700 1 -- 172.21.15.73:0/1908813146 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2e4015ae10 msgr2=0x7f2e400c8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:55:00.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.192+0000 7f2e4629f700 1 --2- 172.21.15.73:0/1908813146 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2e4015ae10 0x7f2e400c8c10 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f2e38015040 tx=0x7f2e400b3470 comp rx=0 tx=0).stop 2024-05-08T21:55:00.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.192+0000 7f2e4629f700 1 -- 172.21.15.73:0/1908813146 shutdown_connections 2024-05-08T21:55:00.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.192+0000 7f2e4629f700 1 --2- 172.21.15.73:0/1908813146 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f2e2006ac90 0x7f2e2006d150 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:00.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.192+0000 7f2e4629f700 1 --2- 172.21.15.73:0/1908813146 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2e4015ae10 0x7f2e400c8c10 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:00.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.192+0000 7f2e4629f700 1 --2- 172.21.15.73:0/1908813146 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e4015d850 0x7f2e401441f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:00.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.192+0000 7f2e4629f700 1 --2- 172.21.15.73:0/1908813146 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2e4015dc30 0x7f2e40144730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:00.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.192+0000 7f2e4629f700 1 -- 172.21.15.73:0/1908813146 >> 172.21.15.73:0/1908813146 conn(0x7f2e400666c0 msgr2=0x7f2e400cbf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:55:00.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.192+0000 7f2e4629f700 1 -- 172.21.15.73:0/1908813146 shutdown_connections 2024-05-08T21:55:00.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.192+0000 7f2e4629f700 1 -- 172.21.15.73:0/1908813146 wait complete. 2024-05-08T21:55:00.195 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-05-08T21:55:00.204 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":179,"stamp":"2024-05-08T21:55:00.034715+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":979501,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":200,"num_read_kb":192,"num_write":9635,"num_write_kb":25168801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11644,"ondisk_log_size":11644,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":260992,"kb_used_data":3904,"kb_used_omap":12,"kb_used_meta":257011,"kb_avail":754713728,"statfs":{"total":773094113280,"available":772826857472,"internally_reserved":0,"allocated":3997696,"data_stored":2692666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":263179834},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002760"},"pg_stats":[{"pgid":"3.3f","version":"24'167","reported_seq":194,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:38.316408+0000","last_change":"2024-05-08T21:54:38.316517+0000","last_active":"2024-05-08T21:54:38.316408+0000","last_peered":"2024-05-08T21:54:38.316408+0000","last_clean":"2024-05-08T21:54:38.316408+0000","last_became_active":"2024-05-08T21:49:43.775657+0000","last_became_peered":"2024-05-08T21:49:43.775657+0000","last_unstale":"2024-05-08T21:54:38.316408+0000","last_undegraded":"2024-05-08T21:54:38.316408+0000","last_fullsized":"2024-05-08T21:54:38.316408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'167","last_scrub_stamp":"2024-05-08T21:54:38.316381+0000","last_deep_scrub":"24'167","last_deep_scrub_stamp":"2024-05-08T21:54:38.316381+0000","last_clean_scrub_stamp":"2024-05-08T21:54:38.316381+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:33:03.804514+0000","scrub_duration":0.0021774569999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"24'152","reported_seq":179,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:36.116002+0000","last_change":"2024-05-08T21:54:36.116135+0000","last_active":"2024-05-08T21:54:36.116002+0000","last_peered":"2024-05-08T21:54:36.116002+0000","last_clean":"2024-05-08T21:54:36.116002+0000","last_became_active":"2024-05-08T21:49:43.765995+0000","last_became_peered":"2024-05-08T21:49:43.765995+0000","last_unstale":"2024-05-08T21:54:36.116002+0000","last_undegraded":"2024-05-08T21:54:36.116002+0000","last_fullsized":"2024-05-08T21:54:36.116002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'152","last_scrub_stamp":"2024-05-08T21:54:36.115975+0000","last_deep_scrub":"24'152","last_deep_scrub_stamp":"2024-05-08T21:54:36.115975+0000","last_clean_scrub_stamp":"2024-05-08T21:54:36.115975+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:12:10.738847+0000","scrub_duration":0.0040263699999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"24'178","reported_seq":205,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:07.675725+0000","last_change":"2024-05-08T21:54:07.675848+0000","last_active":"2024-05-08T21:54:07.675725+0000","last_peered":"2024-05-08T21:54:07.675725+0000","last_clean":"2024-05-08T21:54:07.675725+0000","last_became_active":"2024-05-08T21:49:43.765874+0000","last_became_peered":"2024-05-08T21:49:43.765874+0000","last_unstale":"2024-05-08T21:54:07.675725+0000","last_undegraded":"2024-05-08T21:54:07.675725+0000","last_fullsized":"2024-05-08T21:54:07.675725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'178","last_scrub_stamp":"2024-05-08T21:54:07.675698+0000","last_deep_scrub":"24'178","last_deep_scrub_stamp":"2024-05-08T21:54:07.675698+0000","last_clean_scrub_stamp":"2024-05-08T21:54:07.675698+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:56:49.033245+0000","scrub_duration":0.002959854,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"24'193","reported_seq":220,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:35.493818+0000","last_change":"2024-05-08T21:54:35.493951+0000","last_active":"2024-05-08T21:54:35.493818+0000","last_peered":"2024-05-08T21:54:35.493818+0000","last_clean":"2024-05-08T21:54:35.493818+0000","last_became_active":"2024-05-08T21:49:43.765507+0000","last_became_peered":"2024-05-08T21:49:43.765507+0000","last_unstale":"2024-05-08T21:54:35.493818+0000","last_undegraded":"2024-05-08T21:54:35.493818+0000","last_fullsized":"2024-05-08T21:54:35.493818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'193","last_scrub_stamp":"2024-05-08T21:54:35.493789+0000","last_deep_scrub":"24'193","last_deep_scrub_stamp":"2024-05-08T21:54:35.493789+0000","last_clean_scrub_stamp":"2024-05-08T21:54:35.493789+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:15:19.292276+0000","scrub_duration":0.0041280070000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"24'174","reported_seq":198,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:39.165930+0000","last_change":"2024-05-08T21:54:39.166070+0000","last_active":"2024-05-08T21:54:39.165930+0000","last_peered":"2024-05-08T21:54:39.165930+0000","last_clean":"2024-05-08T21:54:39.165930+0000","last_became_active":"2024-05-08T21:50:33.103943+0000","last_became_peered":"2024-05-08T21:50:33.103943+0000","last_unstale":"2024-05-08T21:54:39.165930+0000","last_undegraded":"2024-05-08T21:54:39.165930+0000","last_fullsized":"2024-05-08T21:54:39.165930+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'174","last_scrub_stamp":"2024-05-08T21:54:39.165907+0000","last_deep_scrub":"24'174","last_deep_scrub_stamp":"2024-05-08T21:54:39.165907+0000","last_clean_scrub_stamp":"2024-05-08T21:54:39.165907+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:15:22.964395+0000","scrub_duration":0.0026400239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"24'162","reported_seq":189,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:47.450630+0000","last_change":"2024-05-08T21:54:47.450630+0000","last_active":"2024-05-08T21:54:47.450630+0000","last_peered":"2024-05-08T21:54:47.450630+0000","last_clean":"2024-05-08T21:54:47.450630+0000","last_became_active":"2024-05-08T21:49:43.770893+0000","last_became_peered":"2024-05-08T21:49:43.770893+0000","last_unstale":"2024-05-08T21:54:47.450630+0000","last_undegraded":"2024-05-08T21:54:47.450630+0000","last_fullsized":"2024-05-08T21:54:47.450630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'162","last_scrub_stamp":"2024-05-08T21:54:47.450486+0000","last_deep_scrub":"24'162","last_deep_scrub_stamp":"2024-05-08T21:54:47.450486+0000","last_clean_scrub_stamp":"2024-05-08T21:54:47.450486+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:58.565562+0000","scrub_duration":0.0041497770000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"24'188","reported_seq":215,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:40.231511+0000","last_change":"2024-05-08T21:54:40.231511+0000","last_active":"2024-05-08T21:54:40.231511+0000","last_peered":"2024-05-08T21:54:40.231511+0000","last_clean":"2024-05-08T21:54:40.231511+0000","last_became_active":"2024-05-08T21:49:43.769667+0000","last_became_peered":"2024-05-08T21:49:43.769667+0000","last_unstale":"2024-05-08T21:54:40.231511+0000","last_undegraded":"2024-05-08T21:54:40.231511+0000","last_fullsized":"2024-05-08T21:54:40.231511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'188","last_scrub_stamp":"2024-05-08T21:54:40.231338+0000","last_deep_scrub":"24'188","last_deep_scrub_stamp":"2024-05-08T21:54:40.231338+0000","last_clean_scrub_stamp":"2024-05-08T21:54:40.231338+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:06:52.717763+0000","scrub_duration":0.0037320460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"24'204","reported_seq":231,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:35.163589+0000","last_change":"2024-05-08T21:54:35.163589+0000","last_active":"2024-05-08T21:54:35.163589+0000","last_peered":"2024-05-08T21:54:35.163589+0000","last_clean":"2024-05-08T21:54:35.163589+0000","last_became_active":"2024-05-08T21:49:43.770912+0000","last_became_peered":"2024-05-08T21:49:43.770912+0000","last_unstale":"2024-05-08T21:54:35.163589+0000","last_undegraded":"2024-05-08T21:54:35.163589+0000","last_fullsized":"2024-05-08T21:54:35.163589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'204","last_scrub_stamp":"2024-05-08T21:54:35.163438+0000","last_deep_scrub":"24'204","last_deep_scrub_stamp":"2024-05-08T21:54:35.163438+0000","last_clean_scrub_stamp":"2024-05-08T21:54:35.163438+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:53:57.209426+0000","scrub_duration":0.0046565479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":483328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"24'178","reported_seq":213,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:34.221515+0000","last_change":"2024-05-08T21:54:34.221515+0000","last_active":"2024-05-08T21:54:34.221515+0000","last_peered":"2024-05-08T21:54:34.221515+0000","last_clean":"2024-05-08T21:54:34.221515+0000","last_became_active":"2024-05-08T21:50:33.106142+0000","last_became_peered":"2024-05-08T21:50:33.106142+0000","last_unstale":"2024-05-08T21:54:34.221515+0000","last_undegraded":"2024-05-08T21:54:34.221515+0000","last_fullsized":"2024-05-08T21:54:34.221515+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'178","last_scrub_stamp":"2024-05-08T21:54:34.221364+0000","last_deep_scrub":"24'178","last_deep_scrub_stamp":"2024-05-08T21:54:34.221364+0000","last_clean_scrub_stamp":"2024-05-08T21:54:34.221364+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:19:40.524754+0000","scrub_duration":0.0030355920000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"24'190","reported_seq":217,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:30.620814+0000","last_change":"2024-05-08T21:54:30.620814+0000","last_active":"2024-05-08T21:54:30.620814+0000","last_peered":"2024-05-08T21:54:30.620814+0000","last_clean":"2024-05-08T21:54:30.620814+0000","last_became_active":"2024-05-08T21:49:43.772505+0000","last_became_peered":"2024-05-08T21:49:43.772505+0000","last_unstale":"2024-05-08T21:54:30.620814+0000","last_undegraded":"2024-05-08T21:54:30.620814+0000","last_fullsized":"2024-05-08T21:54:30.620814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'190","last_scrub_stamp":"2024-05-08T21:54:30.620675+0000","last_deep_scrub":"24'190","last_deep_scrub_stamp":"2024-05-08T21:54:30.620675+0000","last_clean_scrub_stamp":"2024-05-08T21:54:30.620675+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:44:25.504008+0000","scrub_duration":0.0035011619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"24'214","reported_seq":241,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:10.739319+0000","last_change":"2024-05-08T21:54:10.739319+0000","last_active":"2024-05-08T21:54:10.739319+0000","last_peered":"2024-05-08T21:54:10.739319+0000","last_clean":"2024-05-08T21:54:10.739319+0000","last_became_active":"2024-05-08T21:49:43.771457+0000","last_became_peered":"2024-05-08T21:49:43.771457+0000","last_unstale":"2024-05-08T21:54:10.739319+0000","last_undegraded":"2024-05-08T21:54:10.739319+0000","last_fullsized":"2024-05-08T21:54:10.739319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'214","last_scrub_stamp":"2024-05-08T21:54:10.739166+0000","last_deep_scrub":"24'214","last_deep_scrub_stamp":"2024-05-08T21:54:10.739166+0000","last_clean_scrub_stamp":"2024-05-08T21:54:10.739166+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:05:25.395957+0000","scrub_duration":0.0033296089999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"24'166","reported_seq":193,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:05.271747+0000","last_change":"2024-05-08T21:54:05.271747+0000","last_active":"2024-05-08T21:54:05.271747+0000","last_peered":"2024-05-08T21:54:05.271747+0000","last_clean":"2024-05-08T21:54:05.271747+0000","last_became_active":"2024-05-08T21:49:43.763986+0000","last_became_peered":"2024-05-08T21:49:43.763986+0000","last_unstale":"2024-05-08T21:54:05.271747+0000","last_undegraded":"2024-05-08T21:54:05.271747+0000","last_fullsized":"2024-05-08T21:54:05.271747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'166","last_scrub_stamp":"2024-05-08T21:54:05.271586+0000","last_deep_scrub":"24'166","last_deep_scrub_stamp":"2024-05-08T21:54:05.271586+0000","last_clean_scrub_stamp":"2024-05-08T21:54:05.271586+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:38:55.915259+0000","scrub_duration":0.0044053850000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"24'177","reported_seq":204,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:12.015093+0000","last_change":"2024-05-08T21:54:12.015093+0000","last_active":"2024-05-08T21:54:12.015093+0000","last_peered":"2024-05-08T21:54:12.015093+0000","last_clean":"2024-05-08T21:54:12.015093+0000","last_became_active":"2024-05-08T21:49:43.760874+0000","last_became_peered":"2024-05-08T21:49:43.760874+0000","last_unstale":"2024-05-08T21:54:12.015093+0000","last_undegraded":"2024-05-08T21:54:12.015093+0000","last_fullsized":"2024-05-08T21:54:12.015093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'177","last_scrub_stamp":"2024-05-08T21:54:12.014952+0000","last_deep_scrub":"24'177","last_deep_scrub_stamp":"2024-05-08T21:54:12.014952+0000","last_clean_scrub_stamp":"2024-05-08T21:54:12.014952+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:31:09.163282+0000","scrub_duration":0.0037380849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"24'172","reported_seq":199,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:16.692972+0000","last_change":"2024-05-08T21:54:16.692972+0000","last_active":"2024-05-08T21:54:16.692972+0000","last_peered":"2024-05-08T21:54:16.692972+0000","last_clean":"2024-05-08T21:54:16.692972+0000","last_became_active":"2024-05-08T21:49:43.765566+0000","last_became_peered":"2024-05-08T21:49:43.765566+0000","last_unstale":"2024-05-08T21:54:16.692972+0000","last_undegraded":"2024-05-08T21:54:16.692972+0000","last_fullsized":"2024-05-08T21:54:16.692972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'172","last_scrub_stamp":"2024-05-08T21:54:16.692825+0000","last_deep_scrub":"24'172","last_deep_scrub_stamp":"2024-05-08T21:54:16.692825+0000","last_clean_scrub_stamp":"2024-05-08T21:54:16.692825+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:31:13.841155+0000","scrub_duration":0.0040346499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"24'177","reported_seq":204,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:37.165493+0000","last_change":"2024-05-08T21:54:37.165613+0000","last_active":"2024-05-08T21:54:37.165493+0000","last_peered":"2024-05-08T21:54:37.165493+0000","last_clean":"2024-05-08T21:54:37.165493+0000","last_became_active":"2024-05-08T21:49:43.764810+0000","last_became_peered":"2024-05-08T21:49:43.764810+0000","last_unstale":"2024-05-08T21:54:37.165493+0000","last_undegraded":"2024-05-08T21:54:37.165493+0000","last_fullsized":"2024-05-08T21:54:37.165493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'177","last_scrub_stamp":"2024-05-08T21:54:37.165467+0000","last_deep_scrub":"24'177","last_deep_scrub_stamp":"2024-05-08T21:54:37.165467+0000","last_clean_scrub_stamp":"2024-05-08T21:54:37.165467+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:09:57.234184+0000","scrub_duration":0.0042111090000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"24'162","reported_seq":189,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:42.473176+0000","last_change":"2024-05-08T21:54:42.473312+0000","last_active":"2024-05-08T21:54:42.473176+0000","last_peered":"2024-05-08T21:54:42.473176+0000","last_clean":"2024-05-08T21:54:42.473176+0000","last_became_active":"2024-05-08T21:49:43.766427+0000","last_became_peered":"2024-05-08T21:49:43.766427+0000","last_unstale":"2024-05-08T21:54:42.473176+0000","last_undegraded":"2024-05-08T21:54:42.473176+0000","last_fullsized":"2024-05-08T21:54:42.473176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'162","last_scrub_stamp":"2024-05-08T21:54:42.473148+0000","last_deep_scrub":"24'162","last_deep_scrub_stamp":"2024-05-08T21:54:42.473148+0000","last_clean_scrub_stamp":"2024-05-08T21:54:42.473148+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:32:20.073931+0000","scrub_duration":0.0047572659999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"24'176","reported_seq":203,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:19.568252+0000","last_change":"2024-05-08T21:54:19.568252+0000","last_active":"2024-05-08T21:54:19.568252+0000","last_peered":"2024-05-08T21:54:19.568252+0000","last_clean":"2024-05-08T21:54:19.568252+0000","last_became_active":"2024-05-08T21:49:43.776509+0000","last_became_peered":"2024-05-08T21:49:43.776509+0000","last_unstale":"2024-05-08T21:54:19.568252+0000","last_undegraded":"2024-05-08T21:54:19.568252+0000","last_fullsized":"2024-05-08T21:54:19.568252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'176","last_scrub_stamp":"2024-05-08T21:54:19.568081+0000","last_deep_scrub":"24'176","last_deep_scrub_stamp":"2024-05-08T21:54:19.568081+0000","last_clean_scrub_stamp":"2024-05-08T21:54:19.568081+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:59:23.480500+0000","scrub_duration":0.0027818550000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"24'179","reported_seq":206,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:10.057071+0000","last_change":"2024-05-08T21:54:10.057071+0000","last_active":"2024-05-08T21:54:10.057071+0000","last_peered":"2024-05-08T21:54:10.057071+0000","last_clean":"2024-05-08T21:54:10.057071+0000","last_became_active":"2024-05-08T21:49:43.762237+0000","last_became_peered":"2024-05-08T21:49:43.762237+0000","last_unstale":"2024-05-08T21:54:10.057071+0000","last_undegraded":"2024-05-08T21:54:10.057071+0000","last_fullsized":"2024-05-08T21:54:10.057071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'179","last_scrub_stamp":"2024-05-08T21:54:10.056922+0000","last_deep_scrub":"24'179","last_deep_scrub_stamp":"2024-05-08T21:54:10.056922+0000","last_clean_scrub_stamp":"2024-05-08T21:54:10.056922+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:12:15.674986+0000","scrub_duration":0.003987684,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"24'205","reported_seq":232,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:32.143883+0000","last_change":"2024-05-08T21:54:32.144005+0000","last_active":"2024-05-08T21:54:32.143883+0000","last_peered":"2024-05-08T21:54:32.143883+0000","last_clean":"2024-05-08T21:54:32.143883+0000","last_became_active":"2024-05-08T21:49:43.774450+0000","last_became_peered":"2024-05-08T21:49:43.774450+0000","last_unstale":"2024-05-08T21:54:32.143883+0000","last_undegraded":"2024-05-08T21:54:32.143883+0000","last_fullsized":"2024-05-08T21:54:32.143883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'205","last_scrub_stamp":"2024-05-08T21:54:32.143843+0000","last_deep_scrub":"24'205","last_deep_scrub_stamp":"2024-05-08T21:54:32.143843+0000","last_clean_scrub_stamp":"2024-05-08T21:54:32.143843+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:37:36.108788+0000","scrub_duration":0.0039636029999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"24'7","reported_seq":37,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:58.756471+0000","last_change":"2024-05-08T21:53:58.756585+0000","last_active":"2024-05-08T21:53:58.756471+0000","last_peered":"2024-05-08T21:53:58.756471+0000","last_clean":"2024-05-08T21:53:58.756471+0000","last_became_active":"2024-05-08T21:49:43.219161+0000","last_became_peered":"2024-05-08T21:49:43.219161+0000","last_unstale":"2024-05-08T21:53:58.756471+0000","last_undegraded":"2024-05-08T21:53:58.756471+0000","last_fullsized":"2024-05-08T21:53:58.756471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'7","last_scrub_stamp":"2024-05-08T21:53:58.756448+0000","last_deep_scrub":"24'7","last_deep_scrub_stamp":"2024-05-08T21:53:58.756448+0000","last_clean_scrub_stamp":"2024-05-08T21:53:58.756448+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:46:56.777485+0000","scrub_duration":0.0058782679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"24'181","reported_seq":208,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:30.112991+0000","last_change":"2024-05-08T21:54:30.113170+0000","last_active":"2024-05-08T21:54:30.112991+0000","last_peered":"2024-05-08T21:54:30.112991+0000","last_clean":"2024-05-08T21:54:30.112991+0000","last_became_active":"2024-05-08T21:49:43.764045+0000","last_became_peered":"2024-05-08T21:49:43.764045+0000","last_unstale":"2024-05-08T21:54:30.112991+0000","last_undegraded":"2024-05-08T21:54:30.112991+0000","last_fullsized":"2024-05-08T21:54:30.112991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'181","last_scrub_stamp":"2024-05-08T21:54:30.112949+0000","last_deep_scrub":"24'181","last_deep_scrub_stamp":"2024-05-08T21:54:30.112949+0000","last_clean_scrub_stamp":"2024-05-08T21:54:30.112949+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:22:04.449694+0000","scrub_duration":0.0047377349999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'2","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:03.976354+0000","last_change":"2024-05-08T21:54:03.976461+0000","last_active":"2024-05-08T21:54:03.976354+0000","last_peered":"2024-05-08T21:54:03.976354+0000","last_clean":"2024-05-08T21:54:03.976354+0000","last_became_active":"2024-05-08T21:49:43.221309+0000","last_became_peered":"2024-05-08T21:49:43.221309+0000","last_unstale":"2024-05-08T21:54:03.976354+0000","last_undegraded":"2024-05-08T21:54:03.976354+0000","last_fullsized":"2024-05-08T21:54:03.976354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'2","last_scrub_stamp":"2024-05-08T21:54:03.976327+0000","last_deep_scrub":"24'2","last_deep_scrub_stamp":"2024-05-08T21:54:03.976327+0000","last_clean_scrub_stamp":"2024-05-08T21:54:03.976327+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:57:35.011981+0000","scrub_duration":0.0018723979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"24'160","reported_seq":187,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:29.584442+0000","last_change":"2024-05-08T21:54:29.584614+0000","last_active":"2024-05-08T21:54:29.584442+0000","last_peered":"2024-05-08T21:54:29.584442+0000","last_clean":"2024-05-08T21:54:29.584442+0000","last_became_active":"2024-05-08T21:49:43.771295+0000","last_became_peered":"2024-05-08T21:49:43.771295+0000","last_unstale":"2024-05-08T21:54:29.584442+0000","last_undegraded":"2024-05-08T21:54:29.584442+0000","last_fullsized":"2024-05-08T21:54:29.584442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'160","last_scrub_stamp":"2024-05-08T21:54:29.584397+0000","last_deep_scrub":"24'160","last_deep_scrub_stamp":"2024-05-08T21:54:29.584397+0000","last_clean_scrub_stamp":"2024-05-08T21:54:29.584397+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:22:03.921142+0000","scrub_duration":0.0027834410000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"24'4","reported_seq":34,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:15.023966+0000","last_change":"2024-05-08T21:54:15.023966+0000","last_active":"2024-05-08T21:54:15.023966+0000","last_peered":"2024-05-08T21:54:15.023966+0000","last_clean":"2024-05-08T21:54:15.023966+0000","last_became_active":"2024-05-08T21:49:43.226284+0000","last_became_peered":"2024-05-08T21:49:43.226284+0000","last_unstale":"2024-05-08T21:54:15.023966+0000","last_undegraded":"2024-05-08T21:54:15.023966+0000","last_fullsized":"2024-05-08T21:54:15.023966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'4","last_scrub_stamp":"2024-05-08T21:54:15.023799+0000","last_deep_scrub":"24'4","last_deep_scrub_stamp":"2024-05-08T21:54:15.023799+0000","last_clean_scrub_stamp":"2024-05-08T21:54:15.023799+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:31.876453+0000","scrub_duration":0.0029006930000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"24'162","reported_seq":189,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:46.405515+0000","last_change":"2024-05-08T21:54:46.405515+0000","last_active":"2024-05-08T21:54:46.405515+0000","last_peered":"2024-05-08T21:54:46.405515+0000","last_clean":"2024-05-08T21:54:46.405515+0000","last_became_active":"2024-05-08T21:49:43.766079+0000","last_became_peered":"2024-05-08T21:49:43.766079+0000","last_unstale":"2024-05-08T21:54:46.405515+0000","last_undegraded":"2024-05-08T21:54:46.405515+0000","last_fullsized":"2024-05-08T21:54:46.405515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'162","last_scrub_stamp":"2024-05-08T21:54:46.405379+0000","last_deep_scrub":"24'162","last_deep_scrub_stamp":"2024-05-08T21:54:46.405379+0000","last_clean_scrub_stamp":"2024-05-08T21:54:46.405379+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:19:15.068980+0000","scrub_duration":0.0040805490000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"24'3","reported_seq":33,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:08.965385+0000","last_change":"2024-05-08T21:54:08.965385+0000","last_active":"2024-05-08T21:54:08.965385+0000","last_peered":"2024-05-08T21:54:08.965385+0000","last_clean":"2024-05-08T21:54:08.965385+0000","last_became_active":"2024-05-08T21:49:43.229891+0000","last_became_peered":"2024-05-08T21:49:43.229891+0000","last_unstale":"2024-05-08T21:54:08.965385+0000","last_undegraded":"2024-05-08T21:54:08.965385+0000","last_fullsized":"2024-05-08T21:54:08.965385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'3","last_scrub_stamp":"2024-05-08T21:54:08.965240+0000","last_deep_scrub":"24'3","last_deep_scrub_stamp":"2024-05-08T21:54:08.965240+0000","last_clean_scrub_stamp":"2024-05-08T21:54:08.965240+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:25:07.591586+0000","scrub_duration":0.0027495779999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"24'205","reported_seq":229,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:17.083467+0000","last_change":"2024-05-08T21:54:17.083611+0000","last_active":"2024-05-08T21:54:17.083467+0000","last_peered":"2024-05-08T21:54:17.083467+0000","last_clean":"2024-05-08T21:54:17.083467+0000","last_became_active":"2024-05-08T21:50:33.112776+0000","last_became_peered":"2024-05-08T21:50:33.112776+0000","last_unstale":"2024-05-08T21:54:17.083467+0000","last_undegraded":"2024-05-08T21:54:17.083467+0000","last_fullsized":"2024-05-08T21:54:17.083467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'205","last_scrub_stamp":"2024-05-08T21:54:17.083439+0000","last_deep_scrub":"24'205","last_deep_scrub_stamp":"2024-05-08T21:54:17.083439+0000","last_clean_scrub_stamp":"2024-05-08T21:54:17.083439+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:18:45.512107+0000","scrub_duration":0.0041864329999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":458752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"24'2","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:01.895201+0000","last_change":"2024-05-08T21:54:01.895201+0000","last_active":"2024-05-08T21:54:01.895201+0000","last_peered":"2024-05-08T21:54:01.895201+0000","last_clean":"2024-05-08T21:54:01.895201+0000","last_became_active":"2024-05-08T21:49:43.220090+0000","last_became_peered":"2024-05-08T21:49:43.220090+0000","last_unstale":"2024-05-08T21:54:01.895201+0000","last_undegraded":"2024-05-08T21:54:01.895201+0000","last_fullsized":"2024-05-08T21:54:01.895201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'2","last_scrub_stamp":"2024-05-08T21:54:01.894999+0000","last_deep_scrub":"24'2","last_deep_scrub_stamp":"2024-05-08T21:54:01.894999+0000","last_clean_scrub_stamp":"2024-05-08T21:54:01.894999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:38:52.538673+0000","scrub_duration":0.002723521,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"24'149","reported_seq":173,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:13.089760+0000","last_change":"2024-05-08T21:54:13.089891+0000","last_active":"2024-05-08T21:54:13.089760+0000","last_peered":"2024-05-08T21:54:13.089760+0000","last_clean":"2024-05-08T21:54:13.089760+0000","last_became_active":"2024-05-08T21:50:33.103147+0000","last_became_peered":"2024-05-08T21:50:33.103147+0000","last_unstale":"2024-05-08T21:54:13.089760+0000","last_undegraded":"2024-05-08T21:54:13.089760+0000","last_fullsized":"2024-05-08T21:54:13.089760+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'149","last_scrub_stamp":"2024-05-08T21:54:13.089730+0000","last_deep_scrub":"24'149","last_deep_scrub_stamp":"2024-05-08T21:54:13.089730+0000","last_clean_scrub_stamp":"2024-05-08T21:54:13.089730+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:31:10.238060+0000","scrub_duration":0.0044294210000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"24'2","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:59.634326+0000","last_change":"2024-05-08T21:53:59.634326+0000","last_active":"2024-05-08T21:53:59.634326+0000","last_peered":"2024-05-08T21:53:59.634326+0000","last_clean":"2024-05-08T21:53:59.634326+0000","last_became_active":"2024-05-08T21:49:43.218473+0000","last_became_peered":"2024-05-08T21:49:43.218473+0000","last_unstale":"2024-05-08T21:53:59.634326+0000","last_undegraded":"2024-05-08T21:53:59.634326+0000","last_fullsized":"2024-05-08T21:53:59.634326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'2","last_scrub_stamp":"2024-05-08T21:53:59.634180+0000","last_deep_scrub":"24'2","last_deep_scrub_stamp":"2024-05-08T21:53:59.634180+0000","last_clean_scrub_stamp":"2024-05-08T21:53:59.634180+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:38:50.277853+0000","scrub_duration":0.0013227530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"24'162","reported_seq":189,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:13.651830+0000","last_change":"2024-05-08T21:54:13.651830+0000","last_active":"2024-05-08T21:54:13.651830+0000","last_peered":"2024-05-08T21:54:13.651830+0000","last_clean":"2024-05-08T21:54:13.651830+0000","last_became_active":"2024-05-08T21:49:43.770677+0000","last_became_peered":"2024-05-08T21:49:43.770677+0000","last_unstale":"2024-05-08T21:54:13.651830+0000","last_undegraded":"2024-05-08T21:54:13.651830+0000","last_fullsized":"2024-05-08T21:54:13.651830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'162","last_scrub_stamp":"2024-05-08T21:54:13.651690+0000","last_deep_scrub":"24'162","last_deep_scrub_stamp":"2024-05-08T21:54:13.651690+0000","last_clean_scrub_stamp":"2024-05-08T21:54:13.651690+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:12:19.269754+0000","scrub_duration":0.003372454,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:04.933446+0000","last_change":"2024-05-08T21:54:04.933446+0000","last_active":"2024-05-08T21:54:04.933446+0000","last_peered":"2024-05-08T21:54:04.933446+0000","last_clean":"2024-05-08T21:54:04.933446+0000","last_became_active":"2024-05-08T21:49:43.220780+0000","last_became_peered":"2024-05-08T21:49:43.220780+0000","last_unstale":"2024-05-08T21:54:04.933446+0000","last_undegraded":"2024-05-08T21:54:04.933446+0000","last_fullsized":"2024-05-08T21:54:04.933446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:54:04.933315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:54:04.933315+0000","last_clean_scrub_stamp":"2024-05-08T21:54:04.933315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:12:19.285123+0000","scrub_duration":0.0022305060000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"24'190","reported_seq":214,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:15.093196+0000","last_change":"2024-05-08T21:54:15.093348+0000","last_active":"2024-05-08T21:54:15.093196+0000","last_peered":"2024-05-08T21:54:15.093196+0000","last_clean":"2024-05-08T21:54:15.093196+0000","last_became_active":"2024-05-08T21:50:33.305037+0000","last_became_peered":"2024-05-08T21:50:33.305037+0000","last_unstale":"2024-05-08T21:54:15.093196+0000","last_undegraded":"2024-05-08T21:54:15.093196+0000","last_fullsized":"2024-05-08T21:54:15.093196+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'190","last_scrub_stamp":"2024-05-08T21:54:15.093167+0000","last_deep_scrub":"24'190","last_deep_scrub_stamp":"2024-05-08T21:54:15.093167+0000","last_clean_scrub_stamp":"2024-05-08T21:54:15.093167+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:25:13.719513+0000","scrub_duration":0.0041475000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:59.638981+0000","last_change":"2024-05-08T21:53:59.638981+0000","last_active":"2024-05-08T21:53:59.638981+0000","last_peered":"2024-05-08T21:53:59.638981+0000","last_clean":"2024-05-08T21:53:59.638981+0000","last_became_active":"2024-05-08T21:49:43.225057+0000","last_became_peered":"2024-05-08T21:49:43.225057+0000","last_unstale":"2024-05-08T21:53:59.638981+0000","last_undegraded":"2024-05-08T21:53:59.638981+0000","last_fullsized":"2024-05-08T21:53:59.638981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:53:59.638851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:53:59.638851+0000","last_clean_scrub_stamp":"2024-05-08T21:53:59.638851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:30:47.457087+0000","scrub_duration":0.001332172,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"24'187","reported_seq":214,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:23.144319+0000","last_change":"2024-05-08T21:54:23.144319+0000","last_active":"2024-05-08T21:54:23.144319+0000","last_peered":"2024-05-08T21:54:23.144319+0000","last_clean":"2024-05-08T21:54:23.144319+0000","last_became_active":"2024-05-08T21:49:43.757092+0000","last_became_peered":"2024-05-08T21:49:43.757092+0000","last_unstale":"2024-05-08T21:54:23.144319+0000","last_undegraded":"2024-05-08T21:54:23.144319+0000","last_fullsized":"2024-05-08T21:54:23.144319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'187","last_scrub_stamp":"2024-05-08T21:54:23.144159+0000","last_deep_scrub":"24'187","last_deep_scrub_stamp":"2024-05-08T21:54:23.144159+0000","last_clean_scrub_stamp":"2024-05-08T21:54:23.144159+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:59:27.056579+0000","scrub_duration":0.0036987840000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"24'1","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:05.715714+0000","last_change":"2024-05-08T21:54:05.715714+0000","last_active":"2024-05-08T21:54:05.715714+0000","last_peered":"2024-05-08T21:54:05.715714+0000","last_clean":"2024-05-08T21:54:05.715714+0000","last_became_active":"2024-05-08T21:49:43.229105+0000","last_became_peered":"2024-05-08T21:49:43.229105+0000","last_unstale":"2024-05-08T21:54:05.715714+0000","last_undegraded":"2024-05-08T21:54:05.715714+0000","last_fullsized":"2024-05-08T21:54:05.715714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'1","last_scrub_stamp":"2024-05-08T21:54:05.715584+0000","last_deep_scrub":"24'1","last_deep_scrub_stamp":"2024-05-08T21:54:05.715584+0000","last_clean_scrub_stamp":"2024-05-08T21:54:05.715584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:50:49.933050+0000","scrub_duration":0.0026438849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"24'251","reported_seq":278,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:20.587959+0000","last_change":"2024-05-08T21:54:20.587959+0000","last_active":"2024-05-08T21:54:20.587959+0000","last_peered":"2024-05-08T21:54:20.587959+0000","last_clean":"2024-05-08T21:54:20.587959+0000","last_became_active":"2024-05-08T21:49:43.772944+0000","last_became_peered":"2024-05-08T21:49:43.772944+0000","last_unstale":"2024-05-08T21:54:20.587959+0000","last_undegraded":"2024-05-08T21:54:20.587959+0000","last_fullsized":"2024-05-08T21:54:20.587959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'251","last_scrub_stamp":"2024-05-08T21:54:20.587827+0000","last_deep_scrub":"24'251","last_deep_scrub_stamp":"2024-05-08T21:54:20.587827+0000","last_clean_scrub_stamp":"2024-05-08T21:54:20.587827+0000","objects_scrubbed":0,"log_size":251,"log_dups_size":0,"ondisk_log_size":251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:18.094741+0000","scrub_duration":0.0041642789999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":598016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:05.661193+0000","last_change":"2024-05-08T21:54:05.661193+0000","last_active":"2024-05-08T21:54:05.661193+0000","last_peered":"2024-05-08T21:54:05.661193+0000","last_clean":"2024-05-08T21:54:05.661193+0000","last_became_active":"2024-05-08T21:49:43.223476+0000","last_became_peered":"2024-05-08T21:49:43.223476+0000","last_unstale":"2024-05-08T21:54:05.661193+0000","last_undegraded":"2024-05-08T21:54:05.661193+0000","last_fullsized":"2024-05-08T21:54:05.661193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:54:05.661051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:54:05.661051+0000","last_clean_scrub_stamp":"2024-05-08T21:54:05.661051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:48:28.865727+0000","scrub_duration":0.0014156990000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"24'160","reported_seq":187,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:20.710080+0000","last_change":"2024-05-08T21:54:20.710080+0000","last_active":"2024-05-08T21:54:20.710080+0000","last_peered":"2024-05-08T21:54:20.710080+0000","last_clean":"2024-05-08T21:54:20.710080+0000","last_became_active":"2024-05-08T21:49:43.771279+0000","last_became_peered":"2024-05-08T21:49:43.771279+0000","last_unstale":"2024-05-08T21:54:20.710080+0000","last_undegraded":"2024-05-08T21:54:20.710080+0000","last_fullsized":"2024-05-08T21:54:20.710080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'160","last_scrub_stamp":"2024-05-08T21:54:20.709939+0000","last_deep_scrub":"24'160","last_deep_scrub_stamp":"2024-05-08T21:54:20.709939+0000","last_clean_scrub_stamp":"2024-05-08T21:54:20.709939+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:18:49.138608+0000","scrub_duration":0.0032270900000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"24'9","reported_seq":40,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:13.130280+0000","last_change":"2024-05-08T21:54:13.130280+0000","last_active":"2024-05-08T21:54:13.130280+0000","last_peered":"2024-05-08T21:54:13.130280+0000","last_clean":"2024-05-08T21:54:13.130280+0000","last_became_active":"2024-05-08T21:49:43.224164+0000","last_became_peered":"2024-05-08T21:49:43.224164+0000","last_unstale":"2024-05-08T21:54:13.130280+0000","last_undegraded":"2024-05-08T21:54:13.130280+0000","last_fullsized":"2024-05-08T21:54:13.130280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'9","last_scrub_stamp":"2024-05-08T21:54:13.130137+0000","last_deep_scrub":"24'9","last_deep_scrub_stamp":"2024-05-08T21:54:13.130137+0000","last_clean_scrub_stamp":"2024-05-08T21:54:13.130137+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:30:47.087710+0000","scrub_duration":0.0046032640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"24'168","reported_seq":195,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:01.292214+0000","last_change":"2024-05-08T21:54:01.292214+0000","last_active":"2024-05-08T21:54:01.292214+0000","last_peered":"2024-05-08T21:54:01.292214+0000","last_clean":"2024-05-08T21:54:01.292214+0000","last_became_active":"2024-05-08T21:49:43.772685+0000","last_became_peered":"2024-05-08T21:49:43.772685+0000","last_unstale":"2024-05-08T21:54:01.292214+0000","last_undegraded":"2024-05-08T21:54:01.292214+0000","last_fullsized":"2024-05-08T21:54:01.292214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'168","last_scrub_stamp":"2024-05-08T21:54:01.292080+0000","last_deep_scrub":"24'168","last_deep_scrub_stamp":"2024-05-08T21:54:01.292080+0000","last_clean_scrub_stamp":"2024-05-08T21:54:01.292080+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:34.130535+0000","scrub_duration":0.003607589,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"24'186","reported_seq":220,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:01.692635+0000","last_change":"2024-05-08T21:54:01.692635+0000","last_active":"2024-05-08T21:54:01.692635+0000","last_peered":"2024-05-08T21:54:01.692635+0000","last_clean":"2024-05-08T21:54:01.692635+0000","last_became_active":"2024-05-08T21:49:43.221844+0000","last_became_peered":"2024-05-08T21:49:43.221844+0000","last_unstale":"2024-05-08T21:54:01.692635+0000","last_undegraded":"2024-05-08T21:54:01.692635+0000","last_fullsized":"2024-05-08T21:54:01.692635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'186","last_scrub_stamp":"2024-05-08T21:54:01.692501+0000","last_deep_scrub":"24'186","last_deep_scrub_stamp":"2024-05-08T21:54:01.692501+0000","last_clean_scrub_stamp":"2024-05-08T21:54:01.692501+0000","objects_scrubbed":4,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:57:32.728155+0000","scrub_duration":0.0057571819999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":387830,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":182,"num_write_kb":531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"24'176","reported_seq":203,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:30.094819+0000","last_change":"2024-05-08T21:54:30.094819+0000","last_active":"2024-05-08T21:54:30.094819+0000","last_peered":"2024-05-08T21:54:30.094819+0000","last_clean":"2024-05-08T21:54:30.094819+0000","last_became_active":"2024-05-08T21:49:43.772037+0000","last_became_peered":"2024-05-08T21:49:43.772037+0000","last_unstale":"2024-05-08T21:54:30.094819+0000","last_undegraded":"2024-05-08T21:54:30.094819+0000","last_fullsized":"2024-05-08T21:54:30.094819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'176","last_scrub_stamp":"2024-05-08T21:54:30.094694+0000","last_deep_scrub":"24'176","last_deep_scrub_stamp":"2024-05-08T21:54:30.094694+0000","last_clean_scrub_stamp":"2024-05-08T21:54:30.094694+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:54:13.890552+0000","scrub_duration":0.0042606689999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"24'4","reported_seq":34,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:57.730838+0000","last_change":"2024-05-08T21:53:57.730838+0000","last_active":"2024-05-08T21:53:57.730838+0000","last_peered":"2024-05-08T21:53:57.730838+0000","last_clean":"2024-05-08T21:53:57.730838+0000","last_became_active":"2024-05-08T21:49:43.219186+0000","last_became_peered":"2024-05-08T21:49:43.219186+0000","last_unstale":"2024-05-08T21:53:57.730838+0000","last_undegraded":"2024-05-08T21:53:57.730838+0000","last_fullsized":"2024-05-08T21:53:57.730838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'4","last_scrub_stamp":"2024-05-08T21:53:57.730742+0000","last_deep_scrub":"24'4","last_deep_scrub_stamp":"2024-05-08T21:53:57.730742+0000","last_clean_scrub_stamp":"2024-05-08T21:53:57.730742+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:27:07.750268+0000","scrub_duration":0.0042791699999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"24'177","reported_seq":204,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:11.656510+0000","last_change":"2024-05-08T21:54:11.656510+0000","last_active":"2024-05-08T21:54:11.656510+0000","last_peered":"2024-05-08T21:54:11.656510+0000","last_clean":"2024-05-08T21:54:11.656510+0000","last_became_active":"2024-05-08T21:49:43.774919+0000","last_became_peered":"2024-05-08T21:49:43.774919+0000","last_unstale":"2024-05-08T21:54:11.656510+0000","last_undegraded":"2024-05-08T21:54:11.656510+0000","last_fullsized":"2024-05-08T21:54:11.656510+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'177","last_scrub_stamp":"2024-05-08T21:54:11.656373+0000","last_deep_scrub":"24'177","last_deep_scrub_stamp":"2024-05-08T21:54:11.656373+0000","last_clean_scrub_stamp":"2024-05-08T21:54:11.656373+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:50:55.873838+0000","scrub_duration":0.0044413589999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:11.649426+0000","last_change":"2024-05-08T21:54:11.649426+0000","last_active":"2024-05-08T21:54:11.649426+0000","last_peered":"2024-05-08T21:54:11.649426+0000","last_clean":"2024-05-08T21:54:11.649426+0000","last_became_active":"2024-05-08T21:49:43.227065+0000","last_became_peered":"2024-05-08T21:49:43.227065+0000","last_unstale":"2024-05-08T21:54:11.649426+0000","last_undegraded":"2024-05-08T21:54:11.649426+0000","last_fullsized":"2024-05-08T21:54:11.649426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:54:11.649258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:54:11.649258+0000","last_clean_scrub_stamp":"2024-05-08T21:54:11.649258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:47:08.160695+0000","scrub_duration":0.0024401050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"24'201","reported_seq":228,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:23.088221+0000","last_change":"2024-05-08T21:54:23.088221+0000","last_active":"2024-05-08T21:54:23.088221+0000","last_peered":"2024-05-08T21:54:23.088221+0000","last_clean":"2024-05-08T21:54:23.088221+0000","last_became_active":"2024-05-08T21:49:43.770180+0000","last_became_peered":"2024-05-08T21:49:43.770180+0000","last_unstale":"2024-05-08T21:54:23.088221+0000","last_undegraded":"2024-05-08T21:54:23.088221+0000","last_fullsized":"2024-05-08T21:54:23.088221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'201","last_scrub_stamp":"2024-05-08T21:54:23.088040+0000","last_deep_scrub":"24'201","last_deep_scrub_stamp":"2024-05-08T21:54:23.088040+0000","last_clean_scrub_stamp":"2024-05-08T21:54:23.088040+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:44:17.971373+0000","scrub_duration":0.003562609,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:04.728088+0000","last_change":"2024-05-08T21:54:04.728088+0000","last_active":"2024-05-08T21:54:04.728088+0000","last_peered":"2024-05-08T21:54:04.728088+0000","last_clean":"2024-05-08T21:54:04.728088+0000","last_became_active":"2024-05-08T21:49:43.220641+0000","last_became_peered":"2024-05-08T21:49:43.220641+0000","last_unstale":"2024-05-08T21:54:04.728088+0000","last_undegraded":"2024-05-08T21:54:04.728088+0000","last_fullsized":"2024-05-08T21:54:04.728088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:54:04.727909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:54:04.727909+0000","last_clean_scrub_stamp":"2024-05-08T21:54:04.727909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:20:25.262158+0000","scrub_duration":0.0016556240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"24'197","reported_seq":224,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:07.764776+0000","last_change":"2024-05-08T21:54:07.764776+0000","last_active":"2024-05-08T21:54:07.764776+0000","last_peered":"2024-05-08T21:54:07.764776+0000","last_clean":"2024-05-08T21:54:07.764776+0000","last_became_active":"2024-05-08T21:49:43.765945+0000","last_became_peered":"2024-05-08T21:49:43.765945+0000","last_unstale":"2024-05-08T21:54:07.764776+0000","last_undegraded":"2024-05-08T21:54:07.764776+0000","last_fullsized":"2024-05-08T21:54:07.764776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'197","last_scrub_stamp":"2024-05-08T21:54:07.764589+0000","last_deep_scrub":"24'197","last_deep_scrub_stamp":"2024-05-08T21:54:07.764589+0000","last_clean_scrub_stamp":"2024-05-08T21:54:07.764589+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:12:13.382654+0000","scrub_duration":0.0048995460000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"24'13","reported_seq":49,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:01.062501+0000","last_change":"2024-05-08T21:54:01.062501+0000","last_active":"2024-05-08T21:54:01.062501+0000","last_peered":"2024-05-08T21:54:01.062501+0000","last_clean":"2024-05-08T21:54:01.062501+0000","last_became_active":"2024-05-08T21:49:43.208013+0000","last_became_peered":"2024-05-08T21:49:43.208013+0000","last_unstale":"2024-05-08T21:54:01.062501+0000","last_undegraded":"2024-05-08T21:54:01.062501+0000","last_fullsized":"2024-05-08T21:54:01.062501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'13","last_scrub_stamp":"2024-05-08T21:54:01.062323+0000","last_deep_scrub":"24'13","last_deep_scrub_stamp":"2024-05-08T21:54:01.062323+0000","last_clean_scrub_stamp":"2024-05-08T21:54:01.062323+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:38:51.705996+0000","scrub_duration":0.0050219519999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"24'215","reported_seq":242,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:24.092278+0000","last_change":"2024-05-08T21:54:24.092278+0000","last_active":"2024-05-08T21:54:24.092278+0000","last_peered":"2024-05-08T21:54:24.092278+0000","last_clean":"2024-05-08T21:54:24.092278+0000","last_became_active":"2024-05-08T21:49:43.773933+0000","last_became_peered":"2024-05-08T21:49:43.773933+0000","last_unstale":"2024-05-08T21:54:24.092278+0000","last_undegraded":"2024-05-08T21:54:24.092278+0000","last_fullsized":"2024-05-08T21:54:24.092278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'215","last_scrub_stamp":"2024-05-08T21:54:24.092120+0000","last_deep_scrub":"24'215","last_deep_scrub_stamp":"2024-05-08T21:54:24.092120+0000","last_clean_scrub_stamp":"2024-05-08T21:54:24.092120+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:17.601798+0000","scrub_duration":0.0040403330000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"24'2","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:58.265770+0000","last_change":"2024-05-08T21:53:58.265770+0000","last_active":"2024-05-08T21:53:58.265770+0000","last_peered":"2024-05-08T21:53:58.265770+0000","last_clean":"2024-05-08T21:53:58.265770+0000","last_became_active":"2024-05-08T21:49:43.216822+0000","last_became_peered":"2024-05-08T21:49:43.216822+0000","last_unstale":"2024-05-08T21:53:58.265770+0000","last_undegraded":"2024-05-08T21:53:58.265770+0000","last_fullsized":"2024-05-08T21:53:58.265770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'2","last_scrub_stamp":"2024-05-08T21:53:58.265597+0000","last_deep_scrub":"24'2","last_deep_scrub_stamp":"2024-05-08T21:53:58.265597+0000","last_clean_scrub_stamp":"2024-05-08T21:53:58.265597+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:23:36.103671+0000","scrub_duration":0.0039105140000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"24'175","reported_seq":202,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:25.125878+0000","last_change":"2024-05-08T21:54:25.126026+0000","last_active":"2024-05-08T21:54:25.125878+0000","last_peered":"2024-05-08T21:54:25.125878+0000","last_clean":"2024-05-08T21:54:25.125878+0000","last_became_active":"2024-05-08T21:49:43.769762+0000","last_became_peered":"2024-05-08T21:49:43.769762+0000","last_unstale":"2024-05-08T21:54:25.125878+0000","last_undegraded":"2024-05-08T21:54:25.125878+0000","last_fullsized":"2024-05-08T21:54:25.125878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'175","last_scrub_stamp":"2024-05-08T21:54:25.125852+0000","last_deep_scrub":"24'175","last_deep_scrub_stamp":"2024-05-08T21:54:25.125852+0000","last_clean_scrub_stamp":"2024-05-08T21:54:25.125852+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:53:47.171840+0000","scrub_duration":0.0036851039999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:00.091497+0000","last_change":"2024-05-08T21:54:00.091607+0000","last_active":"2024-05-08T21:54:00.091497+0000","last_peered":"2024-05-08T21:54:00.091497+0000","last_clean":"2024-05-08T21:54:00.091497+0000","last_became_active":"2024-05-08T21:49:43.215048+0000","last_became_peered":"2024-05-08T21:49:43.215048+0000","last_unstale":"2024-05-08T21:54:00.091497+0000","last_undegraded":"2024-05-08T21:54:00.091497+0000","last_fullsized":"2024-05-08T21:54:00.091497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:54:00.091474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:54:00.091474+0000","last_clean_scrub_stamp":"2024-05-08T21:54:00.091474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:41:28.795723+0000","scrub_duration":0.0018240509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"24'160","reported_seq":187,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:33.557172+0000","last_change":"2024-05-08T21:54:33.557308+0000","last_active":"2024-05-08T21:54:33.557172+0000","last_peered":"2024-05-08T21:54:33.557172+0000","last_clean":"2024-05-08T21:54:33.557172+0000","last_became_active":"2024-05-08T21:49:43.770029+0000","last_became_peered":"2024-05-08T21:49:43.770029+0000","last_unstale":"2024-05-08T21:54:33.557172+0000","last_undegraded":"2024-05-08T21:54:33.557172+0000","last_fullsized":"2024-05-08T21:54:33.557172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'160","last_scrub_stamp":"2024-05-08T21:54:33.557130+0000","last_deep_scrub":"24'160","last_deep_scrub_stamp":"2024-05-08T21:54:33.557130+0000","last_clean_scrub_stamp":"2024-05-08T21:54:33.557130+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:09:53.625848+0000","scrub_duration":0.0040793909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:02.644657+0000","last_change":"2024-05-08T21:54:02.644782+0000","last_active":"2024-05-08T21:54:02.644657+0000","last_peered":"2024-05-08T21:54:02.644657+0000","last_clean":"2024-05-08T21:54:02.644657+0000","last_became_active":"2024-05-08T21:49:43.227430+0000","last_became_peered":"2024-05-08T21:49:43.227430+0000","last_unstale":"2024-05-08T21:54:02.644657+0000","last_undegraded":"2024-05-08T21:54:02.644657+0000","last_fullsized":"2024-05-08T21:54:02.644657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:54:02.644631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:54:02.644631+0000","last_clean_scrub_stamp":"2024-05-08T21:54:02.644631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:07:34.685146+0000","scrub_duration":0.002515307,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"24'177","reported_seq":204,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:00.273626+0000","last_change":"2024-05-08T21:54:00.273626+0000","last_active":"2024-05-08T21:54:00.273626+0000","last_peered":"2024-05-08T21:54:00.273626+0000","last_clean":"2024-05-08T21:54:00.273626+0000","last_became_active":"2024-05-08T21:49:43.768307+0000","last_became_peered":"2024-05-08T21:49:43.768307+0000","last_unstale":"2024-05-08T21:54:00.273626+0000","last_undegraded":"2024-05-08T21:54:00.273626+0000","last_fullsized":"2024-05-08T21:54:00.273626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'177","last_scrub_stamp":"2024-05-08T21:54:00.273494+0000","last_deep_scrub":"24'177","last_deep_scrub_stamp":"2024-05-08T21:54:00.273494+0000","last_clean_scrub_stamp":"2024-05-08T21:54:00.273494+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:56:54.948792+0000","scrub_duration":0.0038275840000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"24'165","reported_seq":192,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:15.148970+0000","last_change":"2024-05-08T21:54:15.149075+0000","last_active":"2024-05-08T21:54:15.148970+0000","last_peered":"2024-05-08T21:54:15.148970+0000","last_clean":"2024-05-08T21:54:15.148970+0000","last_became_active":"2024-05-08T21:49:43.758367+0000","last_became_peered":"2024-05-08T21:49:43.758367+0000","last_unstale":"2024-05-08T21:54:15.148970+0000","last_undegraded":"2024-05-08T21:54:15.148970+0000","last_fullsized":"2024-05-08T21:54:15.148970+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'165","last_scrub_stamp":"2024-05-08T21:54:15.148943+0000","last_deep_scrub":"24'165","last_deep_scrub_stamp":"2024-05-08T21:54:15.148943+0000","last_clean_scrub_stamp":"2024-05-08T21:54:15.148943+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:47:11.660380+0000","scrub_duration":0.003182023,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"24'6","reported_seq":39,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:07.006691+0000","last_change":"2024-05-08T21:54:07.006803+0000","last_active":"2024-05-08T21:54:07.006691+0000","last_peered":"2024-05-08T21:54:07.006691+0000","last_clean":"2024-05-08T21:54:07.006691+0000","last_became_active":"2024-05-08T21:49:43.217133+0000","last_became_peered":"2024-05-08T21:49:43.217133+0000","last_unstale":"2024-05-08T21:54:07.006691+0000","last_undegraded":"2024-05-08T21:54:07.006691+0000","last_fullsized":"2024-05-08T21:54:07.006691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'6","last_scrub_stamp":"2024-05-08T21:54:07.006665+0000","last_deep_scrub":"24'6","last_deep_scrub_stamp":"2024-05-08T21:54:07.006665+0000","last_clean_scrub_stamp":"2024-05-08T21:54:07.006665+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:20:27.540915+0000","scrub_duration":0.0024388360000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"24'183","reported_seq":210,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:09.963678+0000","last_change":"2024-05-08T21:54:09.963785+0000","last_active":"2024-05-08T21:54:09.963678+0000","last_peered":"2024-05-08T21:54:09.963678+0000","last_clean":"2024-05-08T21:54:09.963678+0000","last_became_active":"2024-05-08T21:49:43.771451+0000","last_became_peered":"2024-05-08T21:49:43.771451+0000","last_unstale":"2024-05-08T21:54:09.963678+0000","last_undegraded":"2024-05-08T21:54:09.963678+0000","last_fullsized":"2024-05-08T21:54:09.963678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'183","last_scrub_stamp":"2024-05-08T21:54:09.963651+0000","last_deep_scrub":"24'183","last_deep_scrub_stamp":"2024-05-08T21:54:09.963651+0000","last_clean_scrub_stamp":"2024-05-08T21:54:09.963651+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:12:15.581715+0000","scrub_duration":0.0044283860000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:09.629236+0000","last_change":"2024-05-08T21:54:09.629368+0000","last_active":"2024-05-08T21:54:09.629236+0000","last_peered":"2024-05-08T21:54:09.629236+0000","last_clean":"2024-05-08T21:54:09.629236+0000","last_became_active":"2024-05-08T21:49:43.223469+0000","last_became_peered":"2024-05-08T21:49:43.223469+0000","last_unstale":"2024-05-08T21:54:09.629236+0000","last_undegraded":"2024-05-08T21:54:09.629236+0000","last_fullsized":"2024-05-08T21:54:09.629236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:54:09.629211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:54:09.629211+0000","last_clean_scrub_stamp":"2024-05-08T21:54:09.629211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:30:43.586785+0000","scrub_duration":0.0033484270000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"24'119","reported_seq":183,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:01.855797+0000","last_change":"2024-05-08T21:54:01.855909+0000","last_active":"2024-05-08T21:54:01.855797+0000","last_peered":"2024-05-08T21:54:01.855797+0000","last_clean":"2024-05-08T21:54:01.855797+0000","last_became_active":"2024-05-08T21:49:38.626159+0000","last_became_peered":"2024-05-08T21:49:38.626159+0000","last_unstale":"2024-05-08T21:54:01.855797+0000","last_undegraded":"2024-05-08T21:54:01.855797+0000","last_fullsized":"2024-05-08T21:54:01.855797+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'119","last_scrub_stamp":"2024-05-08T21:54:01.855772+0000","last_deep_scrub":"24'119","last_deep_scrub_stamp":"2024-05-08T21:54:01.855772+0000","last_clean_scrub_stamp":"2024-05-08T21:54:01.855772+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:50:46.073238+0000","scrub_duration":0.0063122120000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"24'165","reported_seq":192,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:04.734425+0000","last_change":"2024-05-08T21:54:04.734578+0000","last_active":"2024-05-08T21:54:04.734425+0000","last_peered":"2024-05-08T21:54:04.734425+0000","last_clean":"2024-05-08T21:54:04.734425+0000","last_became_active":"2024-05-08T21:49:43.770711+0000","last_became_peered":"2024-05-08T21:49:43.770711+0000","last_unstale":"2024-05-08T21:54:04.734425+0000","last_undegraded":"2024-05-08T21:54:04.734425+0000","last_fullsized":"2024-05-08T21:54:04.734425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'165","last_scrub_stamp":"2024-05-08T21:54:04.734399+0000","last_deep_scrub":"24'165","last_deep_scrub_stamp":"2024-05-08T21:54:04.734399+0000","last_clean_scrub_stamp":"2024-05-08T21:54:04.734399+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:38:55.378073+0000","scrub_duration":0.0038027999999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:03.902183+0000","last_change":"2024-05-08T21:54:03.902325+0000","last_active":"2024-05-08T21:54:03.902183+0000","last_peered":"2024-05-08T21:54:03.902183+0000","last_clean":"2024-05-08T21:54:03.902183+0000","last_became_active":"2024-05-08T21:49:43.220539+0000","last_became_peered":"2024-05-08T21:49:43.220539+0000","last_unstale":"2024-05-08T21:54:03.902183+0000","last_undegraded":"2024-05-08T21:54:03.902183+0000","last_fullsized":"2024-05-08T21:54:03.902183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:54:03.902144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:54:03.902144+0000","last_clean_scrub_stamp":"2024-05-08T21:54:03.902144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:12:09.520208+0000","scrub_duration":0.0024220439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:11.021338+0000","last_change":"2024-05-08T21:54:11.021441+0000","last_active":"2024-05-08T21:54:11.021338+0000","last_peered":"2024-05-08T21:54:11.021338+0000","last_clean":"2024-05-08T21:54:11.021338+0000","last_became_active":"2024-05-08T21:49:43.222131+0000","last_became_peered":"2024-05-08T21:49:43.222131+0000","last_unstale":"2024-05-08T21:54:11.021338+0000","last_undegraded":"2024-05-08T21:54:11.021338+0000","last_fullsized":"2024-05-08T21:54:11.021338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:54:11.021310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:54:11.021310+0000","last_clean_scrub_stamp":"2024-05-08T21:54:11.021310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:18:39.449979+0000","scrub_duration":0.001879045,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"24'162","reported_seq":189,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:24.158761+0000","last_change":"2024-05-08T21:54:24.158892+0000","last_active":"2024-05-08T21:54:24.158761+0000","last_peered":"2024-05-08T21:54:24.158761+0000","last_clean":"2024-05-08T21:54:24.158761+0000","last_became_active":"2024-05-08T21:49:43.758140+0000","last_became_peered":"2024-05-08T21:49:43.758140+0000","last_unstale":"2024-05-08T21:54:24.158761+0000","last_undegraded":"2024-05-08T21:54:24.158761+0000","last_fullsized":"2024-05-08T21:54:24.158761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'162","last_scrub_stamp":"2024-05-08T21:54:24.158736+0000","last_deep_scrub":"24'162","last_deep_scrub_stamp":"2024-05-08T21:54:24.158736+0000","last_clean_scrub_stamp":"2024-05-08T21:54:24.158736+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:21.665649+0000","scrub_duration":0.0039939609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"24'15","reported_seq":44,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:01.062923+0000","last_change":"2024-05-08T21:54:01.062923+0000","last_active":"2024-05-08T21:54:01.062923+0000","last_peered":"2024-05-08T21:54:01.062923+0000","last_clean":"2024-05-08T21:54:01.062923+0000","last_became_active":"2024-05-08T21:49:43.217780+0000","last_became_peered":"2024-05-08T21:49:43.217780+0000","last_unstale":"2024-05-08T21:54:01.062923+0000","last_undegraded":"2024-05-08T21:54:01.062923+0000","last_fullsized":"2024-05-08T21:54:01.062923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'15","last_scrub_stamp":"2024-05-08T21:54:01.062736+0000","last_deep_scrub":"24'15","last_deep_scrub_stamp":"2024-05-08T21:54:01.062736+0000","last_clean_scrub_stamp":"2024-05-08T21:54:01.062736+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:04:59.971978+0000","scrub_duration":0.0028540369999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"24'166","reported_seq":193,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:07.967700+0000","last_change":"2024-05-08T21:54:07.967700+0000","last_active":"2024-05-08T21:54:07.967700+0000","last_peered":"2024-05-08T21:54:07.967700+0000","last_clean":"2024-05-08T21:54:07.967700+0000","last_became_active":"2024-05-08T21:49:43.770221+0000","last_became_peered":"2024-05-08T21:49:43.770221+0000","last_unstale":"2024-05-08T21:54:07.967700+0000","last_undegraded":"2024-05-08T21:54:07.967700+0000","last_fullsized":"2024-05-08T21:54:07.967700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'166","last_scrub_stamp":"2024-05-08T21:54:07.967533+0000","last_deep_scrub":"24'166","last_deep_scrub_stamp":"2024-05-08T21:54:07.967533+0000","last_clean_scrub_stamp":"2024-05-08T21:54:07.967533+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:50:52.184999+0000","scrub_duration":0.003871729,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"24'4","reported_seq":34,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:02.681489+0000","last_change":"2024-05-08T21:54:02.681622+0000","last_active":"2024-05-08T21:54:02.681489+0000","last_peered":"2024-05-08T21:54:02.681489+0000","last_clean":"2024-05-08T21:54:02.681489+0000","last_became_active":"2024-05-08T21:49:43.220953+0000","last_became_peered":"2024-05-08T21:49:43.220953+0000","last_unstale":"2024-05-08T21:54:02.681489+0000","last_undegraded":"2024-05-08T21:54:02.681489+0000","last_fullsized":"2024-05-08T21:54:02.681489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'4","last_scrub_stamp":"2024-05-08T21:54:02.681463+0000","last_deep_scrub":"24'4","last_deep_scrub_stamp":"2024-05-08T21:54:02.681463+0000","last_clean_scrub_stamp":"2024-05-08T21:54:02.681463+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:12:17.033271+0000","scrub_duration":0.0033577419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"24'183","reported_seq":210,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:10.638099+0000","last_change":"2024-05-08T21:54:10.638229+0000","last_active":"2024-05-08T21:54:10.638099+0000","last_peered":"2024-05-08T21:54:10.638099+0000","last_clean":"2024-05-08T21:54:10.638099+0000","last_became_active":"2024-05-08T21:49:43.764740+0000","last_became_peered":"2024-05-08T21:49:43.764740+0000","last_unstale":"2024-05-08T21:54:10.638099+0000","last_undegraded":"2024-05-08T21:54:10.638099+0000","last_fullsized":"2024-05-08T21:54:10.638099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'183","last_scrub_stamp":"2024-05-08T21:54:10.638071+0000","last_deep_scrub":"24'183","last_deep_scrub_stamp":"2024-05-08T21:54:10.638071+0000","last_clean_scrub_stamp":"2024-05-08T21:54:10.638071+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:20:31.172321+0000","scrub_duration":0.0038965330000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:22.071628+0000","last_change":"2024-05-08T21:54:22.071761+0000","last_active":"2024-05-08T21:54:22.071628+0000","last_peered":"2024-05-08T21:54:22.071628+0000","last_clean":"2024-05-08T21:54:22.071628+0000","last_became_active":"2024-05-08T21:49:43.220839+0000","last_became_peered":"2024-05-08T21:49:43.220839+0000","last_unstale":"2024-05-08T21:54:22.071628+0000","last_undegraded":"2024-05-08T21:54:22.071628+0000","last_fullsized":"2024-05-08T21:54:22.071628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:54:22.071603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:54:22.071603+0000","last_clean_scrub_stamp":"2024-05-08T21:54:22.071603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:58:08.972263+0000","scrub_duration":0.0016106250000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"24'162","reported_seq":189,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:59.310338+0000","last_change":"2024-05-08T21:53:59.310338+0000","last_active":"2024-05-08T21:53:59.310338+0000","last_peered":"2024-05-08T21:53:59.310338+0000","last_clean":"2024-05-08T21:53:59.310338+0000","last_became_active":"2024-05-08T21:49:43.762170+0000","last_became_peered":"2024-05-08T21:49:43.762170+0000","last_unstale":"2024-05-08T21:53:59.310338+0000","last_undegraded":"2024-05-08T21:53:59.310338+0000","last_fullsized":"2024-05-08T21:53:59.310338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'162","last_scrub_stamp":"2024-05-08T21:53:59.310186+0000","last_deep_scrub":"24'162","last_deep_scrub_stamp":"2024-05-08T21:53:59.310186+0000","last_clean_scrub_stamp":"2024-05-08T21:53:59.310186+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:27:09.329712+0000","scrub_duration":0.0038376149999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:03.071044+0000","last_change":"2024-05-08T21:54:03.071044+0000","last_active":"2024-05-08T21:54:03.071044+0000","last_peered":"2024-05-08T21:54:03.071044+0000","last_clean":"2024-05-08T21:54:03.071044+0000","last_became_active":"2024-05-08T21:49:43.215162+0000","last_became_peered":"2024-05-08T21:49:43.215162+0000","last_unstale":"2024-05-08T21:54:03.071044+0000","last_undegraded":"2024-05-08T21:54:03.071044+0000","last_fullsized":"2024-05-08T21:54:03.071044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:54:03.070884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:54:03.070884+0000","last_clean_scrub_stamp":"2024-05-08T21:54:03.070884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:30:50.889120+0000","scrub_duration":0.00223391,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"24'173","reported_seq":200,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:33.174471+0000","last_change":"2024-05-08T21:54:33.174595+0000","last_active":"2024-05-08T21:54:33.174471+0000","last_peered":"2024-05-08T21:54:33.174471+0000","last_clean":"2024-05-08T21:54:33.174471+0000","last_became_active":"2024-05-08T21:49:43.757233+0000","last_became_peered":"2024-05-08T21:49:43.757233+0000","last_unstale":"2024-05-08T21:54:33.174471+0000","last_undegraded":"2024-05-08T21:54:33.174471+0000","last_fullsized":"2024-05-08T21:54:33.174471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'173","last_scrub_stamp":"2024-05-08T21:54:33.174445+0000","last_deep_scrub":"24'173","last_deep_scrub_stamp":"2024-05-08T21:54:33.174445+0000","last_clean_scrub_stamp":"2024-05-08T21:54:33.174445+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:44:28.057777+0000","scrub_duration":0.0041494039999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:09.028045+0000","last_change":"2024-05-08T21:54:09.028045+0000","last_active":"2024-05-08T21:54:09.028045+0000","last_peered":"2024-05-08T21:54:09.028045+0000","last_clean":"2024-05-08T21:54:09.028045+0000","last_became_active":"2024-05-08T21:49:43.217595+0000","last_became_peered":"2024-05-08T21:49:43.217595+0000","last_unstale":"2024-05-08T21:54:09.028045+0000","last_undegraded":"2024-05-08T21:54:09.028045+0000","last_fullsized":"2024-05-08T21:54:09.028045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:54:09.027906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:54:09.027906+0000","last_clean_scrub_stamp":"2024-05-08T21:54:09.027906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:48:32.232583+0000","scrub_duration":0.001924608,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"24'164","reported_seq":191,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:06.967960+0000","last_change":"2024-05-08T21:54:06.967960+0000","last_active":"2024-05-08T21:54:06.967960+0000","last_peered":"2024-05-08T21:54:06.967960+0000","last_clean":"2024-05-08T21:54:06.967960+0000","last_became_active":"2024-05-08T21:49:43.766596+0000","last_became_peered":"2024-05-08T21:49:43.766596+0000","last_unstale":"2024-05-08T21:54:06.967960+0000","last_undegraded":"2024-05-08T21:54:06.967960+0000","last_fullsized":"2024-05-08T21:54:06.967960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'164","last_scrub_stamp":"2024-05-08T21:54:06.967815+0000","last_deep_scrub":"24'164","last_deep_scrub_stamp":"2024-05-08T21:54:06.967815+0000","last_clean_scrub_stamp":"2024-05-08T21:54:06.967815+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:20:27.502064+0000","scrub_duration":0.003136518,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"24'5","reported_seq":34,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:06.909587+0000","last_change":"2024-05-08T21:54:06.909587+0000","last_active":"2024-05-08T21:54:06.909587+0000","last_peered":"2024-05-08T21:54:06.909587+0000","last_clean":"2024-05-08T21:54:06.909587+0000","last_became_active":"2024-05-08T21:49:43.223974+0000","last_became_peered":"2024-05-08T21:49:43.223974+0000","last_unstale":"2024-05-08T21:54:06.909587+0000","last_undegraded":"2024-05-08T21:54:06.909587+0000","last_fullsized":"2024-05-08T21:54:06.909587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'5","last_scrub_stamp":"2024-05-08T21:54:06.909436+0000","last_deep_scrub":"24'5","last_deep_scrub_stamp":"2024-05-08T21:54:06.909436+0000","last_clean_scrub_stamp":"2024-05-08T21:54:06.909436+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:31:04.057767+0000","scrub_duration":0.0031627399999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"24'154","reported_seq":181,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:27.632207+0000","last_change":"2024-05-08T21:54:27.632376+0000","last_active":"2024-05-08T21:54:27.632207+0000","last_peered":"2024-05-08T21:54:27.632207+0000","last_clean":"2024-05-08T21:54:27.632207+0000","last_became_active":"2024-05-08T21:49:43.764075+0000","last_became_peered":"2024-05-08T21:49:43.764075+0000","last_unstale":"2024-05-08T21:54:27.632207+0000","last_undegraded":"2024-05-08T21:54:27.632207+0000","last_fullsized":"2024-05-08T21:54:27.632207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'154","last_scrub_stamp":"2024-05-08T21:54:27.632154+0000","last_deep_scrub":"24'154","last_deep_scrub_stamp":"2024-05-08T21:54:27.632154+0000","last_clean_scrub_stamp":"2024-05-08T21:54:27.632154+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:22:01.968898+0000","scrub_duration":0.004325995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:04.062533+0000","last_change":"2024-05-08T21:54:04.062533+0000","last_active":"2024-05-08T21:54:04.062533+0000","last_peered":"2024-05-08T21:54:04.062533+0000","last_clean":"2024-05-08T21:54:04.062533+0000","last_became_active":"2024-05-08T21:49:43.229121+0000","last_became_peered":"2024-05-08T21:49:43.229121+0000","last_unstale":"2024-05-08T21:54:04.062533+0000","last_undegraded":"2024-05-08T21:54:04.062533+0000","last_fullsized":"2024-05-08T21:54:04.062533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:54:04.062359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:54:04.062359+0000","last_clean_scrub_stamp":"2024-05-08T21:54:04.062359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:56:45.419906+0000","scrub_duration":0.0019280689999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"24'175","reported_seq":202,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:00.802783+0000","last_change":"2024-05-08T21:54:00.802783+0000","last_active":"2024-05-08T21:54:00.802783+0000","last_peered":"2024-05-08T21:54:00.802783+0000","last_clean":"2024-05-08T21:54:00.802783+0000","last_became_active":"2024-05-08T21:49:43.772528+0000","last_became_peered":"2024-05-08T21:49:43.772528+0000","last_unstale":"2024-05-08T21:54:00.802783+0000","last_undegraded":"2024-05-08T21:54:00.802783+0000","last_fullsized":"2024-05-08T21:54:00.802783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'175","last_scrub_stamp":"2024-05-08T21:54:00.802639+0000","last_deep_scrub":"24'175","last_deep_scrub_stamp":"2024-05-08T21:54:00.802639+0000","last_clean_scrub_stamp":"2024-05-08T21:54:00.802639+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:20:21.336889+0000","scrub_duration":0.0035440060000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"24'2","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:05.107638+0000","last_change":"2024-05-08T21:54:05.107638+0000","last_active":"2024-05-08T21:54:05.107638+0000","last_peered":"2024-05-08T21:54:05.107638+0000","last_clean":"2024-05-08T21:54:05.107638+0000","last_became_active":"2024-05-08T21:49:43.208326+0000","last_became_peered":"2024-05-08T21:49:43.208326+0000","last_unstale":"2024-05-08T21:54:05.107638+0000","last_undegraded":"2024-05-08T21:54:05.107638+0000","last_fullsized":"2024-05-08T21:54:05.107638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'2","last_scrub_stamp":"2024-05-08T21:54:05.107507+0000","last_deep_scrub":"24'2","last_deep_scrub_stamp":"2024-05-08T21:54:05.107507+0000","last_clean_scrub_stamp":"2024-05-08T21:54:05.107507+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:07:37.148022+0000","scrub_duration":0.0042913359999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"24'165","reported_seq":192,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:38.481906+0000","last_change":"2024-05-08T21:54:38.482037+0000","last_active":"2024-05-08T21:54:38.481906+0000","last_peered":"2024-05-08T21:54:38.481906+0000","last_clean":"2024-05-08T21:54:38.481906+0000","last_became_active":"2024-05-08T21:49:43.765789+0000","last_became_peered":"2024-05-08T21:49:43.765789+0000","last_unstale":"2024-05-08T21:54:38.481906+0000","last_undegraded":"2024-05-08T21:54:38.481906+0000","last_fullsized":"2024-05-08T21:54:38.481906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'165","last_scrub_stamp":"2024-05-08T21:54:38.481881+0000","last_deep_scrub":"24'165","last_deep_scrub_stamp":"2024-05-08T21:54:38.481881+0000","last_clean_scrub_stamp":"2024-05-08T21:54:38.481881+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:39:16.573283+0000","scrub_duration":0.0040214710000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"24'3","reported_seq":33,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:53:57.022707+0000","last_change":"2024-05-08T21:53:57.022707+0000","last_active":"2024-05-08T21:53:57.022707+0000","last_peered":"2024-05-08T21:53:57.022707+0000","last_clean":"2024-05-08T21:53:57.022707+0000","last_became_active":"2024-05-08T21:49:43.217814+0000","last_became_peered":"2024-05-08T21:49:43.217814+0000","last_unstale":"2024-05-08T21:53:57.022707+0000","last_undegraded":"2024-05-08T21:53:57.022707+0000","last_fullsized":"2024-05-08T21:53:57.022707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'3","last_scrub_stamp":"2024-05-08T21:53:57.022599+0000","last_deep_scrub":"24'3","last_deep_scrub_stamp":"2024-05-08T21:53:57.022599+0000","last_clean_scrub_stamp":"2024-05-08T21:53:57.022599+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:29.861054+0000","scrub_duration":0.0025112469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"24'162","reported_seq":189,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:26.148850+0000","last_change":"2024-05-08T21:54:26.148984+0000","last_active":"2024-05-08T21:54:26.148850+0000","last_peered":"2024-05-08T21:54:26.148850+0000","last_clean":"2024-05-08T21:54:26.148850+0000","last_became_active":"2024-05-08T21:49:43.775361+0000","last_became_peered":"2024-05-08T21:49:43.775361+0000","last_unstale":"2024-05-08T21:54:26.148850+0000","last_undegraded":"2024-05-08T21:54:26.148850+0000","last_fullsized":"2024-05-08T21:54:26.148850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'162","last_scrub_stamp":"2024-05-08T21:54:26.148824+0000","last_deep_scrub":"24'162","last_deep_scrub_stamp":"2024-05-08T21:54:26.148824+0000","last_clean_scrub_stamp":"2024-05-08T21:54:26.148824+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:34:58.088689+0000","scrub_duration":0.0029224049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"24'180","reported_seq":207,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:29.600070+0000","last_change":"2024-05-08T21:54:29.600208+0000","last_active":"2024-05-08T21:54:29.600070+0000","last_peered":"2024-05-08T21:54:29.600070+0000","last_clean":"2024-05-08T21:54:29.600070+0000","last_became_active":"2024-05-08T21:49:43.766789+0000","last_became_peered":"2024-05-08T21:49:43.766789+0000","last_unstale":"2024-05-08T21:54:29.600070+0000","last_undegraded":"2024-05-08T21:54:29.600070+0000","last_fullsized":"2024-05-08T21:54:29.600070+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'180","last_scrub_stamp":"2024-05-08T21:54:29.600045+0000","last_deep_scrub":"24'180","last_deep_scrub_stamp":"2024-05-08T21:54:29.600045+0000","last_clean_scrub_stamp":"2024-05-08T21:54:29.600045+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:58:16.500705+0000","scrub_duration":0.0046833999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"24'158","reported_seq":193,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:08.057981+0000","last_change":"2024-05-08T21:54:08.058100+0000","last_active":"2024-05-08T21:54:08.057981+0000","last_peered":"2024-05-08T21:54:08.057981+0000","last_clean":"2024-05-08T21:54:08.057981+0000","last_became_active":"2024-05-08T21:50:33.103289+0000","last_became_peered":"2024-05-08T21:50:33.103289+0000","last_unstale":"2024-05-08T21:54:08.057981+0000","last_undegraded":"2024-05-08T21:54:08.057981+0000","last_fullsized":"2024-05-08T21:54:08.057981+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'158","last_scrub_stamp":"2024-05-08T21:54:08.057953+0000","last_deep_scrub":"24'158","last_deep_scrub_stamp":"2024-05-08T21:54:08.057953+0000","last_clean_scrub_stamp":"2024-05-08T21:54:08.057953+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:50:52.275418+0000","scrub_duration":0.0042494200000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"24'153","reported_seq":180,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:32.535405+0000","last_change":"2024-05-08T21:54:32.535515+0000","last_active":"2024-05-08T21:54:32.535405+0000","last_peered":"2024-05-08T21:54:32.535405+0000","last_clean":"2024-05-08T21:54:32.535405+0000","last_became_active":"2024-05-08T21:49:43.767606+0000","last_became_peered":"2024-05-08T21:49:43.767606+0000","last_unstale":"2024-05-08T21:54:32.535405+0000","last_undegraded":"2024-05-08T21:54:32.535405+0000","last_fullsized":"2024-05-08T21:54:32.535405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'153","last_scrub_stamp":"2024-05-08T21:54:32.535380+0000","last_deep_scrub":"24'153","last_deep_scrub_stamp":"2024-05-08T21:54:32.535380+0000","last_clean_scrub_stamp":"2024-05-08T21:54:32.535380+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:12:07.158253+0000","scrub_duration":0.0038935720000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"24'134","reported_seq":161,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:18.700216+0000","last_change":"2024-05-08T21:54:18.700332+0000","last_active":"2024-05-08T21:54:18.700216+0000","last_peered":"2024-05-08T21:54:18.700216+0000","last_clean":"2024-05-08T21:54:18.700216+0000","last_became_active":"2024-05-08T21:49:43.774406+0000","last_became_peered":"2024-05-08T21:49:43.774406+0000","last_unstale":"2024-05-08T21:54:18.700216+0000","last_undegraded":"2024-05-08T21:54:18.700216+0000","last_fullsized":"2024-05-08T21:54:18.700216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'134","last_scrub_stamp":"2024-05-08T21:54:18.700166+0000","last_deep_scrub":"24'134","last_deep_scrub_stamp":"2024-05-08T21:54:18.700166+0000","last_clean_scrub_stamp":"2024-05-08T21:54:18.700166+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:25:17.326512+0000","scrub_duration":0.003361345,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"24'152","reported_seq":179,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:16.958102+0000","last_change":"2024-05-08T21:54:16.958241+0000","last_active":"2024-05-08T21:54:16.958102+0000","last_peered":"2024-05-08T21:54:16.958102+0000","last_clean":"2024-05-08T21:54:16.958102+0000","last_became_active":"2024-05-08T21:49:43.763937+0000","last_became_peered":"2024-05-08T21:49:43.763937+0000","last_unstale":"2024-05-08T21:54:16.958102+0000","last_undegraded":"2024-05-08T21:54:16.958102+0000","last_fullsized":"2024-05-08T21:54:16.958102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'152","last_scrub_stamp":"2024-05-08T21:54:16.958074+0000","last_deep_scrub":"24'152","last_deep_scrub_stamp":"2024-05-08T21:54:16.958074+0000","last_clean_scrub_stamp":"2024-05-08T21:54:16.958074+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:53:01.915370+0000","scrub_duration":0.004254791,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"24'166","reported_seq":193,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:27.166321+0000","last_change":"2024-05-08T21:54:27.166465+0000","last_active":"2024-05-08T21:54:27.166321+0000","last_peered":"2024-05-08T21:54:27.166321+0000","last_clean":"2024-05-08T21:54:27.166321+0000","last_became_active":"2024-05-08T21:49:43.757083+0000","last_became_peered":"2024-05-08T21:49:43.757083+0000","last_unstale":"2024-05-08T21:54:27.166321+0000","last_undegraded":"2024-05-08T21:54:27.166321+0000","last_fullsized":"2024-05-08T21:54:27.166321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'166","last_scrub_stamp":"2024-05-08T21:54:27.166276+0000","last_deep_scrub":"24'166","last_deep_scrub_stamp":"2024-05-08T21:54:27.166276+0000","last_clean_scrub_stamp":"2024-05-08T21:54:27.166276+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:33:38.486597+0000","scrub_duration":0.0037007120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"24'217","reported_seq":244,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:31.612578+0000","last_change":"2024-05-08T21:54:31.612692+0000","last_active":"2024-05-08T21:54:31.612578+0000","last_peered":"2024-05-08T21:54:31.612578+0000","last_clean":"2024-05-08T21:54:31.612578+0000","last_became_active":"2024-05-08T21:49:43.773203+0000","last_became_peered":"2024-05-08T21:49:43.773203+0000","last_unstale":"2024-05-08T21:54:31.612578+0000","last_undegraded":"2024-05-08T21:54:31.612578+0000","last_fullsized":"2024-05-08T21:54:31.612578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'217","last_scrub_stamp":"2024-05-08T21:54:31.612549+0000","last_deep_scrub":"24'217","last_deep_scrub_stamp":"2024-05-08T21:54:31.612549+0000","last_clean_scrub_stamp":"2024-05-08T21:54:31.612549+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:25.122227+0000","scrub_duration":0.004118549,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"24'160","reported_seq":187,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:34.170757+0000","last_change":"2024-05-08T21:54:34.170889+0000","last_active":"2024-05-08T21:54:34.170757+0000","last_peered":"2024-05-08T21:54:34.170757+0000","last_clean":"2024-05-08T21:54:34.170757+0000","last_became_active":"2024-05-08T21:49:43.761645+0000","last_became_peered":"2024-05-08T21:49:43.761645+0000","last_unstale":"2024-05-08T21:54:34.170757+0000","last_undegraded":"2024-05-08T21:54:34.170757+0000","last_fullsized":"2024-05-08T21:54:34.170757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'160","last_scrub_stamp":"2024-05-08T21:54:34.170729+0000","last_deep_scrub":"24'160","last_deep_scrub_stamp":"2024-05-08T21:54:34.170729+0000","last_clean_scrub_stamp":"2024-05-08T21:54:34.170729+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:27.680408+0000","scrub_duration":0.003151853,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"24'207","reported_seq":234,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:23.555458+0000","last_change":"2024-05-08T21:54:23.555587+0000","last_active":"2024-05-08T21:54:23.555458+0000","last_peered":"2024-05-08T21:54:23.555458+0000","last_clean":"2024-05-08T21:54:23.555458+0000","last_became_active":"2024-05-08T21:49:43.768673+0000","last_became_peered":"2024-05-08T21:49:43.768673+0000","last_unstale":"2024-05-08T21:54:23.555458+0000","last_undegraded":"2024-05-08T21:54:23.555458+0000","last_fullsized":"2024-05-08T21:54:23.555458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'207","last_scrub_stamp":"2024-05-08T21:54:23.555432+0000","last_deep_scrub":"24'207","last_deep_scrub_stamp":"2024-05-08T21:54:23.555432+0000","last_clean_scrub_stamp":"2024-05-08T21:54:23.555432+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:33:34.875753+0000","scrub_duration":0.0045520810000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":475136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"24'150","reported_seq":177,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:32.133628+0000","last_change":"2024-05-08T21:54:32.133764+0000","last_active":"2024-05-08T21:54:32.133628+0000","last_peered":"2024-05-08T21:54:32.133628+0000","last_clean":"2024-05-08T21:54:32.133628+0000","last_became_active":"2024-05-08T21:49:43.765723+0000","last_became_peered":"2024-05-08T21:49:43.765723+0000","last_unstale":"2024-05-08T21:54:32.133628+0000","last_undegraded":"2024-05-08T21:54:32.133628+0000","last_fullsized":"2024-05-08T21:54:32.133628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'150","last_scrub_stamp":"2024-05-08T21:54:32.133601+0000","last_deep_scrub":"24'150","last_deep_scrub_stamp":"2024-05-08T21:54:32.133601+0000","last_clean_scrub_stamp":"2024-05-08T21:54:32.133601+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:58:19.034261+0000","scrub_duration":0.0045527120000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"24'199","reported_seq":226,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:43.432688+0000","last_change":"2024-05-08T21:54:43.432806+0000","last_active":"2024-05-08T21:54:43.432688+0000","last_peered":"2024-05-08T21:54:43.432688+0000","last_clean":"2024-05-08T21:54:43.432688+0000","last_became_active":"2024-05-08T21:49:43.774808+0000","last_became_peered":"2024-05-08T21:49:43.774808+0000","last_unstale":"2024-05-08T21:54:43.432688+0000","last_undegraded":"2024-05-08T21:54:43.432688+0000","last_fullsized":"2024-05-08T21:54:43.432688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'199","last_scrub_stamp":"2024-05-08T21:54:43.432663+0000","last_deep_scrub":"24'199","last_deep_scrub_stamp":"2024-05-08T21:54:43.432663+0000","last_clean_scrub_stamp":"2024-05-08T21:54:43.432663+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:05:01.271404+0000","scrub_duration":0.0042933809999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"24'154","reported_seq":181,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:24.594237+0000","last_change":"2024-05-08T21:54:24.594347+0000","last_active":"2024-05-08T21:54:24.594237+0000","last_peered":"2024-05-08T21:54:24.594237+0000","last_clean":"2024-05-08T21:54:24.594237+0000","last_became_active":"2024-05-08T21:49:43.774881+0000","last_became_peered":"2024-05-08T21:49:43.774881+0000","last_unstale":"2024-05-08T21:54:24.594237+0000","last_undegraded":"2024-05-08T21:54:24.594237+0000","last_fullsized":"2024-05-08T21:54:24.594237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'154","last_scrub_stamp":"2024-05-08T21:54:24.594209+0000","last_deep_scrub":"24'154","last_deep_scrub_stamp":"2024-05-08T21:54:24.594209+0000","last_clean_scrub_stamp":"2024-05-08T21:54:24.594209+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:41.446863+0000","scrub_duration":0.0038226269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"24'179","reported_seq":206,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T21:54:14.680464+0000","last_change":"2024-05-08T21:54:14.680464+0000","last_active":"2024-05-08T21:54:14.680464+0000","last_peered":"2024-05-08T21:54:14.680464+0000","last_clean":"2024-05-08T21:54:14.680464+0000","last_became_active":"2024-05-08T21:49:43.763907+0000","last_became_peered":"2024-05-08T21:49:43.763907+0000","last_unstale":"2024-05-08T21:54:14.680464+0000","last_undegraded":"2024-05-08T21:54:14.680464+0000","last_fullsized":"2024-05-08T21:54:14.680464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'179","last_scrub_stamp":"2024-05-08T21:54:14.680299+0000","last_deep_scrub":"24'179","last_deep_scrub_stamp":"2024-05-08T21:54:14.680299+0000","last_clean_scrub_stamp":"2024-05-08T21:54:14.680299+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:52:59.637596+0000","scrub_duration":0.0048495500000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":417792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9216,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11255,"ondisk_log_size":11255,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":389133,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":84,"num_read_kb":92,"num_write":260,"num_write_kb":561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":843776,"data_stored":778266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":270,"ondisk_log_size":270,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509509,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31936,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339904,"statfs":{"total":96636764160,"available":96604061696,"internally_reserved":0,"allocated":843776,"data_stored":682658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:54:50 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.61199999999999999,"15min":0.60599999999999998},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.76700000000000002,"5min":3.5680000000000001,"15min":3.5680000000000001},"last":0.501},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.64800000000000002,"15min":0.61799999999999999},"min":{"1min":0.42799999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.77100000000000002,"5min":3.6469999999999998,"15min":3.6469999999999998},"last":0.58199999999999996}]},{"osd":1,"last update":"Wed May 8 21:54:50 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.59999999999999998,"15min":0.56399999999999995},"min":{"1min":0.35999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.747,"5min":3.2669999999999999,"15min":3.2669999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.65900000000000003,"15min":0.59399999999999997},"min":{"1min":0.312,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.71099999999999997,"5min":5.5330000000000004,"15min":5.5330000000000004},"last":0.55800000000000005}]},{"osd":2,"last update":"Wed May 8 21:54:50 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.61599999999999999,"15min":0.57799999999999996},"min":{"1min":0.436,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.66800000000000004,"5min":5.0730000000000004,"15min":5.0730000000000004},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.60399999999999998,"15min":0.57199999999999995},"min":{"1min":0.432,"5min":0.25,"15min":0.25},"max":{"1min":0.72099999999999997,"5min":4.0250000000000004,"15min":4.0250000000000004},"last":0.38200000000000001}]},{"osd":3,"last update":"Wed May 8 21:54:50 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.77600000000000002,"15min":0.64700000000000002},"min":{"1min":0.45800000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.67800000000000005,"5min":20.791,"15min":20.791},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59999999999999998,"15min":0.60299999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.78500000000000003,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.46800000000000003}]},{"osd":4,"last update":"Wed May 8 21:54:50 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.51900000000000002,"15min":0.504},"min":{"1min":0.33600000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.65400000000000003,"5min":4.0979999999999999,"15min":4.0979999999999999},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52100000000000002,"15min":0.52500000000000002},"min":{"1min":0.36499999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.66900000000000004,"5min":1.133,"15min":1.133},"last":0.39800000000000002}]},{"osd":5,"last update":"Wed May 8 21:54:50 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52300000000000002,"15min":0.53100000000000003},"min":{"1min":0.34699999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72399999999999998,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.622,"15min":0.59399999999999997},"min":{"1min":0.41099999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.69299999999999995,"5min":7.0890000000000004,"15min":7.0890000000000004},"last":0.51100000000000001}]},{"osd":6,"last update":"Wed May 8 21:54:50 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.47299999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.73399999999999999,"5min":2.2440000000000002,"15min":2.2440000000000002},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57499999999999996,"15min":0.59399999999999997},"min":{"1min":0.436,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.70599999999999996,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.54000000000000004}]}]},{"osd":6,"up_from":15,"seq":64424509508,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31740,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340100,"statfs":{"total":96636764160,"available":96604262400,"internally_reserved":0,"allocated":643072,"data_stored":479538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:54:46 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.91500000000000004,"15min":0.66200000000000003},"min":{"1min":0.35799999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.66100000000000003,"5min":23.625,"15min":23.625},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.54200000000000004,"5min":2.2690000000000001,"15min":1.129},"min":{"1min":0.32700000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.68999999999999995,"5min":73.831999999999994,"15min":73.831999999999994},"last":0.69299999999999995}]},{"osd":1,"last update":"Wed May 8 21:54:46 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.83599999999999997,"15min":0.73399999999999999},"min":{"1min":0.43099999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.71399999999999997,"5min":11.552,"15min":11.552},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.58199999999999996,"5min":1.01,"15min":0.73199999999999998},"min":{"1min":0.40899999999999997,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.64200000000000002,"5min":11.619999999999999,"15min":11.619999999999999},"last":0.63300000000000001}]},{"osd":2,"last update":"Wed May 8 21:54:46 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":1.5509999999999999,"15min":0.88300000000000001},"min":{"1min":0.41599999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.67200000000000004,"5min":36.951000000000001,"15min":36.951000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.86299999999999999,"15min":0.69299999999999995},"min":{"1min":0.40400000000000003,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.746,"5min":20.956,"15min":20.956},"last":0.64600000000000002}]},{"osd":3,"last update":"Wed May 8 21:54:46 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.79100000000000004,"15min":0.68100000000000005},"min":{"1min":0.46899999999999997,"5min":0.38,"15min":0.38},"max":{"1min":0.75800000000000001,"5min":7.9690000000000003,"15min":7.9690000000000003},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.78200000000000003,"15min":0.66800000000000004},"min":{"1min":0.47799999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.69499999999999995,"5min":8.0709999999999997,"15min":8.0709999999999997},"last":0.71999999999999997}]},{"osd":4,"last update":"Wed May 8 21:54:46 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.53500000000000003,"15min":0.505},"min":{"1min":0.33000000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.68500000000000005,"5min":5.1840000000000002,"15min":5.1840000000000002},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.55400000000000005,"15min":0.53000000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.73099999999999998,"5min":2.976,"15min":2.976},"last":0.52800000000000002}]},{"osd":5,"last update":"Wed May 8 21:54:46 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.53000000000000003,"15min":0.497},"min":{"1min":0.34599999999999997,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.70999999999999996,"5min":3.0369999999999999,"15min":3.0369999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.60099999999999998,"15min":0.56999999999999995},"min":{"1min":0.38600000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.74299999999999999,"5min":5.1219999999999999,"15min":5.1219999999999999},"last":0.54800000000000004}]},{"osd":7,"last update":"Wed May 8 21:54:46 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.62,"15min":0.56999999999999995},"min":{"1min":0.36599999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.72399999999999998,"5min":4.0389999999999997,"15min":4.0389999999999997},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.60199999999999998,"15min":0.56799999999999995},"min":{"1min":0.41599999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.75700000000000001,"5min":2.883,"15min":2.883},"last":0.623}]}]},{"osd":5,"up_from":13,"seq":55834574915,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35452,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94336388,"statfs":{"total":96636764160,"available":96600461312,"internally_reserved":0,"allocated":249856,"data_stored":91798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:54:50 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.71799999999999997,"15min":0.628},"min":{"1min":0.40600000000000003,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.75600000000000001,"5min":5.7889999999999997,"15min":5.7889999999999997},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.56399999999999995,"5min":1.101,"15min":0.77100000000000002},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.74399999999999999,"5min":24.751000000000001,"15min":24.751000000000001},"last":0.61799999999999999}]},{"osd":1,"last update":"Wed May 8 21:54:45 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":1.2849999999999999,"15min":0.83999999999999997},"min":{"1min":0.38500000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.751,"5min":53.069000000000003,"15min":53.069000000000003},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.55400000000000005,"5min":1.694,"15min":0.88900000000000001},"min":{"1min":0.38200000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.72899999999999998,"5min":80.463999999999999,"15min":80.463999999999999},"last":0.48199999999999998}]},{"osd":2,"last update":"Wed May 8 21:54:50 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":1.2410000000000001,"15min":0.83899999999999997},"min":{"1min":0.38200000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.75700000000000001,"5min":24.332000000000001,"15min":24.332000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.622,"5min":1.288,"15min":0.81599999999999995},"min":{"1min":0.50700000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.75700000000000001,"5min":24.349,"15min":24.349},"last":0.60299999999999998}]},{"osd":3,"last update":"Wed May 8 21:54:50 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":1.258,"15min":0.77800000000000002},"min":{"1min":0.47099999999999997,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.71799999999999997,"5min":33.368000000000002,"15min":33.368000000000002},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.83999999999999997,"15min":0.69399999999999995},"min":{"1min":0.42599999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.77700000000000002,"5min":8.125,"15min":8.125},"last":0.51600000000000001}]},{"osd":4,"last update":"Wed May 8 21:54:50 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.504,"15min":0.52600000000000002},"min":{"1min":0.32400000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.71999999999999997,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.59899999999999998,"15min":0.60599999999999998},"min":{"1min":0.34599999999999997,"5min":0.307,"15min":0.307},"max":{"1min":0.66400000000000003,"5min":5.0149999999999997,"15min":5.0149999999999997},"last":0.499}]},{"osd":6,"last update":"Wed May 8 21:54:50 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.72299999999999998,"15min":0.59499999999999997},"min":{"1min":0.33600000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.63900000000000001,"5min":8.7430000000000003,"15min":8.7430000000000003},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.57799999999999996,"15min":0.59299999999999997},"min":{"1min":0.312,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.79600000000000004,"5min":2.5649999999999999,"15min":2.5649999999999999},"last":0.57699999999999996}]},{"osd":7,"last update":"Wed May 8 21:54:50 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.75,"15min":0.65800000000000003},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.77800000000000002,"5min":9.5380000000000003,"15min":9.5380000000000003},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.72299999999999998,"15min":0.61399999999999999},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.73699999999999999,"5min":8.7959999999999994,"15min":8.7959999999999994},"last":0.53000000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574914,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31360,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340480,"statfs":{"total":96636764160,"available":96604651520,"internally_reserved":0,"allocated":253952,"data_stored":91868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:54:47 2024","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":2.161,"15min":1.1519999999999999},"min":{"1min":0.253,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.56000000000000005,"5min":119.55200000000001,"15min":119.55200000000001},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.95599999999999996,"15min":0.81599999999999995},"min":{"1min":0.22700000000000001,"5min":0.192,"15min":0.192},"max":{"1min":0.59799999999999998,"5min":23.457999999999998,"15min":23.457999999999998},"last":0.50700000000000001}]},{"osd":2,"last update":"Wed May 8 21:54:47 2024","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":1.1100000000000001,"15min":0.67800000000000005},"min":{"1min":0.25,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.629,"5min":33.259,"15min":33.259},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.40400000000000003,"5min":1.266,"15min":0.94699999999999995},"min":{"1min":0.26500000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.54100000000000004,"5min":43.167000000000002,"15min":43.167000000000002},"last":0.45300000000000001}]},{"osd":3,"last update":"Wed May 8 21:54:47 2024","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":1.2569999999999999,"15min":0.71299999999999997},"min":{"1min":0.25900000000000001,"5min":0.247,"15min":0.247},"max":{"1min":0.61799999999999999,"5min":43.131,"15min":43.131},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.41999999999999998,"5min":1.7949999999999999,"15min":0.88100000000000001},"min":{"1min":0.34100000000000003,"5min":0.253,"15min":0.253},"max":{"1min":0.68799999999999994,"5min":52.923999999999999,"15min":52.923999999999999},"last":0.42099999999999999}]},{"osd":4,"last update":"Wed May 8 21:54:47 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":1.038,"15min":0.78100000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.67500000000000004,"5min":16.914000000000001,"15min":16.914000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.59799999999999998,"5min":1.292,"15min":0.83199999999999996},"min":{"1min":0.40000000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.747,"5min":43.078000000000003,"15min":43.078000000000003},"last":0.629}]},{"osd":5,"last update":"Wed May 8 21:54:41 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":1.262,"15min":0.85599999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.70199999999999996,"5min":33.198,"15min":33.198},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.91400000000000003,"15min":0.98799999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.72899999999999998,"5min":9.2400000000000002,"15min":9.2400000000000002},"last":0.63900000000000001}]},{"osd":6,"last update":"Wed May 8 21:54:47 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.90300000000000002,"15min":0.96199999999999997},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.77800000000000002,"5min":9.202,"15min":9.202},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":1.232,"15min":0.86499999999999999},"min":{"1min":0.40400000000000003,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.82299999999999995,"5min":33.283000000000001,"15min":33.283000000000001},"last":0.65200000000000002}]},{"osd":7,"last update":"Wed May 8 21:54:47 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.90600000000000003,"15min":0.97799999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.872,"5min":9.2249999999999996,"15min":9.2249999999999996},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.61599999999999999,"5min":1.1639999999999999,"15min":0.85099999999999998},"min":{"1min":0.44600000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.85999999999999999,"5min":16.981000000000002,"15min":16.981000000000002},"last":0.61799999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509507,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31944,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339896,"statfs":{"total":96636764160,"available":96604053504,"internally_reserved":0,"allocated":851968,"data_stored":682714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 8 21:54:47 2024","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.63800000000000001,"15min":0.46999999999999997},"min":{"1min":0.216,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.53000000000000003,"5min":27.239999999999998,"15min":27.239999999999998},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.73499999999999999,"15min":0.52600000000000002},"min":{"1min":0.29799999999999999,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.55600000000000005,"5min":27.643000000000001,"15min":27.643000000000001},"last":0.34000000000000002}]},{"osd":2,"last update":"Wed May 8 21:54:47 2024","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.628,"15min":0.48399999999999999},"min":{"1min":0.247,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.52300000000000002,"5min":25.739000000000001,"15min":25.739000000000001},"last":0.312},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.47599999999999998,"15min":0.432},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.59699999999999998,"5min":4.9989999999999997,"15min":4.9989999999999997},"last":0.38200000000000001}]},{"osd":3,"last update":"Wed May 8 21:54:47 2024","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.71399999999999997,"15min":0.52100000000000002},"min":{"1min":0.255,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.61299999999999999,"5min":13.685,"15min":13.685},"last":0.372},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.71699999999999997,"15min":0.54300000000000004},"min":{"1min":0.312,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.64200000000000002,"5min":28.379999999999999,"15min":28.379999999999999},"last":0.39800000000000002}]},{"osd":4,"last update":"Wed May 8 21:54:47 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.70799999999999996,"15min":0.63},"min":{"1min":0.44400000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.84799999999999998,"5min":5.6790000000000003,"15min":5.6790000000000003},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.83599999999999997,"15min":0.65200000000000002},"min":{"1min":0.47099999999999997,"5min":0.309,"15min":0.309},"max":{"1min":0.72499999999999998,"5min":13.794,"15min":13.794},"last":0.56799999999999995}]},{"osd":5,"last update":"Wed May 8 21:54:47 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.86199999999999999,"15min":0.67800000000000005},"min":{"1min":0.50800000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.81999999999999995,"5min":13.827,"15min":13.827},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.67700000000000005,"15min":0.65300000000000002},"min":{"1min":0.52200000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.86499999999999999,"5min":4.9240000000000004,"15min":4.9240000000000004},"last":0.59899999999999998}]},{"osd":6,"last update":"Wed May 8 21:54:47 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.72099999999999997,"15min":0.65800000000000003},"min":{"1min":0.46200000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.82899999999999996,"5min":8.3379999999999992,"15min":8.3379999999999992},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.70699999999999996,"15min":0.63600000000000001},"min":{"1min":0.49299999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.78800000000000003,"5min":5.6500000000000004,"15min":5.6500000000000004},"last":0.58399999999999996}]},{"osd":7,"last update":"Wed May 8 21:54:47 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.77200000000000002,"15min":0.68200000000000005},"min":{"1min":0.53800000000000003,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.83999999999999997,"5min":9.1950000000000003,"15min":9.1950000000000003},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.875,"15min":0.71099999999999997},"min":{"1min":0.41899999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.83499999999999996,"5min":13.756,"15min":13.756},"last":0.51000000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509508,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31356,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340484,"statfs":{"total":96636764160,"available":96604655616,"internally_reserved":0,"allocated":249856,"data_stored":92213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:54:47 2024","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.434,"15min":0.35399999999999998},"min":{"1min":0.214,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.54000000000000004,"5min":3.73,"15min":3.73},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.45200000000000001,"15min":0.38600000000000001},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.55400000000000005,"5min":3.1600000000000001,"15min":3.1600000000000001},"last":0.40600000000000003}]},{"osd":1,"last update":"Wed May 8 21:54:47 2024","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.40300000000000002,"15min":0.36499999999999999},"min":{"1min":0.30299999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.45100000000000001,"5min":3.1930000000000001,"15min":3.1930000000000001},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.376,"5min":0.40400000000000003,"15min":0.376},"min":{"1min":0.28199999999999997,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.53700000000000003,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":0.49099999999999999}]},{"osd":3,"last update":"Wed May 8 21:54:47 2024","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":1.125,"15min":0.60999999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.57999999999999996,"5min":60.899000000000001,"15min":60.899000000000001},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.54500000000000004,"15min":0.439},"min":{"1min":0.318,"5min":0.246,"15min":0.246},"max":{"1min":0.55800000000000005,"5min":9.7469999999999999,"15min":9.7469999999999999},"last":0.64700000000000002}]},{"osd":4,"last update":"Wed May 8 21:54:47 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.70099999999999996,"15min":0.63900000000000001},"min":{"1min":0.45300000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.872,"5min":7.8499999999999996,"15min":7.8499999999999996},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.72999999999999998,"15min":0.66200000000000003},"min":{"1min":0.47499999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.85099999999999998,"5min":8.1189999999999998,"15min":8.1189999999999998},"last":0.54200000000000004}]},{"osd":5,"last update":"Wed May 8 21:54:47 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.77600000000000002,"15min":0.65300000000000002},"min":{"1min":0.46200000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.82099999999999995,"5min":11.326000000000001,"15min":11.326000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.69899999999999995,"15min":0.63100000000000001},"min":{"1min":0.38100000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.83599999999999997,"5min":7.8860000000000001,"15min":7.8860000000000001},"last":0.56499999999999995}]},{"osd":6,"last update":"Wed May 8 21:54:47 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.69399999999999995,"15min":0.63600000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.746,"5min":8.1709999999999994,"15min":8.1709999999999994},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.77300000000000002,"15min":0.66200000000000003},"min":{"1min":0.42899999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.86699999999999999,"5min":10.41,"15min":10.41},"last":0.71199999999999997}]},{"osd":7,"last update":"Wed May 8 21:54:47 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.68100000000000005,"15min":0.624},"min":{"1min":0.42599999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.85299999999999998,"5min":5.2699999999999996,"15min":5.2699999999999996},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.73099999999999998,"15min":0.65300000000000002},"min":{"1min":0.436,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.83199999999999996,"5min":7.5810000000000004,"15min":7.5810000000000004},"last":0.59899999999999998}]}]},{"osd":3,"up_from":15,"seq":64424509507,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35840,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94336000,"statfs":{"total":96636764160,"available":96600064000,"internally_reserved":0,"allocated":647168,"data_stored":480043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36043208},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:54:45 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.68999999999999995,"15min":0.47799999999999998},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.52200000000000002,"5min":39.470999999999997,"15min":39.470999999999997},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.68000000000000005,"15min":0.47999999999999998},"min":{"1min":0.23499999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.5,"5min":32.802,"15min":32.802},"last":0.499}]},{"osd":1,"last update":"Wed May 8 21:54:45 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.378,"15min":0.38500000000000001},"min":{"1min":0.24299999999999999,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.53700000000000003,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.434},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.82499999999999996,"15min":0.56299999999999994},"min":{"1min":0.29399999999999998,"5min":0.248,"15min":0.248},"max":{"1min":0.626,"5min":43.493000000000002,"15min":43.493000000000002},"last":0.47399999999999998}]},{"osd":2,"last update":"Wed May 8 21:54:45 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.84299999999999997,"15min":0.59099999999999997},"min":{"1min":0.25900000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.58999999999999997,"5min":43.445999999999998,"15min":43.445999999999998},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.83599999999999997,"15min":0.59499999999999997},"min":{"1min":0.317,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.70399999999999996,"5min":39.569000000000003,"15min":39.569000000000003},"last":0.51800000000000002}]},{"osd":4,"last update":"Wed May 8 21:54:45 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.63700000000000001,"15min":0.61699999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.92000000000000004,"5min":1.881,"15min":1.881},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.628,"5min":0.85699999999999998,"15min":0.70399999999999996},"min":{"1min":0.41199999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.90100000000000002,"5min":19.024999999999999,"15min":19.024999999999999},"last":0.82599999999999996}]},{"osd":5,"last update":"Wed May 8 21:54:45 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.63200000000000001,"15min":0.627},"min":{"1min":0.47899999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.83399999999999996,"5min":1.833,"15min":1.833},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.92500000000000004,"15min":0.72299999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.93600000000000005,"5min":27.678999999999998,"15min":27.678999999999998},"last":0.71899999999999997}]},{"osd":6,"last update":"Wed May 8 21:54:45 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.66100000000000003,"15min":0.64600000000000002},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.86199999999999999,"5min":1.915,"15min":1.915},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.95899999999999996,"15min":0.76900000000000002},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.90800000000000003,"5min":32.655000000000001,"15min":32.655000000000001},"last":0.78000000000000003}]},{"osd":7,"last update":"Wed May 8 21:54:45 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69399999999999995,"15min":0.67000000000000004},"min":{"1min":0.48099999999999998,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.93300000000000005,"5min":3.4089999999999998,"15min":3.4089999999999998},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.89000000000000001,"15min":0.72399999999999998},"min":{"1min":0.436,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83899999999999997,"5min":18.939,"15min":18.939},"last":0.70199999999999996}]}]},{"osd":4,"up_from":15,"seq":64424509507,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31364,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340476,"statfs":{"total":96636764160,"available":96604647424,"internally_reserved":0,"allocated":258048,"data_stored":91834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:54:44 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.84699999999999998,"15min":0.60799999999999998},"min":{"1min":0.30199999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.79400000000000004,"5min":21.042999999999999,"15min":21.042999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.88700000000000001,"15min":0.65700000000000003},"min":{"1min":0.46600000000000003,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.81499999999999995,"5min":21.478999999999999,"15min":21.478999999999999},"last":0.55100000000000005}]},{"osd":1,"last update":"Wed May 8 21:54:44 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.83999999999999997,"15min":0.63200000000000001},"min":{"1min":0.33500000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.67700000000000005,"5min":14.555999999999999,"15min":14.555999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.65200000000000002,"15min":0.56000000000000005},"min":{"1min":0.38900000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.82399999999999995,"5min":7.7140000000000004,"15min":7.7140000000000004},"last":0.52400000000000002}]},{"osd":2,"last update":"Wed May 8 21:54:44 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.70599999999999996,"15min":0.58599999999999997},"min":{"1min":0.378,"5min":0.377,"15min":0.377},"max":{"1min":0.72499999999999998,"5min":11.724,"15min":11.724},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.66300000000000003,"15min":0.59099999999999997},"min":{"1min":0.42899999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.80200000000000005,"5min":4.6740000000000004,"15min":4.6740000000000004},"last":0.56299999999999994}]},{"osd":3,"last update":"Wed May 8 21:54:44 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.94099999999999995,"15min":0.68500000000000005},"min":{"1min":0.46100000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.73299999999999998,"5min":30.84,"15min":30.84},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.89200000000000002,"15min":0.69199999999999995},"min":{"1min":0.42499999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.82799999999999996,"5min":21.754000000000001,"15min":21.754000000000001},"last":0.42499999999999999}]},{"osd":5,"last update":"Wed May 8 21:54:44 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.51500000000000001,"15min":0.50900000000000001},"min":{"1min":0.34000000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.64500000000000002,"5min":4.4660000000000002,"15min":4.4660000000000002},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.55800000000000005,"15min":0.56200000000000006},"min":{"1min":0.40699999999999997,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68600000000000005,"5min":5.2190000000000003,"15min":5.2190000000000003},"last":0.5}]},{"osd":6,"last update":"Wed May 8 21:54:44 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.59899999999999998,"15min":0.59099999999999997},"min":{"1min":0.36499999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.73799999999999999,"5min":4.9720000000000004,"15min":4.9720000000000004},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.59199999999999997,"15min":0.60199999999999998},"min":{"1min":0.38700000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.71899999999999997,"5min":4.4100000000000001,"15min":4.4100000000000001},"last":0.44400000000000001}]},{"osd":7,"last update":"Wed May 8 21:54:44 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.58799999999999997,"15min":0.60799999999999998},"min":{"1min":0.40100000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.66300000000000003,"5min":4.444,"15min":4.444},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.66600000000000004,"15min":0.65700000000000003},"min":{"1min":0.39100000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.77300000000000002,"5min":5.0430000000000001,"15min":5.0430000000000001},"last":0.58299999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":388335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":397312,"data_stored":387830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T21:55:00.211 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-05-08T21:55:00.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.366+0000 7fbc3d930700 1 Processor -- start 2024-05-08T21:55:00.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.366+0000 7fbc3d930700 1 -- start start 2024-05-08T21:55:00.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.367+0000 7fbc3d930700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fbc3815d170 0x7fbc3815d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:55:00.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.367+0000 7fbc3d930700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc380729f0 con 0x7fbc38153c00 2024-05-08T21:55:00.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.367+0000 7fbc3d930700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc3815a800 con 0x7fbc380cb690 2024-05-08T21:55:00.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.367+0000 7fbc3d930700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc38072800 con 0x7fbc3815d170 2024-05-08T21:55:00.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.367+0000 7fbc36ffd700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fbc38153c00 0x7fbc380720f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:59764/0 (socket says 172.21.15.73:59764) 2024-05-08T21:55:00.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.367+0000 7fbc36ffd700 1 -- 172.21.15.73:0/503430150 learned_addr learned my addr 172.21.15.73:0/503430150 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:55:00.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.367+0000 7fbc377fe700 1 --2- 172.21.15.73:0/503430150 >> v2:172.21.15.115:3300/0 conn(0x7fbc3815d170 0x7fbc3815d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:55:00.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.367+0000 7fbc35ffb700 1 -- 172.21.15.73:0/503430150 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3325460195 0 0) 0x7fbc380729f0 con 0x7fbc38153c00 2024-05-08T21:55:00.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.367+0000 7fbc35ffb700 1 -- 172.21.15.73:0/503430150 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc200035b0 con 0x7fbc38153c00 2024-05-08T21:55:00.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.367+0000 7fbc377fe700 1 -- 172.21.15.73:0/503430150 >> v1:172.21.15.115:6789/0 conn(0x7fbc380cb690 legacy=0x7fbc380c9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:55:00.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.367+0000 7fbc35ffb700 1 -- 172.21.15.73:0/503430150 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 991136980 0 0) 0x7fbc200035b0 con 0x7fbc38153c00 2024-05-08T21:55:00.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.367+0000 7fbc377fe700 1 -- 172.21.15.73:0/503430150 >> v1:172.21.15.73:6789/0 conn(0x7fbc38153c00 legacy=0x7fbc380720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:55:00.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.367+0000 7fbc377fe700 1 -- 172.21.15.73:0/503430150 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc38159c90 con 0x7fbc3815d170 2024-05-08T21:55:00.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.368+0000 7fbc377fe700 1 --2- 172.21.15.73:0/503430150 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc3815d170 0x7fbc3815d5a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbc30009d90 tx=0x7fbc3000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ddd3cf518260239 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:55:00.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.368+0000 7fbc35ffb700 1 -- 172.21.15.73:0/503430150 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3000e070 con 0x7fbc3815d170 2024-05-08T21:55:00.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.368+0000 7fbc35ffb700 1 -- 172.21.15.73:0/503430150 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc30003a20 con 0x7fbc3815d170 2024-05-08T21:55:00.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.368+0000 7fbc35ffb700 1 -- 172.21.15.73:0/503430150 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc2c001670 con 0x7fbc3815d170 2024-05-08T21:55:00.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.368+0000 7fbc3d930700 1 -- 172.21.15.73:0/503430150 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc3815d170 msgr2=0x7fbc3815d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:55:00.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.368+0000 7fbc3d930700 1 --2- 172.21.15.73:0/503430150 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc3815d170 0x7fbc3815d5a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbc30009d90 tx=0x7fbc3000b330 comp rx=0 tx=0).stop 2024-05-08T21:55:00.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.368+0000 7fbc3d930700 1 -- 172.21.15.73:0/503430150 shutdown_connections 2024-05-08T21:55:00.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.368+0000 7fbc3d930700 1 --2- 172.21.15.73:0/503430150 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc3815d170 0x7fbc3815d5a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:00.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.368+0000 7fbc3d930700 1 -- 172.21.15.73:0/503430150 >> 172.21.15.73:0/503430150 conn(0x7fbc3806be70 msgr2=0x7fbc3806c380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:55:00.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.368+0000 7fbc3d930700 1 -- 172.21.15.73:0/503430150 shutdown_connections 2024-05-08T21:55:00.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.368+0000 7fbc3d930700 1 -- 172.21.15.73:0/503430150 wait complete. 2024-05-08T21:55:00.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.369+0000 7fbc3d930700 1 Processor -- start 2024-05-08T21:55:00.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.370+0000 7fbc3d930700 1 -- start start 2024-05-08T21:55:00.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.370+0000 7fbc3d930700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbc380cb690 0x7fbc38152060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:55:00.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.370+0000 7fbc3d930700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc38153c00 0x7fbc3814c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:55:00.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.370+0000 7fbc3d930700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc3815d170 0x7fbc380b3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:55:00.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.370+0000 7fbc3d930700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc381f3500 con 0x7fbc3815d170 2024-05-08T21:55:00.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.370+0000 7fbc3d930700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc38153140 con 0x7fbc38153c00 2024-05-08T21:55:00.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.370+0000 7fbc3d930700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc381f39f0 con 0x7fbc380cb690 2024-05-08T21:55:00.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.370+0000 7fbc377fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc3815d170 0x7fbc380b3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:55:00.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.370+0000 7fbc377fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc3815d170 0x7fbc380b3f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42052/0 (socket says 172.21.15.73:42052) 2024-05-08T21:55:00.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.370+0000 7fbc377fe700 1 -- 172.21.15.73:0/1965843684 learned_addr learned my addr 172.21.15.73:0/1965843684 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:55:00.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.371+0000 7fbc377fe700 1 -- 172.21.15.73:0/1965843684 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbc380cb690 msgr2=0x7fbc38152060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:55:00.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.371+0000 7fbc367fc700 1 --2- 172.21.15.73:0/1965843684 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc38153c00 0x7fbc3814c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:55:00.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.371+0000 7fbc377fe700 1 --2- 172.21.15.73:0/1965843684 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbc380cb690 0x7fbc38152060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:00.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.371+0000 7fbc377fe700 1 -- 172.21.15.73:0/1965843684 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc38153c00 msgr2=0x7fbc3814c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:55:00.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.371+0000 7fbc377fe700 1 --2- 172.21.15.73:0/1965843684 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc38153c00 0x7fbc3814c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:00.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.371+0000 7fbc377fe700 1 -- 172.21.15.73:0/1965843684 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc30009a70 con 0x7fbc3815d170 2024-05-08T21:55:00.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.371+0000 7fbc377fe700 1 --2- 172.21.15.73:0/1965843684 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc3815d170 0x7fbc380b3f90 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fbc3000b370 tx=0x7fbc30004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:55:00.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.371+0000 7fbc1ffff700 1 -- 172.21.15.73:0/1965843684 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc30004760 con 0x7fbc3815d170 2024-05-08T21:55:00.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.371+0000 7fbc1ffff700 1 -- 172.21.15.73:0/1965843684 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc300048e0 con 0x7fbc3815d170 2024-05-08T21:55:00.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.371+0000 7fbc3d930700 1 -- 172.21.15.73:0/1965843684 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc381ef720 con 0x7fbc3815d170 2024-05-08T21:55:00.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.371+0000 7fbc1ffff700 1 -- 172.21.15.73:0/1965843684 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc30012670 con 0x7fbc3815d170 2024-05-08T21:55:00.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.371+0000 7fbc3d930700 1 -- 172.21.15.73:0/1965843684 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc381ef9c0 con 0x7fbc3815d170 2024-05-08T21:55:00.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.372+0000 7fbc3d930700 1 -- 172.21.15.73:0/1965843684 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc381ef580 con 0x7fbc3815d170 2024-05-08T21:55:00.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.372+0000 7fbc1ffff700 1 -- 172.21.15.73:0/1965843684 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbc300127d0 con 0x7fbc3815d170 2024-05-08T21:55:00.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.373+0000 7fbc1ffff700 1 --2- 172.21.15.73:0/1965843684 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fbc2406acc0 0x7fbc2406d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:55:00.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.373+0000 7fbc1ffff700 1 -- 172.21.15.73:0/1965843684 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5969+0+0 (secure 0 0 0) 0x7fbc3008a720 con 0x7fbc3815d170 2024-05-08T21:55:00.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.373+0000 7fbc36ffd700 1 --2- 172.21.15.73:0/1965843684 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fbc2406acc0 0x7fbc2406d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:55:00.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.373+0000 7fbc36ffd700 1 --2- 172.21.15.73:0/1965843684 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fbc2406acc0 0x7fbc2406d180 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c001eb0 tx=0x7fbc2c001a20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:55:00.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.377+0000 7fbc1ffff700 1 -- 172.21.15.73:0/1965843684 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fbc381ef580 con 0x7fbc3815d170 2024-05-08T21:55:00.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.572+0000 7fbc3d930700 1 -- 172.21.15.73:0/1965843684 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fbc381ef580 con 0x7fbc3815d170 2024-05-08T21:55:00.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.576+0000 7fbc1ffff700 1 -- 172.21.15.73:0/1965843684 <== mon.0 v2:172.21.15.73:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fbc30059280 con 0x7fbc3815d170 2024-05-08T21:55:00.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.576+0000 7fbc1ffff700 1 -- 172.21.15.73:0/1965843684 <== mon.0 v2:172.21.15.73:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) v1 ==== 123+0+0 (secure 0 0 0) 0x7fbc381ef580 con 0x7fbc3815d170 2024-05-08T21:55:00.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.579+0000 7fbc3d930700 1 -- 172.21.15.73:0/1965843684 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fbc2406acc0 msgr2=0x7fbc2406d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:55:00.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.579+0000 7fbc3d930700 1 --2- 172.21.15.73:0/1965843684 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fbc2406acc0 0x7fbc2406d180 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c001eb0 tx=0x7fbc2c001a20 comp rx=0 tx=0).stop 2024-05-08T21:55:00.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.579+0000 7fbc3d930700 1 -- 172.21.15.73:0/1965843684 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc3815d170 msgr2=0x7fbc380b3f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:55:00.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.579+0000 7fbc3d930700 1 --2- 172.21.15.73:0/1965843684 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc3815d170 0x7fbc380b3f90 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fbc3000b370 tx=0x7fbc30004ad0 comp rx=0 tx=0).stop 2024-05-08T21:55:00.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.580+0000 7fbc3d930700 1 -- 172.21.15.73:0/1965843684 shutdown_connections 2024-05-08T21:55:00.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.580+0000 7fbc3d930700 1 --2- 172.21.15.73:0/1965843684 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fbc2406acc0 0x7fbc2406d180 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:00.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.580+0000 7fbc3d930700 1 --2- 172.21.15.73:0/1965843684 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc3815d170 0x7fbc380b3f90 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:00.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.580+0000 7fbc3d930700 1 --2- 172.21.15.73:0/1965843684 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbc380cb690 0x7fbc38152060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:00.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.580+0000 7fbc3d930700 1 --2- 172.21.15.73:0/1965843684 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc38153c00 0x7fbc3814c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:00.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.580+0000 7fbc3d930700 1 -- 172.21.15.73:0/1965843684 >> 172.21.15.73:0/1965843684 conn(0x7fbc3806be70 msgr2=0x7fbc380c4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:55:00.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.580+0000 7fbc3d930700 1 -- 172.21.15.73:0/1965843684 shutdown_connections 2024-05-08T21:55:00.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.580+0000 7fbc3d930700 1 -- 172.21.15.73:0/1965843684 wait complete. 2024-05-08T21:55:00.592 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-08T21:55:00.593 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:55:00.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.714+0000 7f9fc5f73700 1 Processor -- start 2024-05-08T21:55:00.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.714+0000 7f9fc5f73700 1 -- start start 2024-05-08T21:55:00.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.715+0000 7f9fc5f73700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9fc00c8a70 0x7f9fc015d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:55:00.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.715+0000 7f9fc5f73700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9fc0070b50 0x7f9fc0164520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:55:00.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.715+0000 7f9fc5f73700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fc00cb020 con 0x7f9fc00b00f0 2024-05-08T21:55:00.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.715+0000 7f9fc5f73700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fc00c4900 con 0x7f9fc00c8a70 2024-05-08T21:55:00.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.715+0000 7f9fc5f73700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc0070670 con 0x7f9fc0070b50 2024-05-08T21:55:00.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.715+0000 7f9fbeffd700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9fc00c8a70 0x7f9fc015d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:55:00.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.715+0000 7f9fbeffd700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9fc00c8a70 0x7f9fc015d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42054/0 (socket says 172.21.15.73:42054) 2024-05-08T21:55:00.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.715+0000 7f9fbeffd700 1 -- 172.21.15.73:0/170464725 learned_addr learned my addr 172.21.15.73:0/170464725 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:55:00.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.715+0000 7f9fbffff700 1 --2- 172.21.15.73:0/170464725 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9fc0070b50 0x7f9fc0164520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:55:00.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.715+0000 7f9fbeffd700 1 -- 172.21.15.73:0/170464725 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9fc0070b50 msgr2=0x7f9fc0164520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:55:00.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.715+0000 7f9fbeffd700 1 --2- 172.21.15.73:0/170464725 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9fc0070b50 0x7f9fc0164520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:00.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.715+0000 7f9fbeffd700 1 -- 172.21.15.73:0/170464725 >> v1:172.21.15.115:6789/0 conn(0x7f9fc00b00f0 legacy=0x7f9fc00ca210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:55:00.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.715+0000 7f9fbeffd700 1 -- 172.21.15.73:0/170464725 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fc0070fa0 con 0x7f9fc00c8a70 2024-05-08T21:55:00.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.716+0000 7f9fbeffd700 1 --2- 172.21.15.73:0/170464725 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9fc00c8a70 0x7f9fc015d1f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f9fb00098f0 tx=0x7f9fb0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9af42d5ebdcf24f3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:55:00.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.716+0000 7f9fbe7fc700 1 -- 172.21.15.73:0/170464725 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb0011830 con 0x7f9fc00c8a70 2024-05-08T21:55:00.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.716+0000 7f9fbe7fc700 1 -- 172.21.15.73:0/170464725 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f9fb0011990 con 0x7f9fc00c8a70 2024-05-08T21:55:00.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.716+0000 7f9fbe7fc700 1 -- 172.21.15.73:0/170464725 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb0011d40 con 0x7f9fc00c8a70 2024-05-08T21:55:00.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.716+0000 7f9fc5f73700 1 -- 172.21.15.73:0/170464725 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9fc00c8a70 msgr2=0x7f9fc015d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:55:00.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.716+0000 7f9fc5f73700 1 --2- 172.21.15.73:0/170464725 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9fc00c8a70 0x7f9fc015d1f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f9fb00098f0 tx=0x7f9fb0009c00 comp rx=0 tx=0).stop 2024-05-08T21:55:00.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.716+0000 7f9fc5f73700 1 -- 172.21.15.73:0/170464725 shutdown_connections 2024-05-08T21:55:00.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.716+0000 7f9fc5f73700 1 --2- 172.21.15.73:0/170464725 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9fc0070b50 0x7f9fc0164520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:00.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.716+0000 7f9fc5f73700 1 --2- 172.21.15.73:0/170464725 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9fc00c8a70 0x7f9fc015d1f0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:00.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.716+0000 7f9fc5f73700 1 -- 172.21.15.73:0/170464725 >> 172.21.15.73:0/170464725 conn(0x7f9fc006ade0 msgr2=0x7f9fc006ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:55:00.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.716+0000 7f9fc5f73700 1 -- 172.21.15.73:0/170464725 shutdown_connections 2024-05-08T21:55:00.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.716+0000 7f9fc5f73700 1 -- 172.21.15.73:0/170464725 wait complete. 2024-05-08T21:55:00.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.717+0000 7f9fc5f73700 1 Processor -- start 2024-05-08T21:55:00.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.718+0000 7f9fc5f73700 1 -- start start 2024-05-08T21:55:00.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.718+0000 7f9fc5f73700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9fc0070b50 0x7f9fc00b04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:55:00.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.718+0000 7f9fc5f73700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9fc00b00f0 0x7f9fc0150080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:55:00.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.718+0000 7f9fc5f73700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9fc00c8a70 0x7f9fc014f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:55:00.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.718+0000 7f9fc5f73700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc00b10a0 con 0x7f9fc00c8a70 2024-05-08T21:55:00.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.718+0000 7f9fc5f73700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc00af900 con 0x7f9fc00b00f0 2024-05-08T21:55:00.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.718+0000 7f9fc5f73700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc0158d40 con 0x7f9fc0070b50 2024-05-08T21:55:00.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.718+0000 7f9fbffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9fc00c8a70 0x7f9fc014f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:55:00.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.718+0000 7f9fbffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9fc00c8a70 0x7f9fc014f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42066/0 (socket says 172.21.15.73:42066) 2024-05-08T21:55:00.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.718+0000 7f9fbffff700 1 -- 172.21.15.73:0/3652670862 learned_addr learned my addr 172.21.15.73:0/3652670862 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:55:00.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.719+0000 7f9fbeffd700 1 --2- 172.21.15.73:0/3652670862 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9fc00b00f0 0x7f9fc0150080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:55:00.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.719+0000 7f9fbffff700 1 -- 172.21.15.73:0/3652670862 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9fc0070b50 msgr2=0x7f9fc00b04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:55:00.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.719+0000 7f9fbf7fe700 1 --2- 172.21.15.73:0/3652670862 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9fc0070b50 0x7f9fc00b04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:55:00.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.719+0000 7f9fbffff700 1 --2- 172.21.15.73:0/3652670862 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9fc0070b50 0x7f9fc00b04d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:00.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.719+0000 7f9fbffff700 1 -- 172.21.15.73:0/3652670862 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9fc00b00f0 msgr2=0x7f9fc0150080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:55:00.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.719+0000 7f9fbffff700 1 --2- 172.21.15.73:0/3652670862 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9fc00b00f0 0x7f9fc0150080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:00.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.719+0000 7f9fbffff700 1 -- 172.21.15.73:0/3652670862 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb0009550 con 0x7f9fc00c8a70 2024-05-08T21:55:00.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.719+0000 7f9fbeffd700 1 --2- 172.21.15.73:0/3652670862 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9fc00b00f0 0x7f9fc0150080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:55:00.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.719+0000 7f9fbffff700 1 --2- 172.21.15.73:0/3652670862 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9fc00c8a70 0x7f9fc014f0a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f9fb800efc0 tx=0x7f9fb800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:55:00.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.719+0000 7f9fa7fff700 1 -- 172.21.15.73:0/3652670862 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb800cd40 con 0x7f9fc00c8a70 2024-05-08T21:55:00.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.719+0000 7f9fa7fff700 1 -- 172.21.15.73:0/3652670862 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f9fb800f040 con 0x7f9fc00c8a70 2024-05-08T21:55:00.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.719+0000 7f9fc5f73700 1 -- 172.21.15.73:0/3652670862 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fc01509b0 con 0x7f9fc00c8a70 2024-05-08T21:55:00.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.719+0000 7f9fa7fff700 1 -- 172.21.15.73:0/3652670862 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb80146e0 con 0x7f9fc00c8a70 2024-05-08T21:55:00.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.719+0000 7f9fc5f73700 1 -- 172.21.15.73:0/3652670862 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fc01512c0 con 0x7f9fc00c8a70 2024-05-08T21:55:00.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.720+0000 7f9fc5f73700 1 -- 172.21.15.73:0/3652670862 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fc0068b80 con 0x7f9fc00c8a70 2024-05-08T21:55:00.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.720+0000 7f9fa7fff700 1 -- 172.21.15.73:0/3652670862 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9fb8014840 con 0x7f9fc00c8a70 2024-05-08T21:55:00.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.721+0000 7f9fa7fff700 1 --2- 172.21.15.73:0/3652670862 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f9fac06ac90 0x7f9fac06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:55:00.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.721+0000 7f9fa7fff700 1 -- 172.21.15.73:0/3652670862 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5969+0+0 (secure 0 0 0) 0x7f9fb8089e40 con 0x7f9fc00c8a70 2024-05-08T21:55:00.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.721+0000 7f9fbf7fe700 1 --2- 172.21.15.73:0/3652670862 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f9fac06ac90 0x7f9fac06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:55:00.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.721+0000 7f9fbf7fe700 1 --2- 172.21.15.73:0/3652670862 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f9fac06ac90 0x7f9fac06d150 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9fb4000f60 tx=0x7f9fb4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:55:00.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.725+0000 7f9fa7fff700 1 -- 172.21.15.73:0/3652670862 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f9fb8054e80 con 0x7f9fc00c8a70 2024-05-08T21:55:00.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.966+0000 7f9fc5f73700 1 -- 172.21.15.73:0/3652670862 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9fc00cad70 con 0x7f9fc00c8a70 2024-05-08T21:55:00.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.966+0000 7f9fa7fff700 1 -- 172.21.15.73:0/3652670862 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+6255 (secure 0 0 0) 0x7f9fb8018070 con 0x7f9fc00c8a70 2024-05-08T21:55:00.966 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:55:00.967 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3242319177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6833","nonce":3242319177},{"type":"v1","addr":"172.21.15.115:6835","nonce":3242319177}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6834/2136341349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2136341349},{"type":"v1","addr":"172.21.15.115:6834","nonce":2136341349}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4249,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1439647913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1439647913},{"type":"v1","addr":"172.21.15.115:6837","nonce":1439647913}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/2386382396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2386382396},{"type":"v1","addr":"172.21.15.73:6836","nonce":2386382396}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4920,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6839/1242908203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1242908203},{"type":"v1","addr":"172.21.15.73:6839","nonce":1242908203}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:49:43.747162+0000","modified":"2024-05-08T21:52:21.299913+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":24,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":9,"state":"up:active","state_seq":44,"addr":"172.21.15.73:6837/1772457954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":1772457954},{"type":"v1","addr":"172.21.15.73:6837","nonce":1772457954}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:55:00.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.969+0000 7f9fc5f73700 1 -- 172.21.15.73:0/3652670862 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f9fac06ac90 msgr2=0x7f9fac06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:55:00.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.969+0000 7f9fc5f73700 1 --2- 172.21.15.73:0/3652670862 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f9fac06ac90 0x7f9fac06d150 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9fb4000f60 tx=0x7f9fb4009040 comp rx=0 tx=0).stop 2024-05-08T21:55:00.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.969+0000 7f9fc5f73700 1 -- 172.21.15.73:0/3652670862 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9fc00c8a70 msgr2=0x7f9fc014f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:55:00.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.969+0000 7f9fc5f73700 1 --2- 172.21.15.73:0/3652670862 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9fc00c8a70 0x7f9fc014f0a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f9fb800efc0 tx=0x7f9fb800c3a0 comp rx=0 tx=0).stop 2024-05-08T21:55:00.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.969+0000 7f9fc5f73700 1 -- 172.21.15.73:0/3652670862 shutdown_connections 2024-05-08T21:55:00.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.969+0000 7f9fc5f73700 1 --2- 172.21.15.73:0/3652670862 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f9fac06ac90 0x7f9fac06d150 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:00.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.969+0000 7f9fc5f73700 1 --2- 172.21.15.73:0/3652670862 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9fc00c8a70 0x7f9fc014f0a0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:00.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.969+0000 7f9fc5f73700 1 --2- 172.21.15.73:0/3652670862 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9fc0070b50 0x7f9fc00b04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:00.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.969+0000 7f9fc5f73700 1 --2- 172.21.15.73:0/3652670862 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9fc00b00f0 0x7f9fc0150080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:00.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.969+0000 7f9fc5f73700 1 -- 172.21.15.73:0/3652670862 >> 172.21.15.73:0/3652670862 conn(0x7f9fc006ade0 msgr2=0x7f9fc006ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:55:00.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.969+0000 7f9fc5f73700 1 -- 172.21.15.73:0/3652670862 shutdown_connections 2024-05-08T21:55:00.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:00.969+0000 7f9fc5f73700 1 -- 172.21.15.73:0/3652670862 wait complete. 2024-05-08T21:55:00.970 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 13 2024-05-08T21:55:00.981 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:55:01.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.103+0000 7f0c8648d700 1 Processor -- start 2024-05-08T21:55:01.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.103+0000 7f0c8648d700 1 -- start start 2024-05-08T21:55:01.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.103+0000 7f0c8648d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c801587e0 0x7f0c800b3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:55:01.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.103+0000 7f0c8648d700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0c800c7700 0x7f0c800c8880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:55:01.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.103+0000 7f0c8648d700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c800b36b0 con 0x7f0c80157b70 2024-05-08T21:55:01.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.103+0000 7f0c8648d700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c800b10e0 con 0x7f0c800c7700 2024-05-08T21:55:01.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.103+0000 7f0c8648d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c800c82f0 con 0x7f0c801587e0 2024-05-08T21:55:01.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.104+0000 7f0c84a2a700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0c800c7700 0x7f0c800c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:55:01.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.104+0000 7f0c84a2a700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0c800c7700 0x7f0c800c8880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42074/0 (socket says 172.21.15.73:42074) 2024-05-08T21:55:01.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.104+0000 7f0c84a2a700 1 -- 172.21.15.73:0/2055300130 learned_addr learned my addr 172.21.15.73:0/2055300130 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:55:01.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.104+0000 7f0c7ffff700 1 --2- 172.21.15.73:0/2055300130 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c801587e0 0x7f0c800b3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:55:01.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.104+0000 7f0c84a2a700 1 -- 172.21.15.73:0/2055300130 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c801587e0 msgr2=0x7f0c800b3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:55:01.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.104+0000 7f0c84a2a700 1 --2- 172.21.15.73:0/2055300130 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c801587e0 0x7f0c800b3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:01.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.104+0000 7f0c84a2a700 1 -- 172.21.15.73:0/2055300130 >> v1:172.21.15.73:6789/0 conn(0x7f0c80157b70 legacy=0x7f0c800b1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:55:01.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.104+0000 7f0c84a2a700 1 -- 172.21.15.73:0/2055300130 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c800c9eb0 con 0x7f0c800c7700 2024-05-08T21:55:01.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.104+0000 7f0c84a2a700 1 --2- 172.21.15.73:0/2055300130 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c800c7700 0x7f0c800c8880 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f0c78009e80 tx=0x7f0c7800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69695096dcb04505 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:55:01.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.104+0000 7f0c7effd700 1 -- 172.21.15.73:0/2055300130 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7800e070 con 0x7f0c800c7700 2024-05-08T21:55:01.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.104+0000 7f0c7effd700 1 -- 172.21.15.73:0/2055300130 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f0c7800b980 con 0x7f0c800c7700 2024-05-08T21:55:01.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.104+0000 7f0c7effd700 1 -- 172.21.15.73:0/2055300130 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7800bd50 con 0x7f0c800c7700 2024-05-08T21:55:01.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.105+0000 7f0c8648d700 1 -- 172.21.15.73:0/2055300130 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c800c7700 msgr2=0x7f0c800c8880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:55:01.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.105+0000 7f0c8648d700 1 --2- 172.21.15.73:0/2055300130 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c800c7700 0x7f0c800c8880 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f0c78009e80 tx=0x7f0c7800b330 comp rx=0 tx=0).stop 2024-05-08T21:55:01.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.105+0000 7f0c8648d700 1 -- 172.21.15.73:0/2055300130 shutdown_connections 2024-05-08T21:55:01.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.105+0000 7f0c8648d700 1 --2- 172.21.15.73:0/2055300130 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c801587e0 0x7f0c800b3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:01.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.105+0000 7f0c8648d700 1 --2- 172.21.15.73:0/2055300130 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c800c7700 0x7f0c800c8880 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:01.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.105+0000 7f0c8648d700 1 -- 172.21.15.73:0/2055300130 >> 172.21.15.73:0/2055300130 conn(0x7f0c80070600 msgr2=0x7f0c80070a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:55:01.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.105+0000 7f0c8648d700 1 -- 172.21.15.73:0/2055300130 shutdown_connections 2024-05-08T21:55:01.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.105+0000 7f0c8648d700 1 -- 172.21.15.73:0/2055300130 wait complete. 2024-05-08T21:55:01.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.106+0000 7f0c8648d700 1 Processor -- start 2024-05-08T21:55:01.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.106+0000 7f0c8648d700 1 -- start start 2024-05-08T21:55:01.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.107+0000 7f0c8648d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c800c7700 0x7f0c80151940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:55:01.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.107+0000 7f0c8648d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c80157b70 0x7f0c8014e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:55:01.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.107+0000 7f0c8648d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c801587e0 0x7f0c8014ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:55:01.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.107+0000 7f0c8648d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8014e450 con 0x7f0c801587e0 2024-05-08T21:55:01.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.107+0000 7f0c8648d700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c801ee1d0 con 0x7f0c80157b70 2024-05-08T21:55:01.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.107+0000 7f0c8648d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8014d490 con 0x7f0c800c7700 2024-05-08T21:55:01.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.107+0000 7f0c84a2a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c801587e0 0x7f0c8014ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:55:01.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.107+0000 7f0c84a2a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c801587e0 0x7f0c8014ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42088/0 (socket says 172.21.15.73:42088) 2024-05-08T21:55:01.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.107+0000 7f0c84a2a700 1 -- 172.21.15.73:0/816238050 learned_addr learned my addr 172.21.15.73:0/816238050 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:55:01.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.107+0000 7f0c7ffff700 1 --2- 172.21.15.73:0/816238050 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c800c7700 0x7f0c80151940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:55:01.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.107+0000 7f0c7f7fe700 1 --2- 172.21.15.73:0/816238050 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c80157b70 0x7f0c8014e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:55:01.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.107+0000 7f0c84a2a700 1 -- 172.21.15.73:0/816238050 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c800c7700 msgr2=0x7f0c80151940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:55:01.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.107+0000 7f0c84a2a700 1 --2- 172.21.15.73:0/816238050 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c800c7700 0x7f0c80151940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:01.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.107+0000 7f0c84a2a700 1 -- 172.21.15.73:0/816238050 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c80157b70 msgr2=0x7f0c8014e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:55:01.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.107+0000 7f0c84a2a700 1 --2- 172.21.15.73:0/816238050 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c80157b70 0x7f0c8014e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:01.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.107+0000 7f0c84a2a700 1 -- 172.21.15.73:0/816238050 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c78009b30 con 0x7f0c801587e0 2024-05-08T21:55:01.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.107+0000 7f0c84a2a700 1 --2- 172.21.15.73:0/816238050 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c801587e0 0x7f0c8014ee20 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f0c80071440 tx=0x7f0c78004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:55:01.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.107+0000 7f0c7cff9700 1 -- 172.21.15.73:0/816238050 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c780099b0 con 0x7f0c801587e0 2024-05-08T21:55:01.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.108+0000 7f0c7cff9700 1 -- 172.21.15.73:0/816238050 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f0c78004250 con 0x7f0c801587e0 2024-05-08T21:55:01.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.108+0000 7f0c8648d700 1 -- 172.21.15.73:0/816238050 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c8014d770 con 0x7f0c801587e0 2024-05-08T21:55:01.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.108+0000 7f0c7cff9700 1 -- 172.21.15.73:0/816238050 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c78004600 con 0x7f0c801587e0 2024-05-08T21:55:01.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.108+0000 7f0c8648d700 1 -- 172.21.15.73:0/816238050 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c8014e0e0 con 0x7f0c801587e0 2024-05-08T21:55:01.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.108+0000 7f0c8648d700 1 -- 172.21.15.73:0/816238050 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c8006b6c0 con 0x7f0c801587e0 2024-05-08T21:55:01.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.109+0000 7f0c7cff9700 1 -- 172.21.15.73:0/816238050 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0c78004760 con 0x7f0c801587e0 2024-05-08T21:55:01.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.109+0000 7f0c7cff9700 1 --2- 172.21.15.73:0/816238050 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f0c6c06ac90 0x7f0c6c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:55:01.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.109+0000 7f0c7cff9700 1 -- 172.21.15.73:0/816238050 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5969+0+0 (secure 0 0 0) 0x7f0c7808ab90 con 0x7f0c801587e0 2024-05-08T21:55:01.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.109+0000 7f0c7ffff700 1 --2- 172.21.15.73:0/816238050 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f0c6c06ac90 0x7f0c6c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:55:01.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.110+0000 7f0c7ffff700 1 --2- 172.21.15.73:0/816238050 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f0c6c06ac90 0x7f0c6c06d150 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0c70006b20 tx=0x7f0c70008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:55:01.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.114+0000 7f0c7cff9700 1 -- 172.21.15.73:0/816238050 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f0c78055b30 con 0x7f0c801587e0 2024-05-08T21:55:01.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.355+0000 7f0c8648d700 1 -- 172.21.15.73:0/816238050 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0c80068b80 con 0x7f0c801587e0 2024-05-08T21:55:01.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.355+0000 7f0c7cff9700 1 -- 172.21.15.73:0/816238050 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+6255 (secure 0 0 0) 0x7f0c78020020 con 0x7f0c801587e0 2024-05-08T21:55:01.356 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:55:01.356 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3242319177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6833","nonce":3242319177},{"type":"v1","addr":"172.21.15.115:6835","nonce":3242319177}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6834/2136341349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2136341349},{"type":"v1","addr":"172.21.15.115:6834","nonce":2136341349}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4249,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1439647913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1439647913},{"type":"v1","addr":"172.21.15.115:6837","nonce":1439647913}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/2386382396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2386382396},{"type":"v1","addr":"172.21.15.73:6836","nonce":2386382396}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4920,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6839/1242908203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1242908203},{"type":"v1","addr":"172.21.15.73:6839","nonce":1242908203}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:49:43.747162+0000","modified":"2024-05-08T21:52:21.299913+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":24,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":9,"state":"up:active","state_seq":44,"addr":"172.21.15.73:6837/1772457954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":1772457954},{"type":"v1","addr":"172.21.15.73:6837","nonce":1772457954}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:55:01.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.358+0000 7f0c8648d700 1 -- 172.21.15.73:0/816238050 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f0c6c06ac90 msgr2=0x7f0c6c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:55:01.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.358+0000 7f0c8648d700 1 --2- 172.21.15.73:0/816238050 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f0c6c06ac90 0x7f0c6c06d150 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0c70006b20 tx=0x7f0c70008040 comp rx=0 tx=0).stop 2024-05-08T21:55:01.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.358+0000 7f0c8648d700 1 -- 172.21.15.73:0/816238050 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c801587e0 msgr2=0x7f0c8014ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:55:01.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.358+0000 7f0c8648d700 1 --2- 172.21.15.73:0/816238050 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c801587e0 0x7f0c8014ee20 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f0c80071440 tx=0x7f0c78004ad0 comp rx=0 tx=0).stop 2024-05-08T21:55:01.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.358+0000 7f0c8648d700 1 -- 172.21.15.73:0/816238050 shutdown_connections 2024-05-08T21:55:01.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.358+0000 7f0c8648d700 1 --2- 172.21.15.73:0/816238050 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f0c6c06ac90 0x7f0c6c06d150 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:01.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.358+0000 7f0c8648d700 1 --2- 172.21.15.73:0/816238050 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c801587e0 0x7f0c8014ee20 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:01.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.358+0000 7f0c8648d700 1 --2- 172.21.15.73:0/816238050 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c800c7700 0x7f0c80151940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:01.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.358+0000 7f0c8648d700 1 --2- 172.21.15.73:0/816238050 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c80157b70 0x7f0c8014e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:01.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.358+0000 7f0c8648d700 1 -- 172.21.15.73:0/816238050 >> 172.21.15.73:0/816238050 conn(0x7f0c80070600 msgr2=0x7f0c800709e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:55:01.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.358+0000 7f0c8648d700 1 -- 172.21.15.73:0/816238050 shutdown_connections 2024-05-08T21:55:01.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.358+0000 7f0c8648d700 1 -- 172.21.15.73:0/816238050 wait complete. 2024-05-08T21:55:01.359 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 13 2024-05-08T21:55:01.370 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T21:55:01.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.492+0000 7fe2a33d4700 1 Processor -- start 2024-05-08T21:55:01.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.492+0000 7fe2a33d4700 1 -- start start 2024-05-08T21:55:01.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.493+0000 7fe2a33d4700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe29c157700 0x7fe29c1622d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:55:01.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.493+0000 7fe2a33d4700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe29c156b10 con 0x7fe29c150f70 2024-05-08T21:55:01.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.493+0000 7fe2a33d4700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe29c0c3b10 con 0x7fe29c0c9150 2024-05-08T21:55:01.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.493+0000 7fe2a33d4700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe29c0727d0 con 0x7fe29c157700 2024-05-08T21:55:01.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.493+0000 7fe2a1971700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe29c157700 0x7fe29c1622d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:55:01.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.493+0000 7fe2a1971700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe29c157700 0x7fe29c1622d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42090/0 (socket says 172.21.15.73:42090) 2024-05-08T21:55:01.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.493+0000 7fe2a1971700 1 -- 172.21.15.73:0/2754938918 learned_addr learned my addr 172.21.15.73:0/2754938918 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:55:01.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.493+0000 7fe2a096f700 1 --1- 172.21.15.73:0/2754938918 >> v1:172.21.15.73:6789/0 conn(0x7fe29c150f70 0x7fe29c156ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:59782/0 (socket says 172.21.15.73:59782) 2024-05-08T21:55:01.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.493+0000 7fe2a1971700 1 -- 172.21.15.73:0/2754938918 >> v1:172.21.15.115:6789/0 conn(0x7fe29c0c9150 legacy=0x7fe29c150860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:55:01.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.493+0000 7fe2a1971700 1 -- 172.21.15.73:0/2754938918 >> v1:172.21.15.73:6789/0 conn(0x7fe29c150f70 legacy=0x7fe29c156ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:55:01.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.493+0000 7fe2a1971700 1 -- 172.21.15.73:0/2754938918 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe29c0c3dd0 con 0x7fe29c157700 2024-05-08T21:55:01.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.493+0000 7fe2a1971700 1 --2- 172.21.15.73:0/2754938918 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe29c157700 0x7fe29c1622d0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fe29400d150 tx=0x7fe29400d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4692862d61051efe server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:55:01.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.494+0000 7fe293fff700 1 -- 172.21.15.73:0/2754938918 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe294010070 con 0x7fe29c157700 2024-05-08T21:55:01.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.494+0000 7fe293fff700 1 -- 172.21.15.73:0/2754938918 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe29400ddc0 con 0x7fe29c157700 2024-05-08T21:55:01.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.494+0000 7fe293fff700 1 -- 172.21.15.73:0/2754938918 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe29400b330 con 0x7fe29c157700 2024-05-08T21:55:01.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.494+0000 7fe2a33d4700 1 -- 172.21.15.73:0/2754938918 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe29c157700 msgr2=0x7fe29c1622d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:55:01.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.494+0000 7fe2a33d4700 1 --2- 172.21.15.73:0/2754938918 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe29c157700 0x7fe29c1622d0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fe29400d150 tx=0x7fe29400d460 comp rx=0 tx=0).stop 2024-05-08T21:55:01.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.494+0000 7fe2a33d4700 1 -- 172.21.15.73:0/2754938918 shutdown_connections 2024-05-08T21:55:01.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.494+0000 7fe2a33d4700 1 --2- 172.21.15.73:0/2754938918 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe29c157700 0x7fe29c1622d0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:01.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.494+0000 7fe2a33d4700 1 -- 172.21.15.73:0/2754938918 >> 172.21.15.73:0/2754938918 conn(0x7fe29c066cf0 msgr2=0x7fe29c06bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:55:01.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.494+0000 7fe2a33d4700 1 -- 172.21.15.73:0/2754938918 shutdown_connections 2024-05-08T21:55:01.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.494+0000 7fe2a33d4700 1 -- 172.21.15.73:0/2754938918 wait complete. 2024-05-08T21:55:01.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.496+0000 7fe2a33d4700 1 Processor -- start 2024-05-08T21:55:01.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.496+0000 7fe2a33d4700 1 -- start start 2024-05-08T21:55:01.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.497+0000 7fe2a33d4700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe29c0c9150 0x7fe29c0ca290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:55:01.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.497+0000 7fe2a33d4700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe29c150f70 0x7fe29c147d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:55:01.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.497+0000 7fe2a33d4700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe29c157700 0x7fe29c148b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:55:01.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.497+0000 7fe2a33d4700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe29c14a7f0 con 0x7fe29c0c9150 2024-05-08T21:55:01.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.497+0000 7fe2a33d4700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe29c148250 con 0x7fe29c150f70 2024-05-08T21:55:01.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.497+0000 7fe2a33d4700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe29c149c90 con 0x7fe29c157700 2024-05-08T21:55:01.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.497+0000 7fe2a1170700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe29c0c9150 0x7fe29c0ca290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:55:01.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.497+0000 7fe2a1170700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe29c0c9150 0x7fe29c0ca290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42098/0 (socket says 172.21.15.73:42098) 2024-05-08T21:55:01.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.497+0000 7fe2a1170700 1 -- 172.21.15.73:0/3481533784 learned_addr learned my addr 172.21.15.73:0/3481533784 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:55:01.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.497+0000 7fe2a1971700 1 --2- 172.21.15.73:0/3481533784 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe29c157700 0x7fe29c148b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:55:01.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.497+0000 7fe2a096f700 1 --2- 172.21.15.73:0/3481533784 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe29c150f70 0x7fe29c147d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:55:01.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.497+0000 7fe2a1170700 1 -- 172.21.15.73:0/3481533784 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe29c157700 msgr2=0x7fe29c148b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:55:01.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.497+0000 7fe2a1170700 1 --2- 172.21.15.73:0/3481533784 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe29c157700 0x7fe29c148b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:01.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.497+0000 7fe2a1170700 1 -- 172.21.15.73:0/3481533784 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe29c150f70 msgr2=0x7fe29c147d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:55:01.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.497+0000 7fe2a1170700 1 --2- 172.21.15.73:0/3481533784 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe29c150f70 0x7fe29c147d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:01.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.497+0000 7fe2a1170700 1 -- 172.21.15.73:0/3481533784 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe29400bd40 con 0x7fe29c0c9150 2024-05-08T21:55:01.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.497+0000 7fe2a1971700 1 --2- 172.21.15.73:0/3481533784 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe29c157700 0x7fe29c148b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:55:01.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.497+0000 7fe2a1170700 1 --2- 172.21.15.73:0/3481533784 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe29c0c9150 0x7fe29c0ca290 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fe29800c4e0 tx=0x7fe29800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:55:01.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.497+0000 7fe291ffb700 1 -- 172.21.15.73:0/3481533784 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2980052d0 con 0x7fe29c0c9150 2024-05-08T21:55:01.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.497+0000 7fe291ffb700 1 -- 172.21.15.73:0/3481533784 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe298005430 con 0x7fe29c0c9150 2024-05-08T21:55:01.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.497+0000 7fe2a33d4700 1 -- 172.21.15.73:0/3481533784 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe29c158570 con 0x7fe29c0c9150 2024-05-08T21:55:01.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.497+0000 7fe291ffb700 1 -- 172.21.15.73:0/3481533784 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2980038e0 con 0x7fe29c0c9150 2024-05-08T21:55:01.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.498+0000 7fe2a33d4700 1 -- 172.21.15.73:0/3481533784 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe29c14a230 con 0x7fe29c0c9150 2024-05-08T21:55:01.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.498+0000 7fe2a33d4700 1 -- 172.21.15.73:0/3481533784 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe29c068b80 con 0x7fe29c0c9150 2024-05-08T21:55:01.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.499+0000 7fe291ffb700 1 -- 172.21.15.73:0/3481533784 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe298003a40 con 0x7fe29c0c9150 2024-05-08T21:55:01.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.499+0000 7fe291ffb700 1 --2- 172.21.15.73:0/3481533784 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fe28006acc0 0x7fe28006d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:55:01.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.499+0000 7fe291ffb700 1 -- 172.21.15.73:0/3481533784 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5969+0+0 (secure 0 0 0) 0x7fe2980889a0 con 0x7fe29c0c9150 2024-05-08T21:55:01.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.499+0000 7fe2a096f700 1 --2- 172.21.15.73:0/3481533784 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fe28006acc0 0x7fe28006d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:55:01.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.500+0000 7fe2a096f700 1 --2- 172.21.15.73:0/3481533784 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fe28006acc0 0x7fe28006d180 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe29c0c4af0 tx=0x7fe28c007d10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:55:01.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.504+0000 7fe291ffb700 1 -- 172.21.15.73:0/3481533784 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fe2980539d0 con 0x7fe29c0c9150 2024-05-08T21:55:01.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.702+0000 7fe2a33d4700 1 -- 172.21.15.73:0/3481533784 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe29c155520 con 0x7fe29c0c9150 2024-05-08T21:55:01.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.703+0000 7fe291ffb700 1 -- 172.21.15.73:0/3481533784 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16510 (secure 0 0 0) 0x7fe298017090 con 0x7fe29c0c9150 2024-05-08T21:55:01.703 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-08T21:55:01.703 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":24,"fsid":"143164b7-c9c7-4737-a494-7dafa5a3320c","created":"2024-05-08T21:49:26.221909+0000","modified":"2024-05-08T21:52:05.996447+0000","last_up_change":"2024-05-08T21:49:37.118386+0000","last_in_change":"2024-05-08T21:49:28.836944+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T21:49:35.998578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T21:49:42.171760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T21:49:42.576293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6b7439c1-daaa-44af-8333-a455f9e9dc67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":47228},{"type":"v1","addr":"172.21.15.73:6809","nonce":47228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":47228},{"type":"v1","addr":"172.21.15.73:6811","nonce":47228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":47228},{"type":"v1","addr":"172.21.15.73:6815","nonce":47228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":47228},{"type":"v1","addr":"172.21.15.73:6813","nonce":47228}]},"public_addr":"172.21.15.73:6809/47228","cluster_addr":"172.21.15.73:6811/47228","heartbeat_back_addr":"172.21.15.73:6815/47228","heartbeat_front_addr":"172.21.15.73:6813/47228","state":["exists","up"]},{"osd":1,"uuid":"fb67886a-d7f7-45ac-832f-36c871c8a208","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":47227},{"type":"v1","addr":"172.21.15.73:6801","nonce":47227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":47227},{"type":"v1","addr":"172.21.15.73:6803","nonce":47227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":47227},{"type":"v1","addr":"172.21.15.73:6807","nonce":47227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":47227},{"type":"v1","addr":"172.21.15.73:6805","nonce":47227}]},"public_addr":"172.21.15.73:6801/47227","cluster_addr":"172.21.15.73:6803/47227","heartbeat_back_addr":"172.21.15.73:6807/47227","heartbeat_front_addr":"172.21.15.73:6805/47227","state":["exists","up"]},{"osd":2,"uuid":"a5cd6e98-6621-473a-bfb8-5c648abbb563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":47229},{"type":"v1","addr":"172.21.15.73:6817","nonce":47229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":47229},{"type":"v1","addr":"172.21.15.73:6819","nonce":47229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":47229},{"type":"v1","addr":"172.21.15.73:6823","nonce":47229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":47229},{"type":"v1","addr":"172.21.15.73:6821","nonce":47229}]},"public_addr":"172.21.15.73:6817/47229","cluster_addr":"172.21.15.73:6819/47229","heartbeat_back_addr":"172.21.15.73:6823/47229","heartbeat_front_addr":"172.21.15.73:6821/47229","state":["exists","up"]},{"osd":3,"uuid":"36927c20-4241-4f3b-91b5-a6a6f27598e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":47232},{"type":"v1","addr":"172.21.15.73:6825","nonce":47232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":47232},{"type":"v1","addr":"172.21.15.73:6827","nonce":47232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":47232},{"type":"v1","addr":"172.21.15.73:6831","nonce":47232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":47232},{"type":"v1","addr":"172.21.15.73:6829","nonce":47232}]},"public_addr":"172.21.15.73:6825/47232","cluster_addr":"172.21.15.73:6827/47232","heartbeat_back_addr":"172.21.15.73:6831/47232","heartbeat_front_addr":"172.21.15.73:6829/47232","state":["exists","up"]},{"osd":4,"uuid":"4ebe0a18-8216-4815-878a-39c39a6cd3fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":47200},{"type":"v1","addr":"172.21.15.115:6801","nonce":47200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":47200},{"type":"v1","addr":"172.21.15.115:6803","nonce":47200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":47200},{"type":"v1","addr":"172.21.15.115:6807","nonce":47200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":47200},{"type":"v1","addr":"172.21.15.115:6805","nonce":47200}]},"public_addr":"172.21.15.115:6801/47200","cluster_addr":"172.21.15.115:6803/47200","heartbeat_back_addr":"172.21.15.115:6807/47200","heartbeat_front_addr":"172.21.15.115:6805/47200","state":["exists","up"]},{"osd":5,"uuid":"957f0ac1-5f26-4f02-8c05-488e6b67ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":47201},{"type":"v1","addr":"172.21.15.115:6809","nonce":47201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":47201},{"type":"v1","addr":"172.21.15.115:6811","nonce":47201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":47201},{"type":"v1","addr":"172.21.15.115:6815","nonce":47201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":47201},{"type":"v1","addr":"172.21.15.115:6813","nonce":47201}]},"public_addr":"172.21.15.115:6809/47201","cluster_addr":"172.21.15.115:6811/47201","heartbeat_back_addr":"172.21.15.115:6815/47201","heartbeat_front_addr":"172.21.15.115:6813/47201","state":["exists","up"]},{"osd":6,"uuid":"f5a6768f-ba7f-4f66-b335-0c303b158e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":47202},{"type":"v1","addr":"172.21.15.115:6817","nonce":47202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":47202},{"type":"v1","addr":"172.21.15.115:6819","nonce":47202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":47202},{"type":"v1","addr":"172.21.15.115:6823","nonce":47202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":47202},{"type":"v1","addr":"172.21.15.115:6821","nonce":47202}]},"public_addr":"172.21.15.115:6817/47202","cluster_addr":"172.21.15.115:6819/47202","heartbeat_back_addr":"172.21.15.115:6823/47202","heartbeat_front_addr":"172.21.15.115:6821/47202","state":["exists","up"]},{"osd":7,"uuid":"f4187743-f9e6-42e6-aca9-0604a58db1ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":47211},{"type":"v1","addr":"172.21.15.115:6825","nonce":47211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":47211},{"type":"v1","addr":"172.21.15.115:6827","nonce":47211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":47211},{"type":"v1","addr":"172.21.15.115:6831","nonce":47211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":47211},{"type":"v1","addr":"172.21.15.115:6829","nonce":47211}]},"public_addr":"172.21.15.115:6825/47211","cluster_addr":"172.21.15.115:6827/47211","heartbeat_back_addr":"172.21.15.115:6831/47211","heartbeat_front_addr":"172.21.15.115:6829/47211","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:33.996335+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:33.687451+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:34.072549+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:33.997588+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:34.047260+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:34.876272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:33.965472+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:49:34.038637+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.18","mappings":[{"from":3,"to":2}]},{"pgid":"3.1a","mappings":[{"from":4,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.3b","mappings":[{"from":7,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:6839/1477468490":"2024-05-09T21:52:05.996377+0000","172.21.15.73:6838/1477468490":"2024-05-09T21:52:05.996377+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T21:55:01.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.705+0000 7fe2a33d4700 1 -- 172.21.15.73:0/3481533784 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fe28006acc0 msgr2=0x7fe28006d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:55:01.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.705+0000 7fe2a33d4700 1 --2- 172.21.15.73:0/3481533784 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fe28006acc0 0x7fe28006d180 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe29c0c4af0 tx=0x7fe28c007d10 comp rx=0 tx=0).stop 2024-05-08T21:55:01.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.705+0000 7fe2a33d4700 1 -- 172.21.15.73:0/3481533784 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe29c0c9150 msgr2=0x7fe29c0ca290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:55:01.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.705+0000 7fe2a33d4700 1 --2- 172.21.15.73:0/3481533784 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe29c0c9150 0x7fe29c0ca290 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fe29800c4e0 tx=0x7fe29800c8a0 comp rx=0 tx=0).stop 2024-05-08T21:55:01.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.705+0000 7fe2a33d4700 1 -- 172.21.15.73:0/3481533784 shutdown_connections 2024-05-08T21:55:01.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.705+0000 7fe2a33d4700 1 --2- 172.21.15.73:0/3481533784 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7fe28006acc0 0x7fe28006d180 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:01.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.705+0000 7fe2a33d4700 1 --2- 172.21.15.73:0/3481533784 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe29c157700 0x7fe29c148b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:01.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.705+0000 7fe2a33d4700 1 --2- 172.21.15.73:0/3481533784 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe29c0c9150 0x7fe29c0ca290 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:01.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.705+0000 7fe2a33d4700 1 --2- 172.21.15.73:0/3481533784 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe29c150f70 0x7fe29c147d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:01.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.705+0000 7fe2a33d4700 1 -- 172.21.15.73:0/3481533784 >> 172.21.15.73:0/3481533784 conn(0x7fe29c066cf0 msgr2=0x7fe29c159790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:55:01.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.705+0000 7fe2a33d4700 1 -- 172.21.15.73:0/3481533784 shutdown_connections 2024-05-08T21:55:01.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.705+0000 7fe2a33d4700 1 -- 172.21.15.73:0/3481533784 wait complete. 2024-05-08T21:55:01.718 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-08T21:55:01.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.840+0000 7efca5656700 1 Processor -- start 2024-05-08T21:55:01.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.840+0000 7efca5656700 1 -- start start 2024-05-08T21:55:01.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.841+0000 7efca5656700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efca0153e20 0x7efca015dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:55:01.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.841+0000 7efca5656700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7efca015a100 0x7efca015a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:55:01.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.841+0000 7efca5656700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efca015e140 con 0x7efca00cac40 2024-05-08T21:55:01.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.841+0000 7efca5656700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efca015aad0 con 0x7efca015a100 2024-05-08T21:55:01.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.841+0000 7efca5656700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efca00c9f90 con 0x7efca0153e20 2024-05-08T21:55:01.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.841+0000 7efc9f7fe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7efca015a100 0x7efca015a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:55:01.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.841+0000 7efc9f7fe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7efca015a100 0x7efca015a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42112/0 (socket says 172.21.15.73:42112) 2024-05-08T21:55:01.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.841+0000 7efc9f7fe700 1 -- 172.21.15.73:0/403365315 learned_addr learned my addr 172.21.15.73:0/403365315 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:55:01.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.842+0000 7efc9effd700 1 --2- 172.21.15.73:0/403365315 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efca0153e20 0x7efca015dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:55:01.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.842+0000 7efc9f7fe700 1 -- 172.21.15.73:0/403365315 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efca0153e20 msgr2=0x7efca015dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:55:01.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.842+0000 7efc9f7fe700 1 --2- 172.21.15.73:0/403365315 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efca0153e20 0x7efca015dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:01.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.842+0000 7efc9f7fe700 1 -- 172.21.15.73:0/403365315 >> v1:172.21.15.115:6789/0 conn(0x7efca00cac40 legacy=0x7efca00720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:55:01.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.842+0000 7efc9f7fe700 1 -- 172.21.15.73:0/403365315 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca0159c00 con 0x7efca015a100 2024-05-08T21:55:01.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.842+0000 7efc9f7fe700 1 --2- 172.21.15.73:0/403365315 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efca015a100 0x7efca015a590 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7efc98009e50 tx=0x7efc9800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=614d3a222513dfe1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:55:01.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.842+0000 7efc9dffb700 1 -- 172.21.15.73:0/403365315 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9800e070 con 0x7efca015a100 2024-05-08T21:55:01.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.842+0000 7efc9dffb700 1 -- 172.21.15.73:0/403365315 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7efc9800b9c0 con 0x7efca015a100 2024-05-08T21:55:01.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.842+0000 7efc9dffb700 1 -- 172.21.15.73:0/403365315 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9800bd90 con 0x7efca015a100 2024-05-08T21:55:01.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.843+0000 7efca5656700 1 -- 172.21.15.73:0/403365315 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efca015a100 msgr2=0x7efca015a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:55:01.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.843+0000 7efca5656700 1 --2- 172.21.15.73:0/403365315 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efca015a100 0x7efca015a590 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7efc98009e50 tx=0x7efc9800b330 comp rx=0 tx=0).stop 2024-05-08T21:55:01.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.843+0000 7efca5656700 1 -- 172.21.15.73:0/403365315 shutdown_connections 2024-05-08T21:55:01.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.843+0000 7efca5656700 1 --2- 172.21.15.73:0/403365315 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efca015a100 0x7efca015a590 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:01.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.843+0000 7efca5656700 1 --2- 172.21.15.73:0/403365315 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efca0153e20 0x7efca015dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:01.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.843+0000 7efca5656700 1 -- 172.21.15.73:0/403365315 >> 172.21.15.73:0/403365315 conn(0x7efca006be90 msgr2=0x7efca006c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:55:01.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.843+0000 7efca5656700 1 -- 172.21.15.73:0/403365315 shutdown_connections 2024-05-08T21:55:01.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.843+0000 7efca5656700 1 -- 172.21.15.73:0/403365315 wait complete. 2024-05-08T21:55:01.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.844+0000 7efca5656700 1 Processor -- start 2024-05-08T21:55:01.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.844+0000 7efca5656700 1 -- start start 2024-05-08T21:55:01.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.845+0000 7efca5656700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efca00cac40 0x7efca01528c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:55:01.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.845+0000 7efca5656700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efca0153e20 0x7efca01f3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:55:01.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.845+0000 7efca5656700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efca015a100 0x7efca00cd280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:55:01.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.845+0000 7efca5656700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca00ce9a0 con 0x7efca00cac40 2024-05-08T21:55:01.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.845+0000 7efca5656700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca01f36f0 con 0x7efca015a100 2024-05-08T21:55:01.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.845+0000 7efca5656700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efca01f3410 con 0x7efca0153e20 2024-05-08T21:55:01.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.845+0000 7efc9effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efca00cac40 0x7efca01528c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:55:01.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.845+0000 7efc9effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efca00cac40 0x7efca01528c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42116/0 (socket says 172.21.15.73:42116) 2024-05-08T21:55:01.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.845+0000 7efc9effd700 1 -- 172.21.15.73:0/53363810 learned_addr learned my addr 172.21.15.73:0/53363810 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:55:01.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.845+0000 7efc9f7fe700 1 --2- 172.21.15.73:0/53363810 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efca015a100 0x7efca00cd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:55:01.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.845+0000 7efc9e7fc700 1 --2- 172.21.15.73:0/53363810 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efca0153e20 0x7efca01f3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:55:01.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.845+0000 7efc9effd700 1 -- 172.21.15.73:0/53363810 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efca0153e20 msgr2=0x7efca01f3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:55:01.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.845+0000 7efc9effd700 1 --2- 172.21.15.73:0/53363810 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efca0153e20 0x7efca01f3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:01.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.845+0000 7efc9effd700 1 -- 172.21.15.73:0/53363810 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efca015a100 msgr2=0x7efca00cd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:55:01.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.845+0000 7efc9effd700 1 --2- 172.21.15.73:0/53363810 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efca015a100 0x7efca00cd280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:01.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.845+0000 7efc9effd700 1 -- 172.21.15.73:0/53363810 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc98009b30 con 0x7efca00cac40 2024-05-08T21:55:01.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.845+0000 7efc9effd700 1 --2- 172.21.15.73:0/53363810 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efca00cac40 0x7efca01528c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7efc9400e810 tx=0x7efc9400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:55:01.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.845+0000 7efc877fe700 1 -- 172.21.15.73:0/53363810 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9400c070 con 0x7efca00cac40 2024-05-08T21:55:01.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.845+0000 7efc877fe700 1 -- 172.21.15.73:0/53363810 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7efc94013610 con 0x7efca00cac40 2024-05-08T21:55:01.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.845+0000 7efc877fe700 1 -- 172.21.15.73:0/53363810 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc940139e0 con 0x7efca00cac40 2024-05-08T21:55:01.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.845+0000 7efca5656700 1 -- 172.21.15.73:0/53363810 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efca015dbf0 con 0x7efca00cac40 2024-05-08T21:55:01.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.845+0000 7efca5656700 1 -- 172.21.15.73:0/53363810 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efca015de90 con 0x7efca00cac40 2024-05-08T21:55:01.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.846+0000 7efca5656700 1 -- 172.21.15.73:0/53363810 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efca00cb060 con 0x7efca00cac40 2024-05-08T21:55:01.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.847+0000 7efc877fe700 1 -- 172.21.15.73:0/53363810 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7efc94013b40 con 0x7efca00cac40 2024-05-08T21:55:01.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.847+0000 7efc877fe700 1 --2- 172.21.15.73:0/53363810 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7efc8c06ac90 0x7efc8c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:55:01.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.847+0000 7efc877fe700 1 -- 172.21.15.73:0/53363810 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5969+0+0 (secure 0 0 0) 0x7efc94088ed0 con 0x7efca00cac40 2024-05-08T21:55:01.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.847+0000 7efc9e7fc700 1 --2- 172.21.15.73:0/53363810 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7efc8c06ac90 0x7efc8c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:55:01.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.848+0000 7efc9e7fc700 1 --2- 172.21.15.73:0/53363810 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7efc8c06ac90 0x7efc8c06d150 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7efca0146860 tx=0x7efc90009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:55:01.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:01.852+0000 7efc877fe700 1 -- 172.21.15.73:0/53363810 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7efc94053fa0 con 0x7efca00cac40 2024-05-08T21:55:02.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.096+0000 7efca5656700 1 -- 172.21.15.73:0/53363810 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7efca01f39d0 con 0x7efca00cac40 2024-05-08T21:55:02.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.106+0000 7efc877fe700 1 -- 172.21.15.73:0/53363810 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v14) v1 ==== 161+0+0 (secure 0 0 0) 0x7efc940575c0 con 0x7efca00cac40 2024-05-08T21:55:02.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.109+0000 7efca5656700 1 -- 172.21.15.73:0/53363810 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7efc8c06ac90 msgr2=0x7efc8c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:55:02.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.109+0000 7efca5656700 1 --2- 172.21.15.73:0/53363810 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7efc8c06ac90 0x7efc8c06d150 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7efca0146860 tx=0x7efc90009040 comp rx=0 tx=0).stop 2024-05-08T21:55:02.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.109+0000 7efca5656700 1 -- 172.21.15.73:0/53363810 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efca00cac40 msgr2=0x7efca01528c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:55:02.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.109+0000 7efca5656700 1 --2- 172.21.15.73:0/53363810 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efca00cac40 0x7efca01528c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7efc9400e810 tx=0x7efc9400eb20 comp rx=0 tx=0).stop 2024-05-08T21:55:02.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.110+0000 7efca5656700 1 -- 172.21.15.73:0/53363810 shutdown_connections 2024-05-08T21:55:02.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.110+0000 7efca5656700 1 --2- 172.21.15.73:0/53363810 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7efc8c06ac90 0x7efc8c06d150 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:02.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.110+0000 7efca5656700 1 --2- 172.21.15.73:0/53363810 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efca015a100 0x7efca00cd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:02.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.110+0000 7efca5656700 1 --2- 172.21.15.73:0/53363810 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efca00cac40 0x7efca01528c0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:02.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.110+0000 7efca5656700 1 --2- 172.21.15.73:0/53363810 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efca0153e20 0x7efca01f3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:02.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.110+0000 7efca5656700 1 -- 172.21.15.73:0/53363810 >> 172.21.15.73:0/53363810 conn(0x7efca006be90 msgr2=0x7efca0159440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:55:02.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.110+0000 7efca5656700 1 -- 172.21.15.73:0/53363810 shutdown_connections 2024-05-08T21:55:02.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.110+0000 7efca5656700 1 -- 172.21.15.73:0/53363810 wait complete. 2024-05-08T21:55:02.111 INFO:teuthology.orchestra.run.smithi073.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-08T21:55:02.123 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-08T21:55:02.146 INFO:tasks.ceph.mds.c.smithi073.stdout:starting mds.c at 2024-05-08T21:55:02.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.247+0000 7f1b2b41e700 1 Processor -- start 2024-05-08T21:55:02.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.248+0000 7f1b2b41e700 1 -- start start 2024-05-08T21:55:02.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.248+0000 7f1b2b41e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1b2414e630 0x7f1b24157a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:55:02.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.248+0000 7f1b2b41e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1b240c4330 0x7f1b24162400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:55:02.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.248+0000 7f1b2b41e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b2414ea10 con 0x7f1b2406ff30 2024-05-08T21:55:02.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.248+0000 7f1b2b41e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b2406f790 con 0x7f1b240c4330 2024-05-08T21:55:02.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.248+0000 7f1b2b41e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b240c2710 con 0x7f1b2414e630 2024-05-08T21:55:02.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.249+0000 7f1b299bb700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1b240c4330 0x7f1b24162400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:55:02.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.249+0000 7f1b289b9700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f1b2406ff30 0x7f1b240c9340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:59806/0 (socket says 172.21.15.73:59806) 2024-05-08T21:55:02.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.249+0000 7f1b289b9700 1 -- 172.21.15.73:0/1093598443 learned_addr learned my addr 172.21.15.73:0/1093598443 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:55:02.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.249+0000 7f1b291ba700 1 --2- 172.21.15.73:0/1093598443 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1b2414e630 0x7f1b24157a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:55:02.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.249+0000 7f1b299bb700 1 -- 172.21.15.73:0/1093598443 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1b2414e630 msgr2=0x7f1b24157a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:55:02.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.249+0000 7f1b299bb700 1 --2- 172.21.15.73:0/1093598443 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1b2414e630 0x7f1b24157a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:02.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.249+0000 7f1b299bb700 1 -- 172.21.15.73:0/1093598443 >> v1:172.21.15.73:6789/0 conn(0x7f1b2406ff30 legacy=0x7f1b240c9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:55:02.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.249+0000 7f1b1bfff700 1 -- 172.21.15.73:0/1093598443 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2754421207 0 0) 0x7f1b2414ea10 con 0x7f1b2406ff30 2024-05-08T21:55:02.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.249+0000 7f1b299bb700 1 -- 172.21.15.73:0/1093598443 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b240c80f0 con 0x7f1b240c4330 2024-05-08T21:55:02.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.249+0000 7f1b291ba700 1 --2- 172.21.15.73:0/1093598443 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1b2414e630 0x7f1b24157a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:55:02.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.249+0000 7f1b299bb700 1 --2- 172.21.15.73:0/1093598443 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b240c4330 0x7f1b24162400 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c009d90 tx=0x7f1b1c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b893a624e8b5c037 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:55:02.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.249+0000 7f1b1bfff700 1 -- 172.21.15.73:0/1093598443 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c00e070 con 0x7f1b240c4330 2024-05-08T21:55:02.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.249+0000 7f1b1bfff700 1 -- 172.21.15.73:0/1093598443 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f1b1c00bbd0 con 0x7f1b240c4330 2024-05-08T21:55:02.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.249+0000 7f1b1bfff700 1 -- 172.21.15.73:0/1093598443 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c012430 con 0x7f1b240c4330 2024-05-08T21:55:02.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.250+0000 7f1b2b41e700 1 -- 172.21.15.73:0/1093598443 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b240c4330 msgr2=0x7f1b24162400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:55:02.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.250+0000 7f1b2b41e700 1 --2- 172.21.15.73:0/1093598443 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b240c4330 0x7f1b24162400 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c009d90 tx=0x7f1b1c00b330 comp rx=0 tx=0).stop 2024-05-08T21:55:02.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.250+0000 7f1b2b41e700 1 -- 172.21.15.73:0/1093598443 shutdown_connections 2024-05-08T21:55:02.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.250+0000 7f1b2b41e700 1 --2- 172.21.15.73:0/1093598443 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1b2414e630 0x7f1b24157a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:02.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.250+0000 7f1b2b41e700 1 --2- 172.21.15.73:0/1093598443 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b240c4330 0x7f1b24162400 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:02.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.250+0000 7f1b2b41e700 1 -- 172.21.15.73:0/1093598443 >> 172.21.15.73:0/1093598443 conn(0x7f1b2406aff0 msgr2=0x7f1b240666c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:55:02.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.250+0000 7f1b2b41e700 1 -- 172.21.15.73:0/1093598443 shutdown_connections 2024-05-08T21:55:02.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.250+0000 7f1b2b41e700 1 -- 172.21.15.73:0/1093598443 wait complete. 2024-05-08T21:55:02.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.251+0000 7f1b2b41e700 1 Processor -- start 2024-05-08T21:55:02.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.251+0000 7f1b2b41e700 1 -- start start 2024-05-08T21:55:02.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.252+0000 7f1b2b41e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1b2406ff30 0x7f1b241f3580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:55:02.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.252+0000 7f1b2b41e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b240c4330 0x7f1b240c52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:55:02.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.252+0000 7f1b2b41e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b2414e630 0x7f1b240cc410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:55:02.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.252+0000 7f1b2b41e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b240c5120 con 0x7f1b240c4330 2024-05-08T21:55:02.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.252+0000 7f1b2b41e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b241ef600 con 0x7f1b2414e630 2024-05-08T21:55:02.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.252+0000 7f1b2b41e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b241efe60 con 0x7f1b2406ff30 2024-05-08T21:55:02.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.252+0000 7f1b289b9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b240c4330 0x7f1b240c52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:55:02.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.252+0000 7f1b289b9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b240c4330 0x7f1b240c52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42146/0 (socket says 172.21.15.73:42146) 2024-05-08T21:55:02.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.252+0000 7f1b289b9700 1 -- 172.21.15.73:0/1258401682 learned_addr learned my addr 172.21.15.73:0/1258401682 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:55:02.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.252+0000 7f1b299bb700 1 --2- 172.21.15.73:0/1258401682 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b2414e630 0x7f1b240cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:55:02.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.252+0000 7f1b291ba700 1 --2- 172.21.15.73:0/1258401682 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1b2406ff30 0x7f1b241f3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:55:02.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.252+0000 7f1b289b9700 1 -- 172.21.15.73:0/1258401682 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1b2406ff30 msgr2=0x7f1b241f3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:55:02.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.252+0000 7f1b289b9700 1 --2- 172.21.15.73:0/1258401682 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1b2406ff30 0x7f1b241f3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:02.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.252+0000 7f1b289b9700 1 -- 172.21.15.73:0/1258401682 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b2414e630 msgr2=0x7f1b240cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:55:02.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.252+0000 7f1b289b9700 1 --2- 172.21.15.73:0/1258401682 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b2414e630 0x7f1b240cc410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:02.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.252+0000 7f1b289b9700 1 -- 172.21.15.73:0/1258401682 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b1c009a70 con 0x7f1b240c4330 2024-05-08T21:55:02.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.252+0000 7f1b289b9700 1 --2- 172.21.15.73:0/1258401682 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b240c4330 0x7f1b240c52b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f1b2000c750 tx=0x7f1b2000ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:55:02.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.252+0000 7f1b19ffb700 1 -- 172.21.15.73:0/1258401682 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b20004c80 con 0x7f1b240c4330 2024-05-08T21:55:02.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.252+0000 7f1b19ffb700 1 -- 172.21.15.73:0/1258401682 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f1b20004e00 con 0x7f1b240c4330 2024-05-08T21:55:02.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.252+0000 7f1b19ffb700 1 -- 172.21.15.73:0/1258401682 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b20007330 con 0x7f1b240c4330 2024-05-08T21:55:02.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.252+0000 7f1b2b41e700 1 -- 172.21.15.73:0/1258401682 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b241f3ac0 con 0x7f1b240c4330 2024-05-08T21:55:02.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.253+0000 7f1b2b41e700 1 -- 172.21.15.73:0/1258401682 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b240c4e40 con 0x7f1b240c4330 2024-05-08T21:55:02.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.254+0000 7f1b2b41e700 1 -- 172.21.15.73:0/1258401682 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b241f0010 con 0x7f1b240c4330 2024-05-08T21:55:02.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.254+0000 7f1b19ffb700 1 -- 172.21.15.73:0/1258401682 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1b20007490 con 0x7f1b240c4330 2024-05-08T21:55:02.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.254+0000 7f1b19ffb700 1 --2- 172.21.15.73:0/1258401682 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f1b0806ac90 0x7f1b0806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:55:02.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.254+0000 7f1b19ffb700 1 -- 172.21.15.73:0/1258401682 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6055+0+0 (secure 0 0 0) 0x7f1b20089090 con 0x7f1b240c4330 2024-05-08T21:55:02.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.254+0000 7f1b291ba700 1 --2- 172.21.15.73:0/1258401682 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f1b0806ac90 0x7f1b0806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:55:02.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.255+0000 7f1b291ba700 1 --2- 172.21.15.73:0/1258401682 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f1b0806ac90 0x7f1b0806d150 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1b14006fd0 tx=0x7f1b14008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:55:02.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.259+0000 7f1b19ffb700 1 -- 172.21.15.73:0/1258401682 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f1b241f0010 con 0x7f1b240c4330 2024-05-08T21:55:02.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:02.499+0000 7f1b2b41e700 1 -- 172.21.15.73:0/1258401682 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f1b241f3ac0 con 0x7f1b240c4330 2024-05-08T21:55:03.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.108+0000 7f1b19ffb700 1 -- 172.21.15.73:0/1258401682 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1b241f3ac0 con 0x7f1b240c4330 2024-05-08T21:55:03.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.112+0000 7f1b2b41e700 1 -- 172.21.15.73:0/1258401682 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f1b0806ac90 msgr2=0x7f1b0806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:55:03.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.112+0000 7f1b2b41e700 1 --2- 172.21.15.73:0/1258401682 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f1b0806ac90 0x7f1b0806d150 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1b14006fd0 tx=0x7f1b14008040 comp rx=0 tx=0).stop 2024-05-08T21:55:03.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.112+0000 7f1b2b41e700 1 -- 172.21.15.73:0/1258401682 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b240c4330 msgr2=0x7f1b240c52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:55:03.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.112+0000 7f1b2b41e700 1 --2- 172.21.15.73:0/1258401682 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b240c4330 0x7f1b240c52b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f1b2000c750 tx=0x7f1b2000ca60 comp rx=0 tx=0).stop 2024-05-08T21:55:03.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.112+0000 7f1b2b41e700 1 -- 172.21.15.73:0/1258401682 shutdown_connections 2024-05-08T21:55:03.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.112+0000 7f1b2b41e700 1 --2- 172.21.15.73:0/1258401682 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f1b0806ac90 0x7f1b0806d150 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:03.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.112+0000 7f1b2b41e700 1 --2- 172.21.15.73:0/1258401682 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b2414e630 0x7f1b240cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:03.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.112+0000 7f1b2b41e700 1 --2- 172.21.15.73:0/1258401682 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1b2406ff30 0x7f1b241f3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:03.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.112+0000 7f1b2b41e700 1 --2- 172.21.15.73:0/1258401682 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b240c4330 0x7f1b240c52b0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:03.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.112+0000 7f1b2b41e700 1 -- 172.21.15.73:0/1258401682 >> 172.21.15.73:0/1258401682 conn(0x7f1b2406aff0 msgr2=0x7f1b240c96e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:55:03.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.112+0000 7f1b2b41e700 1 -- 172.21.15.73:0/1258401682 shutdown_connections 2024-05-08T21:55:03.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.112+0000 7f1b2b41e700 1 -- 172.21.15.73:0/1258401682 wait complete. 2024-05-08T21:55:03.127 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-08T21:55:03.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.300+0000 7f1dabe46700 1 Processor -- start 2024-05-08T21:55:03.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.300+0000 7f1dabe46700 1 -- start start 2024-05-08T21:55:03.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.301+0000 7f1dabe46700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1da4150df0 0x7f1da40c8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:55:03.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.301+0000 7f1dabe46700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1da40c3920 0x7f1da415a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:55:03.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.301+0000 7f1dabe46700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1da40c9c00 con 0x7f1da40c8a60 2024-05-08T21:55:03.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.301+0000 7f1dabe46700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1da40724f0 con 0x7f1da4150df0 2024-05-08T21:55:03.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.301+0000 7f1dabe46700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1da4071b90 con 0x7f1da40c3920 2024-05-08T21:55:03.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.301+0000 7f1da9be2700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1da4150df0 0x7f1da40c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:55:03.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.301+0000 7f1da93e1700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f1da40c8a60 0x7f1da40c8eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:59810/0 (socket says 172.21.15.73:59810) 2024-05-08T21:55:03.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.301+0000 7f1da93e1700 1 -- 172.21.15.73:0/3508136661 learned_addr learned my addr 172.21.15.73:0/3508136661 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-05-08T21:55:03.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.301+0000 7f1daa3e3700 1 --2- 172.21.15.73:0/3508136661 >> v2:172.21.15.115:3300/0 conn(0x7f1da40c3920 0x7f1da415a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:55:03.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.301+0000 7f1da9be2700 1 -- 172.21.15.73:0/3508136661 >> v2:172.21.15.115:3300/0 conn(0x7f1da40c3920 msgr2=0x7f1da415a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:55:03.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.301+0000 7f1da9be2700 1 --2- 172.21.15.73:0/3508136661 >> v2:172.21.15.115:3300/0 conn(0x7f1da40c3920 0x7f1da415a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:03.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.301+0000 7f1da9be2700 1 -- 172.21.15.73:0/3508136661 >> v1:172.21.15.73:6789/0 conn(0x7f1da40c8a60 legacy=0x7f1da40c8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:55:03.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.301+0000 7f1da9be2700 1 -- 172.21.15.73:0/3508136661 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da40c4140 con 0x7f1da4150df0 2024-05-08T21:55:03.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.301+0000 7f1daa3e3700 1 --2- 172.21.15.73:0/3508136661 >> v2:172.21.15.115:3300/0 conn(0x7f1da40c3920 0x7f1da415a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:55:03.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.302+0000 7f1da9be2700 1 --2- 172.21.15.73:0/3508136661 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1da4150df0 0x7f1da40c8520 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f1da4157ba0 tx=0x7f1d94009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93d16919e35312af server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:55:03.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.302+0000 7f1da8be0700 1 -- 172.21.15.73:0/3508136661 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d94011830 con 0x7f1da4150df0 2024-05-08T21:55:03.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.302+0000 7f1da8be0700 1 -- 172.21.15.73:0/3508136661 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f1d94011990 con 0x7f1da4150df0 2024-05-08T21:55:03.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.302+0000 7f1da8be0700 1 -- 172.21.15.73:0/3508136661 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d94011d40 con 0x7f1da4150df0 2024-05-08T21:55:03.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.302+0000 7f1dabe46700 1 -- 172.21.15.73:0/3508136661 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1da4150df0 msgr2=0x7f1da40c8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:55:03.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.302+0000 7f1dabe46700 1 --2- 172.21.15.73:0/3508136661 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1da4150df0 0x7f1da40c8520 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f1da4157ba0 tx=0x7f1d94009b20 comp rx=0 tx=0).stop 2024-05-08T21:55:03.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.302+0000 7f1dabe46700 1 -- 172.21.15.73:0/3508136661 shutdown_connections 2024-05-08T21:55:03.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.302+0000 7f1dabe46700 1 --2- 172.21.15.73:0/3508136661 >> v2:172.21.15.115:3300/0 conn(0x7f1da40c3920 0x7f1da415a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:03.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.302+0000 7f1dabe46700 1 --2- 172.21.15.73:0/3508136661 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1da4150df0 0x7f1da40c8520 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:03.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.302+0000 7f1dabe46700 1 -- 172.21.15.73:0/3508136661 >> 172.21.15.73:0/3508136661 conn(0x7f1da406bad0 msgr2=0x7f1da406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:55:03.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.302+0000 7f1dabe46700 1 -- 172.21.15.73:0/3508136661 shutdown_connections 2024-05-08T21:55:03.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.302+0000 7f1dabe46700 1 -- 172.21.15.73:0/3508136661 wait complete. 2024-05-08T21:55:03.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.304+0000 7f1dabe46700 1 Processor -- start 2024-05-08T21:55:03.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.304+0000 7f1dabe46700 1 -- start start 2024-05-08T21:55:03.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.304+0000 7f1dabe46700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1da40c3920 0x7f1da4154a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:55:03.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.304+0000 7f1dabe46700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1da40c8a60 0x7f1da41e4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:55:03.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.304+0000 7f1dabe46700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1da4150df0 0x7f1da4157bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:55:03.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.304+0000 7f1dabe46700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da4158d20 con 0x7f1da40c8a60 2024-05-08T21:55:03.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.304+0000 7f1dabe46700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da4159f30 con 0x7f1da4150df0 2024-05-08T21:55:03.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.304+0000 7f1dabe46700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1da40c5c10 con 0x7f1da40c3920 2024-05-08T21:55:03.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.304+0000 7f1da93e1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1da40c8a60 0x7f1da41e4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:55:03.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.304+0000 7f1da93e1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1da40c8a60 0x7f1da41e4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42178/0 (socket says 172.21.15.73:42178) 2024-05-08T21:55:03.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.304+0000 7f1da93e1700 1 -- 172.21.15.73:0/2038880898 learned_addr learned my addr 172.21.15.73:0/2038880898 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:55:03.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.305+0000 7f1daa3e3700 1 --2- 172.21.15.73:0/2038880898 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1da4150df0 0x7f1da4157bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:55:03.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.305+0000 7f1da93e1700 1 -- 172.21.15.73:0/2038880898 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1da40c3920 msgr2=0x7f1da4154a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:55:03.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.305+0000 7f1da93e1700 1 --2- 172.21.15.73:0/2038880898 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1da40c3920 0x7f1da4154a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:03.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.305+0000 7f1da93e1700 1 -- 172.21.15.73:0/2038880898 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1da4150df0 msgr2=0x7f1da4157bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:55:03.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.305+0000 7f1da93e1700 1 --2- 172.21.15.73:0/2038880898 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1da4150df0 0x7f1da4157bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:03.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.305+0000 7f1da93e1700 1 -- 172.21.15.73:0/2038880898 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d940094a0 con 0x7f1da40c8a60 2024-05-08T21:55:03.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.305+0000 7f1da93e1700 1 --2- 172.21.15.73:0/2038880898 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1da40c8a60 0x7f1da41e4480 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1da000c530 tx=0x7f1da000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:55:03.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.305+0000 7f1d9a7fc700 1 -- 172.21.15.73:0/2038880898 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da0005d70 con 0x7f1da40c8a60 2024-05-08T21:55:03.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.305+0000 7f1d9a7fc700 1 -- 172.21.15.73:0/2038880898 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f1da00070d0 con 0x7f1da40c8a60 2024-05-08T21:55:03.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.305+0000 7f1d9a7fc700 1 -- 172.21.15.73:0/2038880898 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da0007460 con 0x7f1da40c8a60 2024-05-08T21:55:03.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.305+0000 7f1dabe46700 1 -- 172.21.15.73:0/2038880898 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1da4155090 con 0x7f1da40c8a60 2024-05-08T21:55:03.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.305+0000 7f1dabe46700 1 -- 172.21.15.73:0/2038880898 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1da41566f0 con 0x7f1da40c8a60 2024-05-08T21:55:03.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.306+0000 7f1dabe46700 1 -- 172.21.15.73:0/2038880898 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1da4068b80 con 0x7f1da40c8a60 2024-05-08T21:55:03.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.306+0000 7f1d9a7fc700 1 -- 172.21.15.73:0/2038880898 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1da00075c0 con 0x7f1da40c8a60 2024-05-08T21:55:03.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.307+0000 7f1d9a7fc700 1 --2- 172.21.15.73:0/2038880898 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f1d8806ac90 0x7f1d8806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:55:03.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.307+0000 7f1d9a7fc700 1 -- 172.21.15.73:0/2038880898 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6055+0+0 (secure 0 0 0) 0x7f1da0088a60 con 0x7f1da40c8a60 2024-05-08T21:55:03.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.307+0000 7f1da9be2700 1 --2- 172.21.15.73:0/2038880898 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f1d8806ac90 0x7f1d8806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:55:03.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.307+0000 7f1da9be2700 1 --2- 172.21.15.73:0/2038880898 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f1d8806ac90 0x7f1d8806d150 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1d940090b0 tx=0x7f1d94010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:55:03.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.311+0000 7f1d9a7fc700 1 -- 172.21.15.73:0/2038880898 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f1da0053a50 con 0x7f1da40c8a60 2024-05-08T21:55:03.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:03.510+0000 7f1dabe46700 1 -- 172.21.15.73:0/2038880898 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1da406fff0 con 0x7f1da40c8a60 2024-05-08T21:55:04.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.209+0000 7f1d9a7fc700 1 -- 172.21.15.73:0/2038880898 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v26) v1 ==== 181+0+0 (secure 0 0 0) 0x7f1da0017020 con 0x7f1da40c8a60 2024-05-08T21:55:04.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.212+0000 7f1dabe46700 1 -- 172.21.15.73:0/2038880898 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f1d8806ac90 msgr2=0x7f1d8806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:55:04.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.212+0000 7f1dabe46700 1 --2- 172.21.15.73:0/2038880898 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f1d8806ac90 0x7f1d8806d150 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1d940090b0 tx=0x7f1d94010000 comp rx=0 tx=0).stop 2024-05-08T21:55:04.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.212+0000 7f1dabe46700 1 -- 172.21.15.73:0/2038880898 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1da40c8a60 msgr2=0x7f1da41e4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:55:04.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.212+0000 7f1dabe46700 1 --2- 172.21.15.73:0/2038880898 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1da40c8a60 0x7f1da41e4480 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1da000c530 tx=0x7f1da000c8f0 comp rx=0 tx=0).stop 2024-05-08T21:55:04.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.212+0000 7f1dabe46700 1 -- 172.21.15.73:0/2038880898 shutdown_connections 2024-05-08T21:55:04.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.212+0000 7f1dabe46700 1 --2- 172.21.15.73:0/2038880898 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f1d8806ac90 0x7f1d8806d150 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:04.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.212+0000 7f1dabe46700 1 --2- 172.21.15.73:0/2038880898 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1da4150df0 0x7f1da4157bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:04.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.212+0000 7f1dabe46700 1 --2- 172.21.15.73:0/2038880898 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1da40c3920 0x7f1da4154a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:04.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.212+0000 7f1dabe46700 1 --2- 172.21.15.73:0/2038880898 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1da40c8a60 0x7f1da41e4480 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:04.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.212+0000 7f1dabe46700 1 -- 172.21.15.73:0/2038880898 >> 172.21.15.73:0/2038880898 conn(0x7f1da406bad0 msgr2=0x7f1da414ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:55:04.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.213+0000 7f1dabe46700 1 -- 172.21.15.73:0/2038880898 shutdown_connections 2024-05-08T21:55:04.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.213+0000 7f1dabe46700 1 -- 172.21.15.73:0/2038880898 wait complete. 2024-05-08T21:55:04.214 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_metadata' removed 2024-05-08T21:55:04.228 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-08T21:55:04.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.354+0000 7f8c06889700 1 Processor -- start 2024-05-08T21:55:04.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.354+0000 7f8c06889700 1 -- start start 2024-05-08T21:55:04.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.354+0000 7f8c06889700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8c00153eb0 0x7f8c0006fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:55:04.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.354+0000 7f8c06889700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8c00154290 0x7f8c000c8e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:55:04.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.354+0000 7f8c06889700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c000c85f0 con 0x7f8c0006ee90 2024-05-08T21:55:04.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.354+0000 7f8c06889700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c0006f410 con 0x7f8c00153eb0 2024-05-08T21:55:04.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.354+0000 7f8c06889700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0006f6b0 con 0x7f8c00154290 2024-05-08T21:55:04.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.355+0000 7f8bfffff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8c00153eb0 0x7f8c0006fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:55:04.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.355+0000 7f8bfffff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8c00153eb0 0x7f8c0006fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42194/0 (socket says 172.21.15.73:42194) 2024-05-08T21:55:04.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.355+0000 7f8bfffff700 1 -- 172.21.15.73:0/2207943455 learned_addr learned my addr 172.21.15.73:0/2207943455 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:55:04.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.355+0000 7f8bff7fe700 1 --2- 172.21.15.73:0/2207943455 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8c00154290 0x7f8c000c8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:55:04.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.355+0000 7f8bfffff700 1 -- 172.21.15.73:0/2207943455 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8c00154290 msgr2=0x7f8c000c8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:55:04.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.355+0000 7f8bfffff700 1 --2- 172.21.15.73:0/2207943455 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8c00154290 0x7f8c000c8e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:04.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.355+0000 7f8bfffff700 1 -- 172.21.15.73:0/2207943455 >> v1:172.21.15.115:6789/0 conn(0x7f8c0006ee90 legacy=0x7f8c00159d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:55:04.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.355+0000 7f8bfffff700 1 -- 172.21.15.73:0/2207943455 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c0006f970 con 0x7f8c00153eb0 2024-05-08T21:55:04.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.355+0000 7f8bfffff700 1 --2- 172.21.15.73:0/2207943455 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c00153eb0 0x7f8c0006fc80 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f8bf00098f0 tx=0x7f8bf0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74cd098eaf2e05e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:55:04.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.355+0000 7f8bfeffd700 1 -- 172.21.15.73:0/2207943455 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf000b8a0 con 0x7f8c00153eb0 2024-05-08T21:55:04.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.355+0000 7f8bfeffd700 1 -- 172.21.15.73:0/2207943455 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f8bf000ba00 con 0x7f8c00153eb0 2024-05-08T21:55:04.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.355+0000 7f8bfeffd700 1 -- 172.21.15.73:0/2207943455 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf000bdb0 con 0x7f8c00153eb0 2024-05-08T21:55:04.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.356+0000 7f8c06889700 1 -- 172.21.15.73:0/2207943455 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c00153eb0 msgr2=0x7f8c0006fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:55:04.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.356+0000 7f8c06889700 1 --2- 172.21.15.73:0/2207943455 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c00153eb0 0x7f8c0006fc80 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f8bf00098f0 tx=0x7f8bf0009c00 comp rx=0 tx=0).stop 2024-05-08T21:55:04.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.356+0000 7f8c06889700 1 -- 172.21.15.73:0/2207943455 shutdown_connections 2024-05-08T21:55:04.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.356+0000 7f8c06889700 1 --2- 172.21.15.73:0/2207943455 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c00153eb0 0x7f8c0006fc80 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:04.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.356+0000 7f8c06889700 1 --2- 172.21.15.73:0/2207943455 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8c00154290 0x7f8c000c8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:04.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.356+0000 7f8c06889700 1 -- 172.21.15.73:0/2207943455 >> 172.21.15.73:0/2207943455 conn(0x7f8c0006bad0 msgr2=0x7f8c0006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:55:04.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.356+0000 7f8c06889700 1 -- 172.21.15.73:0/2207943455 shutdown_connections 2024-05-08T21:55:04.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.356+0000 7f8c06889700 1 -- 172.21.15.73:0/2207943455 wait complete. 2024-05-08T21:55:04.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.357+0000 7f8c06889700 1 Processor -- start 2024-05-08T21:55:04.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.357+0000 7f8c06889700 1 -- start start 2024-05-08T21:55:04.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.358+0000 7f8c06889700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8c0006ee90 0x7f8c000c5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:55:04.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.358+0000 7f8c06889700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c00154680 0x7f8c001f3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:55:04.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.358+0000 7f8c06889700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c001f3c80 0x7f8c0013fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:55:04.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.358+0000 7f8c06889700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c001f4100 con 0x7f8c00154680 2024-05-08T21:55:04.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.358+0000 7f8c06889700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c00155410 con 0x7f8c001f3c80 2024-05-08T21:55:04.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.358+0000 7f8c06889700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c00148080 con 0x7f8c0006ee90 2024-05-08T21:55:04.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.358+0000 7f8bff7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c00154680 0x7f8c001f3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:55:04.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.358+0000 7f8bff7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c00154680 0x7f8c001f3740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42204/0 (socket says 172.21.15.73:42204) 2024-05-08T21:55:04.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.358+0000 7f8bff7fe700 1 -- 172.21.15.73:0/2989364467 learned_addr learned my addr 172.21.15.73:0/2989364467 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-08T21:55:04.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.358+0000 7f8c04e26700 1 --2- 172.21.15.73:0/2989364467 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c001f3c80 0x7f8c0013fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:55:04.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.358+0000 7f8bfffff700 1 --2- 172.21.15.73:0/2989364467 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8c0006ee90 0x7f8c000c5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:55:04.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.358+0000 7f8bff7fe700 1 -- 172.21.15.73:0/2989364467 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8c0006ee90 msgr2=0x7f8c000c5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:55:04.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.358+0000 7f8bff7fe700 1 --2- 172.21.15.73:0/2989364467 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8c0006ee90 0x7f8c000c5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:04.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.358+0000 7f8bff7fe700 1 -- 172.21.15.73:0/2989364467 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c001f3c80 msgr2=0x7f8c0013fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:55:04.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.358+0000 7f8bff7fe700 1 --2- 172.21.15.73:0/2989364467 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c001f3c80 0x7f8c0013fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:04.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.358+0000 7f8bff7fe700 1 -- 172.21.15.73:0/2989364467 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf0009550 con 0x7f8c00154680 2024-05-08T21:55:04.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.358+0000 7f8bff7fe700 1 --2- 172.21.15.73:0/2989364467 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c00154680 0x7f8c001f3740 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f8be800d7d0 tx=0x7f8be800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:55:04.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.358+0000 7f8bfcff9700 1 -- 172.21.15.73:0/2989364467 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be80125f0 con 0x7f8c00154680 2024-05-08T21:55:04.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.359+0000 7f8bfcff9700 1 -- 172.21.15.73:0/2989364467 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f8be8012750 con 0x7f8c00154680 2024-05-08T21:55:04.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.359+0000 7f8c06889700 1 -- 172.21.15.73:0/2989364467 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c001471b0 con 0x7f8c00154680 2024-05-08T21:55:04.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.359+0000 7f8bfcff9700 1 -- 172.21.15.73:0/2989364467 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be8012b00 con 0x7f8c00154680 2024-05-08T21:55:04.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.359+0000 7f8c06889700 1 -- 172.21.15.73:0/2989364467 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c00147a30 con 0x7f8c00154680 2024-05-08T21:55:04.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.359+0000 7f8c06889700 1 -- 172.21.15.73:0/2989364467 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c00148410 con 0x7f8c00154680 2024-05-08T21:55:04.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.360+0000 7f8bfcff9700 1 -- 172.21.15.73:0/2989364467 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8be8012c60 con 0x7f8c00154680 2024-05-08T21:55:04.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.360+0000 7f8bfcff9700 1 --2- 172.21.15.73:0/2989364467 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f8be006acc0 0x7f8be006d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:55:04.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.360+0000 7f8bfcff9700 1 -- 172.21.15.73:0/2989364467 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5617+0+0 (secure 0 0 0) 0x7f8be80893d0 con 0x7f8c00154680 2024-05-08T21:55:04.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.360+0000 7f8bfffff700 1 --2- 172.21.15.73:0/2989364467 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f8be006acc0 0x7f8be006d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:55:04.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.361+0000 7f8bfffff700 1 --2- 172.21.15.73:0/2989364467 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f8be006acc0 0x7f8be006d180 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8c000c9a20 tx=0x7f8bf0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:55:04.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.365+0000 7f8bfcff9700 1 -- 172.21.15.73:0/2989364467 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f8c00148410 con 0x7f8c00154680 2024-05-08T21:55:04.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:04.568+0000 7f8c06889700 1 -- 172.21.15.73:0/2989364467 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8c00148410 con 0x7f8c00154680 2024-05-08T21:55:05.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:05.214+0000 7f8bfcff9700 1 -- 172.21.15.73:0/2989364467 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v27) v1 ==== 169+0+0 (secure 0 0 0) 0x7f8c00148410 con 0x7f8c00154680 2024-05-08T21:55:05.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:05.219+0000 7f8c06889700 1 -- 172.21.15.73:0/2989364467 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f8be006acc0 msgr2=0x7f8be006d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:55:05.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:05.219+0000 7f8c06889700 1 --2- 172.21.15.73:0/2989364467 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f8be006acc0 0x7f8be006d180 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8c000c9a20 tx=0x7f8bf0008030 comp rx=0 tx=0).stop 2024-05-08T21:55:05.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:05.219+0000 7f8c06889700 1 -- 172.21.15.73:0/2989364467 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c00154680 msgr2=0x7f8c001f3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:55:05.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:05.219+0000 7f8c06889700 1 --2- 172.21.15.73:0/2989364467 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c00154680 0x7f8c001f3740 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f8be800d7d0 tx=0x7f8be800dae0 comp rx=0 tx=0).stop 2024-05-08T21:55:05.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:05.219+0000 7f8c06889700 1 -- 172.21.15.73:0/2989364467 shutdown_connections 2024-05-08T21:55:05.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:05.219+0000 7f8c06889700 1 --2- 172.21.15.73:0/2989364467 >> [v2:172.21.15.73:6832/46949,v1:172.21.15.73:6833/46949] conn(0x7f8be006acc0 0x7f8be006d180 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:05.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:05.219+0000 7f8c06889700 1 --2- 172.21.15.73:0/2989364467 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c001f3c80 0x7f8c0013fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:05.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:05.219+0000 7f8c06889700 1 --2- 172.21.15.73:0/2989364467 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8c0006ee90 0x7f8c000c5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:05.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:05.220+0000 7f8c06889700 1 --2- 172.21.15.73:0/2989364467 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c00154680 0x7f8c001f3740 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:55:05.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:05.220+0000 7f8c06889700 1 -- 172.21.15.73:0/2989364467 >> 172.21.15.73:0/2989364467 conn(0x7f8c0006bad0 msgr2=0x7f8c0006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:55:05.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:05.220+0000 7f8c06889700 1 -- 172.21.15.73:0/2989364467 shutdown_connections 2024-05-08T21:55:05.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-08T21:55:05.220+0000 7f8c06889700 1 -- 172.21.15.73:0/2989364467 wait complete. 2024-05-08T21:55:05.222 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_data' removed 2024-05-08T21:55:05.241 INFO:teuthology.misc:Shutting down mds daemons... 2024-05-08T21:55:05.242 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-08T21:55:05.242 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:55:05.252 INFO:tasks.ceph.mds.a:Stopped 2024-05-08T21:55:05.252 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-08T21:55:05.252 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:55:05.303 INFO:tasks.ceph.mds.c:Stopped 2024-05-08T21:55:05.303 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-05-08T21:55:05.303 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:55:05.353 INFO:tasks.ceph.mds.e:Stopped 2024-05-08T21:55:05.354 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-08T21:55:05.354 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:55:05.365 INFO:tasks.ceph.mds.b:Stopped 2024-05-08T21:55:05.365 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-08T21:55:05.365 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:55:05.417 INFO:tasks.ceph.mds.d:Stopped 2024-05-08T21:55:05.417 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-05-08T21:55:05.417 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:55:05.467 INFO:tasks.ceph.mds.f:Stopped 2024-05-08T21:55:05.468 INFO:teuthology.misc:Shutting down osd daemons... 2024-05-08T21:55:05.468 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-05-08T21:55:05.468 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:55:05.497 INFO:tasks.ceph.osd.0:Stopped 2024-05-08T21:55:05.497 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-05-08T21:55:05.497 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:55:05.564 INFO:tasks.ceph.osd.1:Stopped 2024-05-08T21:55:05.564 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-05-08T21:55:05.565 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:55:05.633 INFO:tasks.ceph.osd.2:Stopped 2024-05-08T21:55:05.633 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-05-08T21:55:05.633 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:55:05.711 INFO:tasks.ceph.osd.3:Stopped 2024-05-08T21:55:05.712 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-05-08T21:55:05.712 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:55:05.754 INFO:tasks.ceph.osd.4:Stopped 2024-05-08T21:55:05.755 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-05-08T21:55:05.755 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:55:05.801 INFO:tasks.ceph.osd.5:Stopped 2024-05-08T21:55:05.801 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-05-08T21:55:05.801 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:55:05.843 INFO:tasks.ceph.osd.6:Stopped 2024-05-08T21:55:05.843 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-05-08T21:55:05.844 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:55:05.881 INFO:tasks.ceph.osd.7:Stopped 2024-05-08T21:55:05.881 INFO:teuthology.misc:Shutting down mgr daemons... 2024-05-08T21:55:05.881 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-05-08T21:55:05.881 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:55:05.907 INFO:tasks.ceph.mgr.y:Stopped 2024-05-08T21:55:05.907 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-05-08T21:55:05.907 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:55:05.946 INFO:tasks.ceph.mgr.x:Stopped 2024-05-08T21:55:05.946 INFO:teuthology.misc:Shutting down mon daemons... 2024-05-08T21:55:05.947 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-05-08T21:55:05.947 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:55:05.958 INFO:tasks.ceph.mon.a:Stopped 2024-05-08T21:55:05.958 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-05-08T21:55:05.958 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:55:05.998 INFO:tasks.ceph.mon.b:Stopped 2024-05-08T21:55:05.998 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-05-08T21:55:05.998 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:55:06.050 INFO:tasks.ceph.mon.c:Stopped 2024-05-08T21:55:06.050 INFO:tasks.ceph:Checking cluster log for badness... 2024-05-08T21:55:06.051 DEBUG:teuthology.orchestra.run.smithi073:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v 'Replacing daemon mds' | head -n 1 2024-05-08T21:55:06.088 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi073.front.sepia.ceph.com 2024-05-08T21:55:06.088 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-05-08T21:55:06.407 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi073.front.sepia.ceph.com 2024-05-08T21:55:06.408 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-05-08T21:55:06.500 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi073.front.sepia.ceph.com 2024-05-08T21:55:06.500 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-05-08T21:55:06.562 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi073.front.sepia.ceph.com 2024-05-08T21:55:06.562 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-05-08T21:55:06.627 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi115.front.sepia.ceph.com 2024-05-08T21:55:06.628 DEBUG:teuthology.orchestra.run.smithi115:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-05-08T21:55:06.886 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi115.front.sepia.ceph.com 2024-05-08T21:55:06.886 DEBUG:teuthology.orchestra.run.smithi115:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-05-08T21:55:06.962 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi115.front.sepia.ceph.com 2024-05-08T21:55:06.962 DEBUG:teuthology.orchestra.run.smithi115:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-05-08T21:55:07.030 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi115.front.sepia.ceph.com 2024-05-08T21:55:07.031 DEBUG:teuthology.orchestra.run.smithi115:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-05-08T21:55:07.140 INFO:tasks.ceph:Archiving mon data... 2024-05-08T21:55:07.142 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698071/data/mon.a.tgz 2024-05-08T21:55:07.142 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2024-05-08T21:55:07.161 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.DmzJMfyd6O 2024-05-08T21:55:07.161 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.DmzJMfyd6O 2024-05-08T21:55:07.345 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.DmzJMfyd6O 2024-05-08T21:55:07.432 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.DmzJMfyd6O is 311KB 2024-05-08T21:55:07.527 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.DmzJMfyd6O 2024-05-08T21:55:07.544 DEBUG:teuthology.misc:Transferring archived files from smithi115:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698071/data/mon.b.tgz 2024-05-08T21:55:07.544 DEBUG:teuthology.orchestra.run.smithi115:> mktemp 2024-05-08T21:55:07.562 INFO:teuthology.orchestra.run.smithi115.stdout:/tmp/tmp.uTjXrvR2Yz 2024-05-08T21:55:07.562 DEBUG:teuthology.orchestra.run.smithi115:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.uTjXrvR2Yz 2024-05-08T21:55:07.715 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 0666 /tmp/tmp.uTjXrvR2Yz 2024-05-08T21:55:07.801 DEBUG:teuthology.orchestra.remote:smithi115:/tmp/tmp.uTjXrvR2Yz is 412KB 2024-05-08T21:55:07.898 DEBUG:teuthology.orchestra.run.smithi115:> rm -fr /tmp/tmp.uTjXrvR2Yz 2024-05-08T21:55:07.914 DEBUG:teuthology.misc:Transferring archived files from smithi115:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698071/data/mon.c.tgz 2024-05-08T21:55:07.914 DEBUG:teuthology.orchestra.run.smithi115:> mktemp 2024-05-08T21:55:07.970 INFO:teuthology.orchestra.run.smithi115.stdout:/tmp/tmp.YPpxiIfr0Y 2024-05-08T21:55:07.970 DEBUG:teuthology.orchestra.run.smithi115:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.YPpxiIfr0Y 2024-05-08T21:55:08.112 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 0666 /tmp/tmp.YPpxiIfr0Y 2024-05-08T21:55:08.198 DEBUG:teuthology.orchestra.remote:smithi115:/tmp/tmp.YPpxiIfr0Y is 412KB 2024-05-08T21:55:08.293 DEBUG:teuthology.orchestra.run.smithi115:> rm -fr /tmp/tmp.YPpxiIfr0Y 2024-05-08T21:55:08.309 INFO:tasks.ceph:Cleaning ceph cluster... 2024-05-08T21:55:08.310 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-08T21:55:08.312 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-08T21:55:08.375 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-05-08T21:55:08.376 DEBUG:teuthology.orchestra.run.smithi073:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-05-08T21:55:08.385 DEBUG:teuthology.orchestra.run.smithi115:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-05-08T21:55:08.417 INFO:teuthology.orchestra.run.smithi073.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-05-08T21:55:08.443 INFO:teuthology.orchestra.run.smithi115.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-05-08T21:55:08.449 INFO:tasks.ceph:Archiving crash dumps... 2024-05-08T21:55:08.451 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698071/remote/smithi073/crash 2024-05-08T21:55:08.452 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-08T21:55:08.497 DEBUG:teuthology.misc:Transferring archived files from smithi115:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698071/remote/smithi115/crash 2024-05-08T21:55:08.498 DEBUG:teuthology.orchestra.run.smithi115:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-08T21:55:08.525 INFO:tasks.ceph:Shutting down logrotate 2024-05-08T21:55:08.525 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:55:08.542 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:55:08.650 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-08T21:55:08.683 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-08T21:55:08.709 INFO:tasks.ceph:Compressing logs... 2024-05-08T21:55:08.710 DEBUG:teuthology.orchestra.run.smithi073:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-08T21:55:08.725 DEBUG:teuthology.orchestra.run.smithi115:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-08T21:55:11.500 INFO:tasks.ceph:Archiving logs... 2024-05-08T21:55:11.501 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698071/remote/smithi073/log 2024-05-08T21:55:11.502 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-08T21:55:11.986 DEBUG:teuthology.misc:Transferring archived files from smithi115:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698071/remote/smithi115/log 2024-05-08T21:55:11.987 DEBUG:teuthology.orchestra.run.smithi115:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-08T21:55:12.353 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-08T21:55:12.366 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-08T21:55:12.366 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-08T21:55:12.369 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-08T21:55:12.438 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-08T21:55:12.447 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-08T21:55:12.448 DEBUG:teuthology.orchestra.run.smithi073:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T21:55:12.450 DEBUG:teuthology.orchestra.run.smithi115:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T21:55:12.464 INFO:teuthology.orchestra.run.smithi073.stderr:bash: ntpq: command not found 2024-05-08T21:55:12.466 INFO:teuthology.orchestra.run.smithi115.stderr:bash: ntpq: command not found 2024-05-08T21:55:12.468 INFO:teuthology.orchestra.run.smithi073.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T21:55:12.469 INFO:teuthology.orchestra.run.smithi073.stdout:=============================================================================== 2024-05-08T21:55:12.469 INFO:teuthology.orchestra.run.smithi073.stdout:^* hv01.front.sepia.ceph.com 3 6 377 35 +1954us[+1955us] +/- 58ms 2024-05-08T21:55:12.469 INFO:teuthology.orchestra.run.smithi073.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 35 -1464us[-1464us] +/- 60ms 2024-05-08T21:55:12.469 INFO:teuthology.orchestra.run.smithi073.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 34 -743us[ -743us] +/- 60ms 2024-05-08T21:55:12.469 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T21:55:12.470 INFO:teuthology.orchestra.run.smithi115.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T21:55:12.470 INFO:teuthology.orchestra.run.smithi115.stdout:=============================================================================== 2024-05-08T21:55:12.470 INFO:teuthology.orchestra.run.smithi115.stdout:^* hv01.front.sepia.ceph.com 3 6 377 36 +1909us[+1941us] +/- 58ms 2024-05-08T21:55:12.470 INFO:teuthology.orchestra.run.smithi115.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 36 -1474us[-1442us] +/- 60ms 2024-05-08T21:55:12.470 INFO:teuthology.orchestra.run.smithi115.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 35 -764us[ -764us] +/- 60ms 2024-05-08T21:55:12.471 INFO:teuthology.orchestra.run.smithi115.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T21:55:12.471 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-08T21:55:12.484 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-08T21:55:12.484 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-08T21:55:12.499 DEBUG:teuthology.orchestra.run.smithi073:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-08T21:55:12.577 DEBUG:teuthology.orchestra.run.smithi115:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-08T21:55:12.642 DEBUG:teuthology.orchestra.run.smithi073:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-08T21:55:12.672 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T21:55:12.673 DEBUG:teuthology.orchestra.run.smithi115:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-08T21:55:12.701 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T21:55:12.702 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-08T21:55:12.712 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-08T21:55:12.763 INFO:teuthology.task.internal:Duration was 1171.942985 seconds 2024-05-08T21:55:12.764 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-08T21:55:12.779 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-08T21:55:12.779 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-08T21:55:12.782 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-08T21:55:12.827 INFO:teuthology.orchestra.run.smithi073.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T21:55:12.829 INFO:teuthology.orchestra.run.smithi115.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T21:55:13.172 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-08T21:55:13.172 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi073.front.sepia.ceph.com 2024-05-08T21:55:13.172 DEBUG:teuthology.orchestra.run.smithi073:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-08T21:55:13.194 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi115.front.sepia.ceph.com 2024-05-08T21:55:13.195 DEBUG:teuthology.orchestra.run.smithi115:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-08T21:55:13.217 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-08T21:55:13.217 DEBUG:teuthology.orchestra.run.smithi073:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-08T21:55:13.237 DEBUG:teuthology.orchestra.run.smithi115:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-08T21:55:13.302 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-08T21:55:13.302 DEBUG:teuthology.orchestra.run.smithi073:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-08T21:55:13.304 DEBUG:teuthology.orchestra.run.smithi115:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-08T21:55:13.417 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-08T21:55:13.428 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-08T21:55:13.428 DEBUG:teuthology.orchestra.run.smithi073:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-08T21:55:13.456 DEBUG:teuthology.orchestra.run.smithi115:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-08T21:55:13.482 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-08T21:55:13.493 DEBUG:teuthology.orchestra.run.smithi073:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-08T21:55:13.498 DEBUG:teuthology.orchestra.run.smithi115:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-08T21:55:13.521 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = core 2024-05-08T21:55:13.550 INFO:teuthology.orchestra.run.smithi115.stdout:kernel.core_pattern = core 2024-05-08T21:55:13.574 DEBUG:teuthology.orchestra.run.smithi073:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-08T21:55:13.591 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T21:55:13.592 DEBUG:teuthology.orchestra.run.smithi115:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-08T21:55:13.629 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T21:55:13.630 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-08T21:55:13.640 INFO:teuthology.task.internal:Transferring archived files... 2024-05-08T21:55:13.641 DEBUG:teuthology.misc:Transferring archived files from smithi073:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698071/remote/smithi073 2024-05-08T21:55:13.641 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-08T21:55:13.682 DEBUG:teuthology.misc:Transferring archived files from smithi115:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698071/remote/smithi115 2024-05-08T21:55:13.682 DEBUG:teuthology.orchestra.run.smithi115:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-08T21:55:13.721 INFO:teuthology.task.internal:Removing archive directory... 2024-05-08T21:55:13.721 DEBUG:teuthology.orchestra.run.smithi073:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-08T21:55:13.723 DEBUG:teuthology.orchestra.run.smithi115:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-08T21:55:13.771 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-08T21:55:13.783 INFO:teuthology.task.internal:Not uploading archives. 2024-05-08T21:55:13.783 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-08T21:55:13.799 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-08T21:55:13.799 DEBUG:teuthology.orchestra.run.smithi073:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-08T21:55:13.801 DEBUG:teuthology.orchestra.run.smithi115:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-08T21:55:13.815 INFO:teuthology.orchestra.run.smithi073.stdout: 262179 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 8 21:55 /home/ubuntu/cephtest 2024-05-08T21:55:13.828 INFO:teuthology.orchestra.run.smithi115.stdout: 262157 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 8 21:55 /home/ubuntu/cephtest 2024-05-08T21:55:13.830 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-08T21:55:13.844 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-08T21:55:13.878 INFO:teuthology.run:Summary data: description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mds 2-workunit/suites/iozone}} duration: 1171.9429850578308 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-05-08T21:55:13.878 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-08T21:55:13.954 INFO:teuthology.run:pass